-- Logs begin at Thu 2022-09-15 17:19:03 UTC, end at Thu 2022-09-15 18:20:03 UTC. -- Sep 15 17:46:52.122542 dv-cinder-835384-27-smb systemd[1]: Starting Devstack devstack@keystone.service... Sep 15 17:46:52.131640 dv-cinder-835384-27-smb devstack@keystone.service[81580]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Sep 15 17:46:52.134218 dv-cinder-835384-27-smb devstack@keystone.service[81580]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu Sep 15 17:46:52 2022] *** Sep 15 17:46:52.134351 dv-cinder-835384-27-smb devstack@keystone.service[81580]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Sep 15 17:46:52.134470 dv-cinder-835384-27-smb devstack@keystone.service[81580]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Sep 15 17:46:52.134575 dv-cinder-835384-27-smb devstack@keystone.service[81580]: nodename: dv-cinder-835384-27-smb Sep 15 17:46:52.134671 dv-cinder-835384-27-smb devstack@keystone.service[81580]: machine: x86_64 Sep 15 17:46:52.134775 dv-cinder-835384-27-smb devstack@keystone.service[81580]: clock source: unix Sep 15 17:46:52.134869 dv-cinder-835384-27-smb devstack@keystone.service[81580]: pcre jit disabled Sep 15 17:46:52.134969 dv-cinder-835384-27-smb devstack@keystone.service[81580]: detected number of CPU cores: 4 Sep 15 17:46:52.135063 dv-cinder-835384-27-smb devstack@keystone.service[81580]: current working directory: / Sep 15 17:46:52.135162 dv-cinder-835384-27-smb devstack@keystone.service[81580]: detected binary path: /usr/bin/uwsgi-core Sep 15 17:46:52.135270 dv-cinder-835384-27-smb devstack@keystone.service[81580]: your processes number limit is 47680 Sep 15 17:46:52.135367 dv-cinder-835384-27-smb devstack@keystone.service[81580]: your memory page size is 4096 bytes Sep 15 17:46:52.135469 dv-cinder-835384-27-smb devstack@keystone.service[81580]: detected max file descriptor number: 2048 Sep 15 17:46:52.135578 dv-cinder-835384-27-smb devstack@keystone.service[81580]: lock engine: pthread robust mutexes Sep 15 17:46:52.135824 dv-cinder-835384-27-smb devstack@keystone.service[81580]: thunder lock: enabled Sep 15 17:46:52.136101 dv-cinder-835384-27-smb devstack@keystone.service[81580]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Sep 15 17:46:52.136282 dv-cinder-835384-27-smb devstack@keystone.service[81580]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Sep 15 17:46:52.174734 dv-cinder-835384-27-smb devstack@keystone.service[81580]: Python main interpreter initialized at 0x5606085389c0 Sep 15 17:46:52.174734 dv-cinder-835384-27-smb devstack@keystone.service[81580]: python threads support enabled Sep 15 17:46:52.174734 dv-cinder-835384-27-smb devstack@keystone.service[81580]: your server socket listen backlog is limited to 100 connections Sep 15 17:46:52.174734 dv-cinder-835384-27-smb devstack@keystone.service[81580]: your mercy for graceful operations on workers is 90 seconds Sep 15 17:46:52.175085 dv-cinder-835384-27-smb devstack@keystone.service[81580]: mapped 403077 bytes (393 KB) for 2 cores Sep 15 17:46:52.175169 dv-cinder-835384-27-smb devstack@keystone.service[81580]: *** Operational MODE: preforking *** Sep 15 17:46:52.175409 dv-cinder-835384-27-smb devstack@keystone.service[81580]: *** uWSGI is running in multiple interpreter mode *** Sep 15 17:46:52.175409 dv-cinder-835384-27-smb devstack@keystone.service[81580]: spawned uWSGI master process (pid: 81580) Sep 15 17:46:52.175593 dv-cinder-835384-27-smb systemd[1]: Started Devstack devstack@keystone.service. Sep 15 17:46:52.176120 dv-cinder-835384-27-smb devstack@keystone.service[81580]: spawned uWSGI worker 1 (pid: 81592, cores: 1) Sep 15 17:46:52.177188 dv-cinder-835384-27-smb devstack@keystone.service[81580]: spawned uWSGI worker 2 (pid: 81593, cores: 1) Sep 15 17:46:52.177609 dv-cinder-835384-27-smb devstack@keystone.service[81580]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Sep 15 17:46:56.414369 dv-cinder-835384-27-smb devstack@keystone.service[81593]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 15 17:46:56.414369 dv-cinder-835384-27-smb devstack@keystone.service[81593]: from cryptography.utils import int_from_bytes Sep 15 17:46:56.415184 dv-cinder-835384-27-smb devstack@keystone.service[81593]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 15 17:46:56.415184 dv-cinder-835384-27-smb devstack@keystone.service[81593]: from cryptography.utils import int_from_bytes Sep 15 17:46:56.415736 dv-cinder-835384-27-smb devstack@keystone.service[81592]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 15 17:46:56.415736 dv-cinder-835384-27-smb devstack@keystone.service[81592]: from cryptography.utils import int_from_bytes Sep 15 17:46:56.416193 dv-cinder-835384-27-smb devstack@keystone.service[81592]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 15 17:46:56.416193 dv-cinder-835384-27-smb devstack@keystone.service[81592]: from cryptography.utils import int_from_bytes Sep 15 17:46:56.464341 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 15 17:46:56.464511 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 15 17:46:56.464701 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] command line args: [] {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 15 17:46:56.464969 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 15 17:46:56.465146 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] ================================================================================ {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 15 17:46:56.465425 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 15 17:46:56.465520 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] admin_token = **** {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 17:46:56.465627 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 15 17:46:56.465715 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] config_dir = [] {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 17:46:56.465821 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] command line args: [] {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 15 17:46:56.465899 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 17:46:56.466008 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] config_source = [] {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 17:46:56.466096 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 15 17:46:56.466170 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] debug = True {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 17:46:56.466240 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] ================================================================================ {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 15 17:46:56.466368 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 17:46:56.467640 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] admin_token = **** {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 17:46:56.467720 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 17:46:56.467782 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] config_dir = [] {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 17:46:56.467847 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 17:46:56.467929 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 17:46:56.467929 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] config_source = [] {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 17:46:56.468038 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 17:46:56.468103 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] debug = True {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 17:46:56.468168 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 17:46:56.468249 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 17:46:56.468336 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] list_limit = None {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 17:46:56.468396 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 17:46:56.468463 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] log_config_append = None {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 17:46:56.468529 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 17:46:56.468591 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 17:46:56.468591 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] log_dir = None {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 17:46:56.468698 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 17:46:56.468761 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] log_file = None {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 17:46:56.468828 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 17:46:56.468893 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 17:46:56.468951 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] list_limit = None {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 17:46:56.469012 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 17:46:56.469070 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] log_config_append = None {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 17:46:56.469070 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 17:46:56.469187 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 17:46:56.469251 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] log_dir = None {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 17:46:56.469686 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 17:46:56.469776 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] log_file = None {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 17:46:56.469896 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 17:46:56.469988 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 17:46:56.470061 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 17:46:56.470180 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 17:46:56.470255 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 17:46:56.470371 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 17:46:56.470451 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 17:46:56.470534 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 17:46:56.470660 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 17:46:56.470736 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 17:46:56.470853 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 17:46:56.470935 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 17:46:56.471019 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 17:46:56.471101 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 17:46:56.471225 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 17:46:56.471302 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 17:46:56.471419 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 17:46:56.471493 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 17:46:56.471614 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 17:46:56.471711 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 17:46:56.471785 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 17:46:56.471912 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 17:46:56.471912 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 17:46:56.472105 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.25/identity {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 17:46:56.472192 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 17:46:56.472265 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] publish_errors = False {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 17:46:56.472381 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 17:46:56.472478 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 17:46:56.472558 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 17:46:56.472687 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 17:46:56.472764 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 17:46:56.472984 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 17:46:56.473109 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.25/identity {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 17:46:56.473192 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] publish_errors = False {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 17:46:56.473273 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 17:46:56.473422 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 17:46:56.474336 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] standard_threads = False {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 17:46:56.474445 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 17:46:56.474530 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 17:46:56.474604 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 17:46:56.474680 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 17:46:56.474753 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 17:46:56.474823 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 17:46:56.474823 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] use_journal = False {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 17:46:56.474960 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 17:46:56.475030 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] use_json = False {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 17:46:56.475099 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] standard_threads = False {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 17:46:56.475170 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] use_stderr = False {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 17:46:56.475295 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 17:46:56.475469 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] use_syslog = False {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 17:46:56.475578 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 17:46:56.475653 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 17:46:56.475743 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 17:46:56.475802 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 17:46:56.475866 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] use_journal = False {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 17:46:56.475999 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 17:46:56.476092 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] use_json = False {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 17:46:56.476170 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] use_stderr = False {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 17:46:56.476241 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 17:46:56.476349 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] use_syslog = False {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 17:46:56.476471 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 17:46:56.476580 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 17:46:56.476719 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 17:46:56.476836 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 17:46:56.476957 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 17:46:56.477076 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 17:46:56.477206 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 17:46:56.477358 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 17:46:56.477466 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 17:46:56.477605 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 17:46:56.477711 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 17:46:56.477856 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 17:46:56.477956 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 17:46:56.478097 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 17:46:56.478200 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 17:46:56.478349 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 17:46:56.478437 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 17:46:56.478584 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 17:46:56.478668 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 17:46:56.479084 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 17:46:56.479170 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 17:46:56.479340 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 17:46:56.479424 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 17:46:56.479588 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 17:46:56.479666 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 17:46:56.479823 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 17:46:56.479901 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 17:46:56.480072 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 17:46:56.480149 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 17:46:56.480310 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 17:46:56.480393 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 17:46:56.480551 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 17:46:56.480634 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 17:46:56.480786 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 17:46:56.480863 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 17:46:56.481023 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 17:46:56.481099 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 17:46:56.481278 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 17:46:56.481389 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 17:46:56.481554 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 17:46:56.481631 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 17:46:56.481799 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 17:46:56.481884 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 17:46:56.482028 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 17:46:56.482105 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 17:46:56.482263 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 17:46:56.482352 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 17:46:56.482494 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 17:46:56.482580 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 17:46:56.482728 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 17:46:56.482813 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 17:46:56.482977 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 17:46:56.483064 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 17:46:56.483222 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 17:46:56.483308 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 17:46:56.483452 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 17:46:56.483529 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 17:46:56.483680 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 17:46:56.483756 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 17:46:56.483912 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 17:46:56.483997 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 17:46:56.484156 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 17:46:56.484239 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 17:46:56.484393 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 17:46:56.484471 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 17:46:56.484623 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 17:46:56.484706 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 17:46:56.484854 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 17:46:56.484932 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 17:46:56.485085 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 17:46:56.485167 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 17:46:56.485339 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 17:46:56.485513 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 17:46:56.485647 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 17:46:56.485783 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 17:46:56.485914 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 17:46:56.486042 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 17:46:56.486186 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 17:46:56.486324 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 17:46:56.486454 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 17:46:56.486582 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 17:46:56.486715 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 17:46:56.486844 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 17:46:56.486972 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 17:46:56.487197 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 17:46:56.487328 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 17:46:56.487456 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 17:46:56.487583 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 17:46:56.487710 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 17:46:56.487843 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 17:46:56.487990 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 17:46:56.488121 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 17:46:56.488249 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 17:46:56.488376 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 17:46:56.488509 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 17:46:56.488638 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 17:46:56.488793 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 17:46:56.488923 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 17:46:56.489057 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 17:46:56.489216 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 17:46:56.489378 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 17:46:56.489511 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 17:46:56.489653 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 17:46:56.489784 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 17:46:56.490018 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 17:46:56.490153 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 17:46:56.490283 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 17:46:56.490411 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 17:46:56.490551 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 17:46:56.490686 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 17:46:56.490816 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 17:46:56.490978 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 17:46:56.491117 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 17:46:56.491257 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 17:46:56.491393 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 17:46:56.491523 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 17:46:56.491651 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 17:46:56.491796 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 17:46:56.491940 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 17:46:56.492077 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 17:46:56.492217 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 17:46:56.492347 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 17:46:56.492476 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 17:46:56.492610 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 17:46:56.492746 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 17:46:56.492884 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 17:46:56.493027 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 17:46:56.493169 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 17:46:56.493341 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 17:46:56.493481 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 17:46:56.493633 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 17:46:56.493765 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 17:46:56.493894 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 17:46:56.494032 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 17:46:56.494162 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 17:46:56.494291 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 17:46:56.494421 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 17:46:56.494555 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 17:46:56.494691 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 17:46:56.494831 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 17:46:56.494962 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 17:46:56.495091 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 17:46:56.495231 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 17:46:56.495362 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 17:46:56.495502 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 17:46:56.495639 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 17:46:56.495770 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 17:46:56.495899 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 17:46:56.496035 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 17:46:56.496164 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 17:46:56.496300 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 17:46:56.496439 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 17:46:56.496575 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 17:46:56.496706 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 17:46:56.496835 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 17:46:56.496964 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 17:46:56.497094 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 17:46:56.497239 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 17:46:56.497481 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 17:46:56.497621 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 17:46:56.497752 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 17:46:56.497882 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 17:46:56.498012 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 17:46:56.498153 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 17:46:56.498284 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 17:46:56.498413 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 17:46:56.498544 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 17:46:56.498673 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 17:46:56.498808 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 17:46:56.498947 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 17:46:56.499078 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 17:46:56.499217 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 17:46:56.499347 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 17:46:56.499476 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 17:46:56.499606 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 17:46:56.499743 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 17:46:56.499879 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 17:46:56.500009 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 17:46:56.500145 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 17:46:56.500274 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 17:46:56.500409 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 17:46:56.500615 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 17:46:56.500748 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 17:46:56.500878 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 17:46:56.501007 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 17:46:56.501145 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 17:46:56.501284 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 17:46:56.501451 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 17:46:56.501591 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 17:46:56.501722 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 17:46:56.501722 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 17:46:56.501966 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 17:46:56.502095 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 17:46:56.502231 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 17:46:56.502369 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 17:46:56.502500 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 17:46:56.502500 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 17:46:56.502745 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 17:46:56.502882 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 17:46:56.503028 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 17:46:56.503171 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 17:46:56.503302 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 17:46:56.503431 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 17:46:56.503560 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 17:46:56.503688 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 17:46:56.503818 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 17:46:56.503954 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 17:46:56.504085 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] auth.external = None {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 17:46:56.504214 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 17:46:56.504354 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 17:46:56.504484 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 17:46:56.504646 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 17:46:56.504830 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 17:46:56.504965 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 17:46:56.505103 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 17:46:56.505235 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] auth.password = None {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 17:46:56.505387 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 17:46:56.505520 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] auth.token = None {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 17:46:56.505668 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] auth.external = None {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 17:46:56.505800 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 17:46:56.505939 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 17:46:56.506070 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 17:46:56.506070 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 17:46:56.506316 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 17:46:56.506447 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 17:46:56.506577 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 17:46:56.506725 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 17:46:56.506857 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] auth.password = None {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 17:46:56.506857 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] auth.token = None {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 17:46:56.507111 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 17:46:56.507111 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 17:46:56.507355 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 17:46:56.507493 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] credential.caching = True {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 17:46:56.507624 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 17:46:56.507754 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 17:46:56.507884 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 17:46:56.508014 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 17:46:56.508144 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 17:46:56.508282 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 17:46:56.508426 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 17:46:56.508556 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 17:46:56.508686 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 17:46:56.508816 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 17:46:56.508945 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 17:46:56.509084 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 17:46:56.509215 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] credential.caching = True {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 17:46:56.509398 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 17:46:56.509535 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 17:46:56.509666 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 17:46:56.509796 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 17:46:56.509941 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 17:46:56.510075 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 17:46:56.510205 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 17:46:56.510345 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 17:46:56.510475 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 17:46:56.510604 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 17:46:56.510746 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 17:46:56.510878 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 17:46:56.510878 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 17:46:56.511124 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 17:46:56.511124 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 17:46:56.511376 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 17:46:56.511376 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 17:46:56.511633 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 17:46:56.511633 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] federation.caching = True {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 17:46:56.511879 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 17:46:56.512020 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 17:46:56.512152 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 17:46:56.512291 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 17:46:56.512430 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 17:46:56.512562 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 17:46:56.512691 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 17:46:56.512821 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 17:46:56.513019 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 17:46:56.513166 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 17:46:56.513317 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 17:46:56.513455 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 17:46:56.513585 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] federation.caching = True {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 17:46:56.513714 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 17:46:56.513856 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 17:46:56.513997 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 17:46:56.514127 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 17:46:56.514264 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 17:46:56.514402 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 17:46:56.514533 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 17:46:56.514678 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 17:46:56.514813 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 17:46:56.514943 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 17:46:56.515073 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] identity.caching = True {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 17:46:56.515203 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 17:46:56.515402 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 17:46:56.515559 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 17:46:56.515695 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 17:46:56.515836 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 17:46:56.515966 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 17:46:56.516104 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 17:46:56.516234 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 17:46:56.516442 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 17:46:56.516576 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 17:46:56.516706 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 17:46:56.516836 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 17:46:56.516965 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] identity.caching = True {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 17:46:56.517094 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 17:46:56.517232 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 17:46:56.517394 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 17:46:56.517527 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 17:46:56.517658 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 17:46:56.517798 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 17:46:56.517928 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 17:46:56.518068 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 17:46:56.518200 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 17:46:56.518330 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 17:46:56.518461 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 17:46:56.518590 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 17:46:56.518721 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 17:46:56.518860 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 17:46:56.518991 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 17:46:56.519121 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 17:46:56.519251 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 17:46:56.519379 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 17:46:56.519519 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 17:46:56.519658 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 17:46:56.519790 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 17:46:56.519920 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 17:46:56.520050 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 17:46:56.520178 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 17:46:56.520307 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 17:46:56.521064 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 17:46:56.521209 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 17:46:56.521387 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 17:46:56.521527 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 17:46:56.521659 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 17:46:56.521798 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 17:46:56.521938 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 17:46:56.522081 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 17:46:56.522211 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 17:46:56.522349 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 17:46:56.522349 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 17:46:56.522603 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 17:46:56.522743 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 17:46:56.522874 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 17:46:56.523004 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 17:46:56.523134 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 17:46:56.523264 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 17:46:56.523400 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 17:46:56.523539 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 17:46:56.523671 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 17:46:56.523671 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 17:46:56.523934 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 17:46:56.524064 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 17:46:56.524194 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 17:46:56.524332 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 17:46:56.524464 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 17:46:56.524593 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 17:46:56.524724 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 17:46:56.524724 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 17:46:56.524977 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 17:46:56.525115 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 17:46:56.525253 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 17:46:56.525409 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 17:46:56.525541 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 17:46:56.525681 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 17:46:56.525824 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 17:46:56.525955 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 17:46:56.526085 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 17:46:56.526215 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 17:46:56.526344 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 17:46:56.526473 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 17:46:56.526611 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 17:46:56.526742 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 17:46:56.526930 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 17:46:56.527067 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 17:46:56.527198 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 17:46:56.527198 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 17:46:56.527452 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 17:46:56.527593 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 17:46:56.527723 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 17:46:56.527853 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 17:46:56.527984 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 17:46:56.528114 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 17:46:56.528252 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 17:46:56.528383 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 17:46:56.528591 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 17:46:56.528728 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 17:46:56.528858 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 17:46:56.528989 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 17:46:56.529128 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 17:46:56.529128 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 17:46:56.529422 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 17:46:56.529577 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] ldap.user = None {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 17:46:56.529714 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 17:46:56.529714 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 17:46:56.529986 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 17:46:56.529986 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 17:46:56.530248 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 17:46:56.530392 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 17:46:56.530530 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 17:46:56.530667 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 17:46:56.530811 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 17:46:56.530949 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 17:46:56.531086 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 17:46:56.531222 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 17:46:56.531372 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 17:46:56.531509 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 17:46:56.531654 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] ldap.user = None {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 17:46:56.531823 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 17:46:56.531966 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 17:46:56.532104 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 17:46:56.532241 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 17:46:56.532377 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 17:46:56.532521 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 17:46:56.532659 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 17:46:56.532795 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 17:46:56.532931 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 17:46:56.533067 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 17:46:56.533204 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 17:46:56.533383 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 17:46:56.533525 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 17:46:56.533662 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 17:46:56.533798 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 17:46:56.533934 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 17:46:56.534070 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 17:46:56.534214 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 17:46:56.534353 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 17:46:56.534490 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 17:46:56.534625 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 17:46:56.534762 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 17:46:56.534898 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 17:46:56.535042 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 17:46:56.535190 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 17:46:56.535338 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 17:46:56.535476 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 17:46:56.535612 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 17:46:56.535749 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 17:46:56.535900 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 17:46:56.536089 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 17:46:56.536748 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 17:46:56.536887 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 17:46:56.537028 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 17:46:56.537164 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 17:46:56.537366 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 17:46:56.537513 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 17:46:56.537650 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 17:46:56.537798 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 17:46:56.537936 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 17:46:56.538072 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 17:46:56.538220 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 17:46:56.538359 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 17:46:56.538496 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 17:46:56.538632 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 17:46:56.538768 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 17:46:56.538905 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 17:46:56.539049 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 17:46:56.539186 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 17:46:56.539186 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 17:46:56.539445 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 17:46:56.539581 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 17:46:56.539726 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 17:46:56.539871 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 17:46:56.540008 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 17:46:56.540143 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 17:46:56.540279 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 17:46:56.540414 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] resource.caching = True {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 17:46:56.540551 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 17:46:56.540695 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 17:46:56.540833 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 17:46:56.540969 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 17:46:56.541106 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 17:46:56.541241 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 17:46:56.541406 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 17:46:56.541563 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 17:46:56.541714 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 17:46:56.541851 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 17:46:56.541986 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 17:46:56.542122 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 17:46:56.542258 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 17:46:56.542403 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 17:46:56.542541 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 17:46:56.542677 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 17:46:56.542813 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] resource.caching = True {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 17:46:56.542948 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 17:46:56.543084 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 17:46:56.543228 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] role.caching = True {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 17:46:56.543366 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 17:46:56.543511 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] role.driver = sql {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 17:46:56.543648 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 17:46:56.543784 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 17:46:56.543993 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 17:46:56.544134 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 17:46:56.544270 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 17:46:56.544407 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 17:46:56.544544 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 17:46:56.544680 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 17:46:56.544825 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 17:46:56.544963 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 17:46:56.545098 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 17:46:56.545234 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 17:46:56.545437 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 17:46:56.545587 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 17:46:56.545737 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] role.caching = True {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 17:46:56.545876 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 17:46:56.546013 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] role.driver = sql {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 17:46:56.546149 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 17:46:56.546285 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 17:46:56.546421 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 17:46:56.546566 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 17:46:56.546705 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 17:46:56.546842 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 17:46:56.546979 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 17:46:56.547116 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 17:46:56.547252 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 17:46:56.547452 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 17:46:56.547596 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 17:46:56.547733 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 17:46:56.547733 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 17:46:56.547994 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 17:46:56.548131 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 17:46:56.548276 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 17:46:56.548413 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 17:46:56.548549 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 17:46:56.548685 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 17:46:56.548822 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 17:46:56.548958 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 17:46:56.549102 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 17:46:56.549250 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 17:46:56.549411 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 17:46:56.549550 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 17:46:56.549686 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 17:46:56.549823 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 17:46:56.549971 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 17:46:56.549971 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 17:46:56.550232 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 17:46:56.550368 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 17:46:56.550503 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 17:46:56.550647 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 17:46:56.550784 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 17:46:56.550922 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 17:46:56.551068 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 17:46:56.551204 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 17:46:56.551340 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 17:46:56.551484 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 17:46:56.551645 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 17:46:56.551791 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 17:46:56.551927 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 17:46:56.552064 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 17:46:56.552200 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 17:46:56.552345 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 17:46:56.552483 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 17:46:56.552619 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 17:46:56.552755 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 17:46:56.552891 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 17:46:56.553037 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 17:46:56.553182 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] token.caching = True {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 17:46:56.553350 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 17:46:56.553495 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 17:46:56.553632 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 17:46:56.553768 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 17:46:56.553903 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 17:46:56.554050 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 17:46:56.554188 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 17:46:56.554324 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 17:46:56.554460 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 17:46:56.554596 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 17:46:56.554731 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 17:46:56.554885 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 17:46:56.555023 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 17:46:56.555160 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 17:46:56.555306 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 17:46:56.555444 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 17:46:56.555580 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] token.caching = True {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 17:46:56.555723 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 17:46:56.555861 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 17:46:56.555997 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 17:46:56.556132 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 17:46:56.556269 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 17:46:56.556405 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 17:46:56.556549 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 17:46:56.556686 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 17:46:56.556835 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 17:46:56.556972 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 17:46:56.557107 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 17:46:56.557244 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 17:46:56.557426 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 17:46:56.557574 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 17:46:56.557720 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 17:46:56.557858 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 17:46:56.557994 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 17:46:56.558131 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 17:46:56.558267 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] database.connection = **** {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 17:46:56.558410 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 17:46:56.558548 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 17:46:56.558684 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 17:46:56.558830 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 17:46:56.558974 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 17:46:56.559111 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 17:46:56.559255 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 17:46:56.559393 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 17:46:56.559529 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 17:46:56.559666 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 17:46:56.559802 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 17:46:56.559947 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 17:46:56.560093 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 17:46:56.560231 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 17:46:56.560376 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 17:46:56.560514 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 17:46:56.560514 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 17:46:56.560783 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] database.connection = **** {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 17:46:56.560919 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 17:46:56.561055 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 17:46:56.561199 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 17:46:56.561358 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 17:46:56.561503 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 17:46:56.561640 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 17:46:56.561777 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 17:46:56.561913 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 17:46:56.562060 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 17:46:56.562213 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 17:46:56.562356 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 17:46:56.562495 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 17:46:56.562642 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 17:46:56.562779 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 17:46:56.562923 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 17:46:56.563061 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 17:46:56.563198 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 17:46:56.563334 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 17:46:56.563478 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 15 17:46:56.563618 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 17:46:56.563618 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 17:46:56.563618 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 17:46:56.563618 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 17:46:56.563618 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 17:46:56.563618 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 17:46:56.563618 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 17:46:56.563618 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 17:46:56.563618 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 17:46:56.564763 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 15 17:46:56.578675 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81593) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 15 17:46:56.578904 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81593) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 15 17:46:56.579129 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81593) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 15 17:46:56.580039 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81592) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 15 17:46:56.580274 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81592) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 15 17:46:56.580502 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81592) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 15 17:46:56.588154 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81593) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 15 17:46:56.589323 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81592) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 15 17:46:56.616452 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81593) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 15 17:46:56.616682 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81593) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 15 17:46:56.617723 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81592) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 15 17:46:56.617957 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81592) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 15 17:46:56.668914 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81593) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 15 17:46:56.669242 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81592) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 15 17:46:56.716941 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81593) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 15 17:46:56.717172 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81593) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 15 17:46:56.717675 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81592) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 15 17:46:56.717911 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81592) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 15 17:46:56.871199 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81593) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 15 17:46:56.871389 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81592) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 15 17:46:56.871499 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81593) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 15 17:46:56.871624 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81592) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 15 17:46:56.871709 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81593) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 15 17:46:56.871842 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81593) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 15 17:46:56.871925 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81592) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 15 17:46:56.872057 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81593) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 15 17:46:56.872141 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81592) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 15 17:46:56.872269 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81593) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 15 17:46:56.872362 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81592) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 15 17:46:56.872490 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81592) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 15 17:46:56.895233 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81593) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 15 17:46:56.896019 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81593) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 15 17:46:56.896197 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81592) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 15 17:46:56.896283 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81593) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 15 17:46:56.896438 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81592) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 15 17:46:56.896522 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81593) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 15 17:46:56.896661 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81593) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 15 17:46:56.896741 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81592) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 15 17:46:56.896872 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81593) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 15 17:46:56.896963 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81592) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 15 17:46:56.897084 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81592) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 15 17:46:56.897164 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81593) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 15 17:46:56.897321 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81592) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 15 17:46:56.897535 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81592) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 15 17:46:56.908037 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81593) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 15 17:46:56.908426 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81592) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 15 17:46:56.920897 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81593) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 15 17:46:56.921066 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81592) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 15 17:46:56.921159 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81593) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 15 17:46:56.921290 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81593) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 15 17:46:56.921395 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81592) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 15 17:46:56.921548 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81593) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 15 17:46:56.921727 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81592) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 15 17:46:56.921882 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81593) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 15 17:46:56.922031 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81592) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 15 17:46:56.922191 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81593) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 15 17:46:56.922334 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81592) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 15 17:46:56.922473 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81593) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 15 17:46:56.922612 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81592) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 15 17:46:56.922612 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81592) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 15 17:46:56.938663 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81593) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 17:46:56.938873 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81593) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 15 17:46:56.939053 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81592) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 17:46:56.939218 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81593) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 17:46:56.939347 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81592) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 15 17:46:56.939507 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81593) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 15 17:46:56.939590 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81592) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 17:46:56.939663 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81593) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 17:46:56.939783 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81592) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 15 17:46:56.939924 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81593) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 17:46:56.940060 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81592) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 17:46:56.940184 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81593) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 17:46:56.940330 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81592) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 17:46:56.940443 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81593) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 17:46:56.940604 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81592) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 17:46:56.940868 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81592) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 17:46:56.950433 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81593) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 17:46:56.950715 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81593) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 17:46:56.950938 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81592) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 17:46:56.951022 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81593) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 17:46:56.951225 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81592) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 17:46:56.951319 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81593) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 17:46:56.951503 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81592) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 17:46:56.951793 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81592) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 17:46:56.958723 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81593) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 15 17:46:56.959376 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81592) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 15 17:46:56.961676 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81593) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 15 17:46:56.961965 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81593) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 17:46:56.962252 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81593) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 17:46:56.962333 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81592) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 15 17:46:56.962538 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81593) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 17:46:56.962621 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81592) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 17:46:56.962825 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81593) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 17:46:56.962908 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81592) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 17:46:56.963088 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81593) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 17:46:56.963171 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81592) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 17:46:56.963361 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81593) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 17:46:56.963451 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81592) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 17:46:56.963638 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81593) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 17:46:56.963719 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81592) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 17:46:56.963910 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81593) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 17:46:56.963992 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81592) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 17:46:56.964183 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81592) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 17:46:56.964265 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81593) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 17:46:56.964451 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81593) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 17:46:56.964531 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81592) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 17:46:56.964727 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81592) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 17:46:56.965002 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81592) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 17:46:56.987104 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81593) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 17:46:56.987790 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81592) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 17:46:56.988558 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81593) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 15 17:46:56.988842 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81593) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 17:46:56.989314 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81592) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 15 17:46:56.989601 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81592) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 17:46:56.993588 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81593) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 15 17:46:56.993875 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81593) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 17:46:56.994157 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81593) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 17:46:56.994283 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81592) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 15 17:46:56.994572 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81592) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 17:46:56.994859 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81592) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 17:46:57.000512 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81593) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 15 17:46:57.000800 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81593) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 17:46:57.001157 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81592) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 15 17:46:57.001477 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81592) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 17:46:57.006942 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81593) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 15 17:46:57.007239 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81593) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 17:46:57.007528 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81593) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 17:46:57.007666 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81592) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 15 17:46:57.007814 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81593) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 17:46:57.007965 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81592) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 17:46:57.008091 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81593) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 17:46:57.008261 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81592) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 17:46:57.008367 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81593) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 17:46:57.008557 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81592) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 17:46:57.008648 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81593) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 17:46:57.008840 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81592) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 17:46:57.008920 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81593) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 17:46:57.009119 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81592) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 17:46:57.009421 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81592) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 17:46:57.009696 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81592) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 17:46:57.024639 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81593) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 17:46:57.024915 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81593) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 17:46:57.025635 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81592) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 17:46:57.025921 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81592) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 17:46:57.028698 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81593) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 15 17:46:57.029724 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81592) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 15 17:46:57.031858 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81593) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 17:46:57.032155 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81593) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 17:46:57.032897 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81592) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 17:46:57.033202 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81592) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 17:46:57.036273 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81593) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 15 17:46:57.037430 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81592) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 15 17:46:57.039470 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81593) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 15 17:46:57.040487 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81592) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 15 17:46:57.042676 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81593) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 17:46:57.042978 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81593) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 17:46:57.043267 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81593) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 17:46:57.043553 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81593) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 17:46:57.043681 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81592) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 17:46:57.043842 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81593) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 17:46:57.043986 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81592) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 17:46:57.044130 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81593) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 17:46:57.044279 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81592) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 17:46:57.044571 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81592) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 17:46:57.044858 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81592) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 17:46:57.045144 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81592) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 17:46:57.059786 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81593) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 15 17:46:57.060072 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81593) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 17:46:57.060345 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81593) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 17:46:57.060613 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81593) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 17:46:57.060767 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81592) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 15 17:46:57.061061 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81592) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 17:46:57.061357 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81592) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 17:46:57.061635 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81592) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 17:46:57.067923 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=81593) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 17:46:57.068986 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=81592) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 17:46:57.069468 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81593) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 17:46:57.070555 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81592) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 17:46:57.070979 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81593) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 17:46:57.071258 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81593) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 17:46:57.072100 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81592) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 17:46:57.072383 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81592) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 17:46:57.074048 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81593) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 15 17:46:57.074332 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81593) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 17:46:57.074617 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81593) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 17:46:57.074902 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81593) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 17:46:57.075123 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81592) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 15 17:46:57.075303 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81593) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 17:46:57.075412 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81592) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 17:46:57.075709 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81592) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 17:46:57.076000 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81592) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 17:46:57.076404 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81592) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 17:46:57.086398 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81593) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 15 17:46:57.086682 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81593) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 17:46:57.086966 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81593) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 17:46:57.087258 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81593) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 17:46:57.087642 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81593) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 17:46:57.087736 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81592) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 15 17:46:57.087926 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81592) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 17:46:57.088009 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81593) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 17:46:57.088206 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81593) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 17:46:57.088287 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81592) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 17:46:57.088496 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81592) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 17:46:57.088880 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81592) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 17:46:57.089175 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81592) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 17:46:57.089497 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81592) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 17:46:57.104124 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81593) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 15 17:46:57.105648 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81592) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 15 17:46:57.107037 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81593) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 15 17:46:57.108551 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81592) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 15 17:46:57.109910 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81593) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 17:46:57.111341 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81593) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 17:46:57.111475 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81592) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 17:46:57.112791 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81593) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 15 17:46:57.112917 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81592) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 17:46:57.113074 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81593) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 17:46:57.113492 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81593) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 17:46:57.114500 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81592) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 15 17:46:57.114788 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81592) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 17:46:57.115201 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81592) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 17:46:57.119831 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81593) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 17:46:57.121281 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81593) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 15 17:46:57.121580 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81592) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 17:46:57.123039 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81592) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 15 17:46:57.124147 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81593) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 17:46:57.124546 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81593) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 17:46:57.124836 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81593) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 17:46:57.125116 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81593) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 17:46:57.125946 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81592) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 17:46:57.126353 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81592) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 17:46:57.126649 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81592) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 17:46:57.126938 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81592) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 17:46:57.133386 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81593) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 15 17:46:57.133678 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81593) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 17:46:57.133961 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81593) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 17:46:57.135275 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81592) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 15 17:46:57.135570 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81592) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 17:46:57.135861 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81592) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 17:46:57.140853 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81593) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 15 17:46:57.141116 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81593) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 17:46:57.141428 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81593) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 17:46:57.141715 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81593) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 17:46:57.141991 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81593) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 17:46:57.142265 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81593) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 17:46:57.142540 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81593) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 17:46:57.142729 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81592) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 15 17:46:57.142814 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81593) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 17:46:57.143023 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81592) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 17:46:57.143105 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81593) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 17:46:57.143313 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81592) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 17:46:57.143402 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81593) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 17:46:57.143595 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81592) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 17:46:57.143687 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81593) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 17:46:57.143861 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81593) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 17:46:57.143952 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81592) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 17:46:57.144126 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81593) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 17:46:57.144209 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81592) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 17:46:57.144402 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81593) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 17:46:57.144484 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81592) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 17:46:57.144696 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81592) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 17:46:57.144973 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81592) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 17:46:57.145256 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81592) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 17:46:57.145650 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81592) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 17:46:57.145930 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81592) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 17:46:57.146203 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81592) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 17:46:57.146477 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81592) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 17:46:57.178419 dv-cinder-835384-27-smb devstack@keystone.service[81593]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x5606085389c0 pid: 81593 (default app) Sep 15 17:46:57.180687 dv-cinder-835384-27-smb devstack@keystone.service[81592]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x5606085389c0 pid: 81592 (default app) Sep 15 17:46:57.181618 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d311818-a7d4-4fc3-a90b-69c444cb1334 None None] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:46:57.181903 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d311818-a7d4-4fc3-a90b-69c444cb1334 None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:46:57.182172 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d311818-a7d4-4fc3-a90b-69c444cb1334 None None] PATH_INFO: `/v3` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:46:57.186285 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1/1] 10.222.0.25 () {50 vars in 791 bytes} [Thu Sep 15 17:46:57 2022] GET /identity/v3/ => generated 255 bytes in 7 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 17:47:04.034803 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8daf298a-5972-4f2a-92b3-0daa343fa513 None None] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:47:04.035268 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8daf298a-5972-4f2a-92b3-0daa343fa513 None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:47:04.035369 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8daf298a-5972-4f2a-92b3-0daa343fa513 None None] PATH_INFO: `/` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:47:04.039606 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1/2] 10.222.0.25 () {54 vars in 927 bytes} [Thu Sep 15 17:47:04 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 15 17:47:04.044850 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8678dd-bc18-4d1a-ad27-4141825efed8 None None] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:47:04.045251 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8678dd-bc18-4d1a-ad27-4141825efed8 None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:47:04.045413 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8678dd-bc18-4d1a-ad27-4141825efed8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:47:04.115676 dv-cinder-835384-27-smb devstack@keystone.service[81593]: INFO dbcounter [None req-ff8678dd-bc18-4d1a-ad27-4141825efed8 None None] Registered counter for database keystone Sep 15 17:47:04.134919 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG oslo_db.sqlalchemy.engines [None req-ff8678dd-bc18-4d1a-ad27-4141825efed8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81593) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 15 17:47:04.141031 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writer thread running {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 15 17:47:04.319445 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG passlib.handlers.bcrypt [None req-ff8678dd-bc18-4d1a-ad27-4141825efed8 None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=81593) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Sep 15 17:47:04.319829 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG passlib.handlers.bcrypt [None req-ff8678dd-bc18-4d1a-ad27-4141825efed8 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81593) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Sep 15 17:47:04.377605 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.auth.core [None req-ff8678dd-bc18-4d1a-ad27-4141825efed8 None None] MFA Rules not processed for user `5cfa58ef86774ab7800bf91930bf6028`. Rule list: `[]` (Enabled: `True`). {{(pid=81593) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 17:47:04.379207 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-ff8678dd-bc18-4d1a-ad27-4141825efed8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 17:47:04.503288 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 2/3] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Sep 15 17:47:04 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 459 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Sep 15 17:47:04.989952 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8daf298a-5972-4f2a-92b3-0daa343fa513 None None] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:47:05.058907 dv-cinder-835384-27-smb devstack@keystone.service[81592]: INFO dbcounter [None req-8daf298a-5972-4f2a-92b3-0daa343fa513 None None] Registered counter for database keystone Sep 15 17:47:05.079699 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG oslo_db.sqlalchemy.engines [None req-8daf298a-5972-4f2a-92b3-0daa343fa513 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81592) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 15 17:47:05.085942 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writer thread running {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 15 17:47:05.211222 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8daf298a-5972-4f2a-92b3-0daa343fa513 None None] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:47:05.215385 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33f7c36-c36b-4a9f-a1f4-3181e9b4991d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:47:05.216022 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33f7c36-c36b-4a9f-a1f4-3181e9b4991d admin admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:47:05.216303 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33f7c36-c36b-4a9f-a1f4-3181e9b4991d admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:47:05.216577 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33f7c36-c36b-4a9f-a1f4-3181e9b4991d admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:47:05.224688 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33f7c36-c36b-4a9f-a1f4-3181e9b4991d admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:47:05.276722 dv-cinder-835384-27-smb devstack@keystone.service[81592]: WARNING keystone.common.rbac_enforcer.enforcer [None req-d33f7c36-c36b-4a9f-a1f4-3181e9b4991d admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Sep 15 17:47:05.277063 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33f7c36-c36b-4a9f-a1f4-3181e9b4991d admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:47:05.286733 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 2/4] 10.222.0.25 () {58 vars in 1324 bytes} [Thu Sep 15 17:47:04 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 15 17:47:05.292614 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8678dd-bc18-4d1a-ad27-4141825efed8 None None] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:47:05.308923 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8678dd-bc18-4d1a-ad27-4141825efed8 None None] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:47:05.313266 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a5f4c2-ca51-40a4-8b09-6fed33e61436 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:47:05.314402 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a5f4c2-ca51-40a4-8b09-6fed33e61436 admin admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:47:05.314685 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a5f4c2-ca51-40a4-8b09-6fed33e61436 admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:47:05.314956 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a5f4c2-ca51-40a4-8b09-6fed33e61436 admin admin] PATH_INFO: `/v3/projects/e456d0186b2040e49cb0f3fd71d6c972` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:47:05.316526 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a5f4c2-ca51-40a4-8b09-6fed33e61436 admin admin] RBAC: Authorizing `identity:get_project(project_id=e456d0186b2040e49cb0f3fd71d6c972)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:47:05.368716 dv-cinder-835384-27-smb devstack@keystone.service[81593]: WARNING keystone.common.rbac_enforcer.enforcer [None req-f5a5f4c2-ca51-40a4-8b09-6fed33e61436 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Sep 15 17:47:05.369054 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a5f4c2-ca51-40a4-8b09-6fed33e61436 admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:47:05.373541 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 3/5] 10.222.0.25 () {56 vars in 1207 bytes} [Thu Sep 15 17:47:05 2022] GET /identity/v3/projects/e456d0186b2040e49cb0f3fd71d6c972 => generated 344 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 17:47:07.468500 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1223c52d-59ec-478a-bc74-2bef55bdd345 None None] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:47:07.469028 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1223c52d-59ec-478a-bc74-2bef55bdd345 None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:47:07.469028 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1223c52d-59ec-478a-bc74-2bef55bdd345 None None] PATH_INFO: `/` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:47:07.473139 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 3/6] 10.222.0.25 () {54 vars in 927 bytes} [Thu Sep 15 17:47:07 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 15 17:47:07.479033 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b8162d-a803-4bfc-bc50-e6afd0a34291 None None] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:47:07.479719 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b8162d-a803-4bfc-bc50-e6afd0a34291 None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:47:07.479838 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b8162d-a803-4bfc-bc50-e6afd0a34291 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:47:07.499941 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.auth.core [None req-c4b8162d-a803-4bfc-bc50-e6afd0a34291 None None] MFA Rules not processed for user `5cfa58ef86774ab7800bf91930bf6028`. Rule list: `[]` (Enabled: `True`). {{(pid=81593) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 17:47:07.501468 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-c4b8162d-a803-4bfc-bc50-e6afd0a34291 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 17:47:07.509093 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 4/7] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Sep 15 17:47:07 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Sep 15 17:47:07.776216 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1223c52d-59ec-478a-bc74-2bef55bdd345 None None] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:47:07.788159 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1223c52d-59ec-478a-bc74-2bef55bdd345 None None] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:47:07.792343 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3716d20e-178d-4892-8b74-758fa8f04739 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:47:07.792965 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3716d20e-178d-4892-8b74-758fa8f04739 admin admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:47:07.793244 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3716d20e-178d-4892-8b74-758fa8f04739 admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:47:07.793612 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3716d20e-178d-4892-8b74-758fa8f04739 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:47:07.801053 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3716d20e-178d-4892-8b74-758fa8f04739 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:47:07.803363 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3716d20e-178d-4892-8b74-758fa8f04739 admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:47:07.811875 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 4/8] 10.222.0.25 () {58 vars in 1324 bytes} [Thu Sep 15 17:47:07 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 15 17:47:07.816951 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b8162d-a803-4bfc-bc50-e6afd0a34291 None None] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:47:07.826500 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b8162d-a803-4bfc-bc50-e6afd0a34291 None None] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:47:07.830740 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aba4a52-f8db-4ebb-a5b8-64d8f8f86c7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:47:07.831353 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aba4a52-f8db-4ebb-a5b8-64d8f8f86c7d admin admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:47:07.831630 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aba4a52-f8db-4ebb-a5b8-64d8f8f86c7d admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:47:07.831900 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aba4a52-f8db-4ebb-a5b8-64d8f8f86c7d admin admin] PATH_INFO: `/v3/users/5cfa58ef86774ab7800bf91930bf6028` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:47:07.833202 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aba4a52-f8db-4ebb-a5b8-64d8f8f86c7d admin admin] RBAC: Authorizing `identity:get_user(user_id=5cfa58ef86774ab7800bf91930bf6028)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:47:07.835034 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aba4a52-f8db-4ebb-a5b8-64d8f8f86c7d admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:47:07.836537 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 5/9] 10.222.0.25 () {56 vars in 1198 bytes} [Thu Sep 15 17:47:07 2022] GET /identity/v3/users/5cfa58ef86774ab7800bf91930bf6028 => generated 247 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 17:47:10.072478 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d044ceb5-99dd-4008-aaa9-b830d75bd91b None None] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:47:10.073014 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d044ceb5-99dd-4008-aaa9-b830d75bd91b None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:47:10.073014 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d044ceb5-99dd-4008-aaa9-b830d75bd91b None None] PATH_INFO: `/` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:47:10.074417 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 5/10] 10.222.0.25 () {54 vars in 927 bytes} [Thu Sep 15 17:47:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 17:47:10.079729 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e54758-0b63-4a47-803d-40f436d151bd None None] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:47:10.080158 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e54758-0b63-4a47-803d-40f436d151bd None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:47:10.080419 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e54758-0b63-4a47-803d-40f436d151bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:47:10.081858 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7325ad3-e054-4dce-8782-e03a009991e3 None None] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:47:10.082144 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7325ad3-e054-4dce-8782-e03a009991e3 None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:47:10.082418 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7325ad3-e054-4dce-8782-e03a009991e3 None None] PATH_INFO: `/` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:47:10.083762 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 6/11] 10.222.0.25 () {54 vars in 927 bytes} [Thu Sep 15 17:47:10 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 15 17:47:10.088678 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5ee3aa-8581-45a8-957c-9fa7bc49384f None None] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:47:10.088959 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5ee3aa-8581-45a8-957c-9fa7bc49384f None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:47:10.089234 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5ee3aa-8581-45a8-957c-9fa7bc49384f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:47:10.098468 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.auth.core [None req-77e54758-0b63-4a47-803d-40f436d151bd None None] MFA Rules not processed for user `5cfa58ef86774ab7800bf91930bf6028`. Rule list: `[]` (Enabled: `True`). {{(pid=81593) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 17:47:10.099633 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-77e54758-0b63-4a47-803d-40f436d151bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 17:47:10.131261 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG passlib.handlers.bcrypt [None req-4e5ee3aa-8581-45a8-957c-9fa7bc49384f None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=81592) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Sep 15 17:47:10.131646 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG passlib.handlers.bcrypt [None req-4e5ee3aa-8581-45a8-957c-9fa7bc49384f None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81592) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Sep 15 17:47:10.180034 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 6/12] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Sep 15 17:47:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 15 17:47:10.180566 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.auth.core [None req-4e5ee3aa-8581-45a8-957c-9fa7bc49384f None None] MFA Rules not processed for user `5cfa58ef86774ab7800bf91930bf6028`. Rule list: `[]` (Enabled: `True`). {{(pid=81592) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 17:47:10.182259 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-4e5ee3aa-8581-45a8-957c-9fa7bc49384f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 17:47:10.280713 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 7/13] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Sep 15 17:47:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 15 17:47:10.451781 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e54758-0b63-4a47-803d-40f436d151bd None None] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:47:10.475560 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:47:10.554521 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5ee3aa-8581-45a8-957c-9fa7bc49384f None None] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:47:10.556165 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e54758-0b63-4a47-803d-40f436d151bd None None] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:47:10.589103 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856bb194-0c55-4b9d-a326-b72c847a29a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:47:10.589758 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856bb194-0c55-4b9d-a326-b72c847a29a4 None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:47:10.590037 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856bb194-0c55-4b9d-a326-b72c847a29a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:47:10.590310 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856bb194-0c55-4b9d-a326-b72c847a29a4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:47:10.601857 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-856bb194-0c55-4b9d-a326-b72c847a29a4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 17:47:10.610937 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application [None req-856bb194-0c55-4b9d-a326-b72c847a29a4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 15 17:47:10.610937 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 17:47:10.610937 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 17:47:10.610937 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 17:47:10.610937 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 17:47:10.610937 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 17:47:10.610937 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 17:47:10.610937 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 17:47:10.610937 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 17:47:10.610937 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 17:47:10.610937 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 17:47:10.610937 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 17:47:10.610937 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 17:47:10.610937 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 17:47:10.610937 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 17:47:10.610937 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 17:47:10.611950 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 17:47:10.611950 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 17:47:10.611950 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 17:47:10.611950 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 17:47:10.611950 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 17:47:10.611950 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 17:47:10.611950 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 17:47:10.611950 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 17:47:10.611950 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 17:47:10.611950 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 17:47:10.611950 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 17:47:10.611950 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application with Lock( Sep 15 17:47:10.611950 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 17:47:10.611950 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._enter() Sep 15 17:47:10.611950 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 17:47:10.611950 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 17:47:10.612772 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 17:47:10.612772 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.creator() Sep 15 17:47:10.612772 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 17:47:10.612772 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application created_value = creator( Sep 15 17:47:10.612772 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 17:47:10.612772 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 17:47:10.612772 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 17:47:10.612772 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 17:47:10.612772 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 17:47:10.612772 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 17:47:10.612772 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 15 17:47:10.612772 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Sep 15 17:47:10.612772 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 7/14] 10.222.0.25 () {56 vars in 1096 bytes} [Thu Sep 15 17:47:10 2022] GET /identity/v3/roles/admin => generated 83 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 17:47:10.618504 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856bb194-0c55-4b9d-a326-b72c847a29a4 None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:47:10.653982 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5ee3aa-8581-45a8-957c-9fa7bc49384f None None] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:47:10.656225 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:47:10.690954 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913eef22-5199-42d3-a96b-c13c669d2b8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:47:10.691812 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913eef22-5199-42d3-a96b-c13c669d2b8e None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:47:10.692094 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913eef22-5199-42d3-a96b-c13c669d2b8e None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:47:10.692965 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913eef22-5199-42d3-a96b-c13c669d2b8e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:47:10.701365 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:47:10.719571 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856bb194-0c55-4b9d-a326-b72c847a29a4 None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:47:10.752768 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b748fa3-5dd3-4a72-a701-ae020893657c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:47:10.753403 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b748fa3-5dd3-4a72-a701-ae020893657c None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:47:10.753684 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b748fa3-5dd3-4a72-a701-ae020893657c None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:47:10.753958 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b748fa3-5dd3-4a72-a701-ae020893657c None admin] PATH_INFO: `/v3/roles` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:47:10.754628 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b748fa3-5dd3-4a72-a701-ae020893657c None admin] RBAC: Adding query filter params (name=admin) {{(pid=81593) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 17:47:10.754988 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b748fa3-5dd3-4a72-a701-ae020893657c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:47:10.756391 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b748fa3-5dd3-4a72-a701-ae020893657c None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:47:10.758885 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-913eef22-5199-42d3-a96b-c13c669d2b8e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:47:10.760382 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-913eef22-5199-42d3-a96b-c13c669d2b8e None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:47:10.767779 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 8/15] 10.222.0.25 () {56 vars in 1099 bytes} [Thu Sep 15 17:47:10 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 17:47:10.773914 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b748fa3-5dd3-4a72-a701-ae020893657c None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:47:10.857820 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 8/16] 10.222.0.25 () {58 vars in 1282 bytes} [Thu Sep 15 17:47:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 15 17:47:10.863337 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913eef22-5199-42d3-a96b-c13c669d2b8e None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:47:10.866042 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:47:10.870262 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b748fa3-5dd3-4a72-a701-ae020893657c None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:47:10.903482 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9fa2af1-ac6b-4230-9ff9-a54476650fc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:47:10.904116 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fa2af1-ac6b-4230-9ff9-a54476650fc9 None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:47:10.904403 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fa2af1-ac6b-4230-9ff9-a54476650fc9 None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:47:10.904681 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fa2af1-ac6b-4230-9ff9-a54476650fc9 None admin] PATH_INFO: `/v3/users/5cfa58ef86774ab7800bf91930bf6028` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:47:10.905861 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9fa2af1-ac6b-4230-9ff9-a54476650fc9 None admin] RBAC: Authorizing `identity:get_user(user_id=5cfa58ef86774ab7800bf91930bf6028)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:47:10.907335 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9fa2af1-ac6b-4230-9ff9-a54476650fc9 None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:47:10.908901 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 9/17] 10.222.0.25 () {56 vars in 1177 bytes} [Thu Sep 15 17:47:10 2022] GET /identity/v3/users/5cfa58ef86774ab7800bf91930bf6028 => generated 247 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 17:47:10.914466 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9fa2af1-ac6b-4230-9ff9-a54476650fc9 None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:47:10.929272 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:47:10.968184 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913eef22-5199-42d3-a96b-c13c669d2b8e None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:47:11.002295 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e17935-2939-4f38-8957-514eafaa9884 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:47:11.003150 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e17935-2939-4f38-8957-514eafaa9884 None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:47:11.003431 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e17935-2939-4f38-8957-514eafaa9884 None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:47:11.003714 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e17935-2939-4f38-8957-514eafaa9884 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:47:11.012387 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9fa2af1-ac6b-4230-9ff9-a54476650fc9 None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:47:11.022303 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e17935-2939-4f38-8957-514eafaa9884 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:47:11.023783 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e17935-2939-4f38-8957-514eafaa9884 None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:47:11.042011 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application [None req-61e17935-2939-4f38-8957-514eafaa9884 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 17:47:11.042011 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 17:47:11.042011 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 17:47:11.042011 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 17:47:11.042011 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 17:47:11.042011 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 17:47:11.042011 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 17:47:11.042011 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 17:47:11.042011 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 17:47:11.042011 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 17:47:11.042011 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 17:47:11.042011 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 17:47:11.042011 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 15 17:47:11.042011 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 15 17:47:11.042011 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 15 17:47:11.042011 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 15 17:47:11.043005 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 17:47:11.043005 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 17:47:11.043005 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 17:47:11.043005 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 17:47:11.043005 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 17:47:11.043005 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 17:47:11.043005 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 17:47:11.043005 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application with Lock( Sep 15 17:47:11.043005 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 17:47:11.043005 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._enter() Sep 15 17:47:11.043005 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 17:47:11.043005 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 17:47:11.043005 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 17:47:11.043005 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.creator() Sep 15 17:47:11.043005 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 17:47:11.043005 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application created_value = creator( Sep 15 17:47:11.043005 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 15 17:47:11.043806 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 15 17:47:11.043806 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 17:47:11.043806 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Sep 15 17:47:11.043806 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 9/18] 10.222.0.25 () {56 vars in 1108 bytes} [Thu Sep 15 17:47:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 15 17:47:11.047712 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c153483f-36ef-4ab3-8800-2dbb30af47b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:47:11.048341 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c153483f-36ef-4ab3-8800-2dbb30af47b7 None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:47:11.048619 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c153483f-36ef-4ab3-8800-2dbb30af47b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:47:11.048889 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c153483f-36ef-4ab3-8800-2dbb30af47b7 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:47:11.049081 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e17935-2939-4f38-8957-514eafaa9884 None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:47:11.050025 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c153483f-36ef-4ab3-8800-2dbb30af47b7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:47:11.051468 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c153483f-36ef-4ab3-8800-2dbb30af47b7 None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:47:11.053788 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 10/19] 10.222.0.25 () {56 vars in 1108 bytes} [Thu Sep 15 17:47:10 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 17:47:11.059304 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c153483f-36ef-4ab3-8800-2dbb30af47b7 None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:47:11.105947 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:47:11.137858 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:47:11.151076 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e17935-2939-4f38-8957-514eafaa9884 None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:47:11.156763 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c153483f-36ef-4ab3-8800-2dbb30af47b7 None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:47:11.184492 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a760d8d4-296c-4bfa-bc9d-a0e6ecbda6dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:47:11.185101 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a760d8d4-296c-4bfa-bc9d-a0e6ecbda6dc None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:47:11.185409 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a760d8d4-296c-4bfa-bc9d-a0e6ecbda6dc None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:47:11.185688 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a760d8d4-296c-4bfa-bc9d-a0e6ecbda6dc None admin] PATH_INFO: `/v3/domains` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:47:11.186339 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a760d8d4-296c-4bfa-bc9d-a0e6ecbda6dc None admin] RBAC: Adding query filter params (name=Default) {{(pid=81592) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 17:47:11.186643 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a760d8d4-296c-4bfa-bc9d-a0e6ecbda6dc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:47:11.188021 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a760d8d4-296c-4bfa-bc9d-a0e6ecbda6dc None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:47:11.191890 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1529aa6-6191-444f-87af-505c9451883d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:47:11.193024 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1529aa6-6191-444f-87af-505c9451883d None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:47:11.193320 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1529aa6-6191-444f-87af-505c9451883d None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:47:11.193603 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1529aa6-6191-444f-87af-505c9451883d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:47:11.194345 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1529aa6-6191-444f-87af-505c9451883d None admin] RBAC: Adding query filter params (role.id=a9e42be86923434f8af52d3fc07fb4f7, scope.domain.id=default, user.id=5cfa58ef86774ab7800bf91930bf6028) {{(pid=81593) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 17:47:11.194655 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1529aa6-6191-444f-87af-505c9451883d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:47:11.196075 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1529aa6-6191-444f-87af-505c9451883d None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:47:11.202770 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 11/20] 10.222.0.25 () {56 vars in 1322 bytes} [Thu Sep 15 17:47:11 2022] GET /identity/v3/role_assignments?user.id=5cfa58ef86774ab7800bf91930bf6028&scope.domain.id=default&role.id=a9e42be86923434f8af52d3fc07fb4f7 => generated 233 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 17:47:11.205605 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 10/21] 10.222.0.25 () {56 vars in 1109 bytes} [Thu Sep 15 17:47:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 17:47:13.791320 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36f7962-28ce-4f62-a9d6-7a9cbb77d3cc None None] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:47:13.792327 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36f7962-28ce-4f62-a9d6-7a9cbb77d3cc None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:47:13.792814 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36f7962-28ce-4f62-a9d6-7a9cbb77d3cc None None] PATH_INFO: `/` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:47:13.794377 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 12/22] 10.222.0.25 () {54 vars in 927 bytes} [Thu Sep 15 17:47:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 17:47:13.799998 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7238c1e2-98e5-415d-9408-9eb0e56246e6 None None] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:47:13.800852 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7238c1e2-98e5-415d-9408-9eb0e56246e6 None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:47:13.801368 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7238c1e2-98e5-415d-9408-9eb0e56246e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:47:13.806173 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a8a6b2-207f-4f2e-9f69-bbcfdee642a2 None None] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:47:13.806708 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a8a6b2-207f-4f2e-9f69-bbcfdee642a2 None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:47:13.807554 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a8a6b2-207f-4f2e-9f69-bbcfdee642a2 None None] PATH_INFO: `/` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:47:13.814855 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 13/23] 10.222.0.25 () {54 vars in 927 bytes} [Thu Sep 15 17:47:13 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 17:47:13.820688 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3194f02d-0c3e-4f37-9af6-7ddfc5a3e577 None None] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:47:13.821210 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3194f02d-0c3e-4f37-9af6-7ddfc5a3e577 None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:47:13.821732 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3194f02d-0c3e-4f37-9af6-7ddfc5a3e577 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:47:13.839923 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.auth.core [None req-7238c1e2-98e5-415d-9408-9eb0e56246e6 None None] MFA Rules not processed for user `5cfa58ef86774ab7800bf91930bf6028`. Rule list: `[]` (Enabled: `True`). {{(pid=81592) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 17:47:13.846896 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-7238c1e2-98e5-415d-9408-9eb0e56246e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 17:47:13.861261 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.auth.core [None req-3194f02d-0c3e-4f37-9af6-7ddfc5a3e577 None None] MFA Rules not processed for user `5cfa58ef86774ab7800bf91930bf6028`. Rule list: `[]` (Enabled: `True`). {{(pid=81593) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 17:47:13.862829 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-3194f02d-0c3e-4f37-9af6-7ddfc5a3e577 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 17:47:14.016856 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 11/24] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Sep 15 17:47:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 15 17:47:14.023722 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 14/25] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Sep 15 17:47:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 15 17:47:14.097340 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3daf148f-0af9-45e0-8ec5-e6db0fefa594 None None] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:47:14.097545 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3daf148f-0af9-45e0-8ec5-e6db0fefa594 None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:47:14.098028 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3daf148f-0af9-45e0-8ec5-e6db0fefa594 None None] PATH_INFO: `/` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:47:14.099567 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 12/26] 10.222.0.25 () {54 vars in 927 bytes} [Thu Sep 15 17:47:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 17:47:14.105386 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2dc7dc-9d0d-4bcf-a2a1-3deef6816146 None None] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:47:14.105674 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2dc7dc-9d0d-4bcf-a2a1-3deef6816146 None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:47:14.106130 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2dc7dc-9d0d-4bcf-a2a1-3deef6816146 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:47:14.136330 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.auth.core [None req-fb2dc7dc-9d0d-4bcf-a2a1-3deef6816146 None None] MFA Rules not processed for user `5cfa58ef86774ab7800bf91930bf6028`. Rule list: `[]` (Enabled: `True`). {{(pid=81593) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 17:47:14.137551 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-fb2dc7dc-9d0d-4bcf-a2a1-3deef6816146 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 17:47:14.162599 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84a9ba1-aa22-46be-9181-f63e5a2dbc54 None None] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:47:14.163131 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84a9ba1-aa22-46be-9181-f63e5a2dbc54 None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:47:14.163628 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84a9ba1-aa22-46be-9181-f63e5a2dbc54 None None] PATH_INFO: `/` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:47:14.169311 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 13/27] 10.222.0.25 () {54 vars in 927 bytes} [Thu Sep 15 17:47:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 17:47:14.170714 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cc6246-0f2d-4c86-b720-c03c197eafe9 None None] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:47:14.171297 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cc6246-0f2d-4c86-b720-c03c197eafe9 None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:47:14.171866 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cc6246-0f2d-4c86-b720-c03c197eafe9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:47:14.199247 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.auth.core [None req-90cc6246-0f2d-4c86-b720-c03c197eafe9 None None] MFA Rules not processed for user `5cfa58ef86774ab7800bf91930bf6028`. Rule list: `[]` (Enabled: `True`). {{(pid=81592) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 17:47:14.200430 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-90cc6246-0f2d-4c86-b720-c03c197eafe9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 17:47:14.210494 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 15/28] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Sep 15 17:47:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 15 17:47:14.279329 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:47:14.309437 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 14/29] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Sep 15 17:47:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 15 17:47:14.470702 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2dc7dc-9d0d-4bcf-a2a1-3deef6816146 None None] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:47:14.475856 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:47:14.597662 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2dc7dc-9d0d-4bcf-a2a1-3deef6816146 None None] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:47:14.637127 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b780bfb-2598-482e-ac6b-1b631da6bf96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:47:14.637339 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b780bfb-2598-482e-ac6b-1b631da6bf96 None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:47:14.637821 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b780bfb-2598-482e-ac6b-1b631da6bf96 None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:47:14.637935 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90cc6246-0f2d-4c86-b720-c03c197eafe9 None None] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:47:14.638011 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b780bfb-2598-482e-ac6b-1b631da6bf96 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:47:14.650735 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b780bfb-2598-482e-ac6b-1b631da6bf96 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:47:14.652325 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b780bfb-2598-482e-ac6b-1b631da6bf96 None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:47:14.670612 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application [None req-7b780bfb-2598-482e-ac6b-1b631da6bf96 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 17:47:14.670612 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 17:47:14.670612 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 17:47:14.670612 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 17:47:14.670612 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 17:47:14.670612 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 17:47:14.670612 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 17:47:14.670612 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 17:47:14.670612 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 17:47:14.670612 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 17:47:14.670612 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 17:47:14.670612 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 17:47:14.670612 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 15 17:47:14.670612 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 15 17:47:14.670612 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 15 17:47:14.670612 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 15 17:47:14.671519 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 17:47:14.671519 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 17:47:14.671519 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 17:47:14.671519 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 17:47:14.671519 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 17:47:14.671519 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 17:47:14.671519 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 17:47:14.671519 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application with Lock( Sep 15 17:47:14.671519 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 17:47:14.671519 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._enter() Sep 15 17:47:14.671519 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 17:47:14.671519 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 17:47:14.671519 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 17:47:14.671519 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.creator() Sep 15 17:47:14.671519 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 17:47:14.671519 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application created_value = creator( Sep 15 17:47:14.671519 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 15 17:47:14.672312 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 15 17:47:14.672312 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 17:47:14.672312 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Sep 15 17:47:14.672312 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 16/30] 10.222.0.25 () {56 vars in 1108 bytes} [Thu Sep 15 17:47:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 17:47:14.673100 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b780bfb-2598-482e-ac6b-1b631da6bf96 None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:47:14.777702 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:47:14.826019 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90cc6246-0f2d-4c86-b720-c03c197eafe9 None None] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:47:14.828626 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b780bfb-2598-482e-ac6b-1b631da6bf96 None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:47:14.865674 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3535d7ea-d8af-4963-90d1-d66c3948e54e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:47:14.866587 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3535d7ea-d8af-4963-90d1-d66c3948e54e None admin] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:47:14.867045 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3535d7ea-d8af-4963-90d1-d66c3948e54e None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:47:14.867486 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3535d7ea-d8af-4963-90d1-d66c3948e54e None admin] PATH_INFO: `/v3/roles` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:47:14.868374 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3535d7ea-d8af-4963-90d1-d66c3948e54e None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:47:14.870018 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3535d7ea-d8af-4963-90d1-d66c3948e54e None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:47:14.874234 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c030fce1-3854-408a-9b63-913a7a57c468 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:47:14.875672 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c030fce1-3854-408a-9b63-913a7a57c468 None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:47:14.876041 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c030fce1-3854-408a-9b63-913a7a57c468 None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:47:14.876328 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c030fce1-3854-408a-9b63-913a7a57c468 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:47:14.893218 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c030fce1-3854-408a-9b63-913a7a57c468 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 17:47:14.901993 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application [None req-c030fce1-3854-408a-9b63-913a7a57c468 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 15 17:47:14.901993 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 17:47:14.901993 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 17:47:14.901993 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 17:47:14.901993 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 17:47:14.901993 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 17:47:14.901993 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 17:47:14.901993 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 17:47:14.901993 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 17:47:14.901993 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 17:47:14.901993 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 17:47:14.901993 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 17:47:14.901993 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 17:47:14.901993 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 17:47:14.901993 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 17:47:14.901993 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 17:47:14.902835 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 17:47:14.902835 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 17:47:14.902835 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 17:47:14.902835 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 17:47:14.902835 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 17:47:14.902835 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 17:47:14.902835 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 17:47:14.902835 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 17:47:14.902835 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 17:47:14.902835 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 17:47:14.902835 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 17:47:14.902835 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application with Lock( Sep 15 17:47:14.902835 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 17:47:14.902835 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._enter() Sep 15 17:47:14.902835 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 17:47:14.902835 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 17:47:14.903625 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 17:47:14.903625 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.creator() Sep 15 17:47:14.903625 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 17:47:14.903625 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application created_value = creator( Sep 15 17:47:14.903625 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 17:47:14.903625 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 17:47:14.903625 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 17:47:14.903625 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 17:47:14.903625 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 17:47:14.903625 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 17:47:14.903625 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 15 17:47:14.903625 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Sep 15 17:47:14.903625 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 15/31] 10.222.0.25 () {56 vars in 1096 bytes} [Thu Sep 15 17:47:14 2022] GET /identity/v3/roles/admin => generated 83 bytes in 266 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 17:47:14.904272 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c030fce1-3854-408a-9b63-913a7a57c468 None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:47:14.952343 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:47:15.026650 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c030fce1-3854-408a-9b63-913a7a57c468 None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:47:15.031553 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 17/32] 10.222.0.25 () {60 vars in 1131 bytes} [Thu Sep 15 17:47:14 2022] POST /identity/v3/roles => generated 219 bytes in 359 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 17:47:15.032582 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3535d7ea-d8af-4963-90d1-d66c3948e54e None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:47:15.065113 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce500ce7-a3a1-4b4e-9979-11cd28c725c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:47:15.066050 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce500ce7-a3a1-4b4e-9979-11cd28c725c0 None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:47:15.066537 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce500ce7-a3a1-4b4e-9979-11cd28c725c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:47:15.066949 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce500ce7-a3a1-4b4e-9979-11cd28c725c0 None admin] PATH_INFO: `/v3/domains` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:47:15.067848 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce500ce7-a3a1-4b4e-9979-11cd28c725c0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81592) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 17:47:15.068297 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce500ce7-a3a1-4b4e-9979-11cd28c725c0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:47:15.069941 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce500ce7-a3a1-4b4e-9979-11cd28c725c0 None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:47:15.082596 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 16/33] 10.222.0.25 () {56 vars in 1109 bytes} [Thu Sep 15 17:47:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 17:47:15.083749 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce500ce7-a3a1-4b4e-9979-11cd28c725c0 None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:47:15.159171 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3535d7ea-d8af-4963-90d1-d66c3948e54e None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:47:15.178743 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:47:15.189819 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:47:15.196684 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce500ce7-a3a1-4b4e-9979-11cd28c725c0 None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:47:15.204558 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d24fdae-253f-42b3-b055-dedea06d8503 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:47:15.205488 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d24fdae-253f-42b3-b055-dedea06d8503 None admin] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:47:15.205927 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d24fdae-253f-42b3-b055-dedea06d8503 None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:47:15.206456 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d24fdae-253f-42b3-b055-dedea06d8503 None admin] PATH_INFO: `/v3/roles` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:47:15.207314 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d24fdae-253f-42b3-b055-dedea06d8503 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:47:15.209890 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d24fdae-253f-42b3-b055-dedea06d8503 None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:47:15.228164 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 18/34] 10.222.0.25 () {60 vars in 1131 bytes} [Thu Sep 15 17:47:15 2022] POST /identity/v3/roles => generated 225 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 17:47:15.229336 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d24fdae-253f-42b3-b055-dedea06d8503 None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:47:15.271518 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acff58f6-b03a-4f74-9e67-7d22638c3fe3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:47:15.272492 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acff58f6-b03a-4f74-9e67-7d22638c3fe3 None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:47:15.273114 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acff58f6-b03a-4f74-9e67-7d22638c3fe3 None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:47:15.273593 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acff58f6-b03a-4f74-9e67-7d22638c3fe3 None admin] PATH_INFO: `/v3/roles` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:47:15.274466 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acff58f6-b03a-4f74-9e67-7d22638c3fe3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81592) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 17:47:15.274946 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acff58f6-b03a-4f74-9e67-7d22638c3fe3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:47:15.276788 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acff58f6-b03a-4f74-9e67-7d22638c3fe3 None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:47:15.314542 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 17/35] 10.222.0.25 () {56 vars in 1099 bytes} [Thu Sep 15 17:47:15 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 17:47:15.342982 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acff58f6-b03a-4f74-9e67-7d22638c3fe3 None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:47:15.461342 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d24fdae-253f-42b3-b055-dedea06d8503 None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:47:15.503245 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bda0cd9-e46f-4a9c-a6d9-05a89cea6252 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:47:15.503959 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bda0cd9-e46f-4a9c-a6d9-05a89cea6252 None admin] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:47:15.504360 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bda0cd9-e46f-4a9c-a6d9-05a89cea6252 None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:47:15.504637 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bda0cd9-e46f-4a9c-a6d9-05a89cea6252 None admin] PATH_INFO: `/v3/projects` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:47:15.505446 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bda0cd9-e46f-4a9c-a6d9-05a89cea6252 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:47:15.506995 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bda0cd9-e46f-4a9c-a6d9-05a89cea6252 None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:47:15.512206 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acff58f6-b03a-4f74-9e67-7d22638c3fe3 None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:47:15.544063 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 19/36] 10.222.0.25 () {60 vars in 1141 bytes} [Thu Sep 15 17:47:15 2022] POST /identity/v3/projects => generated 301 bytes in 315 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 17:47:15.561927 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed44d749-3f47-4f6f-9498-76a10b6572d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:47:15.563070 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed44d749-3f47-4f6f-9498-76a10b6572d9 None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:47:15.563665 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed44d749-3f47-4f6f-9498-76a10b6572d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:47:15.564205 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed44d749-3f47-4f6f-9498-76a10b6572d9 None admin] PATH_INFO: `/v3/users/5cfa58ef86774ab7800bf91930bf6028` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:47:15.566410 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed44d749-3f47-4f6f-9498-76a10b6572d9 None admin] RBAC: Authorizing `identity:get_user(user_id=5cfa58ef86774ab7800bf91930bf6028)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:47:15.568846 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed44d749-3f47-4f6f-9498-76a10b6572d9 None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:47:15.571065 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 18/37] 10.222.0.25 () {56 vars in 1177 bytes} [Thu Sep 15 17:47:15 2022] GET /identity/v3/users/5cfa58ef86774ab7800bf91930bf6028 => generated 247 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 17:47:15.577163 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bda0cd9-e46f-4a9c-a6d9-05a89cea6252 None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:47:15.612347 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57110647-9417-4383-b817-1cc32856d97f None None] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:47:15.612661 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57110647-9417-4383-b817-1cc32856d97f None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:47:15.612897 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57110647-9417-4383-b817-1cc32856d97f None None] PATH_INFO: `/` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:47:15.613393 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:47:15.614387 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 19/38] 10.222.0.25 () {54 vars in 927 bytes} [Thu Sep 15 17:47:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 17:47:15.623044 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6db1db-68bb-4f50-a746-1dc048d7b3f7 None None] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:47:15.623326 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6db1db-68bb-4f50-a746-1dc048d7b3f7 None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:47:15.623571 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6db1db-68bb-4f50-a746-1dc048d7b3f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:47:15.656921 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.auth.core [None req-1c6db1db-68bb-4f50-a746-1dc048d7b3f7 None None] MFA Rules not processed for user `5cfa58ef86774ab7800bf91930bf6028`. Rule list: `[]` (Enabled: `True`). {{(pid=81592) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 17:47:15.658302 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-1c6db1db-68bb-4f50-a746-1dc048d7b3f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 17:47:15.685108 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:47:15.733871 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bda0cd9-e46f-4a9c-a6d9-05a89cea6252 None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:47:15.753869 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 20/39] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Sep 15 17:47:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 15 17:47:15.755907 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2471fe4-5b52-45e6-be23-af9805eb4783 None None] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:47:15.756331 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2471fe4-5b52-45e6-be23-af9805eb4783 None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:47:15.757037 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2471fe4-5b52-45e6-be23-af9805eb4783 None None] PATH_INFO: `/` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:47:15.759430 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 21/40] 10.222.0.25 () {54 vars in 927 bytes} [Thu Sep 15 17:47:15 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 17:47:15.765395 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4e4cd7-a896-49e3-8069-f06f952ef7dd None None] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:47:15.765553 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4e4cd7-a896-49e3-8069-f06f952ef7dd None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:47:15.765930 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4e4cd7-a896-49e3-8069-f06f952ef7dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:47:15.782555 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e422320-6f14-46d9-8b9f-2f6f7a12c5ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:47:15.783338 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e422320-6f14-46d9-8b9f-2f6f7a12c5ce None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:47:15.783726 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e422320-6f14-46d9-8b9f-2f6f7a12c5ce None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:47:15.784106 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e422320-6f14-46d9-8b9f-2f6f7a12c5ce None admin] PATH_INFO: `/v3/domains/default` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:47:15.785886 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e422320-6f14-46d9-8b9f-2f6f7a12c5ce None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:47:15.786754 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.auth.core [None req-0d4e4cd7-a896-49e3-8069-f06f952ef7dd None None] MFA Rules not processed for user `5cfa58ef86774ab7800bf91930bf6028`. Rule list: `[]` (Enabled: `True`). {{(pid=81592) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 17:47:15.787559 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e422320-6f14-46d9-8b9f-2f6f7a12c5ce None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:47:15.787958 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-0d4e4cd7-a896-49e3-8069-f06f952ef7dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 17:47:15.790067 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 20/41] 10.222.0.25 () {56 vars in 1108 bytes} [Thu Sep 15 17:47:15 2022] GET /identity/v3/domains/default => generated 199 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 17:47:15.795061 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e422320-6f14-46d9-8b9f-2f6f7a12c5ce None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:47:15.877408 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 22/42] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Sep 15 17:47:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 15 17:47:15.901957 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:47:15.908356 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e422320-6f14-46d9-8b9f-2f6f7a12c5ce None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:47:16.033538 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4e4cd7-a896-49e3-8069-f06f952ef7dd None None] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:47:16.060904 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d70902-3afe-4c86-8d18-2ec35434d8d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:47:16.061628 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d70902-3afe-4c86-8d18-2ec35434d8d9 None admin] REQUEST_METHOD: `PUT` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:47:16.061932 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d70902-3afe-4c86-8d18-2ec35434d8d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:47:16.062194 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d70902-3afe-4c86-8d18-2ec35434d8d9 None admin] PATH_INFO: `/v3/domains/default/users/5cfa58ef86774ab7800bf91930bf6028/roles/a9e42be86923434f8af52d3fc07fb4f7` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:47:16.064159 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d70902-3afe-4c86-8d18-2ec35434d8d9 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=5cfa58ef86774ab7800bf91930bf6028, role_id=a9e42be86923434f8af52d3fc07fb4f7)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:47:16.065661 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d70902-3afe-4c86-8d18-2ec35434d8d9 None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:47:16.081336 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 21/43] 10.222.0.25 () {58 vars in 1361 bytes} [Thu Sep 15 17:47:15 2022] PUT /identity/v3/domains/default/users/5cfa58ef86774ab7800bf91930bf6028/roles/a9e42be86923434f8af52d3fc07fb4f7 => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 15 17:47:16.142738 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:47:16.160445 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4e4cd7-a896-49e3-8069-f06f952ef7dd None None] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:47:16.162978 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d70902-3afe-4c86-8d18-2ec35434d8d9 None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:47:16.199903 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48de7af-b30a-4fcd-a294-43fc9944383c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:47:16.200543 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48de7af-b30a-4fcd-a294-43fc9944383c None admin] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:47:16.200943 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48de7af-b30a-4fcd-a294-43fc9944383c None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:47:16.201108 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48de7af-b30a-4fcd-a294-43fc9944383c None admin] PATH_INFO: `/v3/roles` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:47:16.201816 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48de7af-b30a-4fcd-a294-43fc9944383c None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:47:16.203221 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48de7af-b30a-4fcd-a294-43fc9944383c None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:47:16.278843 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d70902-3afe-4c86-8d18-2ec35434d8d9 None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:47:16.313283 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b818d4f-fb8a-4c15-bb35-10d759cffe15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:47:16.313948 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b818d4f-fb8a-4c15-bb35-10d759cffe15 None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:47:16.314233 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b818d4f-fb8a-4c15-bb35-10d759cffe15 None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:47:16.314513 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b818d4f-fb8a-4c15-bb35-10d759cffe15 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:47:16.315624 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b818d4f-fb8a-4c15-bb35-10d759cffe15 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:47:16.317084 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b818d4f-fb8a-4c15-bb35-10d759cffe15 None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:47:16.319493 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 22/44] 10.222.0.25 () {56 vars in 1108 bytes} [Thu Sep 15 17:47:16 2022] GET /identity/v3/domains/default => generated 199 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 17:47:16.324838 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b818d4f-fb8a-4c15-bb35-10d759cffe15 None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:47:16.330264 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 23/45] 10.222.0.25 () {60 vars in 1131 bytes} [Thu Sep 15 17:47:16 2022] POST /identity/v3/roles => generated 223 bytes in 295 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 15 17:47:16.355914 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:47:16.448924 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b818d4f-fb8a-4c15-bb35-10d759cffe15 None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:47:16.486089 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2092522-3a91-44fb-8915-43b2c6676482 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:47:16.486706 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2092522-3a91-44fb-8915-43b2c6676482 None admin] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:47:16.486986 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2092522-3a91-44fb-8915-43b2c6676482 None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:47:16.487260 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2092522-3a91-44fb-8915-43b2c6676482 None admin] PATH_INFO: `/v3/projects` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:47:16.487951 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2092522-3a91-44fb-8915-43b2c6676482 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:47:16.489511 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2092522-3a91-44fb-8915-43b2c6676482 None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:47:16.518486 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 23/46] 10.222.0.25 () {60 vars in 1141 bytes} [Thu Sep 15 17:47:16 2022] POST /identity/v3/projects => generated 312 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 15 17:47:18.245665 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc96e768-ca55-4495-b24d-795c08156e11 None None] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:47:18.246194 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc96e768-ca55-4495-b24d-795c08156e11 None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:47:18.246194 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc96e768-ca55-4495-b24d-795c08156e11 None None] PATH_INFO: `/` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:47:18.247553 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 24/47] 10.222.0.25 () {54 vars in 927 bytes} [Thu Sep 15 17:47:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 17:47:18.252894 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a3fb31-680f-44ec-93ef-ca79b1b04249 None None] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:47:18.253318 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a3fb31-680f-44ec-93ef-ca79b1b04249 None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:47:18.253498 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a3fb31-680f-44ec-93ef-ca79b1b04249 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:47:18.272300 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.auth.core [None req-37a3fb31-680f-44ec-93ef-ca79b1b04249 None None] MFA Rules not processed for user `5cfa58ef86774ab7800bf91930bf6028`. Rule list: `[]` (Enabled: `True`). {{(pid=81593) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 17:47:18.273844 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-37a3fb31-680f-44ec-93ef-ca79b1b04249 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 17:47:18.339712 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 24/48] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Sep 15 17:47:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 15 17:47:18.614411 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc96e768-ca55-4495-b24d-795c08156e11 None None] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:47:18.641858 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b5c6f2-f269-4185-bf08-92fa6a83fa05 None None] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:47:18.642262 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b5c6f2-f269-4185-bf08-92fa6a83fa05 None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:47:18.642604 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b5c6f2-f269-4185-bf08-92fa6a83fa05 None None] PATH_INFO: `/` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:47:18.644127 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 25/49] 10.222.0.25 () {54 vars in 927 bytes} [Thu Sep 15 17:47:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 15 17:47:18.651910 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6395388e-5ae3-42ab-902d-b07064db295d None None] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:47:18.652197 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6395388e-5ae3-42ab-902d-b07064db295d None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:47:18.652472 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6395388e-5ae3-42ab-902d-b07064db295d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:47:18.665997 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:47:18.672023 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.auth.core [None req-6395388e-5ae3-42ab-902d-b07064db295d None None] MFA Rules not processed for user `5cfa58ef86774ab7800bf91930bf6028`. Rule list: `[]` (Enabled: `True`). {{(pid=81593) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 17:47:18.673381 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-6395388e-5ae3-42ab-902d-b07064db295d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 17:47:18.725422 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc96e768-ca55-4495-b24d-795c08156e11 None None] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:47:18.760794 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 26/50] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Sep 15 17:47:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 15 17:47:18.761907 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13dda7e0-a389-478e-a89f-e846794a67a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:47:18.762545 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13dda7e0-a389-478e-a89f-e846794a67a8 None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:47:18.762827 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13dda7e0-a389-478e-a89f-e846794a67a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:47:18.763103 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13dda7e0-a389-478e-a89f-e846794a67a8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:47:18.773622 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13dda7e0-a389-478e-a89f-e846794a67a8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 17:47:18.778430 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application [None req-13dda7e0-a389-478e-a89f-e846794a67a8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 15 17:47:18.778430 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 17:47:18.778430 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 17:47:18.778430 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 17:47:18.778430 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 17:47:18.778430 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 17:47:18.778430 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 17:47:18.778430 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 17:47:18.778430 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 17:47:18.778430 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 17:47:18.778430 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 17:47:18.778430 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 17:47:18.778430 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 17:47:18.778430 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 17:47:18.778430 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 17:47:18.778430 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 17:47:18.779291 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 17:47:18.779291 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 17:47:18.779291 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 17:47:18.779291 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 17:47:18.779291 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 17:47:18.779291 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 17:47:18.779291 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 17:47:18.779291 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 17:47:18.779291 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 17:47:18.779291 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 17:47:18.779291 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 17:47:18.779291 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application with Lock( Sep 15 17:47:18.779291 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 17:47:18.779291 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._enter() Sep 15 17:47:18.779291 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 17:47:18.779291 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 17:47:18.780078 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 17:47:18.780078 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.creator() Sep 15 17:47:18.780078 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 17:47:18.780078 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application created_value = creator( Sep 15 17:47:18.780078 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 17:47:18.780078 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 17:47:18.780078 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 17:47:18.780078 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 17:47:18.780078 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 17:47:18.780078 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 17:47:18.780078 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 15 17:47:18.780078 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Sep 15 17:47:18.780078 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 25/51] 10.222.0.25 () {56 vars in 1096 bytes} [Thu Sep 15 17:47:18 2022] GET /identity/v3/roles/admin => generated 83 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 17:47:18.785124 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6395388e-5ae3-42ab-902d-b07064db295d None None] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:47:18.881216 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6395388e-5ae3-42ab-902d-b07064db295d None None] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:47:18.915208 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2912568a-f30b-4ecf-bfa1-4b30505982ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:47:18.915830 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2912568a-f30b-4ecf-bfa1-4b30505982ec None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:47:18.916113 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2912568a-f30b-4ecf-bfa1-4b30505982ec None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:47:18.916390 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2912568a-f30b-4ecf-bfa1-4b30505982ec None admin] PATH_INFO: `/v3/roles` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:47:18.917066 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2912568a-f30b-4ecf-bfa1-4b30505982ec None admin] RBAC: Adding query filter params (name=admin) {{(pid=81593) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 17:47:18.917406 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2912568a-f30b-4ecf-bfa1-4b30505982ec None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:47:18.918816 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2912568a-f30b-4ecf-bfa1-4b30505982ec None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:47:18.921202 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:47:18.930812 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 27/52] 10.222.0.25 () {56 vars in 1099 bytes} [Thu Sep 15 17:47:18 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 17:47:18.936458 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13dda7e0-a389-478e-a89f-e846794a67a8 None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:47:18.946546 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:47:19.041072 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2912568a-f30b-4ecf-bfa1-4b30505982ec None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:47:19.059395 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13dda7e0-a389-478e-a89f-e846794a67a8 None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:47:19.091946 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa874238-0a03-47b0-baec-5017fa0fcc6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:47:19.092560 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa874238-0a03-47b0-baec-5017fa0fcc6d None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:47:19.092847 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa874238-0a03-47b0-baec-5017fa0fcc6d None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:47:19.093120 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa874238-0a03-47b0-baec-5017fa0fcc6d None admin] PATH_INFO: `/v3/users/5cfa58ef86774ab7800bf91930bf6028` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:47:19.094351 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa874238-0a03-47b0-baec-5017fa0fcc6d None admin] RBAC: Authorizing `identity:get_user(user_id=5cfa58ef86774ab7800bf91930bf6028)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:47:19.095898 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa874238-0a03-47b0-baec-5017fa0fcc6d None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:47:19.097488 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 26/53] 10.222.0.25 () {56 vars in 1177 bytes} [Thu Sep 15 17:47:18 2022] GET /identity/v3/users/5cfa58ef86774ab7800bf91930bf6028 => generated 247 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 17:47:19.103459 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa874238-0a03-47b0-baec-5017fa0fcc6d None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:47:19.139223 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2912568a-f30b-4ecf-bfa1-4b30505982ec None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:47:19.172038 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baae94e4-c5c7-4b19-a6d8-e21b0c60b60f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:47:19.172669 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baae94e4-c5c7-4b19-a6d8-e21b0c60b60f None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:47:19.172957 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baae94e4-c5c7-4b19-a6d8-e21b0c60b60f None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:47:19.173236 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baae94e4-c5c7-4b19-a6d8-e21b0c60b60f None admin] PATH_INFO: `/v3/domains/default` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:47:19.174693 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baae94e4-c5c7-4b19-a6d8-e21b0c60b60f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:47:19.175585 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:47:19.176168 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baae94e4-c5c7-4b19-a6d8-e21b0c60b60f None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:47:19.178280 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 28/54] 10.222.0.25 () {56 vars in 1108 bytes} [Thu Sep 15 17:47:19 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 17:47:19.183456 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baae94e4-c5c7-4b19-a6d8-e21b0c60b60f None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:47:19.200941 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa874238-0a03-47b0-baec-5017fa0fcc6d None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:47:19.234957 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff41f6e-a136-4638-a4f1-15c66e050591 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:47:19.235580 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff41f6e-a136-4638-a4f1-15c66e050591 None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:47:19.235861 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff41f6e-a136-4638-a4f1-15c66e050591 None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:47:19.236132 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff41f6e-a136-4638-a4f1-15c66e050591 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:47:19.237361 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff41f6e-a136-4638-a4f1-15c66e050591 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:47:19.238808 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff41f6e-a136-4638-a4f1-15c66e050591 None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:47:19.240385 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 27/55] 10.222.0.25 () {56 vars in 1108 bytes} [Thu Sep 15 17:47:19 2022] GET /identity/v3/domains/default => generated 199 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 17:47:19.246120 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff41f6e-a136-4638-a4f1-15c66e050591 None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:47:19.247701 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:47:19.282436 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baae94e4-c5c7-4b19-a6d8-e21b0c60b60f None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:47:19.316822 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85008b58-8de3-41b4-afbf-98e9a700e2a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:47:19.317971 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85008b58-8de3-41b4-afbf-98e9a700e2a6 None admin] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:47:19.318254 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85008b58-8de3-41b4-afbf-98e9a700e2a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:47:19.318528 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85008b58-8de3-41b4-afbf-98e9a700e2a6 None admin] PATH_INFO: `/v3/projects` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:47:19.319187 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85008b58-8de3-41b4-afbf-98e9a700e2a6 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:47:19.320632 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85008b58-8de3-41b4-afbf-98e9a700e2a6 None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:47:19.343391 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff41f6e-a136-4638-a4f1-15c66e050591 None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:47:19.347214 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 29/56] 10.222.0.25 () {60 vars in 1140 bytes} [Thu Sep 15 17:47:19 2022] POST /identity/v3/projects => generated 298 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 15 17:47:19.378464 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec98784-06fd-4f25-9824-02608dfc252c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:47:19.379097 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec98784-06fd-4f25-9824-02608dfc252c None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:47:19.379381 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec98784-06fd-4f25-9824-02608dfc252c None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:47:19.379658 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec98784-06fd-4f25-9824-02608dfc252c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:47:19.380936 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec98784-06fd-4f25-9824-02608dfc252c None admin] RBAC: Adding query filter params (role.id=a9e42be86923434f8af52d3fc07fb4f7, scope.domain.id=default, user.id=5cfa58ef86774ab7800bf91930bf6028) {{(pid=81592) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 17:47:19.381341 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec98784-06fd-4f25-9824-02608dfc252c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:47:19.382891 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec98784-06fd-4f25-9824-02608dfc252c None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:47:19.394352 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 28/57] 10.222.0.25 () {56 vars in 1322 bytes} [Thu Sep 15 17:47:19 2022] GET /identity/v3/role_assignments?user.id=5cfa58ef86774ab7800bf91930bf6028&scope.domain.id=default&role.id=a9e42be86923434f8af52d3fc07fb4f7 => generated 530 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 17:47:21.503177 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32d8931-65a2-4e2a-ba55-d4244194dabc None None] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:47:21.503692 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32d8931-65a2-4e2a-ba55-d4244194dabc None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:47:21.503776 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32d8931-65a2-4e2a-ba55-d4244194dabc None None] PATH_INFO: `/` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:47:21.505731 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 30/58] 10.222.0.25 () {54 vars in 927 bytes} [Thu Sep 15 17:47:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 17:47:21.510754 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef326a7a-1e87-4ca8-980a-2f304ac74c4f None None] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:47:21.511187 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef326a7a-1e87-4ca8-980a-2f304ac74c4f None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:47:21.511317 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef326a7a-1e87-4ca8-980a-2f304ac74c4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:47:21.523595 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:47:21.631113 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.auth.core [None req-ef326a7a-1e87-4ca8-980a-2f304ac74c4f None None] MFA Rules not processed for user `5cfa58ef86774ab7800bf91930bf6028`. Rule list: `[]` (Enabled: `True`). {{(pid=81592) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 17:47:21.632655 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-ef326a7a-1e87-4ca8-980a-2f304ac74c4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 17:47:21.698606 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 29/59] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Sep 15 17:47:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 15 17:47:21.967977 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32d8931-65a2-4e2a-ba55-d4244194dabc None None] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:47:22.066075 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32d8931-65a2-4e2a-ba55-d4244194dabc None None] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:47:22.083049 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:47:22.099806 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0eba1cf-d411-4260-ab8b-f9925deec57d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:47:22.100428 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0eba1cf-d411-4260-ab8b-f9925deec57d None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:47:22.100710 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0eba1cf-d411-4260-ab8b-f9925deec57d None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:47:22.100993 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0eba1cf-d411-4260-ab8b-f9925deec57d None admin] PATH_INFO: `/v3/domains/default` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:47:22.102135 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0eba1cf-d411-4260-ab8b-f9925deec57d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:47:22.103581 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0eba1cf-d411-4260-ab8b-f9925deec57d None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:47:22.105598 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 31/60] 10.222.0.25 () {56 vars in 1108 bytes} [Thu Sep 15 17:47:21 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 17:47:22.110691 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef326a7a-1e87-4ca8-980a-2f304ac74c4f None None] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:47:22.205053 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef326a7a-1e87-4ca8-980a-2f304ac74c4f None None] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:47:22.236939 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a24868-1734-48fe-9fed-2d02734f53f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:47:22.237557 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a24868-1734-48fe-9fed-2d02734f53f9 None admin] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:47:22.237841 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a24868-1734-48fe-9fed-2d02734f53f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:47:22.238115 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a24868-1734-48fe-9fed-2d02734f53f9 None admin] PATH_INFO: `/v3/users` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:47:22.238775 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a24868-1734-48fe-9fed-2d02734f53f9 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:47:22.240754 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a24868-1734-48fe-9fed-2d02734f53f9 None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:47:22.252927 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:47:22.267798 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 30/61] 10.222.0.25 () {60 vars in 1132 bytes} [Thu Sep 15 17:47:22 2022] POST /identity/v3/users => generated 275 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 17:47:25.501081 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e867c2-08a0-4801-aeda-c380ad145cc4 None None] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:47:25.502130 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e867c2-08a0-4801-aeda-c380ad145cc4 None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:47:25.502644 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e867c2-08a0-4801-aeda-c380ad145cc4 None None] PATH_INFO: `/` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:47:25.504205 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 32/62] 10.222.0.25 () {54 vars in 927 bytes} [Thu Sep 15 17:47:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 17:47:25.510296 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab8af7d-f783-4442-9499-f35e83fbb814 None None] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:47:25.511130 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab8af7d-f783-4442-9499-f35e83fbb814 None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:47:25.511601 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab8af7d-f783-4442-9499-f35e83fbb814 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:47:25.533483 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.auth.core [None req-9ab8af7d-f783-4442-9499-f35e83fbb814 None None] MFA Rules not processed for user `5cfa58ef86774ab7800bf91930bf6028`. Rule list: `[]` (Enabled: `True`). {{(pid=81592) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 17:47:25.535071 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-9ab8af7d-f783-4442-9499-f35e83fbb814 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 17:47:25.628277 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 31/63] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Sep 15 17:47:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 15 17:47:25.830042 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee48083-83bc-4446-9a56-4a90866b96e6 None None] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:47:25.830682 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee48083-83bc-4446-9a56-4a90866b96e6 None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:47:25.831195 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee48083-83bc-4446-9a56-4a90866b96e6 None None] PATH_INFO: `/` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:47:25.833081 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 33/64] 10.222.0.25 () {54 vars in 927 bytes} [Thu Sep 15 17:47:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 17:47:25.838280 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e576c70-57a5-41a8-a7b5-629b4aa217d4 None None] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:47:25.838789 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e576c70-57a5-41a8-a7b5-629b4aa217d4 None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:47:25.839263 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e576c70-57a5-41a8-a7b5-629b4aa217d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:47:25.866200 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.auth.core [None req-9e576c70-57a5-41a8-a7b5-629b4aa217d4 None None] MFA Rules not processed for user `5cfa58ef86774ab7800bf91930bf6028`. Rule list: `[]` (Enabled: `True`). {{(pid=81592) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 17:47:25.867438 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-9e576c70-57a5-41a8-a7b5-629b4aa217d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 17:47:25.983784 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 32/65] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Sep 15 17:47:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 15 17:47:26.015231 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee48083-83bc-4446-9a56-4a90866b96e6 None None] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:47:26.049603 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19d2984-5605-43eb-8319-9a15c65ad100 None None] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:47:26.050253 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19d2984-5605-43eb-8319-9a15c65ad100 None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:47:26.050727 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19d2984-5605-43eb-8319-9a15c65ad100 None None] PATH_INFO: `/` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:47:26.052635 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 33/66] 10.222.0.25 () {54 vars in 927 bytes} [Thu Sep 15 17:47:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 17:47:26.057550 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265714bf-7672-4551-b881-eebbfda3a760 None None] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:47:26.058091 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265714bf-7672-4551-b881-eebbfda3a760 None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:47:26.058591 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265714bf-7672-4551-b881-eebbfda3a760 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:47:26.090192 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.auth.core [None req-265714bf-7672-4551-b881-eebbfda3a760 None None] MFA Rules not processed for user `5cfa58ef86774ab7800bf91930bf6028`. Rule list: `[]` (Enabled: `True`). {{(pid=81592) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 17:47:26.092395 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-265714bf-7672-4551-b881-eebbfda3a760 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 17:47:26.196836 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:47:26.212449 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee48083-83bc-4446-9a56-4a90866b96e6 None None] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:47:26.238428 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 34/67] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Sep 15 17:47:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 15 17:47:26.266286 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab22fa59-fb2a-4f8c-9093-ce7f38a5e75c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:47:26.267314 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab22fa59-fb2a-4f8c-9093-ce7f38a5e75c None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:47:26.267826 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab22fa59-fb2a-4f8c-9093-ce7f38a5e75c None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:47:26.268338 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab22fa59-fb2a-4f8c-9093-ce7f38a5e75c None admin] PATH_INFO: `/v3/roles/member` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:47:26.280565 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45074167-4ea8-43db-9f7e-ff95c955b8a1 None None] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:47:26.281151 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45074167-4ea8-43db-9f7e-ff95c955b8a1 None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:47:26.281679 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45074167-4ea8-43db-9f7e-ff95c955b8a1 None None] PATH_INFO: `/` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:47:26.283382 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 35/68] 10.222.0.25 () {54 vars in 927 bytes} [Thu Sep 15 17:47:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 15 17:47:26.285284 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab22fa59-fb2a-4f8c-9093-ce7f38a5e75c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 17:47:26.289112 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bc5473-0006-4fce-88f2-a51089a7e6cb None None] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:47:26.289690 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bc5473-0006-4fce-88f2-a51089a7e6cb None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:47:26.290176 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bc5473-0006-4fce-88f2-a51089a7e6cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:47:26.301118 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application [None req-ab22fa59-fb2a-4f8c-9093-ce7f38a5e75c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 15 17:47:26.301118 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 17:47:26.301118 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 17:47:26.301118 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 17:47:26.301118 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 17:47:26.301118 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 17:47:26.301118 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 17:47:26.301118 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 17:47:26.301118 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 17:47:26.301118 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 17:47:26.301118 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 17:47:26.301118 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 17:47:26.301118 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 17:47:26.301118 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 17:47:26.301118 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 17:47:26.301118 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 17:47:26.302074 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 17:47:26.302074 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 17:47:26.302074 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 17:47:26.302074 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 17:47:26.302074 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 17:47:26.302074 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 17:47:26.302074 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 17:47:26.302074 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 17:47:26.302074 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 17:47:26.302074 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 17:47:26.302074 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 17:47:26.302074 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application with Lock( Sep 15 17:47:26.302074 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 17:47:26.302074 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._enter() Sep 15 17:47:26.302074 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 17:47:26.302074 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 17:47:26.302834 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 17:47:26.302834 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.creator() Sep 15 17:47:26.302834 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 17:47:26.302834 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application created_value = creator( Sep 15 17:47:26.302834 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 17:47:26.302834 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 17:47:26.302834 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 17:47:26.302834 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 17:47:26.302834 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 17:47:26.302834 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 17:47:26.302834 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 15 17:47:26.302834 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Sep 15 17:47:26.310964 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 34/69] 10.222.0.25 () {56 vars in 1099 bytes} [Thu Sep 15 17:47:26 2022] GET /identity/v3/roles/member => generated 84 bytes in 296 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 17:47:26.316910 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab22fa59-fb2a-4f8c-9093-ce7f38a5e75c None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:47:26.319716 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.auth.core [None req-a0bc5473-0006-4fce-88f2-a51089a7e6cb None None] MFA Rules not processed for user `5cfa58ef86774ab7800bf91930bf6028`. Rule list: `[]` (Enabled: `True`). {{(pid=81592) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 17:47:26.322696 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-a0bc5473-0006-4fce-88f2-a51089a7e6cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 17:47:26.387446 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:47:26.419824 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 36/70] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Sep 15 17:47:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 15 17:47:26.421090 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0bc5473-0006-4fce-88f2-a51089a7e6cb None None] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:47:26.468530 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab22fa59-fb2a-4f8c-9093-ce7f38a5e75c None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:47:26.505992 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4882b986-e067-4442-8e64-96572c326553 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:47:26.506637 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4882b986-e067-4442-8e64-96572c326553 None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:47:26.506881 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4882b986-e067-4442-8e64-96572c326553 None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:47:26.507156 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4882b986-e067-4442-8e64-96572c326553 None admin] PATH_INFO: `/v3/roles` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:47:26.507857 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4882b986-e067-4442-8e64-96572c326553 None admin] RBAC: Adding query filter params (name=member) {{(pid=81593) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 17:47:26.508163 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4882b986-e067-4442-8e64-96572c326553 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:47:26.510112 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4882b986-e067-4442-8e64-96572c326553 None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:47:26.521573 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 35/71] 10.222.0.25 () {56 vars in 1101 bytes} [Thu Sep 15 17:47:26 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 17:47:26.522796 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01d30a0-c4dd-4873-97ff-36d9b57b8ecb None None] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:47:26.523088 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01d30a0-c4dd-4873-97ff-36d9b57b8ecb None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:47:26.523366 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01d30a0-c4dd-4873-97ff-36d9b57b8ecb None None] PATH_INFO: `/` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:47:26.525540 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 36/72] 10.222.0.25 () {54 vars in 927 bytes} [Thu Sep 15 17:47:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 17:47:26.530498 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01d30a0-c4dd-4873-97ff-36d9b57b8ecb None None] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:47:26.557119 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0bc5473-0006-4fce-88f2-a51089a7e6cb None None] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:47:26.572402 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:47:26.607662 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4effab35-a594-4324-860d-49a868f21204 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:47:26.608318 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4effab35-a594-4324-860d-49a868f21204 None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:47:26.608602 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4effab35-a594-4324-860d-49a868f21204 None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:47:26.608880 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4effab35-a594-4324-860d-49a868f21204 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:47:26.620209 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4effab35-a594-4324-860d-49a868f21204 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 17:47:26.626211 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application [None req-4effab35-a594-4324-860d-49a868f21204 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 15 17:47:26.626211 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 17:47:26.626211 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 17:47:26.626211 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 17:47:26.626211 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 17:47:26.626211 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 17:47:26.626211 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 17:47:26.626211 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 17:47:26.626211 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 17:47:26.626211 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 17:47:26.626211 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 17:47:26.626211 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 17:47:26.626211 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 17:47:26.626211 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 17:47:26.626211 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 17:47:26.626211 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 17:47:26.627116 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 17:47:26.627116 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 17:47:26.627116 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 17:47:26.627116 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 17:47:26.627116 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 17:47:26.627116 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 17:47:26.627116 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 17:47:26.627116 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 17:47:26.627116 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 17:47:26.627116 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 17:47:26.627116 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 17:47:26.627116 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application with Lock( Sep 15 17:47:26.627116 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 17:47:26.627116 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._enter() Sep 15 17:47:26.627116 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 17:47:26.627116 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 17:47:26.629314 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 17:47:26.629314 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.creator() Sep 15 17:47:26.629314 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 17:47:26.629314 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application created_value = creator( Sep 15 17:47:26.629314 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 17:47:26.629314 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 17:47:26.629314 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 17:47:26.629314 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 17:47:26.629314 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 17:47:26.629314 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 17:47:26.629314 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 15 17:47:26.629314 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Sep 15 17:47:26.629314 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 37/73] 10.222.0.25 () {56 vars in 1096 bytes} [Thu Sep 15 17:47:26 2022] GET /identity/v3/roles/admin => generated 83 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 17:47:26.629314 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5b06ed-5026-42bc-a871-ea7c2784e899 None None] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:47:26.630139 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5b06ed-5026-42bc-a871-ea7c2784e899 None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:47:26.630139 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5b06ed-5026-42bc-a871-ea7c2784e899 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:47:26.648786 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.auth.core [None req-9c5b06ed-5026-42bc-a871-ea7c2784e899 None None] MFA Rules not processed for user `5cfa58ef86774ab7800bf91930bf6028`. Rule list: `[]` (Enabled: `True`). {{(pid=81592) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 17:47:26.649928 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-9c5b06ed-5026-42bc-a871-ea7c2784e899 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 17:47:26.661720 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01d30a0-c4dd-4873-97ff-36d9b57b8ecb None None] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:47:26.671552 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:47:26.709092 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c596b7f-d042-4d9c-9c76-e1c26217d5ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:47:26.710264 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c596b7f-d042-4d9c-9c76-e1c26217d5ab None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:47:26.710786 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c596b7f-d042-4d9c-9c76-e1c26217d5ab None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:47:26.711213 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c596b7f-d042-4d9c-9c76-e1c26217d5ab None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:47:26.724203 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c596b7f-d042-4d9c-9c76-e1c26217d5ab None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 17:47:26.729148 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application [None req-8c596b7f-d042-4d9c-9c76-e1c26217d5ab None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 15 17:47:26.729148 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 17:47:26.729148 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 17:47:26.729148 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 17:47:26.729148 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 17:47:26.729148 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 17:47:26.729148 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 17:47:26.729148 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 17:47:26.729148 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 17:47:26.729148 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 17:47:26.729148 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 17:47:26.729148 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 17:47:26.729148 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 17:47:26.729148 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 17:47:26.729148 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 17:47:26.729148 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 17:47:26.730284 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 17:47:26.730284 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 17:47:26.730284 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 17:47:26.730284 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 17:47:26.730284 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 17:47:26.730284 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 17:47:26.730284 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 17:47:26.730284 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 17:47:26.730284 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 17:47:26.730284 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 17:47:26.730284 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 17:47:26.730284 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application with Lock( Sep 15 17:47:26.730284 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 17:47:26.730284 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._enter() Sep 15 17:47:26.730284 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 17:47:26.730284 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 17:47:26.731168 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 17:47:26.731168 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.creator() Sep 15 17:47:26.731168 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 17:47:26.731168 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application created_value = creator( Sep 15 17:47:26.731168 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 17:47:26.731168 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 17:47:26.731168 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 17:47:26.731168 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 17:47:26.731168 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 17:47:26.731168 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 17:47:26.731168 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 15 17:47:26.731168 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Sep 15 17:47:26.733338 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 38/74] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Sep 15 17:47:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 15 17:47:26.733569 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 37/75] 10.222.0.25 () {56 vars in 1114 bytes} [Thu Sep 15 17:47:26 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 15 17:47:26.734210 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5b06ed-5026-42bc-a871-ea7c2784e899 None None] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:47:26.734733 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c596b7f-d042-4d9c-9c76-e1c26217d5ab None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:47:26.854650 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5b06ed-5026-42bc-a871-ea7c2784e899 None None] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:47:26.855797 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c596b7f-d042-4d9c-9c76-e1c26217d5ab None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:47:26.856797 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:47:26.891582 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7973b605-ea09-4489-8197-c14037dee5d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:47:26.892461 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7973b605-ea09-4489-8197-c14037dee5d0 None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:47:26.892818 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7973b605-ea09-4489-8197-c14037dee5d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:47:26.893156 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7973b605-ea09-4489-8197-c14037dee5d0 None admin] PATH_INFO: `/v3/roles` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:47:26.893849 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7973b605-ea09-4489-8197-c14037dee5d0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81593) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 17:47:26.894209 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7973b605-ea09-4489-8197-c14037dee5d0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:47:26.894498 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6338205-0adb-4695-8293-8ac8b9605156 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:47:26.895138 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6338205-0adb-4695-8293-8ac8b9605156 None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:47:26.895978 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6338205-0adb-4695-8293-8ac8b9605156 None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:47:26.896209 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7973b605-ea09-4489-8197-c14037dee5d0 None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:47:26.896301 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6338205-0adb-4695-8293-8ac8b9605156 None admin] PATH_INFO: `/v3/users/823825bfaf1b44a7ba5999ca5e7b26ce` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:47:26.904596 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 38/76] 10.222.0.25 () {56 vars in 1099 bytes} [Thu Sep 15 17:47:26 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 17:47:26.909139 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7973b605-ea09-4489-8197-c14037dee5d0 None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:47:26.922129 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6338205-0adb-4695-8293-8ac8b9605156 None admin] RBAC: Authorizing `identity:get_user(user_id=823825bfaf1b44a7ba5999ca5e7b26ce)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:47:26.925390 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6338205-0adb-4695-8293-8ac8b9605156 None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:47:26.925543 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 39/77] 10.222.0.25 () {56 vars in 1177 bytes} [Thu Sep 15 17:47:26 2022] GET /identity/v3/users/823825bfaf1b44a7ba5999ca5e7b26ce => generated 275 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 17:47:26.926312 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6338205-0adb-4695-8293-8ac8b9605156 None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:47:26.951274 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:47:27.028797 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7973b605-ea09-4489-8197-c14037dee5d0 None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:47:27.034524 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6338205-0adb-4695-8293-8ac8b9605156 None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:47:27.062293 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b315d8-5092-4a43-9fc7-633668a99e45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:47:27.062951 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b315d8-5092-4a43-9fc7-633668a99e45 None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:47:27.063200 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b315d8-5092-4a43-9fc7-633668a99e45 None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:47:27.063477 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b315d8-5092-4a43-9fc7-633668a99e45 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:47:27.064597 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b315d8-5092-4a43-9fc7-633668a99e45 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:47:27.066184 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b315d8-5092-4a43-9fc7-633668a99e45 None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:47:27.068315 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 39/78] 10.222.0.25 () {56 vars in 1108 bytes} [Thu Sep 15 17:47:26 2022] GET /identity/v3/domains/default => generated 199 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 17:47:27.069144 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b315d8-5092-4a43-9fc7-633668a99e45 None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:47:27.072466 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8658bbaa-6097-4365-bcfd-e9c2a05550e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:47:27.072466 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8658bbaa-6097-4365-bcfd-e9c2a05550e0 None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:47:27.072466 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8658bbaa-6097-4365-bcfd-e9c2a05550e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:47:27.072466 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8658bbaa-6097-4365-bcfd-e9c2a05550e0 None admin] PATH_INFO: `/v3/roles` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:47:27.073017 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8658bbaa-6097-4365-bcfd-e9c2a05550e0 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81592) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 17:47:27.073347 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8658bbaa-6097-4365-bcfd-e9c2a05550e0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:47:27.074761 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8658bbaa-6097-4365-bcfd-e9c2a05550e0 None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:47:27.083910 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 40/79] 10.222.0.25 () {56 vars in 1111 bytes} [Thu Sep 15 17:47:26 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 17:47:27.084737 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8658bbaa-6097-4365-bcfd-e9c2a05550e0 None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:47:27.111619 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:47:27.174419 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:47:27.178987 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b315d8-5092-4a43-9fc7-633668a99e45 None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:47:27.190687 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8658bbaa-6097-4365-bcfd-e9c2a05550e0 None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:47:27.219521 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f10879-93cd-4c1f-8f16-a14e87335149 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:47:27.220163 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f10879-93cd-4c1f-8f16-a14e87335149 None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:47:27.220455 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f10879-93cd-4c1f-8f16-a14e87335149 None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:47:27.220732 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f10879-93cd-4c1f-8f16-a14e87335149 None admin] PATH_INFO: `/v3/users/5cfa58ef86774ab7800bf91930bf6028` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:47:27.221986 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f10879-93cd-4c1f-8f16-a14e87335149 None admin] RBAC: Authorizing `identity:get_user(user_id=5cfa58ef86774ab7800bf91930bf6028)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:47:27.223467 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f10879-93cd-4c1f-8f16-a14e87335149 None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:47:27.225056 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 40/80] 10.222.0.25 () {56 vars in 1177 bytes} [Thu Sep 15 17:47:27 2022] GET /identity/v3/users/5cfa58ef86774ab7800bf91930bf6028 => generated 247 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 17:47:27.225862 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f10879-93cd-4c1f-8f16-a14e87335149 None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:47:27.229803 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a3f863-56ca-4e12-95e2-560758512f6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:47:27.230694 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a3f863-56ca-4e12-95e2-560758512f6a None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:47:27.230976 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a3f863-56ca-4e12-95e2-560758512f6a None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:47:27.231251 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a3f863-56ca-4e12-95e2-560758512f6a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:47:27.300902 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a3f863-56ca-4e12-95e2-560758512f6a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:47:27.302995 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a3f863-56ca-4e12-95e2-560758512f6a None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:47:27.326132 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:47:27.337869 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f10879-93cd-4c1f-8f16-a14e87335149 None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:47:27.371803 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c330aca1-77a4-4528-ad01-6594460bdaaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:47:27.372433 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c330aca1-77a4-4528-ad01-6594460bdaaf None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:47:27.372712 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c330aca1-77a4-4528-ad01-6594460bdaaf None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:47:27.372999 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c330aca1-77a4-4528-ad01-6594460bdaaf None admin] PATH_INFO: `/v3/roles/member` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:47:27.384064 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c330aca1-77a4-4528-ad01-6594460bdaaf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 17:47:27.389390 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application [None req-c330aca1-77a4-4528-ad01-6594460bdaaf None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 15 17:47:27.389390 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 17:47:27.389390 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 17:47:27.389390 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 17:47:27.389390 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 17:47:27.389390 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 17:47:27.389390 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 17:47:27.389390 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 17:47:27.389390 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 17:47:27.389390 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 17:47:27.389390 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 17:47:27.389390 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 17:47:27.389390 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 17:47:27.389390 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 17:47:27.389390 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 17:47:27.389390 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 17:47:27.390311 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 17:47:27.390311 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 17:47:27.390311 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 17:47:27.390311 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 17:47:27.390311 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 17:47:27.390311 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 17:47:27.390311 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 17:47:27.390311 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 17:47:27.390311 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 17:47:27.390311 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 17:47:27.390311 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 17:47:27.390311 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application with Lock( Sep 15 17:47:27.390311 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 17:47:27.390311 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._enter() Sep 15 17:47:27.390311 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 17:47:27.390311 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 17:47:27.391065 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 17:47:27.391065 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.creator() Sep 15 17:47:27.391065 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 17:47:27.391065 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application created_value = creator( Sep 15 17:47:27.391065 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 17:47:27.391065 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 17:47:27.391065 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 17:47:27.391065 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 17:47:27.391065 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 17:47:27.391065 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 17:47:27.391065 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 15 17:47:27.391065 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Sep 15 17:47:27.391065 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 41/81] 10.222.0.25 () {56 vars in 1099 bytes} [Thu Sep 15 17:47:27 2022] GET /identity/v3/roles/member => generated 84 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 17:47:27.391701 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c330aca1-77a4-4528-ad01-6594460bdaaf None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:47:27.407972 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 41/82] 10.222.0.25 () {58 vars in 1282 bytes} [Thu Sep 15 17:47:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 15 17:47:27.408879 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a3f863-56ca-4e12-95e2-560758512f6a None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:47:27.424160 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:47:27.498858 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c330aca1-77a4-4528-ad01-6594460bdaaf None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:47:27.509440 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a3f863-56ca-4e12-95e2-560758512f6a None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:47:27.537340 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:47:27.538014 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52208c25-cce7-403e-9935-9415af1df678 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:47:27.539120 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52208c25-cce7-403e-9935-9415af1df678 None admin] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:47:27.539654 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52208c25-cce7-403e-9935-9415af1df678 None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:47:27.539936 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52208c25-cce7-403e-9935-9415af1df678 None admin] PATH_INFO: `/v3/users` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:47:27.540954 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52208c25-cce7-403e-9935-9415af1df678 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:47:27.542445 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52208c25-cce7-403e-9935-9415af1df678 None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:47:27.549311 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4d638e-baff-4537-8b73-75dcea4f4b31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:47:27.549957 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4d638e-baff-4537-8b73-75dcea4f4b31 None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:47:27.550241 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4d638e-baff-4537-8b73-75dcea4f4b31 None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:47:27.550516 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4d638e-baff-4537-8b73-75dcea4f4b31 None admin] PATH_INFO: `/v3/users/823825bfaf1b44a7ba5999ca5e7b26ce` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:47:27.552250 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed4d638e-baff-4537-8b73-75dcea4f4b31 None admin] RBAC: Authorizing `identity:get_user(user_id=823825bfaf1b44a7ba5999ca5e7b26ce)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:47:27.553718 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed4d638e-baff-4537-8b73-75dcea4f4b31 None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:47:27.555348 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 42/83] 10.222.0.25 () {56 vars in 1177 bytes} [Thu Sep 15 17:47:27 2022] GET /identity/v3/users/823825bfaf1b44a7ba5999ca5e7b26ce => generated 275 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 17:47:27.557385 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4d638e-baff-4537-8b73-75dcea4f4b31 None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:47:27.573625 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 42/84] 10.222.0.25 () {60 vars in 1132 bytes} [Thu Sep 15 17:47:27 2022] POST /identity/v3/users => generated 289 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 17:47:27.574472 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52208c25-cce7-403e-9935-9415af1df678 None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:47:27.672160 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:47:27.680651 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4d638e-baff-4537-8b73-75dcea4f4b31 None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:47:27.696490 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52208c25-cce7-403e-9935-9415af1df678 None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:47:27.720611 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a1a0f5-f566-4e92-b43b-2f3cb5c3b438 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:47:27.721244 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a1a0f5-f566-4e92-b43b-2f3cb5c3b438 None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:47:27.721565 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a1a0f5-f566-4e92-b43b-2f3cb5c3b438 None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:47:27.721843 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a1a0f5-f566-4e92-b43b-2f3cb5c3b438 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:47:27.739058 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b80fb37-7ea5-44b7-b391-8fac729e07eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:47:27.740581 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b80fb37-7ea5-44b7-b391-8fac729e07eb None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:47:27.741029 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b80fb37-7ea5-44b7-b391-8fac729e07eb None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:47:27.741495 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b80fb37-7ea5-44b7-b391-8fac729e07eb None admin] PATH_INFO: `/v3/roles` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:47:27.742334 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b80fb37-7ea5-44b7-b391-8fac729e07eb None admin] RBAC: Adding query filter params (name=member) {{(pid=81593) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 17:47:27.742842 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b80fb37-7ea5-44b7-b391-8fac729e07eb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:47:27.744308 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b80fb37-7ea5-44b7-b391-8fac729e07eb None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:47:27.755161 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 43/85] 10.222.0.25 () {56 vars in 1101 bytes} [Thu Sep 15 17:47:27 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 17:47:27.755308 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b80fb37-7ea5-44b7-b391-8fac729e07eb None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:47:27.795050 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:47:27.807635 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a1a0f5-f566-4e92-b43b-2f3cb5c3b438 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:47:27.809136 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a1a0f5-f566-4e92-b43b-2f3cb5c3b438 None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:47:27.876768 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b80fb37-7ea5-44b7-b391-8fac729e07eb None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:47:27.919359 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b9b395-4629-4e79-94e6-e00b061d1617 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:47:27.920483 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b9b395-4629-4e79-94e6-e00b061d1617 None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:47:27.920832 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b9b395-4629-4e79-94e6-e00b061d1617 None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:47:27.921275 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b9b395-4629-4e79-94e6-e00b061d1617 None admin] PATH_INFO: `/v3/projects/f18aabde2e1f4bebaec9fb09d1725a11` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:47:27.922550 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b9b395-4629-4e79-94e6-e00b061d1617 None admin] RBAC: Authorizing `identity:get_project(project_id=f18aabde2e1f4bebaec9fb09d1725a11)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:47:27.924046 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b9b395-4629-4e79-94e6-e00b061d1617 None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:47:27.926516 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 44/86] 10.222.0.25 () {56 vars in 1186 bytes} [Thu Sep 15 17:47:27 2022] GET /identity/v3/projects/f18aabde2e1f4bebaec9fb09d1725a11 => generated 298 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 17:47:27.926668 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b9b395-4629-4e79-94e6-e00b061d1617 None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:47:27.945327 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 43/87] 10.222.0.25 () {58 vars in 1282 bytes} [Thu Sep 15 17:47:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 385 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 15 17:47:27.945520 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:47:27.945610 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a1a0f5-f566-4e92-b43b-2f3cb5c3b438 None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:47:28.055120 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:47:28.065329 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b9b395-4629-4e79-94e6-e00b061d1617 None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:47:28.067167 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a1a0f5-f566-4e92-b43b-2f3cb5c3b438 None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:47:28.106122 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1429759-f57f-4aa4-be15-c5921bdb00e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:47:28.107010 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1429759-f57f-4aa4-be15-c5921bdb00e3 None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:47:28.107439 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1429759-f57f-4aa4-be15-c5921bdb00e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:47:28.107840 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1429759-f57f-4aa4-be15-c5921bdb00e3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:47:28.109935 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe0c6f1-14a0-4691-9da5-5f1d1f0579bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:47:28.110579 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe0c6f1-14a0-4691-9da5-5f1d1f0579bd None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:47:28.110864 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe0c6f1-14a0-4691-9da5-5f1d1f0579bd None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:47:28.111288 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe0c6f1-14a0-4691-9da5-5f1d1f0579bd None admin] PATH_INFO: `/v3/users/823825bfaf1b44a7ba5999ca5e7b26ce` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:47:28.112984 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe0c6f1-14a0-4691-9da5-5f1d1f0579bd None admin] RBAC: Authorizing `identity:get_user(user_id=823825bfaf1b44a7ba5999ca5e7b26ce)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:47:28.114100 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe0c6f1-14a0-4691-9da5-5f1d1f0579bd None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:47:28.120845 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 44/88] 10.222.0.25 () {56 vars in 1177 bytes} [Thu Sep 15 17:47:27 2022] GET /identity/v3/users/823825bfaf1b44a7ba5999ca5e7b26ce => generated 275 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 17:47:28.120845 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe0c6f1-14a0-4691-9da5-5f1d1f0579bd None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:47:28.190531 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1429759-f57f-4aa4-be15-c5921bdb00e3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:47:28.192323 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1429759-f57f-4aa4-be15-c5921bdb00e3 None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:47:28.207446 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:47:28.230381 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe0c6f1-14a0-4691-9da5-5f1d1f0579bd None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:47:28.281221 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca56b96-d854-407b-9e1c-301ae79c498d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:47:28.282241 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca56b96-d854-407b-9e1c-301ae79c498d None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:47:28.282721 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca56b96-d854-407b-9e1c-301ae79c498d None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:47:28.283217 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca56b96-d854-407b-9e1c-301ae79c498d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:47:28.284170 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca56b96-d854-407b-9e1c-301ae79c498d None admin] RBAC: Adding query filter params (role.id=343cc8b1bc7243eebabdf08147e8366d, scope.project.id=f18aabde2e1f4bebaec9fb09d1725a11, user.id=823825bfaf1b44a7ba5999ca5e7b26ce) {{(pid=81592) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 17:47:28.284679 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca56b96-d854-407b-9e1c-301ae79c498d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:47:28.287094 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca56b96-d854-407b-9e1c-301ae79c498d None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:47:28.294926 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 45/89] 10.222.0.25 () {56 vars in 1374 bytes} [Thu Sep 15 17:47:28 2022] GET /identity/v3/role_assignments?user.id=823825bfaf1b44a7ba5999ca5e7b26ce&scope.project.id=f18aabde2e1f4bebaec9fb09d1725a11&role.id=343cc8b1bc7243eebabdf08147e8366d => generated 259 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 17:47:28.302821 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca56b96-d854-407b-9e1c-301ae79c498d None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:47:28.321602 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 45/90] 10.222.0.25 () {58 vars in 1282 bytes} [Thu Sep 15 17:47:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 392 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 15 17:47:28.321602 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1429759-f57f-4aa4-be15-c5921bdb00e3 None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:47:28.374191 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:47:28.449589 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1429759-f57f-4aa4-be15-c5921bdb00e3 None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:47:28.475123 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:47:28.491306 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bac5041-f6da-44ee-aa0e-da4ca6333672 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:47:28.491937 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bac5041-f6da-44ee-aa0e-da4ca6333672 None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:47:28.492222 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bac5041-f6da-44ee-aa0e-da4ca6333672 None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:47:28.492494 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bac5041-f6da-44ee-aa0e-da4ca6333672 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:47:28.576718 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bac5041-f6da-44ee-aa0e-da4ca6333672 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:47:28.578315 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bac5041-f6da-44ee-aa0e-da4ca6333672 None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:47:28.615481 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca56b96-d854-407b-9e1c-301ae79c498d None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:47:28.659306 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a09e4e-4f8c-4d22-a590-582347f85c53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:47:28.660386 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a09e4e-4f8c-4d22-a590-582347f85c53 None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:47:28.661121 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a09e4e-4f8c-4d22-a590-582347f85c53 None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:47:28.661632 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a09e4e-4f8c-4d22-a590-582347f85c53 None admin] PATH_INFO: `/v3/projects/f18aabde2e1f4bebaec9fb09d1725a11` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:47:28.663172 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a09e4e-4f8c-4d22-a590-582347f85c53 None admin] RBAC: Authorizing `identity:get_project(project_id=f18aabde2e1f4bebaec9fb09d1725a11)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:47:28.665819 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a09e4e-4f8c-4d22-a590-582347f85c53 None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:47:28.667907 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 46/91] 10.222.0.25 () {56 vars in 1186 bytes} [Thu Sep 15 17:47:28 2022] GET /identity/v3/projects/f18aabde2e1f4bebaec9fb09d1725a11 => generated 298 bytes in 366 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 17:47:28.668921 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a09e4e-4f8c-4d22-a590-582347f85c53 None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:47:28.699146 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 46/92] 10.222.0.25 () {58 vars in 1282 bytes} [Thu Sep 15 17:47:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 15 17:47:28.700481 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bac5041-f6da-44ee-aa0e-da4ca6333672 None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:47:28.729668 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:47:28.868757 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:47:28.878393 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a09e4e-4f8c-4d22-a590-582347f85c53 None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:47:28.918573 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea429ef-c922-422a-8376-c2cad6d8c8b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:47:28.919701 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea429ef-c922-422a-8376-c2cad6d8c8b4 None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:47:28.919995 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea429ef-c922-422a-8376-c2cad6d8c8b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:47:28.920527 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea429ef-c922-422a-8376-c2cad6d8c8b4 None admin] PATH_INFO: `/v3/projects/f18aabde2e1f4bebaec9fb09d1725a11` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:47:28.921918 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea429ef-c922-422a-8376-c2cad6d8c8b4 None admin] RBAC: Authorizing `identity:get_project(project_id=f18aabde2e1f4bebaec9fb09d1725a11)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:47:28.923695 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea429ef-c922-422a-8376-c2cad6d8c8b4 None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:47:28.925604 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 47/93] 10.222.0.25 () {56 vars in 1186 bytes} [Thu Sep 15 17:47:28 2022] GET /identity/v3/projects/f18aabde2e1f4bebaec9fb09d1725a11 => generated 298 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 17:47:28.926244 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea429ef-c922-422a-8376-c2cad6d8c8b4 None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:47:28.930732 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bac5041-f6da-44ee-aa0e-da4ca6333672 None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:47:28.966241 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af345363-644f-4195-91c3-ab6b42151097 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:47:28.966857 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af345363-644f-4195-91c3-ab6b42151097 None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:47:28.967138 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af345363-644f-4195-91c3-ab6b42151097 None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:47:28.967413 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af345363-644f-4195-91c3-ab6b42151097 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:47:28.968144 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af345363-644f-4195-91c3-ab6b42151097 None admin] RBAC: Adding query filter params (role.id=a9e42be86923434f8af52d3fc07fb4f7, scope.project.id=f18aabde2e1f4bebaec9fb09d1725a11, user.id=5cfa58ef86774ab7800bf91930bf6028) {{(pid=81593) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 17:47:28.968452 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af345363-644f-4195-91c3-ab6b42151097 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:47:28.969954 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af345363-644f-4195-91c3-ab6b42151097 None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:47:28.975648 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 47/94] 10.222.0.25 () {56 vars in 1374 bytes} [Thu Sep 15 17:47:28 2022] GET /identity/v3/role_assignments?user.id=5cfa58ef86774ab7800bf91930bf6028&scope.project.id=f18aabde2e1f4bebaec9fb09d1725a11&role.id=a9e42be86923434f8af52d3fc07fb4f7 => generated 259 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 17:47:28.976473 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af345363-644f-4195-91c3-ab6b42151097 None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:47:29.094611 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:47:29.106985 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea429ef-c922-422a-8376-c2cad6d8c8b4 None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:47:29.169694 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af345363-644f-4195-91c3-ab6b42151097 None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:47:29.203589 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e28854-9226-432c-8ad7-1a1e8432e21c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:47:29.204238 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e28854-9226-432c-8ad7-1a1e8432e21c None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:47:29.204524 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e28854-9226-432c-8ad7-1a1e8432e21c None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:47:29.204805 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e28854-9226-432c-8ad7-1a1e8432e21c None admin] PATH_INFO: `/v3/projects/21144bc65efd46cc9d858227221c68e9` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:47:29.208449 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e28854-9226-432c-8ad7-1a1e8432e21c None admin] RBAC: Authorizing `identity:get_project(project_id=21144bc65efd46cc9d858227221c68e9)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:47:29.210040 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e28854-9226-432c-8ad7-1a1e8432e21c None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:47:29.212171 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 48/95] 10.222.0.25 () {56 vars in 1186 bytes} [Thu Sep 15 17:47:28 2022] GET /identity/v3/projects/21144bc65efd46cc9d858227221c68e9 => generated 312 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 17:47:29.218722 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e28854-9226-432c-8ad7-1a1e8432e21c None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:47:29.250822 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f23178-a0a4-4903-9f1a-642015b5f4e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:47:29.251503 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f23178-a0a4-4903-9f1a-642015b5f4e0 None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:47:29.251892 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f23178-a0a4-4903-9f1a-642015b5f4e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:47:29.252167 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f23178-a0a4-4903-9f1a-642015b5f4e0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:47:29.253060 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f23178-a0a4-4903-9f1a-642015b5f4e0 None admin] RBAC: Adding query filter params (role.id=0dd1b9f5b7924e20a665ce50d6e34dc7, scope.project.id=f18aabde2e1f4bebaec9fb09d1725a11, user.id=823825bfaf1b44a7ba5999ca5e7b26ce) {{(pid=81593) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 17:47:29.253427 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f23178-a0a4-4903-9f1a-642015b5f4e0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:47:29.254793 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:47:29.255754 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f23178-a0a4-4903-9f1a-642015b5f4e0 None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:47:29.269476 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 48/96] 10.222.0.25 () {56 vars in 1374 bytes} [Thu Sep 15 17:47:28 2022] GET /identity/v3/role_assignments?user.id=823825bfaf1b44a7ba5999ca5e7b26ce&scope.project.id=f18aabde2e1f4bebaec9fb09d1725a11&role.id=0dd1b9f5b7924e20a665ce50d6e34dc7 => generated 259 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 17:47:29.365072 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e28854-9226-432c-8ad7-1a1e8432e21c None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:47:29.408817 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17658c02-9f35-480c-8898-23672181d9f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:47:29.409784 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17658c02-9f35-480c-8898-23672181d9f4 None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:47:29.410240 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17658c02-9f35-480c-8898-23672181d9f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:47:29.410690 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17658c02-9f35-480c-8898-23672181d9f4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:47:29.411764 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17658c02-9f35-480c-8898-23672181d9f4 None admin] RBAC: Adding query filter params (role.id=343cc8b1bc7243eebabdf08147e8366d, scope.project.id=21144bc65efd46cc9d858227221c68e9, user.id=823825bfaf1b44a7ba5999ca5e7b26ce) {{(pid=81592) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 17:47:29.412259 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17658c02-9f35-480c-8898-23672181d9f4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:47:29.413930 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17658c02-9f35-480c-8898-23672181d9f4 None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:47:29.425809 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 49/97] 10.222.0.25 () {56 vars in 1374 bytes} [Thu Sep 15 17:47:29 2022] GET /identity/v3/role_assignments?user.id=823825bfaf1b44a7ba5999ca5e7b26ce&scope.project.id=21144bc65efd46cc9d858227221c68e9&role.id=343cc8b1bc7243eebabdf08147e8366d => generated 259 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 17:47:30.253498 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3688f37-0be0-43c4-a835-7ae62be5b443 None None] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:47:30.254521 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3688f37-0be0-43c4-a835-7ae62be5b443 None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:47:30.255084 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3688f37-0be0-43c4-a835-7ae62be5b443 None None] PATH_INFO: `/` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:47:30.256639 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 49/98] 10.222.0.25 () {54 vars in 927 bytes} [Thu Sep 15 17:47:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 17:47:30.262287 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b82b71c-e52c-42e3-aa74-28d3dd05e7bc None None] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:47:30.263099 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b82b71c-e52c-42e3-aa74-28d3dd05e7bc None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:47:30.263595 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b82b71c-e52c-42e3-aa74-28d3dd05e7bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:47:30.290301 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.auth.core [None req-5b82b71c-e52c-42e3-aa74-28d3dd05e7bc None None] MFA Rules not processed for user `5cfa58ef86774ab7800bf91930bf6028`. Rule list: `[]` (Enabled: `True`). {{(pid=81592) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 17:47:30.291828 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-5b82b71c-e52c-42e3-aa74-28d3dd05e7bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 17:47:30.375766 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 50/99] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Sep 15 17:47:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 15 17:47:30.791043 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34a3fbe-9627-4be3-b735-e2f3ea2cd3fa None None] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:47:30.791817 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34a3fbe-9627-4be3-b735-e2f3ea2cd3fa None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:47:30.792323 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34a3fbe-9627-4be3-b735-e2f3ea2cd3fa None None] PATH_INFO: `/` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:47:30.793897 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 50/100] 10.222.0.25 () {54 vars in 927 bytes} [Thu Sep 15 17:47:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 17:47:30.799169 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b2fe3e-a63a-48d0-b88b-98042646ce92 None None] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:47:30.799678 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b2fe3e-a63a-48d0-b88b-98042646ce92 None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:47:30.800166 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b2fe3e-a63a-48d0-b88b-98042646ce92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:47:30.826259 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.auth.core [None req-46b2fe3e-a63a-48d0-b88b-98042646ce92 None None] MFA Rules not processed for user `5cfa58ef86774ab7800bf91930bf6028`. Rule list: `[]` (Enabled: `True`). {{(pid=81592) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 17:47:30.827756 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-46b2fe3e-a63a-48d0-b88b-98042646ce92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 17:47:30.842800 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:47:30.868415 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34a3fbe-9627-4be3-b735-e2f3ea2cd3fa None None] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:47:30.937873 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 51/101] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Sep 15 17:47:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 15 17:47:31.024346 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34a3fbe-9627-4be3-b735-e2f3ea2cd3fa None None] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:47:31.088513 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6c6016-6073-4365-b07f-7bfa91af7b17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:47:31.089519 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6c6016-6073-4365-b07f-7bfa91af7b17 None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:47:31.089991 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6c6016-6073-4365-b07f-7bfa91af7b17 None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:47:31.090445 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6c6016-6073-4365-b07f-7bfa91af7b17 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:47:31.103358 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:47:31.109350 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e6c6016-6073-4365-b07f-7bfa91af7b17 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 17:47:31.119882 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application [None req-3e6c6016-6073-4365-b07f-7bfa91af7b17 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 15 17:47:31.119882 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 17:47:31.119882 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 17:47:31.119882 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 17:47:31.119882 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 17:47:31.119882 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 17:47:31.119882 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 17:47:31.119882 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 17:47:31.119882 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 17:47:31.119882 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 17:47:31.119882 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 17:47:31.119882 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 17:47:31.119882 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 17:47:31.119882 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 17:47:31.119882 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 17:47:31.119882 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 17:47:31.120763 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 17:47:31.120763 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 17:47:31.120763 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 17:47:31.120763 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 17:47:31.120763 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 17:47:31.120763 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 17:47:31.120763 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 17:47:31.120763 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 17:47:31.120763 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 17:47:31.120763 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 17:47:31.120763 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 17:47:31.120763 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application with Lock( Sep 15 17:47:31.120763 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 17:47:31.120763 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._enter() Sep 15 17:47:31.120763 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 17:47:31.120763 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 17:47:31.121539 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 17:47:31.121539 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.creator() Sep 15 17:47:31.121539 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 17:47:31.121539 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application created_value = creator( Sep 15 17:47:31.121539 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 17:47:31.121539 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 17:47:31.121539 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 17:47:31.121539 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 17:47:31.121539 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 17:47:31.121539 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 17:47:31.121539 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 15 17:47:31.121539 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Sep 15 17:47:31.122684 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 51/102] 10.222.0.25 () {56 vars in 1099 bytes} [Thu Sep 15 17:47:30 2022] GET /identity/v3/roles/reader => generated 84 bytes in 254 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 15 17:47:31.131774 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b2fe3e-a63a-48d0-b88b-98042646ce92 None None] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:47:31.336994 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b2fe3e-a63a-48d0-b88b-98042646ce92 None None] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:47:31.386411 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1544da-70d3-4224-bb0f-031b6d0d8d59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:47:31.386950 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1544da-70d3-4224-bb0f-031b6d0d8d59 None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:47:31.387215 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1544da-70d3-4224-bb0f-031b6d0d8d59 None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:47:31.387497 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1544da-70d3-4224-bb0f-031b6d0d8d59 None admin] PATH_INFO: `/v3/roles` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:47:31.388193 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1544da-70d3-4224-bb0f-031b6d0d8d59 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81592) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 17:47:31.388502 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1544da-70d3-4224-bb0f-031b6d0d8d59 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:47:31.390005 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1544da-70d3-4224-bb0f-031b6d0d8d59 None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:47:31.401439 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 52/103] 10.222.0.25 () {56 vars in 1101 bytes} [Thu Sep 15 17:47:31 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 17:47:31.407502 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6c6016-6073-4365-b07f-7bfa91af7b17 None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:47:31.535271 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6c6016-6073-4365-b07f-7bfa91af7b17 None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:47:31.539713 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1544da-70d3-4224-bb0f-031b6d0d8d59 None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:47:31.566088 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:47:31.610454 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e62c650-e52e-4679-9364-f64af56bd590 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:47:31.611620 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e62c650-e52e-4679-9364-f64af56bd590 None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:47:31.612322 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e62c650-e52e-4679-9364-f64af56bd590 None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:47:31.612783 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e62c650-e52e-4679-9364-f64af56bd590 None admin] PATH_INFO: `/v3/users/c881452b85fd43edbbe822cb34592782` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:47:31.662744 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e62c650-e52e-4679-9364-f64af56bd590 None admin] RBAC: Authorizing `identity:get_user(user_id=c881452b85fd43edbbe822cb34592782)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:47:31.665172 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e62c650-e52e-4679-9364-f64af56bd590 None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:47:31.668366 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 52/104] 10.222.0.25 () {56 vars in 1177 bytes} [Thu Sep 15 17:47:31 2022] GET /identity/v3/users/c881452b85fd43edbbe822cb34592782 => generated 289 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 17:47:31.677489 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e62c650-e52e-4679-9364-f64af56bd590 None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:47:31.723143 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1544da-70d3-4224-bb0f-031b6d0d8d59 None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:47:31.790929 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3329ed4b-33af-4e46-817a-9aaaa76bebc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:47:31.792465 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3329ed4b-33af-4e46-817a-9aaaa76bebc4 None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:47:31.793199 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3329ed4b-33af-4e46-817a-9aaaa76bebc4 None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:47:31.793997 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3329ed4b-33af-4e46-817a-9aaaa76bebc4 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:47:31.797417 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3329ed4b-33af-4e46-817a-9aaaa76bebc4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:47:31.801314 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3329ed4b-33af-4e46-817a-9aaaa76bebc4 None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:47:31.809444 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 53/105] 10.222.0.25 () {56 vars in 1108 bytes} [Thu Sep 15 17:47:31 2022] GET /identity/v3/domains/default => generated 199 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 17:47:31.811857 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8735f39f-b50d-4fac-beb0-64280c840c78 None None] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:47:31.812596 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8735f39f-b50d-4fac-beb0-64280c840c78 None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:47:31.813343 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8735f39f-b50d-4fac-beb0-64280c840c78 None None] PATH_INFO: `/` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:47:31.816592 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 54/106] 10.222.0.25 () {54 vars in 927 bytes} [Thu Sep 15 17:47:31 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 17:47:31.821813 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8735f39f-b50d-4fac-beb0-64280c840c78 None None] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:47:31.888866 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:47:31.993921 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:47:32.026567 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8735f39f-b50d-4fac-beb0-64280c840c78 None None] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:47:32.039604 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e62c650-e52e-4679-9364-f64af56bd590 None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:47:32.088232 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ac8ee0-349f-4796-ae3d-9ba170e4f19d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:47:32.089973 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ac8ee0-349f-4796-ae3d-9ba170e4f19d None admin] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:47:32.090715 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ac8ee0-349f-4796-ae3d-9ba170e4f19d None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:47:32.091437 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ac8ee0-349f-4796-ae3d-9ba170e4f19d None admin] PATH_INFO: `/v3/projects` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:47:32.092802 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ac8ee0-349f-4796-ae3d-9ba170e4f19d None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:47:32.095516 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ac8ee0-349f-4796-ae3d-9ba170e4f19d None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:47:32.132246 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85db0539-136d-44a9-98aa-336cf4c14acd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:47:32.133966 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85db0539-136d-44a9-98aa-336cf4c14acd None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:47:32.139998 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85db0539-136d-44a9-98aa-336cf4c14acd None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:47:32.140882 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85db0539-136d-44a9-98aa-336cf4c14acd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:47:32.154304 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 55/107] 10.222.0.25 () {60 vars in 1141 bytes} [Thu Sep 15 17:47:31 2022] POST /identity/v3/projects => generated 302 bytes in 333 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 15 17:47:32.165114 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6552b3e-fd1d-4ebc-9b46-fabceb9316ed None None] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:47:32.166025 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6552b3e-fd1d-4ebc-9b46-fabceb9316ed None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:47:32.166755 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6552b3e-fd1d-4ebc-9b46-fabceb9316ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:47:32.224703 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.auth.core [None req-b6552b3e-fd1d-4ebc-9b46-fabceb9316ed None None] MFA Rules not processed for user `5cfa58ef86774ab7800bf91930bf6028`. Rule list: `[]` (Enabled: `True`). {{(pid=81592) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 17:47:32.227360 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-b6552b3e-fd1d-4ebc-9b46-fabceb9316ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 17:47:32.393545 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85db0539-136d-44a9-98aa-336cf4c14acd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:47:32.395166 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85db0539-136d-44a9-98aa-336cf4c14acd None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:47:32.444722 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 56/108] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Sep 15 17:47:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 281 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 15 17:47:32.448180 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5128dcd6-4240-4235-9014-f4b5d74de763 None None] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:47:32.450045 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5128dcd6-4240-4235-9014-f4b5d74de763 None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:47:32.450856 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5128dcd6-4240-4235-9014-f4b5d74de763 None None] PATH_INFO: `/` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:47:32.455234 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 57/109] 10.222.0.25 () {54 vars in 927 bytes} [Thu Sep 15 17:47:32 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 17:47:32.462566 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d136b645-1998-4129-92c7-10f2d0e4f2d4 None None] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:47:32.463261 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d136b645-1998-4129-92c7-10f2d0e4f2d4 None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:47:32.463980 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d136b645-1998-4129-92c7-10f2d0e4f2d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:47:32.498928 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:47:32.505874 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.auth.core [None req-d136b645-1998-4129-92c7-10f2d0e4f2d4 None None] MFA Rules not processed for user `5cfa58ef86774ab7800bf91930bf6028`. Rule list: `[]` (Enabled: `True`). {{(pid=81592) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 17:47:32.507812 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-d136b645-1998-4129-92c7-10f2d0e4f2d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 17:47:32.576276 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 53/110] 10.222.0.25 () {58 vars in 1282 bytes} [Thu Sep 15 17:47:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 900 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 15 17:47:32.582087 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85db0539-136d-44a9-98aa-336cf4c14acd None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:47:32.584205 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:47:32.595722 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 58/111] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Sep 15 17:47:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 15 17:47:32.739899 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85db0539-136d-44a9-98aa-336cf4c14acd None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:47:32.787192 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2384d5e-4ddc-41b9-8f52-3e9774b3e0a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:47:32.788084 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2384d5e-4ddc-41b9-8f52-3e9774b3e0a7 None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:47:32.788511 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2384d5e-4ddc-41b9-8f52-3e9774b3e0a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:47:32.788949 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2384d5e-4ddc-41b9-8f52-3e9774b3e0a7 None admin] PATH_INFO: `/v3/projects/f18aabde2e1f4bebaec9fb09d1725a11` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:47:32.790437 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2384d5e-4ddc-41b9-8f52-3e9774b3e0a7 None admin] RBAC: Authorizing `identity:get_project(project_id=f18aabde2e1f4bebaec9fb09d1725a11)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:47:32.792152 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2384d5e-4ddc-41b9-8f52-3e9774b3e0a7 None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:47:32.794466 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 54/112] 10.222.0.25 () {56 vars in 1186 bytes} [Thu Sep 15 17:47:32 2022] GET /identity/v3/projects/f18aabde2e1f4bebaec9fb09d1725a11 => generated 298 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 17:47:32.795760 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d136b645-1998-4129-92c7-10f2d0e4f2d4 None None] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:47:32.799916 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2384d5e-4ddc-41b9-8f52-3e9774b3e0a7 None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:47:32.856791 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:47:33.023863 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2384d5e-4ddc-41b9-8f52-3e9774b3e0a7 None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:47:33.039870 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d136b645-1998-4129-92c7-10f2d0e4f2d4 None None] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:47:33.065726 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab32243-f3a5-469f-aab2-7b486c1df828 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:47:33.066847 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab32243-f3a5-469f-aab2-7b486c1df828 None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:47:33.067440 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab32243-f3a5-469f-aab2-7b486c1df828 None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:47:33.067907 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab32243-f3a5-469f-aab2-7b486c1df828 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:47:33.068824 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab32243-f3a5-469f-aab2-7b486c1df828 None admin] RBAC: Adding query filter params (role.id=80bb25250ed34dd9a6ed0740bcc3dac6, scope.project.id=f18aabde2e1f4bebaec9fb09d1725a11, user.id=c881452b85fd43edbbe822cb34592782) {{(pid=81593) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 17:47:33.069376 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab32243-f3a5-469f-aab2-7b486c1df828 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:47:33.071226 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab32243-f3a5-469f-aab2-7b486c1df828 None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:47:33.077692 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 55/113] 10.222.0.25 () {56 vars in 1374 bytes} [Thu Sep 15 17:47:32 2022] GET /identity/v3/role_assignments?user.id=c881452b85fd43edbbe822cb34592782&scope.project.id=f18aabde2e1f4bebaec9fb09d1725a11&role.id=80bb25250ed34dd9a6ed0740bcc3dac6 => generated 259 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 17:47:33.079317 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91cd138-50d9-43bb-bf42-36a89349bc45 None None] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:47:33.079797 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91cd138-50d9-43bb-bf42-36a89349bc45 None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:47:33.080283 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91cd138-50d9-43bb-bf42-36a89349bc45 None None] PATH_INFO: `/` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:47:33.081798 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 56/114] 10.222.0.25 () {54 vars in 927 bytes} [Thu Sep 15 17:47:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 17:47:33.082784 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91cd138-50d9-43bb-bf42-36a89349bc45 None None] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:47:33.100611 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f7a4c8-c294-4a6b-87f7-875e7ca0eea4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:47:33.101282 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f7a4c8-c294-4a6b-87f7-875e7ca0eea4 None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:47:33.101589 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f7a4c8-c294-4a6b-87f7-875e7ca0eea4 None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:47:33.101867 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f7a4c8-c294-4a6b-87f7-875e7ca0eea4 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:47:33.125623 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f7a4c8-c294-4a6b-87f7-875e7ca0eea4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 17:47:33.131204 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application [None req-f3f7a4c8-c294-4a6b-87f7-875e7ca0eea4 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 15 17:47:33.131204 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 17:47:33.131204 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 17:47:33.131204 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 17:47:33.131204 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 17:47:33.131204 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 17:47:33.131204 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 17:47:33.131204 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 17:47:33.131204 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 17:47:33.131204 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 17:47:33.131204 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 17:47:33.131204 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 17:47:33.131204 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 17:47:33.131204 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 17:47:33.131204 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 17:47:33.131204 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 17:47:33.132154 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 17:47:33.132154 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 17:47:33.132154 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 17:47:33.132154 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 17:47:33.132154 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 17:47:33.132154 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 17:47:33.132154 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 17:47:33.132154 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 17:47:33.132154 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 17:47:33.132154 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 17:47:33.132154 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 17:47:33.132154 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application with Lock( Sep 15 17:47:33.132154 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 17:47:33.132154 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._enter() Sep 15 17:47:33.132154 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 17:47:33.132154 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 17:47:33.132910 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 17:47:33.132910 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.creator() Sep 15 17:47:33.132910 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 17:47:33.132910 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application created_value = creator( Sep 15 17:47:33.132910 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 17:47:33.132910 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 17:47:33.132910 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 17:47:33.132910 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 17:47:33.132910 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 17:47:33.132910 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 17:47:33.132910 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 15 17:47:33.132910 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Sep 15 17:47:33.132910 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 59/115] 10.222.0.25 () {56 vars in 1099 bytes} [Thu Sep 15 17:47:32 2022] GET /identity/v3/roles/member => generated 84 bytes in 337 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 17:47:33.134570 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526d1259-d8b0-46a2-ba70-c6a6866ea049 None None] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:47:33.135434 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526d1259-d8b0-46a2-ba70-c6a6866ea049 None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:47:33.135434 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526d1259-d8b0-46a2-ba70-c6a6866ea049 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:47:33.170166 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.auth.core [None req-526d1259-d8b0-46a2-ba70-c6a6866ea049 None None] MFA Rules not processed for user `5cfa58ef86774ab7800bf91930bf6028`. Rule list: `[]` (Enabled: `True`). {{(pid=81592) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 17:47:33.171558 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-526d1259-d8b0-46a2-ba70-c6a6866ea049 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 17:47:33.236563 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:47:33.258210 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:47:33.269331 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 60/116] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Sep 15 17:47:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 15 17:47:33.269331 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526d1259-d8b0-46a2-ba70-c6a6866ea049 None None] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:47:33.286520 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91cd138-50d9-43bb-bf42-36a89349bc45 None None] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:47:33.353947 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6aefb3b-b0a3-4dfc-bf70-07c8202f802b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:47:33.354504 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6aefb3b-b0a3-4dfc-bf70-07c8202f802b None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:47:33.354846 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6aefb3b-b0a3-4dfc-bf70-07c8202f802b None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:47:33.355385 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6aefb3b-b0a3-4dfc-bf70-07c8202f802b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:47:33.378760 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6aefb3b-b0a3-4dfc-bf70-07c8202f802b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 17:47:33.385324 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application [None req-c6aefb3b-b0a3-4dfc-bf70-07c8202f802b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 15 17:47:33.385324 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 17:47:33.385324 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 17:47:33.385324 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 17:47:33.385324 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 17:47:33.385324 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 17:47:33.385324 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 17:47:33.385324 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 17:47:33.385324 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 17:47:33.385324 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 17:47:33.385324 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 17:47:33.385324 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 17:47:33.385324 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 17:47:33.385324 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 17:47:33.385324 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 17:47:33.385324 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 17:47:33.386150 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 17:47:33.386150 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 17:47:33.386150 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 17:47:33.386150 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 17:47:33.386150 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 17:47:33.386150 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 17:47:33.386150 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 17:47:33.386150 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 17:47:33.386150 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 17:47:33.386150 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 17:47:33.386150 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 17:47:33.386150 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application with Lock( Sep 15 17:47:33.386150 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 17:47:33.386150 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._enter() Sep 15 17:47:33.386150 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 17:47:33.386150 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 17:47:33.386908 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 17:47:33.386908 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.creator() Sep 15 17:47:33.386908 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 17:47:33.386908 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application created_value = creator( Sep 15 17:47:33.386908 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 17:47:33.386908 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 17:47:33.386908 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 17:47:33.386908 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 17:47:33.386908 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 17:47:33.386908 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 17:47:33.386908 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 15 17:47:33.386908 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Sep 15 17:47:33.389241 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 57/117] 10.222.0.25 () {56 vars in 1096 bytes} [Thu Sep 15 17:47:33 2022] GET /identity/v3/roles/admin => generated 83 bytes in 307 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 17:47:33.390705 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14026604-6910-4412-a48e-72d83f942045 None None] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:47:33.391186 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14026604-6910-4412-a48e-72d83f942045 None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:47:33.391652 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14026604-6910-4412-a48e-72d83f942045 None None] PATH_INFO: `/` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:47:33.393183 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 58/118] 10.222.0.25 () {54 vars in 927 bytes} [Thu Sep 15 17:47:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 17:47:33.399410 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8795162-5209-4be2-939d-56f54c15ba28 None None] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:47:33.399987 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8795162-5209-4be2-939d-56f54c15ba28 None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:47:33.400453 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8795162-5209-4be2-939d-56f54c15ba28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:47:33.424359 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.auth.core [None req-d8795162-5209-4be2-939d-56f54c15ba28 None None] MFA Rules not processed for user `5cfa58ef86774ab7800bf91930bf6028`. Rule list: `[]` (Enabled: `True`). {{(pid=81593) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 17:47:33.426422 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-d8795162-5209-4be2-939d-56f54c15ba28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 17:47:33.455913 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526d1259-d8b0-46a2-ba70-c6a6866ea049 None None] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:47:33.523055 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257ff0c7-4f2b-4213-9d4f-4f6b1ba9810c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:47:33.523676 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257ff0c7-4f2b-4213-9d4f-4f6b1ba9810c None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:47:33.523958 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257ff0c7-4f2b-4213-9d4f-4f6b1ba9810c None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:47:33.524231 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257ff0c7-4f2b-4213-9d4f-4f6b1ba9810c None admin] PATH_INFO: `/v3/roles` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:47:33.524908 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257ff0c7-4f2b-4213-9d4f-4f6b1ba9810c None admin] RBAC: Adding query filter params (name=member) {{(pid=81592) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 17:47:33.525210 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257ff0c7-4f2b-4213-9d4f-4f6b1ba9810c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:47:33.526695 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257ff0c7-4f2b-4213-9d4f-4f6b1ba9810c None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:47:33.537100 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 61/119] 10.222.0.25 () {56 vars in 1101 bytes} [Thu Sep 15 17:47:33 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 17:47:33.537283 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 59/120] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Sep 15 17:47:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 15 17:47:33.537820 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257ff0c7-4f2b-4213-9d4f-4f6b1ba9810c None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:47:33.543643 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8795162-5209-4be2-939d-56f54c15ba28 None None] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:47:33.592891 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:47:33.673878 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:47:33.694789 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257ff0c7-4f2b-4213-9d4f-4f6b1ba9810c None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:47:33.715465 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8795162-5209-4be2-939d-56f54c15ba28 None None] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:47:33.736146 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46592872-9a40-4783-aef5-91df8c4d9544 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:47:33.737427 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46592872-9a40-4783-aef5-91df8c4d9544 None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:47:33.737927 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46592872-9a40-4783-aef5-91df8c4d9544 None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:47:33.738378 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46592872-9a40-4783-aef5-91df8c4d9544 None admin] PATH_INFO: `/v3/roles` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:47:33.739836 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46592872-9a40-4783-aef5-91df8c4d9544 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81592) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 17:47:33.740363 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46592872-9a40-4783-aef5-91df8c4d9544 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:47:33.742121 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46592872-9a40-4783-aef5-91df8c4d9544 None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:47:33.751760 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 62/121] 10.222.0.25 () {56 vars in 1099 bytes} [Thu Sep 15 17:47:33 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 17:47:33.752893 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46592872-9a40-4783-aef5-91df8c4d9544 None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:47:33.798018 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fcf864-88bc-479c-97b5-91c369c07ec0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:47:33.798679 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fcf864-88bc-479c-97b5-91c369c07ec0 None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:47:33.798961 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fcf864-88bc-479c-97b5-91c369c07ec0 None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:47:33.799241 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fcf864-88bc-479c-97b5-91c369c07ec0 None admin] PATH_INFO: `/v3/users/823825bfaf1b44a7ba5999ca5e7b26ce` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:47:33.800423 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0fcf864-88bc-479c-97b5-91c369c07ec0 None admin] RBAC: Authorizing `identity:get_user(user_id=823825bfaf1b44a7ba5999ca5e7b26ce)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:47:33.802078 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0fcf864-88bc-479c-97b5-91c369c07ec0 None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:47:33.803830 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 60/122] 10.222.0.25 () {56 vars in 1177 bytes} [Thu Sep 15 17:47:33 2022] GET /identity/v3/users/823825bfaf1b44a7ba5999ca5e7b26ce => generated 275 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 17:47:33.804440 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fcf864-88bc-479c-97b5-91c369c07ec0 None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:47:33.939253 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46592872-9a40-4783-aef5-91df8c4d9544 None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:47:33.950230 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:47:34.015543 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fcf864-88bc-479c-97b5-91c369c07ec0 None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:47:34.017885 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83be2140-bafa-42a8-b3e2-365d5bbd91a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:47:34.018822 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83be2140-bafa-42a8-b3e2-365d5bbd91a9 None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:47:34.019367 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83be2140-bafa-42a8-b3e2-365d5bbd91a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:47:34.019866 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83be2140-bafa-42a8-b3e2-365d5bbd91a9 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:47:34.032146 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83be2140-bafa-42a8-b3e2-365d5bbd91a9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 17:47:34.038150 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application [None req-83be2140-bafa-42a8-b3e2-365d5bbd91a9 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 15 17:47:34.038150 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 17:47:34.038150 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 17:47:34.038150 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 17:47:34.038150 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 17:47:34.038150 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 17:47:34.038150 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 17:47:34.038150 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 17:47:34.038150 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 17:47:34.038150 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 17:47:34.038150 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 17:47:34.038150 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 17:47:34.038150 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 17:47:34.038150 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 17:47:34.038150 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 17:47:34.038150 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 17:47:34.039050 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 17:47:34.039050 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 17:47:34.039050 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 17:47:34.039050 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 17:47:34.039050 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 17:47:34.039050 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 17:47:34.039050 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 17:47:34.039050 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 17:47:34.039050 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 17:47:34.039050 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 17:47:34.039050 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 17:47:34.039050 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application with Lock( Sep 15 17:47:34.039050 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 17:47:34.039050 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._enter() Sep 15 17:47:34.039050 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 17:47:34.039050 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 17:47:34.039802 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 17:47:34.039802 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.creator() Sep 15 17:47:34.039802 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 17:47:34.039802 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application created_value = creator( Sep 15 17:47:34.039802 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 17:47:34.039802 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 17:47:34.039802 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 17:47:34.039802 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 17:47:34.039802 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 17:47:34.039802 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 17:47:34.039802 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 15 17:47:34.039802 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Sep 15 17:47:34.042218 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 63/123] 10.222.0.25 () {56 vars in 1114 bytes} [Thu Sep 15 17:47:33 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 290 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 17:47:34.043391 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83be2140-bafa-42a8-b3e2-365d5bbd91a9 None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:47:34.060079 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d878e3bf-e181-40a6-9fbf-6f75686c1cc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:47:34.060791 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d878e3bf-e181-40a6-9fbf-6f75686c1cc9 None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:47:34.061202 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d878e3bf-e181-40a6-9fbf-6f75686c1cc9 None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:47:34.061418 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d878e3bf-e181-40a6-9fbf-6f75686c1cc9 None admin] PATH_INFO: `/v3/users/5cfa58ef86774ab7800bf91930bf6028` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:47:34.062985 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d878e3bf-e181-40a6-9fbf-6f75686c1cc9 None admin] RBAC: Authorizing `identity:get_user(user_id=5cfa58ef86774ab7800bf91930bf6028)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:47:34.064353 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d878e3bf-e181-40a6-9fbf-6f75686c1cc9 None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:47:34.070256 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 61/124] 10.222.0.25 () {56 vars in 1177 bytes} [Thu Sep 15 17:47:33 2022] GET /identity/v3/users/5cfa58ef86774ab7800bf91930bf6028 => generated 247 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 17:47:34.071119 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d878e3bf-e181-40a6-9fbf-6f75686c1cc9 None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:47:34.104589 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:47:34.169667 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83be2140-bafa-42a8-b3e2-365d5bbd91a9 None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:47:34.205568 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99e6d08-8c37-4cd7-b355-03a1618f8337 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:47:34.206574 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99e6d08-8c37-4cd7-b355-03a1618f8337 None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:47:34.207055 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99e6d08-8c37-4cd7-b355-03a1618f8337 None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:47:34.207530 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99e6d08-8c37-4cd7-b355-03a1618f8337 None admin] PATH_INFO: `/v3/projects/f18aabde2e1f4bebaec9fb09d1725a11` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:47:34.209656 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c99e6d08-8c37-4cd7-b355-03a1618f8337 None admin] RBAC: Authorizing `identity:get_project(project_id=f18aabde2e1f4bebaec9fb09d1725a11)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:47:34.211425 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c99e6d08-8c37-4cd7-b355-03a1618f8337 None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:47:34.213574 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 64/125] 10.222.0.25 () {56 vars in 1186 bytes} [Thu Sep 15 17:47:34 2022] GET /identity/v3/projects/f18aabde2e1f4bebaec9fb09d1725a11 => generated 298 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 17:47:34.214702 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99e6d08-8c37-4cd7-b355-03a1618f8337 None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:47:34.251963 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:47:34.271449 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d878e3bf-e181-40a6-9fbf-6f75686c1cc9 None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:47:34.323244 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99e6d08-8c37-4cd7-b355-03a1618f8337 None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:47:34.327709 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27678599-3bfb-443d-bc8b-7b3a72b0bc4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:47:34.328615 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27678599-3bfb-443d-bc8b-7b3a72b0bc4e None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:47:34.329021 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27678599-3bfb-443d-bc8b-7b3a72b0bc4e None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:47:34.329451 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27678599-3bfb-443d-bc8b-7b3a72b0bc4e None admin] PATH_INFO: `/v3/roles/member` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:47:34.347217 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27678599-3bfb-443d-bc8b-7b3a72b0bc4e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 17:47:34.356480 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application [None req-27678599-3bfb-443d-bc8b-7b3a72b0bc4e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 15 17:47:34.356480 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 17:47:34.356480 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 17:47:34.356480 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 17:47:34.356480 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 17:47:34.356480 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 17:47:34.356480 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 17:47:34.356480 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 17:47:34.356480 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 17:47:34.356480 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 17:47:34.356480 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 17:47:34.356480 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 17:47:34.356480 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 17:47:34.356480 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 17:47:34.356480 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 17:47:34.356480 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 17:47:34.357438 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 17:47:34.357438 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 17:47:34.357438 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 17:47:34.357438 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 17:47:34.357438 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 17:47:34.357438 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 17:47:34.357438 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 17:47:34.357438 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 17:47:34.357438 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 17:47:34.357438 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 17:47:34.357438 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 17:47:34.357438 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application with Lock( Sep 15 17:47:34.357438 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 17:47:34.357438 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._enter() Sep 15 17:47:34.357438 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 17:47:34.357438 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 17:47:34.358219 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 17:47:34.358219 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.creator() Sep 15 17:47:34.358219 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 17:47:34.358219 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application created_value = creator( Sep 15 17:47:34.358219 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 17:47:34.358219 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 17:47:34.358219 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 17:47:34.358219 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 17:47:34.358219 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 17:47:34.358219 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 17:47:34.358219 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 15 17:47:34.358219 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Sep 15 17:47:34.358219 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 62/126] 10.222.0.25 () {56 vars in 1099 bytes} [Thu Sep 15 17:47:34 2022] GET /identity/v3/roles/member => generated 84 bytes in 287 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 17:47:34.360945 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27678599-3bfb-443d-bc8b-7b3a72b0bc4e None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:47:34.367067 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69576ed9-984c-4d8a-8dcb-392c3a47c971 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:47:34.367983 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69576ed9-984c-4d8a-8dcb-392c3a47c971 None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:47:34.368461 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69576ed9-984c-4d8a-8dcb-392c3a47c971 None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:47:34.368929 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69576ed9-984c-4d8a-8dcb-392c3a47c971 None admin] PATH_INFO: `/v3/roles` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:47:34.369893 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69576ed9-984c-4d8a-8dcb-392c3a47c971 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81592) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 17:47:34.370393 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69576ed9-984c-4d8a-8dcb-392c3a47c971 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:47:34.372016 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69576ed9-984c-4d8a-8dcb-392c3a47c971 None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:47:34.381785 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 65/127] 10.222.0.25 () {56 vars in 1111 bytes} [Thu Sep 15 17:47:34 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 17:47:34.382919 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69576ed9-984c-4d8a-8dcb-392c3a47c971 None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:47:34.488061 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:47:34.491411 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:47:34.502957 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69576ed9-984c-4d8a-8dcb-392c3a47c971 None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:47:34.521688 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27678599-3bfb-443d-bc8b-7b3a72b0bc4e None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:47:34.562335 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690dc907-5d50-4730-b5a8-c5c7ac3c5087 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:47:34.563350 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690dc907-5d50-4730-b5a8-c5c7ac3c5087 None admin] REQUEST_METHOD: `PUT` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:47:34.563926 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690dc907-5d50-4730-b5a8-c5c7ac3c5087 None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:47:34.564493 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690dc907-5d50-4730-b5a8-c5c7ac3c5087 None admin] PATH_INFO: `/v3/projects/f18aabde2e1f4bebaec9fb09d1725a11/users/823825bfaf1b44a7ba5999ca5e7b26ce/roles/343cc8b1bc7243eebabdf08147e8366d` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:47:34.565348 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05a3db4-b370-4af0-9e93-caddf867cc34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:47:34.565999 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05a3db4-b370-4af0-9e93-caddf867cc34 None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:47:34.566315 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05a3db4-b370-4af0-9e93-caddf867cc34 None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:47:34.566547 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05a3db4-b370-4af0-9e93-caddf867cc34 None admin] PATH_INFO: `/v3/projects/f18aabde2e1f4bebaec9fb09d1725a11` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:47:34.568220 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05a3db4-b370-4af0-9e93-caddf867cc34 None admin] RBAC: Authorizing `identity:get_project(project_id=f18aabde2e1f4bebaec9fb09d1725a11)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:47:34.568659 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690dc907-5d50-4730-b5a8-c5c7ac3c5087 None admin] RBAC: Authorizing `identity:create_grant(project_id=f18aabde2e1f4bebaec9fb09d1725a11, user_id=823825bfaf1b44a7ba5999ca5e7b26ce, role_id=343cc8b1bc7243eebabdf08147e8366d)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:47:34.569730 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05a3db4-b370-4af0-9e93-caddf867cc34 None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:47:34.570597 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690dc907-5d50-4730-b5a8-c5c7ac3c5087 None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:47:34.576113 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 63/128] 10.222.0.25 () {56 vars in 1186 bytes} [Thu Sep 15 17:47:34 2022] GET /identity/v3/projects/f18aabde2e1f4bebaec9fb09d1725a11 => generated 298 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 17:47:34.576113 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05a3db4-b370-4af0-9e93-caddf867cc34 None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:47:34.590684 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 66/129] 10.222.0.25 () {58 vars in 1439 bytes} [Thu Sep 15 17:47:34 2022] PUT /identity/v3/projects/f18aabde2e1f4bebaec9fb09d1725a11/users/823825bfaf1b44a7ba5999ca5e7b26ce/roles/343cc8b1bc7243eebabdf08147e8366d => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 17:47:34.591535 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690dc907-5d50-4730-b5a8-c5c7ac3c5087 None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:47:34.686896 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05a3db4-b370-4af0-9e93-caddf867cc34 None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:47:34.716704 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690dc907-5d50-4730-b5a8-c5c7ac3c5087 None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:47:34.731379 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3d50a3-c027-4846-b631-dc1b5af8a72f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:47:34.734336 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3d50a3-c027-4846-b631-dc1b5af8a72f None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:47:34.734874 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3d50a3-c027-4846-b631-dc1b5af8a72f None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:47:34.737454 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3d50a3-c027-4846-b631-dc1b5af8a72f None admin] PATH_INFO: `/v3/roles` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:47:34.738584 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f3d50a3-c027-4846-b631-dc1b5af8a72f None admin] RBAC: Adding query filter params (name=member) {{(pid=81593) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 17:47:34.739905 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f3d50a3-c027-4846-b631-dc1b5af8a72f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:47:34.743266 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f3d50a3-c027-4846-b631-dc1b5af8a72f None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:47:34.759279 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 64/130] 10.222.0.25 () {56 vars in 1101 bytes} [Thu Sep 15 17:47:34 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 17:47:34.763933 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3d50a3-c027-4846-b631-dc1b5af8a72f None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:47:34.779685 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:47:34.798594 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a7b0a0-ca2e-4503-a01b-f68b4ee8d46b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:47:34.800422 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a7b0a0-ca2e-4503-a01b-f68b4ee8d46b None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:47:34.800698 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a7b0a0-ca2e-4503-a01b-f68b4ee8d46b None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:47:34.800972 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a7b0a0-ca2e-4503-a01b-f68b4ee8d46b None admin] PATH_INFO: `/v3/users/823825bfaf1b44a7ba5999ca5e7b26ce` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:47:34.806069 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a7b0a0-ca2e-4503-a01b-f68b4ee8d46b None admin] RBAC: Authorizing `identity:get_user(user_id=823825bfaf1b44a7ba5999ca5e7b26ce)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:47:34.807593 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a7b0a0-ca2e-4503-a01b-f68b4ee8d46b None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:47:34.813355 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 67/131] 10.222.0.25 () {56 vars in 1177 bytes} [Thu Sep 15 17:47:34 2022] GET /identity/v3/users/823825bfaf1b44a7ba5999ca5e7b26ce => generated 275 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 17:47:34.815423 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a7b0a0-ca2e-4503-a01b-f68b4ee8d46b None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:47:34.862493 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:47:34.920223 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3d50a3-c027-4846-b631-dc1b5af8a72f None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:47:34.967036 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f371fe99-53e3-45d0-91b8-5a2b9c51842f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:47:34.968185 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f371fe99-53e3-45d0-91b8-5a2b9c51842f None admin] REQUEST_METHOD: `PUT` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:47:34.969769 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f371fe99-53e3-45d0-91b8-5a2b9c51842f None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:47:34.970742 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f371fe99-53e3-45d0-91b8-5a2b9c51842f None admin] PATH_INFO: `/v3/projects/f18aabde2e1f4bebaec9fb09d1725a11/users/5cfa58ef86774ab7800bf91930bf6028/roles/a9e42be86923434f8af52d3fc07fb4f7` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:47:34.974209 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f371fe99-53e3-45d0-91b8-5a2b9c51842f None admin] RBAC: Authorizing `identity:create_grant(project_id=f18aabde2e1f4bebaec9fb09d1725a11, user_id=5cfa58ef86774ab7800bf91930bf6028, role_id=a9e42be86923434f8af52d3fc07fb4f7)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:47:34.978051 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f371fe99-53e3-45d0-91b8-5a2b9c51842f None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:47:35.009106 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 65/132] 10.222.0.25 () {58 vars in 1439 bytes} [Thu Sep 15 17:47:34 2022] PUT /identity/v3/projects/f18aabde2e1f4bebaec9fb09d1725a11/users/5cfa58ef86774ab7800bf91930bf6028/roles/a9e42be86923434f8af52d3fc07fb4f7 => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 17:47:35.010015 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f371fe99-53e3-45d0-91b8-5a2b9c51842f None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:47:35.056092 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a7b0a0-ca2e-4503-a01b-f68b4ee8d46b None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:47:35.129241 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5849d019-55e2-4b6f-a858-f69e4c2d634f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:47:35.130445 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5849d019-55e2-4b6f-a858-f69e4c2d634f None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:47:35.130731 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5849d019-55e2-4b6f-a858-f69e4c2d634f None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:47:35.131006 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5849d019-55e2-4b6f-a858-f69e4c2d634f None admin] PATH_INFO: `/v3/users/823825bfaf1b44a7ba5999ca5e7b26ce` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:47:35.132696 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5849d019-55e2-4b6f-a858-f69e4c2d634f None admin] RBAC: Authorizing `identity:get_user(user_id=823825bfaf1b44a7ba5999ca5e7b26ce)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:47:35.134310 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5849d019-55e2-4b6f-a858-f69e4c2d634f None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:47:35.136063 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 68/133] 10.222.0.25 () {56 vars in 1177 bytes} [Thu Sep 15 17:47:34 2022] GET /identity/v3/users/823825bfaf1b44a7ba5999ca5e7b26ce => generated 275 bytes in 322 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 17:47:35.141502 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5849d019-55e2-4b6f-a858-f69e4c2d634f None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:47:35.144790 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:47:35.188420 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f371fe99-53e3-45d0-91b8-5a2b9c51842f None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:47:35.249595 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:47:35.260627 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5849d019-55e2-4b6f-a858-f69e4c2d634f None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:47:35.263165 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9801dadd-6a09-4c00-acba-c9f68a820465 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:47:35.263835 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9801dadd-6a09-4c00-acba-c9f68a820465 None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:47:35.264123 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9801dadd-6a09-4c00-acba-c9f68a820465 None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:47:35.264405 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9801dadd-6a09-4c00-acba-c9f68a820465 None admin] PATH_INFO: `/v3/projects/f18aabde2e1f4bebaec9fb09d1725a11` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:47:35.270270 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9801dadd-6a09-4c00-acba-c9f68a820465 None admin] RBAC: Authorizing `identity:get_project(project_id=f18aabde2e1f4bebaec9fb09d1725a11)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:47:35.271822 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9801dadd-6a09-4c00-acba-c9f68a820465 None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:47:35.274218 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 66/134] 10.222.0.25 () {56 vars in 1186 bytes} [Thu Sep 15 17:47:35 2022] GET /identity/v3/projects/f18aabde2e1f4bebaec9fb09d1725a11 => generated 298 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 17:47:35.279823 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9801dadd-6a09-4c00-acba-c9f68a820465 None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:47:35.304280 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3951e851-b672-49c6-86c7-6aee626688ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:47:35.305494 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3951e851-b672-49c6-86c7-6aee626688ea None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:47:35.306125 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3951e851-b672-49c6-86c7-6aee626688ea None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:47:35.306600 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3951e851-b672-49c6-86c7-6aee626688ea None admin] PATH_INFO: `/v3/projects/21144bc65efd46cc9d858227221c68e9` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:47:35.308221 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3951e851-b672-49c6-86c7-6aee626688ea None admin] RBAC: Authorizing `identity:get_project(project_id=21144bc65efd46cc9d858227221c68e9)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:47:35.310162 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3951e851-b672-49c6-86c7-6aee626688ea None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:47:35.312183 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 69/135] 10.222.0.25 () {56 vars in 1186 bytes} [Thu Sep 15 17:47:35 2022] GET /identity/v3/projects/21144bc65efd46cc9d858227221c68e9 => generated 312 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 17:47:35.313779 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08073de-d082-443f-ad94-03f67bbd3b00 None None] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:47:35.314311 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08073de-d082-443f-ad94-03f67bbd3b00 None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:47:35.314775 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08073de-d082-443f-ad94-03f67bbd3b00 None None] PATH_INFO: `/` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:47:35.316652 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 70/136] 10.222.0.25 () {54 vars in 927 bytes} [Thu Sep 15 17:47:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 17:47:35.318911 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08073de-d082-443f-ad94-03f67bbd3b00 None None] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:47:35.415013 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9801dadd-6a09-4c00-acba-c9f68a820465 None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:47:35.443736 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08073de-d082-443f-ad94-03f67bbd3b00 None None] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:47:35.461006 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873b7cdb-d99d-45fd-a638-e78acfd007e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:47:35.462316 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873b7cdb-d99d-45fd-a638-e78acfd007e2 None admin] REQUEST_METHOD: `PUT` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:47:35.463185 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873b7cdb-d99d-45fd-a638-e78acfd007e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:47:35.463711 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873b7cdb-d99d-45fd-a638-e78acfd007e2 None admin] PATH_INFO: `/v3/projects/f18aabde2e1f4bebaec9fb09d1725a11/users/823825bfaf1b44a7ba5999ca5e7b26ce/roles/0dd1b9f5b7924e20a665ce50d6e34dc7` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:47:35.466683 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-873b7cdb-d99d-45fd-a638-e78acfd007e2 None admin] RBAC: Authorizing `identity:create_grant(project_id=f18aabde2e1f4bebaec9fb09d1725a11, user_id=823825bfaf1b44a7ba5999ca5e7b26ce, role_id=0dd1b9f5b7924e20a665ce50d6e34dc7)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:47:35.468906 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-873b7cdb-d99d-45fd-a638-e78acfd007e2 None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:47:35.472533 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:47:35.489908 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 67/137] 10.222.0.25 () {58 vars in 1439 bytes} [Thu Sep 15 17:47:35 2022] PUT /identity/v3/projects/f18aabde2e1f4bebaec9fb09d1725a11/users/823825bfaf1b44a7ba5999ca5e7b26ce/roles/0dd1b9f5b7924e20a665ce50d6e34dc7 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 17:47:35.490912 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d344691-2807-4e54-aad0-d5b8621398b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:47:35.491704 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d344691-2807-4e54-aad0-d5b8621398b0 None admin] REQUEST_METHOD: `PUT` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:47:35.491989 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d344691-2807-4e54-aad0-d5b8621398b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:47:35.492262 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d344691-2807-4e54-aad0-d5b8621398b0 None admin] PATH_INFO: `/v3/projects/21144bc65efd46cc9d858227221c68e9/users/823825bfaf1b44a7ba5999ca5e7b26ce/roles/343cc8b1bc7243eebabdf08147e8366d` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:47:35.492942 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c8c67b-692a-4082-90b5-2ced22aad97a None None] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:47:35.493549 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c8c67b-692a-4082-90b5-2ced22aad97a None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:47:35.494166 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c8c67b-692a-4082-90b5-2ced22aad97a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:47:35.494544 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d344691-2807-4e54-aad0-d5b8621398b0 None admin] RBAC: Authorizing `identity:create_grant(project_id=21144bc65efd46cc9d858227221c68e9, user_id=823825bfaf1b44a7ba5999ca5e7b26ce, role_id=343cc8b1bc7243eebabdf08147e8366d)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:47:35.496192 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d344691-2807-4e54-aad0-d5b8621398b0 None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:47:35.513144 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 71/138] 10.222.0.25 () {58 vars in 1439 bytes} [Thu Sep 15 17:47:35 2022] PUT /identity/v3/projects/21144bc65efd46cc9d858227221c68e9/users/823825bfaf1b44a7ba5999ca5e7b26ce/roles/343cc8b1bc7243eebabdf08147e8366d => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 17:47:35.517513 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.auth.core [None req-76c8c67b-692a-4082-90b5-2ced22aad97a None None] MFA Rules not processed for user `5cfa58ef86774ab7800bf91930bf6028`. Rule list: `[]` (Enabled: `True`). {{(pid=81593) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 17:47:35.519726 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-76c8c67b-692a-4082-90b5-2ced22aad97a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 17:47:35.602545 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 68/139] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Sep 15 17:47:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 15 17:47:35.858444 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b0dcfb-0a03-40dd-94ba-bbb02794ea1b None None] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:47:35.858974 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b0dcfb-0a03-40dd-94ba-bbb02794ea1b None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:47:35.859355 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b0dcfb-0a03-40dd-94ba-bbb02794ea1b None None] PATH_INFO: `/` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:47:35.861406 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 72/140] 10.222.0.25 () {54 vars in 927 bytes} [Thu Sep 15 17:47:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 17:47:35.867725 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3cdf81-0231-4e5c-a18c-11ae9562b210 None None] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:47:35.868022 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3cdf81-0231-4e5c-a18c-11ae9562b210 None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:47:35.868307 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3cdf81-0231-4e5c-a18c-11ae9562b210 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:47:35.890623 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.auth.core [None req-0b3cdf81-0231-4e5c-a18c-11ae9562b210 None None] MFA Rules not processed for user `5cfa58ef86774ab7800bf91930bf6028`. Rule list: `[]` (Enabled: `True`). {{(pid=81593) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 17:47:35.891849 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-0b3cdf81-0231-4e5c-a18c-11ae9562b210 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 17:47:35.981450 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 69/141] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Sep 15 17:47:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 15 17:47:36.003477 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b0dcfb-0a03-40dd-94ba-bbb02794ea1b None None] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:47:36.026982 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:47:36.139840 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b0dcfb-0a03-40dd-94ba-bbb02794ea1b None None] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:47:36.178677 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9a6c54-ac3a-4729-ae0c-93fc476444d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:47:36.179319 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9a6c54-ac3a-4729-ae0c-93fc476444d7 None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:47:36.179599 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9a6c54-ac3a-4729-ae0c-93fc476444d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:47:36.179873 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9a6c54-ac3a-4729-ae0c-93fc476444d7 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:47:36.181876 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db9a6c54-ac3a-4729-ae0c-93fc476444d7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:47:36.183380 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db9a6c54-ac3a-4729-ae0c-93fc476444d7 None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:47:36.184956 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 73/142] 10.222.0.25 () {56 vars in 1108 bytes} [Thu Sep 15 17:47:36 2022] GET /identity/v3/domains/default => generated 199 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 17:47:36.190646 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3cdf81-0231-4e5c-a18c-11ae9562b210 None None] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:47:36.266530 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:47:36.320723 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3cdf81-0231-4e5c-a18c-11ae9562b210 None None] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:47:36.360360 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6b8b62-7959-42d2-9e18-0ffb4a70959d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:47:36.360989 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6b8b62-7959-42d2-9e18-0ffb4a70959d None admin] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:47:36.361285 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6b8b62-7959-42d2-9e18-0ffb4a70959d None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:47:36.361587 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6b8b62-7959-42d2-9e18-0ffb4a70959d None admin] PATH_INFO: `/v3/users` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:47:36.362251 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6b8b62-7959-42d2-9e18-0ffb4a70959d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:47:36.363723 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6b8b62-7959-42d2-9e18-0ffb4a70959d None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:47:36.371281 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9a6c54-ac3a-4729-ae0c-93fc476444d7 None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:47:36.399117 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 70/143] 10.222.0.25 () {60 vars in 1132 bytes} [Thu Sep 15 17:47:36 2022] POST /identity/v3/users => generated 283 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 17:47:36.504035 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:47:36.522476 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9a6c54-ac3a-4729-ae0c-93fc476444d7 None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:47:36.573986 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae310fb3-f481-4355-8ce3-de615980289c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:47:36.574634 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae310fb3-f481-4355-8ce3-de615980289c None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:47:36.574920 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae310fb3-f481-4355-8ce3-de615980289c None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:47:36.575210 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae310fb3-f481-4355-8ce3-de615980289c None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:47:36.594358 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae310fb3-f481-4355-8ce3-de615980289c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 17:47:36.600529 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application [None req-ae310fb3-f481-4355-8ce3-de615980289c None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 15 17:47:36.600529 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 17:47:36.600529 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 17:47:36.600529 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 17:47:36.600529 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 17:47:36.600529 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 17:47:36.600529 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 17:47:36.600529 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 17:47:36.600529 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 17:47:36.600529 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 17:47:36.600529 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 17:47:36.600529 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 17:47:36.600529 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 17:47:36.600529 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 17:47:36.600529 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 17:47:36.600529 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 17:47:36.601501 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 17:47:36.601501 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 17:47:36.601501 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 17:47:36.601501 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 17:47:36.601501 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 17:47:36.601501 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 17:47:36.601501 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 17:47:36.601501 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 17:47:36.601501 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 17:47:36.601501 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 17:47:36.601501 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 17:47:36.601501 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application with Lock( Sep 15 17:47:36.601501 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 17:47:36.601501 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._enter() Sep 15 17:47:36.601501 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 17:47:36.601501 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 17:47:36.602295 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 17:47:36.602295 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.creator() Sep 15 17:47:36.602295 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 17:47:36.602295 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application created_value = creator( Sep 15 17:47:36.602295 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 17:47:36.602295 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 17:47:36.602295 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 17:47:36.602295 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 17:47:36.602295 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 17:47:36.602295 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 17:47:36.602295 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 15 17:47:36.602295 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Sep 15 17:47:36.602295 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 74/144] 10.222.0.25 () {56 vars in 1099 bytes} [Thu Sep 15 17:47:36 2022] GET /identity/v3/roles/reader => generated 84 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 15 17:47:36.609907 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6b8b62-7959-42d2-9e18-0ffb4a70959d None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:47:36.787535 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6b8b62-7959-42d2-9e18-0ffb4a70959d None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:47:36.802635 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:47:36.832273 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0ef8e0-f92a-4de3-b728-d0218fc76908 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:47:36.832960 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0ef8e0-f92a-4de3-b728-d0218fc76908 None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:47:36.833238 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0ef8e0-f92a-4de3-b728-d0218fc76908 None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:47:36.833540 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0ef8e0-f92a-4de3-b728-d0218fc76908 None admin] PATH_INFO: `/v3/roles` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:47:36.834236 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f0ef8e0-f92a-4de3-b728-d0218fc76908 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81593) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 17:47:36.834536 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f0ef8e0-f92a-4de3-b728-d0218fc76908 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:47:36.836065 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f0ef8e0-f92a-4de3-b728-d0218fc76908 None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:47:36.849013 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 71/145] 10.222.0.25 () {56 vars in 1101 bytes} [Thu Sep 15 17:47:36 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 17:47:36.856130 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae310fb3-f481-4355-8ce3-de615980289c None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:47:37.017185 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae310fb3-f481-4355-8ce3-de615980289c None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:47:37.067005 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee50f96-f5e1-46b1-ab7c-05ce233ca881 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:47:37.068266 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee50f96-f5e1-46b1-ab7c-05ce233ca881 None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:47:37.068548 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee50f96-f5e1-46b1-ab7c-05ce233ca881 None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:47:37.068837 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee50f96-f5e1-46b1-ab7c-05ce233ca881 None admin] PATH_INFO: `/v3/users/c881452b85fd43edbbe822cb34592782` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:47:37.070032 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee50f96-f5e1-46b1-ab7c-05ce233ca881 None admin] RBAC: Authorizing `identity:get_user(user_id=c881452b85fd43edbbe822cb34592782)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:47:37.071493 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee50f96-f5e1-46b1-ab7c-05ce233ca881 None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:47:37.073407 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 75/146] 10.222.0.25 () {56 vars in 1177 bytes} [Thu Sep 15 17:47:36 2022] GET /identity/v3/users/c881452b85fd43edbbe822cb34592782 => generated 289 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 17:47:37.079416 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0ef8e0-f92a-4de3-b728-d0218fc76908 None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:47:37.224436 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0ef8e0-f92a-4de3-b728-d0218fc76908 None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:47:37.263648 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67039199-fb5d-4649-b45b-9cda045ec5e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:47:37.264711 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67039199-fb5d-4649-b45b-9cda045ec5e7 None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:47:37.265198 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67039199-fb5d-4649-b45b-9cda045ec5e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:47:37.265713 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67039199-fb5d-4649-b45b-9cda045ec5e7 None admin] PATH_INFO: `/v3/projects/f18aabde2e1f4bebaec9fb09d1725a11` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:47:37.267052 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67039199-fb5d-4649-b45b-9cda045ec5e7 None admin] RBAC: Authorizing `identity:get_project(project_id=f18aabde2e1f4bebaec9fb09d1725a11)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:47:37.268726 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67039199-fb5d-4649-b45b-9cda045ec5e7 None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:47:37.271243 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 72/147] 10.222.0.25 () {56 vars in 1186 bytes} [Thu Sep 15 17:47:37 2022] GET /identity/v3/projects/f18aabde2e1f4bebaec9fb09d1725a11 => generated 298 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 17:47:37.277158 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee50f96-f5e1-46b1-ab7c-05ce233ca881 None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:47:37.315915 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:47:37.421734 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee50f96-f5e1-46b1-ab7c-05ce233ca881 None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:47:37.462310 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbccc1a0-17ec-4e7f-b154-6f1e0d46c615 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:47:37.463008 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbccc1a0-17ec-4e7f-b154-6f1e0d46c615 None admin] REQUEST_METHOD: `PUT` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:47:37.463293 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbccc1a0-17ec-4e7f-b154-6f1e0d46c615 None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:47:37.463573 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbccc1a0-17ec-4e7f-b154-6f1e0d46c615 None admin] PATH_INFO: `/v3/projects/f18aabde2e1f4bebaec9fb09d1725a11/users/c881452b85fd43edbbe822cb34592782/roles/80bb25250ed34dd9a6ed0740bcc3dac6` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:47:37.465702 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbccc1a0-17ec-4e7f-b154-6f1e0d46c615 None admin] RBAC: Authorizing `identity:create_grant(project_id=f18aabde2e1f4bebaec9fb09d1725a11, user_id=c881452b85fd43edbbe822cb34592782, role_id=80bb25250ed34dd9a6ed0740bcc3dac6)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:47:37.467194 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbccc1a0-17ec-4e7f-b154-6f1e0d46c615 None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:47:37.487590 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 76/148] 10.222.0.25 () {58 vars in 1439 bytes} [Thu Sep 15 17:47:37 2022] PUT /identity/v3/projects/f18aabde2e1f4bebaec9fb09d1725a11/users/c881452b85fd43edbbe822cb34592782/roles/80bb25250ed34dd9a6ed0740bcc3dac6 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 17:47:37.593674 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4f405a-cde4-42b9-b7b0-56325c7dd238 None None] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:47:37.594359 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4f405a-cde4-42b9-b7b0-56325c7dd238 None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:47:37.594866 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4f405a-cde4-42b9-b7b0-56325c7dd238 None None] PATH_INFO: `/` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:47:37.596556 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 73/149] 10.222.0.25 () {54 vars in 927 bytes} [Thu Sep 15 17:47:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 17:47:37.603136 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570c85ec-c59f-4b47-803e-e9547db193a2 None None] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:47:37.603877 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570c85ec-c59f-4b47-803e-e9547db193a2 None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:47:37.603877 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570c85ec-c59f-4b47-803e-e9547db193a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:47:37.631347 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.auth.core [None req-570c85ec-c59f-4b47-803e-e9547db193a2 None None] MFA Rules not processed for user `5cfa58ef86774ab7800bf91930bf6028`. Rule list: `[]` (Enabled: `True`). {{(pid=81592) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 17:47:37.632568 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-570c85ec-c59f-4b47-803e-e9547db193a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 17:47:37.721824 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 77/150] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Sep 15 17:47:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 15 17:47:38.305840 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4f405a-cde4-42b9-b7b0-56325c7dd238 None None] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:47:38.354544 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:47:38.428859 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4f405a-cde4-42b9-b7b0-56325c7dd238 None None] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:47:38.471357 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace72a86-8fae-43ff-85c9-6b9b8011738c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:47:38.471993 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace72a86-8fae-43ff-85c9-6b9b8011738c None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:47:38.472271 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace72a86-8fae-43ff-85c9-6b9b8011738c None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:47:38.472544 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace72a86-8fae-43ff-85c9-6b9b8011738c None admin] PATH_INFO: `/v3/roles/member` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:47:38.484369 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace72a86-8fae-43ff-85c9-6b9b8011738c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 17:47:38.490373 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application [None req-ace72a86-8fae-43ff-85c9-6b9b8011738c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 15 17:47:38.490373 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 17:47:38.490373 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 17:47:38.490373 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 17:47:38.490373 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 17:47:38.490373 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 17:47:38.490373 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 17:47:38.490373 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 17:47:38.490373 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 17:47:38.490373 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 17:47:38.490373 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 17:47:38.490373 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 17:47:38.490373 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 17:47:38.490373 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 17:47:38.490373 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 17:47:38.490373 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 17:47:38.491261 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 17:47:38.491261 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 17:47:38.491261 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 17:47:38.491261 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 17:47:38.491261 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 17:47:38.491261 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 17:47:38.491261 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 17:47:38.491261 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 17:47:38.491261 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 17:47:38.491261 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 17:47:38.491261 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 17:47:38.491261 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application with Lock( Sep 15 17:47:38.491261 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 17:47:38.491261 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._enter() Sep 15 17:47:38.491261 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 17:47:38.491261 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 17:47:38.492008 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 17:47:38.492008 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.creator() Sep 15 17:47:38.492008 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 17:47:38.492008 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application created_value = creator( Sep 15 17:47:38.492008 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 17:47:38.492008 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 17:47:38.492008 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 17:47:38.492008 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 17:47:38.492008 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 17:47:38.492008 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 17:47:38.492008 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 15 17:47:38.492008 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Sep 15 17:47:38.492008 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 74/151] 10.222.0.25 () {56 vars in 1099 bytes} [Thu Sep 15 17:47:38 2022] GET /identity/v3/roles/member => generated 84 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 17:47:38.501279 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570c85ec-c59f-4b47-803e-e9547db193a2 None None] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:47:38.511755 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:47:38.631795 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570c85ec-c59f-4b47-803e-e9547db193a2 None None] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:47:38.675069 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db672ec2-9331-4b3b-a092-699a0b5e45cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:47:38.676101 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db672ec2-9331-4b3b-a092-699a0b5e45cd None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:47:38.677363 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db672ec2-9331-4b3b-a092-699a0b5e45cd None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:47:38.677851 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db672ec2-9331-4b3b-a092-699a0b5e45cd None admin] PATH_INFO: `/v3/roles` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:47:38.678779 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db672ec2-9331-4b3b-a092-699a0b5e45cd None admin] RBAC: Adding query filter params (name=member) {{(pid=81592) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 17:47:38.679276 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db672ec2-9331-4b3b-a092-699a0b5e45cd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:47:38.680865 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db672ec2-9331-4b3b-a092-699a0b5e45cd None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:47:38.693408 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 78/152] 10.222.0.25 () {56 vars in 1101 bytes} [Thu Sep 15 17:47:38 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 17:47:38.701833 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace72a86-8fae-43ff-85c9-6b9b8011738c None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:47:38.845705 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:47:38.849224 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace72a86-8fae-43ff-85c9-6b9b8011738c None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:47:38.896536 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5a1699-0c65-4776-a6b1-424d47be4bf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:47:38.897091 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5a1699-0c65-4776-a6b1-424d47be4bf8 None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:47:38.897394 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5a1699-0c65-4776-a6b1-424d47be4bf8 None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:47:38.897666 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5a1699-0c65-4776-a6b1-424d47be4bf8 None admin] PATH_INFO: `/v3/users/823825bfaf1b44a7ba5999ca5e7b26ce` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:47:38.898817 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f5a1699-0c65-4776-a6b1-424d47be4bf8 None admin] RBAC: Authorizing `identity:get_user(user_id=823825bfaf1b44a7ba5999ca5e7b26ce)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:47:38.900363 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f5a1699-0c65-4776-a6b1-424d47be4bf8 None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:47:38.901985 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 75/153] 10.222.0.25 () {56 vars in 1177 bytes} [Thu Sep 15 17:47:38 2022] GET /identity/v3/users/823825bfaf1b44a7ba5999ca5e7b26ce => generated 275 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 17:47:38.915813 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db672ec2-9331-4b3b-a092-699a0b5e45cd None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:47:39.043426 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:47:39.092131 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db672ec2-9331-4b3b-a092-699a0b5e45cd None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:47:39.109649 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cb7bc8-1413-478f-a014-9b14f46d2a74 None None] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:47:39.109965 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cb7bc8-1413-478f-a014-9b14f46d2a74 None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:47:39.110204 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cb7bc8-1413-478f-a014-9b14f46d2a74 None None] PATH_INFO: `/` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:47:39.111674 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 76/154] 10.222.0.25 () {54 vars in 927 bytes} [Thu Sep 15 17:47:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 15 17:47:39.127118 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5372a9-91fc-4db0-ab36-06bbf0cae315 None None] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:47:39.127401 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5372a9-91fc-4db0-ab36-06bbf0cae315 None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:47:39.127664 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5372a9-91fc-4db0-ab36-06bbf0cae315 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:47:39.142645 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14079488-c083-4dcc-8c4a-7e6bff6de055 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:47:39.143635 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14079488-c083-4dcc-8c4a-7e6bff6de055 None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:47:39.144158 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14079488-c083-4dcc-8c4a-7e6bff6de055 None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:47:39.146041 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14079488-c083-4dcc-8c4a-7e6bff6de055 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:47:39.174533 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.auth.core [None req-ad5372a9-91fc-4db0-ab36-06bbf0cae315 None None] MFA Rules not processed for user `5cfa58ef86774ab7800bf91930bf6028`. Rule list: `[]` (Enabled: `True`). {{(pid=81593) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 17:47:39.175741 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-ad5372a9-91fc-4db0-ab36-06bbf0cae315 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 17:47:39.269796 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14079488-c083-4dcc-8c4a-7e6bff6de055 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:47:39.274940 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14079488-c083-4dcc-8c4a-7e6bff6de055 None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:47:39.331693 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 77/155] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Sep 15 17:47:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 15 17:47:39.339070 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6445663-f2b0-4949-b446-f4e24cedc8b3 None None] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:47:39.339618 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6445663-f2b0-4949-b446-f4e24cedc8b3 None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:47:39.340291 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6445663-f2b0-4949-b446-f4e24cedc8b3 None None] PATH_INFO: `/` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:47:39.342752 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 78/156] 10.222.0.25 () {54 vars in 927 bytes} [Thu Sep 15 17:47:39 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 17:47:39.348483 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ed7c7b-b34d-4faf-b471-88f7b877aee1 None None] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:47:39.349047 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ed7c7b-b34d-4faf-b471-88f7b877aee1 None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:47:39.349553 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ed7c7b-b34d-4faf-b471-88f7b877aee1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:47:39.389100 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.auth.core [None req-91ed7c7b-b34d-4faf-b471-88f7b877aee1 None None] MFA Rules not processed for user `5cfa58ef86774ab7800bf91930bf6028`. Rule list: `[]` (Enabled: `True`). {{(pid=81593) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 17:47:39.392040 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-91ed7c7b-b34d-4faf-b471-88f7b877aee1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 17:47:39.417700 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:47:39.459385 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 79/157] 10.222.0.25 () {58 vars in 1282 bytes} [Thu Sep 15 17:47:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 550 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 15 17:47:39.467407 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14079488-c083-4dcc-8c4a-7e6bff6de055 None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:47:39.593527 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14079488-c083-4dcc-8c4a-7e6bff6de055 None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:47:39.609217 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 79/158] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Sep 15 17:47:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 262 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 15 17:47:39.633982 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15909c5-79fb-4238-8e5a-14d7dbcb44f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:47:39.635300 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15909c5-79fb-4238-8e5a-14d7dbcb44f0 None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:47:39.635774 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15909c5-79fb-4238-8e5a-14d7dbcb44f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:47:39.636260 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15909c5-79fb-4238-8e5a-14d7dbcb44f0 None admin] PATH_INFO: `/v3/projects/f18aabde2e1f4bebaec9fb09d1725a11` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:47:39.637695 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15909c5-79fb-4238-8e5a-14d7dbcb44f0 None admin] RBAC: Authorizing `identity:get_project(project_id=f18aabde2e1f4bebaec9fb09d1725a11)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:47:39.639360 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15909c5-79fb-4238-8e5a-14d7dbcb44f0 None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:47:39.641619 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 80/159] 10.222.0.25 () {56 vars in 1186 bytes} [Thu Sep 15 17:47:39 2022] GET /identity/v3/projects/f18aabde2e1f4bebaec9fb09d1725a11 => generated 298 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 17:47:39.647781 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ed7c7b-b34d-4faf-b471-88f7b877aee1 None None] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:47:39.700093 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:47:39.791977 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ed7c7b-b34d-4faf-b471-88f7b877aee1 None None] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:47:39.835370 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac89429a-4c3a-4375-a324-14ee77e0263a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:47:39.835988 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac89429a-4c3a-4375-a324-14ee77e0263a None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:47:39.836267 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac89429a-4c3a-4375-a324-14ee77e0263a None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:47:39.836539 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac89429a-4c3a-4375-a324-14ee77e0263a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:47:39.837274 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac89429a-4c3a-4375-a324-14ee77e0263a None admin] RBAC: Adding query filter params (role.id=343cc8b1bc7243eebabdf08147e8366d, scope.project.id=f18aabde2e1f4bebaec9fb09d1725a11, user.id=823825bfaf1b44a7ba5999ca5e7b26ce) {{(pid=81593) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 17:47:39.837613 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac89429a-4c3a-4375-a324-14ee77e0263a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:47:39.839113 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac89429a-4c3a-4375-a324-14ee77e0263a None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:47:39.851010 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 80/160] 10.222.0.25 () {56 vars in 1374 bytes} [Thu Sep 15 17:47:39 2022] GET /identity/v3/role_assignments?user.id=823825bfaf1b44a7ba5999ca5e7b26ce&scope.project.id=f18aabde2e1f4bebaec9fb09d1725a11&role.id=343cc8b1bc7243eebabdf08147e8366d => generated 608 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 17:47:39.930018 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15909c5-79fb-4238-8e5a-14d7dbcb44f0 None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:47:39.982483 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:47:40.059358 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15909c5-79fb-4238-8e5a-14d7dbcb44f0 None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:47:40.097934 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7482e516-c6bd-40a1-a5f7-54df44f58ad2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:47:40.098987 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7482e516-c6bd-40a1-a5f7-54df44f58ad2 None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:47:40.099462 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7482e516-c6bd-40a1-a5f7-54df44f58ad2 None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:47:40.099948 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7482e516-c6bd-40a1-a5f7-54df44f58ad2 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:47:40.111907 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7482e516-c6bd-40a1-a5f7-54df44f58ad2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 17:47:40.118053 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application [None req-7482e516-c6bd-40a1-a5f7-54df44f58ad2 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 15 17:47:40.118053 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 17:47:40.118053 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 17:47:40.118053 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 17:47:40.118053 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 17:47:40.118053 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 17:47:40.118053 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 17:47:40.118053 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 17:47:40.118053 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 17:47:40.118053 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 17:47:40.118053 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 17:47:40.118053 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 17:47:40.118053 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 17:47:40.118053 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 17:47:40.118053 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 17:47:40.118053 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 17:47:40.118986 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 17:47:40.118986 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 17:47:40.118986 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 17:47:40.118986 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 17:47:40.118986 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 17:47:40.118986 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 17:47:40.118986 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 17:47:40.118986 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 17:47:40.118986 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 17:47:40.118986 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 17:47:40.118986 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 17:47:40.118986 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application with Lock( Sep 15 17:47:40.118986 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 17:47:40.118986 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._enter() Sep 15 17:47:40.118986 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 17:47:40.118986 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 17:47:40.119767 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 17:47:40.119767 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.creator() Sep 15 17:47:40.119767 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 17:47:40.119767 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application created_value = creator( Sep 15 17:47:40.119767 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 17:47:40.119767 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 17:47:40.119767 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 17:47:40.119767 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 17:47:40.119767 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 17:47:40.119767 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 17:47:40.119767 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 15 17:47:40.119767 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Sep 15 17:47:40.122300 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 81/161] 10.222.0.25 () {56 vars in 1114 bytes} [Thu Sep 15 17:47:39 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 17:47:40.130555 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac89429a-4c3a-4375-a324-14ee77e0263a None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:47:40.214409 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7482e516-c6bd-40a1-a5f7-54df44f58ad2 None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:47:40.307509 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:47:40.355605 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac89429a-4c3a-4375-a324-14ee77e0263a None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:47:40.379069 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:47:40.392610 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7482e516-c6bd-40a1-a5f7-54df44f58ad2 None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:47:40.440680 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270c98c1-3e7f-455b-93bb-d409a0f881f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:47:40.441343 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270c98c1-3e7f-455b-93bb-d409a0f881f6 None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:47:40.441629 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270c98c1-3e7f-455b-93bb-d409a0f881f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:47:40.441901 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270c98c1-3e7f-455b-93bb-d409a0f881f6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:47:40.442538 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3dcc760-b71b-46e3-98d1-db51136b6b07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:47:40.443154 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3dcc760-b71b-46e3-98d1-db51136b6b07 None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:47:40.443436 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3dcc760-b71b-46e3-98d1-db51136b6b07 None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:47:40.443713 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3dcc760-b71b-46e3-98d1-db51136b6b07 None admin] PATH_INFO: `/v3/roles` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:47:40.444386 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3dcc760-b71b-46e3-98d1-db51136b6b07 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81593) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 17:47:40.444692 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3dcc760-b71b-46e3-98d1-db51136b6b07 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:47:40.446118 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3dcc760-b71b-46e3-98d1-db51136b6b07 None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:47:40.457381 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-270c98c1-3e7f-455b-93bb-d409a0f881f6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 17:47:40.459431 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 81/162] 10.222.0.25 () {56 vars in 1111 bytes} [Thu Sep 15 17:47:40 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 330 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 17:47:40.460688 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2786f539-232b-4f33-b6bb-25439d292c7b None None] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:47:40.460974 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2786f539-232b-4f33-b6bb-25439d292c7b None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:47:40.461251 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2786f539-232b-4f33-b6bb-25439d292c7b None None] PATH_INFO: `/` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:47:40.462484 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 82/163] 10.222.0.25 () {54 vars in 927 bytes} [Thu Sep 15 17:47:40 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 17:47:40.462779 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application [None req-270c98c1-3e7f-455b-93bb-d409a0f881f6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 15 17:47:40.462779 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 17:47:40.462779 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 17:47:40.462779 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 17:47:40.462779 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 17:47:40.462779 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 17:47:40.462779 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 17:47:40.462779 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 17:47:40.462779 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 17:47:40.462779 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 17:47:40.462779 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 17:47:40.462779 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 17:47:40.462779 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 17:47:40.462779 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 17:47:40.462779 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 17:47:40.462779 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 17:47:40.463600 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 17:47:40.463600 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 17:47:40.463600 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 17:47:40.463600 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 17:47:40.463600 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 17:47:40.463600 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 17:47:40.463600 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 17:47:40.463600 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 17:47:40.463600 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 17:47:40.463600 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 17:47:40.463600 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 17:47:40.463600 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application with Lock( Sep 15 17:47:40.463600 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 17:47:40.463600 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._enter() Sep 15 17:47:40.463600 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 17:47:40.463600 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 17:47:40.465090 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 17:47:40.465090 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.creator() Sep 15 17:47:40.465090 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 17:47:40.465090 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application created_value = creator( Sep 15 17:47:40.465090 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 17:47:40.465090 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 17:47:40.465090 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 17:47:40.465090 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 17:47:40.465090 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 17:47:40.465090 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 17:47:40.465090 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 15 17:47:40.465090 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Sep 15 17:47:40.465090 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 82/164] 10.222.0.25 () {56 vars in 1096 bytes} [Thu Sep 15 17:47:40 2022] GET /identity/v3/roles/admin => generated 83 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 15 17:47:40.470273 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2786f539-232b-4f33-b6bb-25439d292c7b None None] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:47:40.470773 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb19064-2799-4070-b7e6-58a686fb52ba None None] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:47:40.471065 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb19064-2799-4070-b7e6-58a686fb52ba None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:47:40.471341 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb19064-2799-4070-b7e6-58a686fb52ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:47:40.503804 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.auth.core [None req-2cb19064-2799-4070-b7e6-58a686fb52ba None None] MFA Rules not processed for user `5cfa58ef86774ab7800bf91930bf6028`. Rule list: `[]` (Enabled: `True`). {{(pid=81592) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 17:47:40.505778 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-2cb19064-2799-4070-b7e6-58a686fb52ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 17:47:40.654526 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 83/165] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Sep 15 17:47:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 15 17:47:40.657322 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb19064-2799-4070-b7e6-58a686fb52ba None None] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:47:40.691757 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2786f539-232b-4f33-b6bb-25439d292c7b None None] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:47:40.766937 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5713876c-4a16-4491-a168-026f29498637 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:47:40.767625 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5713876c-4a16-4491-a168-026f29498637 None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:47:40.767910 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5713876c-4a16-4491-a168-026f29498637 None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:47:40.768183 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5713876c-4a16-4491-a168-026f29498637 None admin] PATH_INFO: `/v3/users/823825bfaf1b44a7ba5999ca5e7b26ce` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:47:40.769973 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5713876c-4a16-4491-a168-026f29498637 None admin] RBAC: Authorizing `identity:get_user(user_id=823825bfaf1b44a7ba5999ca5e7b26ce)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:47:40.772651 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5713876c-4a16-4491-a168-026f29498637 None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:47:40.774988 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 83/166] 10.222.0.25 () {56 vars in 1177 bytes} [Thu Sep 15 17:47:40 2022] GET /identity/v3/users/823825bfaf1b44a7ba5999ca5e7b26ce => generated 275 bytes in 305 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 17:47:40.781049 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5713876c-4a16-4491-a168-026f29498637 None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:47:40.829064 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:47:40.860020 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:47:40.894429 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb19064-2799-4070-b7e6-58a686fb52ba None None] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:47:40.976048 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d1d2d0-286e-440f-a30f-960d3aea22de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:47:40.976666 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d1d2d0-286e-440f-a30f-960d3aea22de None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:47:40.976941 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d1d2d0-286e-440f-a30f-960d3aea22de None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:47:40.977207 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d1d2d0-286e-440f-a30f-960d3aea22de None admin] PATH_INFO: `/v3/roles` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:47:40.982713 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d1d2d0-286e-440f-a30f-960d3aea22de None admin] RBAC: Adding query filter params (name=admin) {{(pid=81592) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 17:47:40.983025 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d1d2d0-286e-440f-a30f-960d3aea22de None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:47:40.984408 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d1d2d0-286e-440f-a30f-960d3aea22de None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:47:41.000976 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5713876c-4a16-4491-a168-026f29498637 None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:47:41.011986 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 84/167] 10.222.0.25 () {56 vars in 1099 bytes} [Thu Sep 15 17:47:40 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 355 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 17:47:41.017553 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d1d2d0-286e-440f-a30f-960d3aea22de None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:47:41.078447 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a56d47a-4fb3-45c0-8eb2-8db45a8a56e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:47:41.079086 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a56d47a-4fb3-45c0-8eb2-8db45a8a56e2 None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:47:41.079368 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a56d47a-4fb3-45c0-8eb2-8db45a8a56e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:47:41.079662 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a56d47a-4fb3-45c0-8eb2-8db45a8a56e2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:47:41.216033 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d1d2d0-286e-440f-a30f-960d3aea22de None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:47:41.225179 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a56d47a-4fb3-45c0-8eb2-8db45a8a56e2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:47:41.226711 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a56d47a-4fb3-45c0-8eb2-8db45a8a56e2 None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:47:41.278949 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:47:41.286865 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804ecadc-a0f5-4123-8439-7fb37ad0bbfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:47:41.287604 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804ecadc-a0f5-4123-8439-7fb37ad0bbfb None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:47:41.287779 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804ecadc-a0f5-4123-8439-7fb37ad0bbfb None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:47:41.288044 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804ecadc-a0f5-4123-8439-7fb37ad0bbfb None admin] PATH_INFO: `/v3/users/5cfa58ef86774ab7800bf91930bf6028` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:47:41.289306 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-804ecadc-a0f5-4123-8439-7fb37ad0bbfb None admin] RBAC: Authorizing `identity:get_user(user_id=5cfa58ef86774ab7800bf91930bf6028)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:47:41.297881 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-804ecadc-a0f5-4123-8439-7fb37ad0bbfb None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:47:41.299726 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 85/168] 10.222.0.25 () {56 vars in 1177 bytes} [Thu Sep 15 17:47:41 2022] GET /identity/v3/users/5cfa58ef86774ab7800bf91930bf6028 => generated 247 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 17:47:41.300312 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804ecadc-a0f5-4123-8439-7fb37ad0bbfb None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:47:41.354166 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:47:41.439314 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 84/169] 10.222.0.25 () {58 vars in 1282 bytes} [Thu Sep 15 17:47:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 659 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 15 17:47:41.440859 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a56d47a-4fb3-45c0-8eb2-8db45a8a56e2 None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:47:41.555812 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804ecadc-a0f5-4123-8439-7fb37ad0bbfb None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:47:41.629649 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a77c39-fc4b-44d0-a3e3-a091d3ef8522 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:47:41.631497 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a77c39-fc4b-44d0-a3e3-a091d3ef8522 None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:47:41.631779 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a77c39-fc4b-44d0-a3e3-a091d3ef8522 None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:47:41.632054 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a77c39-fc4b-44d0-a3e3-a091d3ef8522 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:47:41.638170 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a56d47a-4fb3-45c0-8eb2-8db45a8a56e2 None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:47:41.651161 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a77c39-fc4b-44d0-a3e3-a091d3ef8522 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 17:47:41.656620 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application [None req-e1a77c39-fc4b-44d0-a3e3-a091d3ef8522 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 15 17:47:41.656620 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 17:47:41.656620 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 17:47:41.656620 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 17:47:41.656620 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 17:47:41.656620 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 17:47:41.656620 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 17:47:41.656620 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 17:47:41.656620 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 17:47:41.656620 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 17:47:41.656620 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 17:47:41.656620 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 17:47:41.656620 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 17:47:41.656620 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 17:47:41.656620 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 17:47:41.656620 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 17:47:41.658003 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 17:47:41.658003 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 17:47:41.658003 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 17:47:41.658003 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 17:47:41.658003 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 17:47:41.658003 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 17:47:41.658003 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 17:47:41.658003 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 17:47:41.658003 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 17:47:41.658003 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 17:47:41.658003 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 17:47:41.658003 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application with Lock( Sep 15 17:47:41.658003 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 17:47:41.658003 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._enter() Sep 15 17:47:41.658003 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 17:47:41.658003 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 17:47:41.658810 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 17:47:41.658810 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.creator() Sep 15 17:47:41.658810 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 17:47:41.658810 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application created_value = creator( Sep 15 17:47:41.658810 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 17:47:41.658810 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 17:47:41.658810 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 17:47:41.658810 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 17:47:41.658810 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 17:47:41.658810 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 17:47:41.658810 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 15 17:47:41.658810 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Sep 15 17:47:41.658810 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 86/170] 10.222.0.25 () {56 vars in 1099 bytes} [Thu Sep 15 17:47:41 2022] GET /identity/v3/roles/member => generated 84 bytes in 358 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 17:47:41.659537 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a77c39-fc4b-44d0-a3e3-a091d3ef8522 None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:47:41.711293 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:47:41.746612 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a3e3c9-c610-4431-bc20-d40184023965 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:47:41.747350 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a3e3c9-c610-4431-bc20-d40184023965 None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:47:41.747500 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a3e3c9-c610-4431-bc20-d40184023965 None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:47:41.747772 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a3e3c9-c610-4431-bc20-d40184023965 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:47:41.819044 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:47:41.856560 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a3e3c9-c610-4431-bc20-d40184023965 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:47:41.858102 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a3e3c9-c610-4431-bc20-d40184023965 None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:47:41.864153 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a77c39-fc4b-44d0-a3e3-a091d3ef8522 None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:47:41.930933 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37fbbea-c391-4b54-ba5d-e6eb575518c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:47:41.931769 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37fbbea-c391-4b54-ba5d-e6eb575518c8 None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:47:41.932306 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37fbbea-c391-4b54-ba5d-e6eb575518c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:47:41.932584 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37fbbea-c391-4b54-ba5d-e6eb575518c8 None admin] PATH_INFO: `/v3/projects/f18aabde2e1f4bebaec9fb09d1725a11` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:47:41.935675 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37fbbea-c391-4b54-ba5d-e6eb575518c8 None admin] RBAC: Authorizing `identity:get_project(project_id=f18aabde2e1f4bebaec9fb09d1725a11)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:47:41.937181 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37fbbea-c391-4b54-ba5d-e6eb575518c8 None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:47:41.938998 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 87/171] 10.222.0.25 () {56 vars in 1186 bytes} [Thu Sep 15 17:47:41 2022] GET /identity/v3/projects/f18aabde2e1f4bebaec9fb09d1725a11 => generated 298 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 17:47:41.941707 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37fbbea-c391-4b54-ba5d-e6eb575518c8 None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:47:42.048172 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 85/172] 10.222.0.25 () {58 vars in 1282 bytes} [Thu Sep 15 17:47:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 608 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 15 17:47:42.050410 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e863e5e-d528-4cb7-8b98-9daef5fd3cff None None] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:47:42.050700 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e863e5e-d528-4cb7-8b98-9daef5fd3cff None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:47:42.050975 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e863e5e-d528-4cb7-8b98-9daef5fd3cff None None] PATH_INFO: `/` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:47:42.053211 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 86/173] 10.222.0.25 () {54 vars in 927 bytes} [Thu Sep 15 17:47:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 17:47:42.058166 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e863e5e-d528-4cb7-8b98-9daef5fd3cff None None] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:47:42.099398 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:47:42.151506 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37fbbea-c391-4b54-ba5d-e6eb575518c8 None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:47:42.216663 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e863e5e-d528-4cb7-8b98-9daef5fd3cff None None] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:47:42.217207 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f68bd4-46d7-43b8-a509-b613b7680e09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:47:42.217865 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f68bd4-46d7-43b8-a509-b613b7680e09 None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:47:42.218143 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f68bd4-46d7-43b8-a509-b613b7680e09 None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:47:42.218414 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f68bd4-46d7-43b8-a509-b613b7680e09 None admin] PATH_INFO: `/v3/roles` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:47:42.219091 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f68bd4-46d7-43b8-a509-b613b7680e09 None admin] RBAC: Adding query filter params (name=member) {{(pid=81592) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 17:47:42.219394 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f68bd4-46d7-43b8-a509-b613b7680e09 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:47:42.220780 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f68bd4-46d7-43b8-a509-b613b7680e09 None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:47:42.232582 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 88/174] 10.222.0.25 () {56 vars in 1101 bytes} [Thu Sep 15 17:47:41 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 17:47:42.233647 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f68bd4-46d7-43b8-a509-b613b7680e09 None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:47:42.249948 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:47:42.258141 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe4c287-a10a-451e-a02d-7da2e05fe475 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:47:42.260450 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe4c287-a10a-451e-a02d-7da2e05fe475 None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:47:42.261094 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe4c287-a10a-451e-a02d-7da2e05fe475 None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:47:42.261599 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe4c287-a10a-451e-a02d-7da2e05fe475 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:47:42.262678 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe4c287-a10a-451e-a02d-7da2e05fe475 None admin] RBAC: Adding query filter params (role.id=0dd1b9f5b7924e20a665ce50d6e34dc7, scope.project.id=f18aabde2e1f4bebaec9fb09d1725a11, user.id=823825bfaf1b44a7ba5999ca5e7b26ce) {{(pid=81593) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 17:47:42.263795 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe4c287-a10a-451e-a02d-7da2e05fe475 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:47:42.265859 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe4c287-a10a-451e-a02d-7da2e05fe475 None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:47:42.274574 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 87/175] 10.222.0.25 () {56 vars in 1374 bytes} [Thu Sep 15 17:47:42 2022] GET /identity/v3/role_assignments?user.id=823825bfaf1b44a7ba5999ca5e7b26ce&scope.project.id=f18aabde2e1f4bebaec9fb09d1725a11&role.id=0dd1b9f5b7924e20a665ce50d6e34dc7 => generated 608 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 17:47:42.276346 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65b6a6d-b5c2-4b2a-bca2-748194237989 None None] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:47:42.276883 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65b6a6d-b5c2-4b2a-bca2-748194237989 None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:47:42.277403 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65b6a6d-b5c2-4b2a-bca2-748194237989 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:47:42.300629 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.auth.core [None req-a65b6a6d-b5c2-4b2a-bca2-748194237989 None None] MFA Rules not processed for user `5cfa58ef86774ab7800bf91930bf6028`. Rule list: `[]` (Enabled: `True`). {{(pid=81593) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 17:47:42.303248 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-a65b6a6d-b5c2-4b2a-bca2-748194237989 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 17:47:42.397850 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 88/176] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Sep 15 17:47:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 15 17:47:42.399460 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3394257d-9772-4bfe-a3c2-064edfee1077 None None] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:47:42.400209 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3394257d-9772-4bfe-a3c2-064edfee1077 None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:47:42.400688 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3394257d-9772-4bfe-a3c2-064edfee1077 None None] PATH_INFO: `/` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:47:42.403102 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 89/177] 10.222.0.25 () {54 vars in 927 bytes} [Thu Sep 15 17:47:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 17:47:42.409327 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3394257d-9772-4bfe-a3c2-064edfee1077 None None] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:47:42.428853 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f68bd4-46d7-43b8-a509-b613b7680e09 None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:47:42.434099 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:47:42.512830 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c4408d-2aa0-4ed9-a693-4eab95b305e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:47:42.513986 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c4408d-2aa0-4ed9-a693-4eab95b305e4 None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:47:42.513986 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c4408d-2aa0-4ed9-a693-4eab95b305e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:47:42.514328 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c4408d-2aa0-4ed9-a693-4eab95b305e4 None admin] PATH_INFO: `/v3/projects/f18aabde2e1f4bebaec9fb09d1725a11` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:47:42.521362 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c4408d-2aa0-4ed9-a693-4eab95b305e4 None admin] RBAC: Authorizing `identity:get_project(project_id=f18aabde2e1f4bebaec9fb09d1725a11)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:47:42.521362 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c4408d-2aa0-4ed9-a693-4eab95b305e4 None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:47:42.524059 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 89/178] 10.222.0.25 () {56 vars in 1186 bytes} [Thu Sep 15 17:47:42 2022] GET /identity/v3/projects/f18aabde2e1f4bebaec9fb09d1725a11 => generated 298 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 17:47:42.525511 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ef9de6-39af-40fd-9cd9-4b912b60cafc None None] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:47:42.526016 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ef9de6-39af-40fd-9cd9-4b912b60cafc None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:47:42.526493 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ef9de6-39af-40fd-9cd9-4b912b60cafc None None] PATH_INFO: `/` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:47:42.528004 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 90/179] 10.222.0.25 () {54 vars in 927 bytes} [Thu Sep 15 17:47:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 17:47:42.529232 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3e1e6a-3952-4c68-9e42-cd96f44a66e8 None None] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:47:42.529903 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3e1e6a-3952-4c68-9e42-cd96f44a66e8 None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:47:42.530265 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3e1e6a-3952-4c68-9e42-cd96f44a66e8 None None] PATH_INFO: `/` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:47:42.531666 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 91/180] 10.222.0.25 () {54 vars in 927 bytes} [Thu Sep 15 17:47:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 17:47:42.534298 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5662ff-f173-41ec-889d-a3bda98ff1fd None None] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:47:42.534579 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5662ff-f173-41ec-889d-a3bda98ff1fd None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:47:42.534857 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5662ff-f173-41ec-889d-a3bda98ff1fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:47:42.564119 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.auth.core [None req-4c5662ff-f173-41ec-889d-a3bda98ff1fd None None] MFA Rules not processed for user `5cfa58ef86774ab7800bf91930bf6028`. Rule list: `[]` (Enabled: `True`). {{(pid=81592) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 17:47:42.565469 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-4c5662ff-f173-41ec-889d-a3bda98ff1fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 17:47:42.577613 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3394257d-9772-4bfe-a3c2-064edfee1077 None None] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:47:42.637768 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0820cef8-1102-431b-b90b-b7b0d2aabe49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:47:42.638609 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0820cef8-1102-431b-b90b-b7b0d2aabe49 None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:47:42.638892 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0820cef8-1102-431b-b90b-b7b0d2aabe49 None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:47:42.639168 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0820cef8-1102-431b-b90b-b7b0d2aabe49 None admin] PATH_INFO: `/v3/users/823825bfaf1b44a7ba5999ca5e7b26ce` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:47:42.641099 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0820cef8-1102-431b-b90b-b7b0d2aabe49 None admin] RBAC: Authorizing `identity:get_user(user_id=823825bfaf1b44a7ba5999ca5e7b26ce)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:47:42.645551 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0820cef8-1102-431b-b90b-b7b0d2aabe49 None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:47:42.650120 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 90/181] 10.222.0.25 () {56 vars in 1177 bytes} [Thu Sep 15 17:47:42 2022] GET /identity/v3/users/823825bfaf1b44a7ba5999ca5e7b26ce => generated 275 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 17:47:42.655985 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0820cef8-1102-431b-b90b-b7b0d2aabe49 None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:47:42.683403 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 92/182] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Sep 15 17:47:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 15 17:47:42.692514 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50ea54b-6a72-49a7-b010-96ba4fd0e9f6 None None] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:47:42.692514 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50ea54b-6a72-49a7-b010-96ba4fd0e9f6 None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:47:42.692514 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50ea54b-6a72-49a7-b010-96ba4fd0e9f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:47:42.697478 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:47:42.709031 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.auth.core [None req-f50ea54b-6a72-49a7-b010-96ba4fd0e9f6 None None] MFA Rules not processed for user `5cfa58ef86774ab7800bf91930bf6028`. Rule list: `[]` (Enabled: `True`). {{(pid=81592) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 17:47:42.710463 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-f50ea54b-6a72-49a7-b010-96ba4fd0e9f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 17:47:42.764490 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:47:42.782409 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0820cef8-1102-431b-b90b-b7b0d2aabe49 None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:47:42.784362 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 93/183] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Sep 15 17:47:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 15 17:47:42.786616 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51251696-8308-4beb-aeb5-0a26883f0586 None None] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:47:42.786974 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51251696-8308-4beb-aeb5-0a26883f0586 None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:47:42.787318 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51251696-8308-4beb-aeb5-0a26883f0586 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:47:42.813984 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.auth.core [None req-51251696-8308-4beb-aeb5-0a26883f0586 None None] MFA Rules not processed for user `5cfa58ef86774ab7800bf91930bf6028`. Rule list: `[]` (Enabled: `True`). {{(pid=81592) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 17:47:42.815330 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-51251696-8308-4beb-aeb5-0a26883f0586 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 17:47:42.825527 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8ae225-5f7e-48ec-9f9d-3cc0a7acd9fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:47:42.826591 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8ae225-5f7e-48ec-9f9d-3cc0a7acd9fe None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:47:42.827104 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8ae225-5f7e-48ec-9f9d-3cc0a7acd9fe None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:47:42.827719 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8ae225-5f7e-48ec-9f9d-3cc0a7acd9fe None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:47:42.828463 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8ae225-5f7e-48ec-9f9d-3cc0a7acd9fe None admin] RBAC: Adding query filter params (role.id=a9e42be86923434f8af52d3fc07fb4f7, scope.project.id=f18aabde2e1f4bebaec9fb09d1725a11, user.id=5cfa58ef86774ab7800bf91930bf6028) {{(pid=81593) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 17:47:42.828814 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8ae225-5f7e-48ec-9f9d-3cc0a7acd9fe None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:47:42.830355 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8ae225-5f7e-48ec-9f9d-3cc0a7acd9fe None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:47:42.837000 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 91/184] 10.222.0.25 () {56 vars in 1374 bytes} [Thu Sep 15 17:47:42 2022] GET /identity/v3/role_assignments?user.id=5cfa58ef86774ab7800bf91930bf6028&scope.project.id=f18aabde2e1f4bebaec9fb09d1725a11&role.id=a9e42be86923434f8af52d3fc07fb4f7 => generated 608 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 17:47:42.837767 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8ae225-5f7e-48ec-9f9d-3cc0a7acd9fe None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:47:42.899829 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 94/185] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Sep 15 17:47:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 15 17:47:42.901938 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51251696-8308-4beb-aeb5-0a26883f0586 None None] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:47:42.959713 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8ae225-5f7e-48ec-9f9d-3cc0a7acd9fe None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:47:42.996953 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:47:43.006535 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0a6a18-96d4-48b6-bafe-81a6a320fc72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:47:43.007156 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0a6a18-96d4-48b6-bafe-81a6a320fc72 None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:47:43.007437 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0a6a18-96d4-48b6-bafe-81a6a320fc72 None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:47:43.007708 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0a6a18-96d4-48b6-bafe-81a6a320fc72 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:47:43.037066 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:47:43.044997 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51251696-8308-4beb-aeb5-0a26883f0586 None None] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:47:43.084194 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34cb30fc-3338-4cee-8da6-3d51fab0984b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:47:43.085010 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cb30fc-3338-4cee-8da6-3d51fab0984b None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:47:43.085465 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cb30fc-3338-4cee-8da6-3d51fab0984b None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:47:43.085846 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cb30fc-3338-4cee-8da6-3d51fab0984b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:47:43.098574 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34cb30fc-3338-4cee-8da6-3d51fab0984b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 17:47:43.107703 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb0a6a18-96d4-48b6-bafe-81a6a320fc72 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:47:43.109603 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb0a6a18-96d4-48b6-bafe-81a6a320fc72 None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:47:43.110074 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application [None req-34cb30fc-3338-4cee-8da6-3d51fab0984b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 15 17:47:43.110074 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 17:47:43.110074 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 17:47:43.110074 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 17:47:43.110074 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 17:47:43.110074 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 17:47:43.110074 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 17:47:43.110074 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 17:47:43.110074 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 17:47:43.110074 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 17:47:43.110074 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 17:47:43.110074 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 17:47:43.110074 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 17:47:43.110074 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 17:47:43.110074 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 17:47:43.110074 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 17:47:43.110950 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 17:47:43.110950 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 17:47:43.110950 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 17:47:43.110950 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 17:47:43.110950 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 17:47:43.110950 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 17:47:43.110950 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 17:47:43.110950 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 17:47:43.110950 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 17:47:43.110950 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 17:47:43.110950 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 17:47:43.110950 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application with Lock( Sep 15 17:47:43.110950 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 17:47:43.110950 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._enter() Sep 15 17:47:43.110950 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 17:47:43.110950 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 17:47:43.112142 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 17:47:43.112142 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.creator() Sep 15 17:47:43.112142 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 17:47:43.112142 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application created_value = creator( Sep 15 17:47:43.112142 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 17:47:43.112142 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 17:47:43.112142 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 17:47:43.112142 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 17:47:43.112142 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 17:47:43.112142 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 17:47:43.112142 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 15 17:47:43.112142 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Sep 15 17:47:43.112142 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 95/186] 10.222.0.25 () {56 vars in 1096 bytes} [Thu Sep 15 17:47:42 2022] GET /identity/v3/roles/admin => generated 83 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 17:47:43.112787 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34cb30fc-3338-4cee-8da6-3d51fab0984b None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:47:43.248170 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 92/187] 10.222.0.25 () {58 vars in 1282 bytes} [Thu Sep 15 17:47:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 411 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 15 17:47:43.250212 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34cb30fc-3338-4cee-8da6-3d51fab0984b None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:47:43.251387 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0a6a18-96d4-48b6-bafe-81a6a320fc72 None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:47:43.278413 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:47:43.288956 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4951fe-1862-4127-b974-c92f1de2df1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:47:43.289629 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4951fe-1862-4127-b974-c92f1de2df1b None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:47:43.289905 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4951fe-1862-4127-b974-c92f1de2df1b None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:47:43.290174 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4951fe-1862-4127-b974-c92f1de2df1b None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:47:43.302816 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d4951fe-1862-4127-b974-c92f1de2df1b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 17:47:43.308026 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:47:43.309217 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application [None req-4d4951fe-1862-4127-b974-c92f1de2df1b None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 15 17:47:43.309217 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 17:47:43.309217 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 17:47:43.309217 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 17:47:43.309217 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 17:47:43.309217 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 17:47:43.309217 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 17:47:43.309217 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 17:47:43.309217 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 17:47:43.309217 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 17:47:43.309217 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 17:47:43.309217 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 17:47:43.309217 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 17:47:43.309217 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 17:47:43.309217 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 17:47:43.309217 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 17:47:43.310274 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 17:47:43.310274 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 17:47:43.310274 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 17:47:43.310274 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 17:47:43.310274 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 17:47:43.310274 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 17:47:43.310274 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 17:47:43.310274 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 17:47:43.310274 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 17:47:43.310274 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 17:47:43.310274 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 17:47:43.310274 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application with Lock( Sep 15 17:47:43.310274 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 17:47:43.310274 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._enter() Sep 15 17:47:43.310274 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 17:47:43.310274 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 17:47:43.311163 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 17:47:43.311163 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.creator() Sep 15 17:47:43.311163 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 17:47:43.311163 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application created_value = creator( Sep 15 17:47:43.311163 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 17:47:43.311163 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 17:47:43.311163 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 17:47:43.311163 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 17:47:43.311163 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 17:47:43.311163 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 17:47:43.311163 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 15 17:47:43.311163 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Sep 15 17:47:43.311163 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 96/188] 10.222.0.25 () {56 vars in 1099 bytes} [Thu Sep 15 17:47:43 2022] GET /identity/v3/roles/reader => generated 84 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 17:47:43.311947 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4951fe-1862-4127-b974-c92f1de2df1b None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:47:43.368552 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0a6a18-96d4-48b6-bafe-81a6a320fc72 None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:47:43.402827 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca32d0d-c781-49a2-b394-5c24509236ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:47:43.403461 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca32d0d-c781-49a2-b394-5c24509236ff None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:47:43.403739 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca32d0d-c781-49a2-b394-5c24509236ff None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:47:43.404017 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca32d0d-c781-49a2-b394-5c24509236ff None admin] PATH_INFO: `/v3/roles` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:47:43.404680 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca32d0d-c781-49a2-b394-5c24509236ff None admin] RBAC: Adding query filter params (name=admin) {{(pid=81593) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 17:47:43.404982 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca32d0d-c781-49a2-b394-5c24509236ff None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:47:43.406409 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca32d0d-c781-49a2-b394-5c24509236ff None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:47:43.413641 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4951fe-1862-4127-b974-c92f1de2df1b None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:47:43.414555 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 93/189] 10.222.0.25 () {56 vars in 1099 bytes} [Thu Sep 15 17:47:43 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 17:47:43.415360 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca32d0d-c781-49a2-b394-5c24509236ff None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:47:43.449754 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a51fe32-cce8-4e8c-883b-cf8b9ee55ee2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:47:43.450390 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a51fe32-cce8-4e8c-883b-cf8b9ee55ee2 None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:47:43.450666 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a51fe32-cce8-4e8c-883b-cf8b9ee55ee2 None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:47:43.450940 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a51fe32-cce8-4e8c-883b-cf8b9ee55ee2 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:47:43.461705 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a51fe32-cce8-4e8c-883b-cf8b9ee55ee2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 17:47:43.466734 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application [None req-2a51fe32-cce8-4e8c-883b-cf8b9ee55ee2 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 15 17:47:43.466734 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 17:47:43.466734 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 17:47:43.466734 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 17:47:43.466734 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 17:47:43.466734 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 17:47:43.466734 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 17:47:43.466734 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 17:47:43.466734 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 17:47:43.466734 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 17:47:43.466734 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 17:47:43.466734 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 17:47:43.466734 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 17:47:43.466734 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 17:47:43.466734 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 17:47:43.466734 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 17:47:43.467800 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 17:47:43.467800 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 17:47:43.467800 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 17:47:43.467800 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 17:47:43.467800 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 17:47:43.467800 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 17:47:43.467800 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 17:47:43.467800 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 17:47:43.467800 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 17:47:43.467800 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 17:47:43.467800 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 17:47:43.467800 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application with Lock( Sep 15 17:47:43.467800 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 17:47:43.467800 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._enter() Sep 15 17:47:43.467800 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 17:47:43.467800 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 17:47:43.468596 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 17:47:43.468596 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.creator() Sep 15 17:47:43.468596 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 17:47:43.468596 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application created_value = creator( Sep 15 17:47:43.468596 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 17:47:43.468596 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 17:47:43.468596 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 17:47:43.468596 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 17:47:43.468596 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 17:47:43.468596 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 17:47:43.468596 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 15 17:47:43.468596 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Sep 15 17:47:43.468596 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 97/190] 10.222.0.25 () {56 vars in 1114 bytes} [Thu Sep 15 17:47:43 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 17:47:43.469251 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a51fe32-cce8-4e8c-883b-cf8b9ee55ee2 None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:47:43.515118 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:47:43.518329 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca32d0d-c781-49a2-b394-5c24509236ff None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:47:43.528661 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:47:43.553946 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab5c686-d0c0-4bc2-92be-cd6f1c9d5f28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:47:43.554583 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab5c686-d0c0-4bc2-92be-cd6f1c9d5f28 None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:47:43.554864 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab5c686-d0c0-4bc2-92be-cd6f1c9d5f28 None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:47:43.555134 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab5c686-d0c0-4bc2-92be-cd6f1c9d5f28 None admin] PATH_INFO: `/v3/projects/21144bc65efd46cc9d858227221c68e9` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:47:43.556259 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab5c686-d0c0-4bc2-92be-cd6f1c9d5f28 None admin] RBAC: Authorizing `identity:get_project(project_id=21144bc65efd46cc9d858227221c68e9)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:47:43.557751 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab5c686-d0c0-4bc2-92be-cd6f1c9d5f28 None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:47:43.559386 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 94/191] 10.222.0.25 () {56 vars in 1186 bytes} [Thu Sep 15 17:47:43 2022] GET /identity/v3/projects/21144bc65efd46cc9d858227221c68e9 => generated 312 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 17:47:43.560153 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab5c686-d0c0-4bc2-92be-cd6f1c9d5f28 None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:47:43.572179 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a51fe32-cce8-4e8c-883b-cf8b9ee55ee2 None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:47:43.605111 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d328ea0-3e25-406f-8b56-3bd833039830 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:47:43.606017 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d328ea0-3e25-406f-8b56-3bd833039830 None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:47:43.606291 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d328ea0-3e25-406f-8b56-3bd833039830 None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:47:43.606559 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d328ea0-3e25-406f-8b56-3bd833039830 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:47:43.607672 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d328ea0-3e25-406f-8b56-3bd833039830 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:47:43.609109 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d328ea0-3e25-406f-8b56-3bd833039830 None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:47:43.610716 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 98/192] 10.222.0.25 () {56 vars in 1108 bytes} [Thu Sep 15 17:47:43 2022] GET /identity/v3/domains/default => generated 199 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 17:47:43.614268 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d328ea0-3e25-406f-8b56-3bd833039830 None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:47:43.659552 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab5c686-d0c0-4bc2-92be-cd6f1c9d5f28 None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:47:43.693799 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd01ae0-9244-4b28-94ed-8c2177b1e994 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:47:43.694411 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd01ae0-9244-4b28-94ed-8c2177b1e994 None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:47:43.694689 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd01ae0-9244-4b28-94ed-8c2177b1e994 None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:47:43.694962 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd01ae0-9244-4b28-94ed-8c2177b1e994 None admin] PATH_INFO: `/v3/roles` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:47:43.695629 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd01ae0-9244-4b28-94ed-8c2177b1e994 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81593) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 17:47:43.695928 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd01ae0-9244-4b28-94ed-8c2177b1e994 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:47:43.697398 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd01ae0-9244-4b28-94ed-8c2177b1e994 None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:47:43.705569 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 95/193] 10.222.0.25 () {56 vars in 1101 bytes} [Thu Sep 15 17:47:43 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 17:47:43.706388 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd01ae0-9244-4b28-94ed-8c2177b1e994 None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:47:43.715887 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d328ea0-3e25-406f-8b56-3bd833039830 None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:47:43.729523 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:47:43.748645 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:47:43.751487 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a98ee7-e49d-4db9-b924-0136943ec96d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:47:43.752128 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a98ee7-e49d-4db9-b924-0136943ec96d None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:47:43.752410 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a98ee7-e49d-4db9-b924-0136943ec96d None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:47:43.752685 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a98ee7-e49d-4db9-b924-0136943ec96d None admin] PATH_INFO: `/v3/users/a303232e7f114a67988a8375149b82f2` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:47:43.766605 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a98ee7-e49d-4db9-b924-0136943ec96d None admin] RBAC: Authorizing `identity:get_user(user_id=a303232e7f114a67988a8375149b82f2)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:47:43.767988 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a98ee7-e49d-4db9-b924-0136943ec96d None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:47:43.769653 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 99/194] 10.222.0.25 () {56 vars in 1177 bytes} [Thu Sep 15 17:47:43 2022] GET /identity/v3/users/a303232e7f114a67988a8375149b82f2 => generated 283 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 17:47:43.770961 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a98ee7-e49d-4db9-b924-0136943ec96d None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:47:43.809588 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd01ae0-9244-4b28-94ed-8c2177b1e994 None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:47:43.844500 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899f36af-7bbc-465c-bc18-dcaef68c4272 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:47:43.845111 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899f36af-7bbc-465c-bc18-dcaef68c4272 None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:47:43.845422 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899f36af-7bbc-465c-bc18-dcaef68c4272 None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:47:43.845698 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899f36af-7bbc-465c-bc18-dcaef68c4272 None admin] PATH_INFO: `/v3/roles` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:47:43.846439 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-899f36af-7bbc-465c-bc18-dcaef68c4272 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81593) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 17:47:43.846748 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-899f36af-7bbc-465c-bc18-dcaef68c4272 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:47:43.848139 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-899f36af-7bbc-465c-bc18-dcaef68c4272 None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:47:43.858436 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 96/195] 10.222.0.25 () {56 vars in 1111 bytes} [Thu Sep 15 17:47:43 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 17:47:43.860109 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899f36af-7bbc-465c-bc18-dcaef68c4272 None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:47:43.874466 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a98ee7-e49d-4db9-b924-0136943ec96d None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:47:43.907994 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9453cc97-1fd6-4c98-b4d8-c41db511561a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:47:43.908700 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9453cc97-1fd6-4c98-b4d8-c41db511561a None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:47:43.908870 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9453cc97-1fd6-4c98-b4d8-c41db511561a None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:47:43.909142 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9453cc97-1fd6-4c98-b4d8-c41db511561a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:47:43.909912 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9453cc97-1fd6-4c98-b4d8-c41db511561a None admin] RBAC: Adding query filter params (role.id=343cc8b1bc7243eebabdf08147e8366d, scope.project.id=21144bc65efd46cc9d858227221c68e9, user.id=823825bfaf1b44a7ba5999ca5e7b26ce) {{(pid=81592) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 17:47:43.910221 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9453cc97-1fd6-4c98-b4d8-c41db511561a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:47:43.912222 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9453cc97-1fd6-4c98-b4d8-c41db511561a None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:47:43.919408 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 100/196] 10.222.0.25 () {56 vars in 1374 bytes} [Thu Sep 15 17:47:43 2022] GET /identity/v3/role_assignments?user.id=823825bfaf1b44a7ba5999ca5e7b26ce&scope.project.id=21144bc65efd46cc9d858227221c68e9&role.id=343cc8b1bc7243eebabdf08147e8366d => generated 608 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 17:47:43.920359 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9453cc97-1fd6-4c98-b4d8-c41db511561a None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:47:43.960427 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:47:44.005962 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899f36af-7bbc-465c-bc18-dcaef68c4272 None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:47:44.007920 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:47:44.046144 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9453cc97-1fd6-4c98-b4d8-c41db511561a None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:47:44.047900 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8b6d89-ad39-47b1-9543-c24157d46161 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:47:44.048537 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8b6d89-ad39-47b1-9543-c24157d46161 None admin] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:47:44.048811 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8b6d89-ad39-47b1-9543-c24157d46161 None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:47:44.049076 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8b6d89-ad39-47b1-9543-c24157d46161 None admin] PATH_INFO: `/v3/users` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:47:44.049784 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8b6d89-ad39-47b1-9543-c24157d46161 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:47:44.051257 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8b6d89-ad39-47b1-9543-c24157d46161 None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:47:44.076811 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 97/197] 10.222.0.25 () {60 vars in 1132 bytes} [Thu Sep 15 17:47:43 2022] POST /identity/v3/users => generated 297 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 17:47:44.077721 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8b6d89-ad39-47b1-9543-c24157d46161 None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:47:44.102814 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40e6c80-cf50-4544-a213-f452d17ee5ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:47:44.104409 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40e6c80-cf50-4544-a213-f452d17ee5ad None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:47:44.104967 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40e6c80-cf50-4544-a213-f452d17ee5ad None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:47:44.105705 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40e6c80-cf50-4544-a213-f452d17ee5ad None admin] PATH_INFO: `/v3/users/c881452b85fd43edbbe822cb34592782` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:47:44.108168 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c40e6c80-cf50-4544-a213-f452d17ee5ad None admin] RBAC: Authorizing `identity:get_user(user_id=c881452b85fd43edbbe822cb34592782)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:47:44.109791 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c40e6c80-cf50-4544-a213-f452d17ee5ad None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:47:44.111561 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 101/198] 10.222.0.25 () {56 vars in 1177 bytes} [Thu Sep 15 17:47:43 2022] GET /identity/v3/users/c881452b85fd43edbbe822cb34592782 => generated 289 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 17:47:44.112376 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40e6c80-cf50-4544-a213-f452d17ee5ad None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:47:44.232411 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8b6d89-ad39-47b1-9543-c24157d46161 None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:47:44.252383 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40e6c80-cf50-4544-a213-f452d17ee5ad None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:47:44.254098 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:47:44.286602 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf712952-6a9b-4a9d-9404-d68ad1a194e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:47:44.288223 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf712952-6a9b-4a9d-9404-d68ad1a194e4 None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:47:44.288223 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf712952-6a9b-4a9d-9404-d68ad1a194e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:47:44.288223 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf712952-6a9b-4a9d-9404-d68ad1a194e4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:47:44.305384 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766f0f64-4060-4354-960c-2aa7bfe89fdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:47:44.306500 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766f0f64-4060-4354-960c-2aa7bfe89fdc None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:47:44.306783 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766f0f64-4060-4354-960c-2aa7bfe89fdc None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:47:44.307186 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766f0f64-4060-4354-960c-2aa7bfe89fdc None admin] PATH_INFO: `/v3/users/a303232e7f114a67988a8375149b82f2` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:47:44.308747 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-766f0f64-4060-4354-960c-2aa7bfe89fdc None admin] RBAC: Authorizing `identity:get_user(user_id=a303232e7f114a67988a8375149b82f2)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:47:44.310184 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-766f0f64-4060-4354-960c-2aa7bfe89fdc None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:47:44.311993 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 102/199] 10.222.0.25 () {56 vars in 1177 bytes} [Thu Sep 15 17:47:44 2022] GET /identity/v3/users/a303232e7f114a67988a8375149b82f2 => generated 283 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 17:47:44.312745 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766f0f64-4060-4354-960c-2aa7bfe89fdc None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:47:44.328216 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:47:44.378814 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf712952-6a9b-4a9d-9404-d68ad1a194e4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:47:44.380854 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf712952-6a9b-4a9d-9404-d68ad1a194e4 None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:47:44.434928 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766f0f64-4060-4354-960c-2aa7bfe89fdc None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:47:44.476270 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654ed553-e7ef-4de6-9ea2-ae10c1be20e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:47:44.477424 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654ed553-e7ef-4de6-9ea2-ae10c1be20e2 None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:47:44.477714 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654ed553-e7ef-4de6-9ea2-ae10c1be20e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:47:44.477990 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654ed553-e7ef-4de6-9ea2-ae10c1be20e2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:47:44.507440 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 98/200] 10.222.0.25 () {58 vars in 1282 bytes} [Thu Sep 15 17:47:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 430 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 15 17:47:44.508380 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf712952-6a9b-4a9d-9404-d68ad1a194e4 None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:47:44.528482 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:47:44.563850 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-654ed553-e7ef-4de6-9ea2-ae10c1be20e2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:47:44.565768 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-654ed553-e7ef-4de6-9ea2-ae10c1be20e2 None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:47:44.570704 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:47:44.627415 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf712952-6a9b-4a9d-9404-d68ad1a194e4 None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:47:44.671053 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabc5f83-9135-4bff-9b7f-807aea5c30f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:47:44.671740 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabc5f83-9135-4bff-9b7f-807aea5c30f7 None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:47:44.672360 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabc5f83-9135-4bff-9b7f-807aea5c30f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:47:44.672360 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabc5f83-9135-4bff-9b7f-807aea5c30f7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:47:44.698873 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 103/201] 10.222.0.25 () {58 vars in 1282 bytes} [Thu Sep 15 17:47:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 386 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 15 17:47:44.700156 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654ed553-e7ef-4de6-9ea2-ae10c1be20e2 None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:47:44.758563 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eabc5f83-9135-4bff-9b7f-807aea5c30f7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:47:44.760173 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eabc5f83-9135-4bff-9b7f-807aea5c30f7 None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:47:44.793751 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:47:44.828956 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:47:44.836396 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654ed553-e7ef-4de6-9ea2-ae10c1be20e2 None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:47:44.880159 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509b1ec7-95c7-45ed-a147-08ed1187a6b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:47:44.880792 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509b1ec7-95c7-45ed-a147-08ed1187a6b1 None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:47:44.881070 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509b1ec7-95c7-45ed-a147-08ed1187a6b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:47:44.881367 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509b1ec7-95c7-45ed-a147-08ed1187a6b1 None admin] PATH_INFO: `/v3/projects/db66614609564cbf9e5fb3c7e35442d4` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:47:44.882727 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-509b1ec7-95c7-45ed-a147-08ed1187a6b1 None admin] RBAC: Authorizing `identity:get_project(project_id=db66614609564cbf9e5fb3c7e35442d4)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:47:44.884173 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-509b1ec7-95c7-45ed-a147-08ed1187a6b1 None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:47:44.886596 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 99/202] 10.222.0.25 () {58 vars in 1282 bytes} [Thu Sep 15 17:47:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 15 17:47:44.887739 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabc5f83-9135-4bff-9b7f-807aea5c30f7 None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:47:44.891165 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 104/203] 10.222.0.25 () {56 vars in 1186 bytes} [Thu Sep 15 17:47:44 2022] GET /identity/v3/projects/db66614609564cbf9e5fb3c7e35442d4 => generated 302 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 17:47:44.893041 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509b1ec7-95c7-45ed-a147-08ed1187a6b1 None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:47:45.012924 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabc5f83-9135-4bff-9b7f-807aea5c30f7 None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:47:45.030515 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509b1ec7-95c7-45ed-a147-08ed1187a6b1 None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:47:45.056030 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3d8589-1258-454d-966c-1ae2eb7c1849 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:47:45.056686 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3d8589-1258-454d-966c-1ae2eb7c1849 None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:47:45.056969 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3d8589-1258-454d-966c-1ae2eb7c1849 None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:47:45.057243 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3d8589-1258-454d-966c-1ae2eb7c1849 None admin] PATH_INFO: `/v3/projects/f18aabde2e1f4bebaec9fb09d1725a11` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:47:45.058708 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da3d8589-1258-454d-966c-1ae2eb7c1849 None admin] RBAC: Authorizing `identity:get_project(project_id=f18aabde2e1f4bebaec9fb09d1725a11)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:47:45.060956 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da3d8589-1258-454d-966c-1ae2eb7c1849 None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:47:45.063401 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 100/204] 10.222.0.25 () {56 vars in 1186 bytes} [Thu Sep 15 17:47:44 2022] GET /identity/v3/projects/f18aabde2e1f4bebaec9fb09d1725a11 => generated 298 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 17:47:45.064556 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3d8589-1258-454d-966c-1ae2eb7c1849 None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:47:45.072300 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7c183b-bc05-4102-b503-79c807bb5847 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:47:45.073474 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7c183b-bc05-4102-b503-79c807bb5847 None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:47:45.073956 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7c183b-bc05-4102-b503-79c807bb5847 None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:47:45.074445 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7c183b-bc05-4102-b503-79c807bb5847 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:47:45.075443 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7c183b-bc05-4102-b503-79c807bb5847 None admin] RBAC: Adding query filter params (role.id=a9e42be86923434f8af52d3fc07fb4f7, scope.project.id=db66614609564cbf9e5fb3c7e35442d4, user.id=a303232e7f114a67988a8375149b82f2) {{(pid=81592) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 17:47:45.076008 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7c183b-bc05-4102-b503-79c807bb5847 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:47:45.077813 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7c183b-bc05-4102-b503-79c807bb5847 None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:47:45.084772 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 105/205] 10.222.0.25 () {56 vars in 1374 bytes} [Thu Sep 15 17:47:44 2022] GET /identity/v3/role_assignments?user.id=a303232e7f114a67988a8375149b82f2&scope.project.id=db66614609564cbf9e5fb3c7e35442d4&role.id=a9e42be86923434f8af52d3fc07fb4f7 => generated 259 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 17:47:45.086077 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7c183b-bc05-4102-b503-79c807bb5847 None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:47:45.089552 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:47:45.098947 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:47:45.196584 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3d8589-1258-454d-966c-1ae2eb7c1849 None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:47:45.240991 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0ebc53-706a-4e7e-bcba-969303e83ccb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:47:45.242145 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0ebc53-706a-4e7e-bcba-969303e83ccb None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:47:45.242629 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0ebc53-706a-4e7e-bcba-969303e83ccb None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:47:45.243890 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0ebc53-706a-4e7e-bcba-969303e83ccb None admin] PATH_INFO: `/v3/projects/db66614609564cbf9e5fb3c7e35442d4` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:47:45.245643 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0ebc53-706a-4e7e-bcba-969303e83ccb None admin] RBAC: Authorizing `identity:get_project(project_id=db66614609564cbf9e5fb3c7e35442d4)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:47:45.247670 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0ebc53-706a-4e7e-bcba-969303e83ccb None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:47:45.249896 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 101/206] 10.222.0.25 () {56 vars in 1186 bytes} [Thu Sep 15 17:47:45 2022] GET /identity/v3/projects/db66614609564cbf9e5fb3c7e35442d4 => generated 302 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 17:47:45.256646 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0ebc53-706a-4e7e-bcba-969303e83ccb None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:47:45.332418 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7c183b-bc05-4102-b503-79c807bb5847 None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:47:45.376942 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4323eb5-ffbc-420f-82a5-eb3311015ef0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:47:45.377566 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4323eb5-ffbc-420f-82a5-eb3311015ef0 None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:47:45.377843 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4323eb5-ffbc-420f-82a5-eb3311015ef0 None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:47:45.378114 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4323eb5-ffbc-420f-82a5-eb3311015ef0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:47:45.378849 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4323eb5-ffbc-420f-82a5-eb3311015ef0 None admin] RBAC: Adding query filter params (role.id=80bb25250ed34dd9a6ed0740bcc3dac6, scope.project.id=f18aabde2e1f4bebaec9fb09d1725a11, user.id=c881452b85fd43edbbe822cb34592782) {{(pid=81592) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 17:47:45.379151 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4323eb5-ffbc-420f-82a5-eb3311015ef0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:47:45.380679 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4323eb5-ffbc-420f-82a5-eb3311015ef0 None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:47:45.387332 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 106/207] 10.222.0.25 () {56 vars in 1374 bytes} [Thu Sep 15 17:47:45 2022] GET /identity/v3/role_assignments?user.id=c881452b85fd43edbbe822cb34592782&scope.project.id=f18aabde2e1f4bebaec9fb09d1725a11&role.id=80bb25250ed34dd9a6ed0740bcc3dac6 => generated 608 bytes in 302 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 17:47:45.449075 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:47:45.457497 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0ebc53-706a-4e7e-bcba-969303e83ccb None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:47:45.518507 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a9f082-ec88-4d5d-b4a3-c3d41a618ffd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:47:45.519145 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a9f082-ec88-4d5d-b4a3-c3d41a618ffd None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:47:45.519430 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a9f082-ec88-4d5d-b4a3-c3d41a618ffd None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:47:45.519706 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a9f082-ec88-4d5d-b4a3-c3d41a618ffd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:47:45.520994 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a9f082-ec88-4d5d-b4a3-c3d41a618ffd None admin] RBAC: Adding query filter params (role.id=0dd1b9f5b7924e20a665ce50d6e34dc7, scope.project.id=db66614609564cbf9e5fb3c7e35442d4, user.id=a303232e7f114a67988a8375149b82f2) {{(pid=81593) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 17:47:45.521322 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a9f082-ec88-4d5d-b4a3-c3d41a618ffd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:47:45.522931 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a9f082-ec88-4d5d-b4a3-c3d41a618ffd None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:47:45.534305 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 102/208] 10.222.0.25 () {56 vars in 1374 bytes} [Thu Sep 15 17:47:45 2022] GET /identity/v3/role_assignments?user.id=a303232e7f114a67988a8375149b82f2&scope.project.id=db66614609564cbf9e5fb3c7e35442d4&role.id=0dd1b9f5b7924e20a665ce50d6e34dc7 => generated 259 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 17:47:46.612543 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b4fe33-c91f-45c5-83e5-b77dbf5917b2 None None] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:47:46.612543 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b4fe33-c91f-45c5-83e5-b77dbf5917b2 None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:47:46.612543 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b4fe33-c91f-45c5-83e5-b77dbf5917b2 None None] PATH_INFO: `/` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:47:46.612543 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 107/209] 10.222.0.25 () {54 vars in 927 bytes} [Thu Sep 15 17:47:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 17:47:46.620352 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c127ef9b-ea8c-48dd-9454-189c13972955 None None] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:47:46.621036 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c127ef9b-ea8c-48dd-9454-189c13972955 None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:47:46.621036 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c127ef9b-ea8c-48dd-9454-189c13972955 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:47:46.642617 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.auth.core [None req-c127ef9b-ea8c-48dd-9454-189c13972955 None None] MFA Rules not processed for user `5cfa58ef86774ab7800bf91930bf6028`. Rule list: `[]` (Enabled: `True`). {{(pid=81593) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 17:47:46.643482 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636b0acb-c0d2-4f6d-8939-fe7e46552ee0 None None] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:47:46.643785 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636b0acb-c0d2-4f6d-8939-fe7e46552ee0 None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:47:46.644064 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636b0acb-c0d2-4f6d-8939-fe7e46552ee0 None None] PATH_INFO: `/` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:47:46.644783 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-c127ef9b-ea8c-48dd-9454-189c13972955 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 17:47:46.646258 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 108/210] 10.222.0.25 () {54 vars in 927 bytes} [Thu Sep 15 17:47:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 17:47:46.651371 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e55bfeb-ffd3-4315-962a-4ceae2068137 None None] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:47:46.651662 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e55bfeb-ffd3-4315-962a-4ceae2068137 None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:47:46.651933 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e55bfeb-ffd3-4315-962a-4ceae2068137 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:47:46.671382 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.auth.core [None req-5e55bfeb-ffd3-4315-962a-4ceae2068137 None None] MFA Rules not processed for user `5cfa58ef86774ab7800bf91930bf6028`. Rule list: `[]` (Enabled: `True`). {{(pid=81592) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 17:47:46.672733 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-5e55bfeb-ffd3-4315-962a-4ceae2068137 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 17:47:46.722116 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 103/211] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Sep 15 17:47:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 15 17:47:46.750308 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:47:46.760221 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 109/212] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Sep 15 17:47:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 15 17:47:46.995153 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c127ef9b-ea8c-48dd-9454-189c13972955 None None] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:47:47.050703 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e55bfeb-ffd3-4315-962a-4ceae2068137 None None] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:47:47.113061 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:47:47.134816 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c127ef9b-ea8c-48dd-9454-189c13972955 None None] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:47:47.173178 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de04b6f7-73f7-40b9-880b-07e3baae7e8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:47:47.174230 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de04b6f7-73f7-40b9-880b-07e3baae7e8d None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:47:47.174708 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de04b6f7-73f7-40b9-880b-07e3baae7e8d None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:47:47.175179 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de04b6f7-73f7-40b9-880b-07e3baae7e8d None admin] PATH_INFO: `/v3/domains/default` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:47:47.176542 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de04b6f7-73f7-40b9-880b-07e3baae7e8d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:47:47.177872 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e55bfeb-ffd3-4315-962a-4ceae2068137 None None] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:47:47.178549 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de04b6f7-73f7-40b9-880b-07e3baae7e8d None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:47:47.185044 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 104/213] 10.222.0.25 () {56 vars in 1108 bytes} [Thu Sep 15 17:47:46 2022] GET /identity/v3/domains/default => generated 199 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 17:47:47.186252 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de04b6f7-73f7-40b9-880b-07e3baae7e8d None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:47:47.224176 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f714a5-adb4-4e3e-b95f-bc4a2c133088 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:47:47.224827 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f714a5-adb4-4e3e-b95f-bc4a2c133088 None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:47:47.225106 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f714a5-adb4-4e3e-b95f-bc4a2c133088 None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:47:47.225402 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f714a5-adb4-4e3e-b95f-bc4a2c133088 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:47:47.239096 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f714a5-adb4-4e3e-b95f-bc4a2c133088 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 17:47:47.245286 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application [None req-02f714a5-adb4-4e3e-b95f-bc4a2c133088 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 15 17:47:47.245286 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 17:47:47.245286 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 17:47:47.245286 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 17:47:47.245286 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 17:47:47.245286 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 17:47:47.245286 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 17:47:47.245286 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 17:47:47.245286 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 17:47:47.245286 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 17:47:47.245286 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 17:47:47.245286 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 17:47:47.245286 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 17:47:47.245286 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 17:47:47.245286 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 17:47:47.245286 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 17:47:47.246209 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 17:47:47.246209 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 17:47:47.246209 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 17:47:47.246209 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 17:47:47.246209 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 17:47:47.246209 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 17:47:47.246209 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 17:47:47.246209 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 17:47:47.246209 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 17:47:47.246209 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 17:47:47.246209 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 17:47:47.246209 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application with Lock( Sep 15 17:47:47.246209 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 17:47:47.246209 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._enter() Sep 15 17:47:47.246209 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 17:47:47.246209 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 17:47:47.247005 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 17:47:47.247005 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.creator() Sep 15 17:47:47.247005 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 17:47:47.247005 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application created_value = creator( Sep 15 17:47:47.247005 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 17:47:47.247005 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 17:47:47.247005 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 17:47:47.247005 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 17:47:47.247005 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 17:47:47.247005 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 17:47:47.247005 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 15 17:47:47.247005 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Sep 15 17:47:47.247005 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 110/214] 10.222.0.25 () {56 vars in 1099 bytes} [Thu Sep 15 17:47:47 2022] GET /identity/v3/roles/member => generated 84 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 15 17:47:47.254183 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f714a5-adb4-4e3e-b95f-bc4a2c133088 None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:47:47.327358 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de04b6f7-73f7-40b9-880b-07e3baae7e8d None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:47:47.335328 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:47:47.370368 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef68aa9-12f6-4f10-94bc-37e268a1de94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:47:47.371375 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef68aa9-12f6-4f10-94bc-37e268a1de94 None admin] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:47:47.371866 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef68aa9-12f6-4f10-94bc-37e268a1de94 None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:47:47.372338 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef68aa9-12f6-4f10-94bc-37e268a1de94 None admin] PATH_INFO: `/v3/users` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:47:47.373502 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef68aa9-12f6-4f10-94bc-37e268a1de94 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:47:47.375265 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef68aa9-12f6-4f10-94bc-37e268a1de94 None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:47:47.402716 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 105/215] 10.222.0.25 () {60 vars in 1132 bytes} [Thu Sep 15 17:47:47 2022] POST /identity/v3/users => generated 297 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 17:47:47.414157 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f714a5-adb4-4e3e-b95f-bc4a2c133088 None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:47:47.442654 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52428d60-92ff-494f-b496-7f3d5478a7a1 None None] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:47:47.442948 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52428d60-92ff-494f-b496-7f3d5478a7a1 None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:47:47.443204 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52428d60-92ff-494f-b496-7f3d5478a7a1 None None] PATH_INFO: `/` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:47:47.444969 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 106/216] 10.222.0.25 () {54 vars in 927 bytes} [Thu Sep 15 17:47:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 17:47:47.450265 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703bf501-c5ae-4f7b-9a6d-395980cb1cf1 None None] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:47:47.450541 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703bf501-c5ae-4f7b-9a6d-395980cb1cf1 None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:47:47.450813 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703bf501-c5ae-4f7b-9a6d-395980cb1cf1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:47:47.459238 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1fa9d4-7dff-4630-8996-dd420506806e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:47:47.459856 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1fa9d4-7dff-4630-8996-dd420506806e None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:47:47.460139 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1fa9d4-7dff-4630-8996-dd420506806e None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:47:47.460412 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1fa9d4-7dff-4630-8996-dd420506806e None admin] PATH_INFO: `/v3/roles` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:47:47.461091 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1fa9d4-7dff-4630-8996-dd420506806e None admin] RBAC: Adding query filter params (name=member) {{(pid=81592) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 17:47:47.461443 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1fa9d4-7dff-4630-8996-dd420506806e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:47:47.462839 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1fa9d4-7dff-4630-8996-dd420506806e None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:47:47.472173 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 111/217] 10.222.0.25 () {56 vars in 1101 bytes} [Thu Sep 15 17:47:47 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 17:47:47.472856 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.auth.core [None req-703bf501-c5ae-4f7b-9a6d-395980cb1cf1 None None] MFA Rules not processed for user `5cfa58ef86774ab7800bf91930bf6028`. Rule list: `[]` (Enabled: `True`). {{(pid=81593) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 17:47:47.474488 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-703bf501-c5ae-4f7b-9a6d-395980cb1cf1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 17:47:47.479008 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1fa9d4-7dff-4630-8996-dd420506806e None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:47:47.484924 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:47:47.577466 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 107/218] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Sep 15 17:47:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 15 17:47:47.626909 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1fa9d4-7dff-4630-8996-dd420506806e None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:47:47.645370 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:47:47.664026 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c79323-a69b-4fe0-9da8-e32ac407c0b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:47:47.665078 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c79323-a69b-4fe0-9da8-e32ac407c0b3 None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:47:47.665613 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c79323-a69b-4fe0-9da8-e32ac407c0b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:47:47.666101 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c79323-a69b-4fe0-9da8-e32ac407c0b3 None admin] PATH_INFO: `/v3/users/ce95965c617a4cabbfe2e097fe3363f4` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:47:47.682797 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c79323-a69b-4fe0-9da8-e32ac407c0b3 None admin] RBAC: Authorizing `identity:get_user(user_id=ce95965c617a4cabbfe2e097fe3363f4)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:47:47.684246 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c79323-a69b-4fe0-9da8-e32ac407c0b3 None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:47:47.686001 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 112/219] 10.222.0.25 () {56 vars in 1177 bytes} [Thu Sep 15 17:47:47 2022] GET /identity/v3/users/ce95965c617a4cabbfe2e097fe3363f4 => generated 297 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 17:47:47.694067 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703bf501-c5ae-4f7b-9a6d-395980cb1cf1 None None] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:47:47.824536 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703bf501-c5ae-4f7b-9a6d-395980cb1cf1 None None] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:47:47.862059 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7e53a9-e1c6-442e-a9eb-41ee5bcaeeef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:47:47.862678 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7e53a9-e1c6-442e-a9eb-41ee5bcaeeef None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:47:47.862959 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7e53a9-e1c6-442e-a9eb-41ee5bcaeeef None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:47:47.863231 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7e53a9-e1c6-442e-a9eb-41ee5bcaeeef None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:47:47.864089 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b26fce-2984-42f5-bde6-9f5ed9b613c7 None None] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:47:47.864780 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b26fce-2984-42f5-bde6-9f5ed9b613c7 None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:47:47.865475 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b26fce-2984-42f5-bde6-9f5ed9b613c7 None None] PATH_INFO: `/` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:47:47.868031 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 113/220] 10.222.0.25 () {54 vars in 927 bytes} [Thu Sep 15 17:47:47 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 17:47:47.876278 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:47:47.878370 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6113ead1-8628-45f9-a328-a40cb7440068 None None] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:47:47.879074 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6113ead1-8628-45f9-a328-a40cb7440068 None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:47:47.880336 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6113ead1-8628-45f9-a328-a40cb7440068 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:47:47.914666 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.auth.core [None req-6113ead1-8628-45f9-a328-a40cb7440068 None None] MFA Rules not processed for user `5cfa58ef86774ab7800bf91930bf6028`. Rule list: `[]` (Enabled: `True`). {{(pid=81592) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 17:47:47.915948 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-6113ead1-8628-45f9-a328-a40cb7440068 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 17:47:47.953626 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7e53a9-e1c6-442e-a9eb-41ee5bcaeeef None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:47:47.955049 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7e53a9-e1c6-442e-a9eb-41ee5bcaeeef None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:47:48.010253 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 114/221] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Sep 15 17:47:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 15 17:47:48.011114 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6113ead1-8628-45f9-a328-a40cb7440068 None None] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:47:48.096017 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 108/222] 10.222.0.25 () {58 vars in 1282 bytes} [Thu Sep 15 17:47:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 402 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 15 17:47:48.113803 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7e53a9-e1c6-442e-a9eb-41ee5bcaeeef None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:47:48.140568 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6113ead1-8628-45f9-a328-a40cb7440068 None None] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:47:48.150518 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:47:48.197606 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07de5fe3-24a6-42c4-a326-b7efce5d1a24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:47:48.198517 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07de5fe3-24a6-42c4-a326-b7efce5d1a24 None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:47:48.198945 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07de5fe3-24a6-42c4-a326-b7efce5d1a24 None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:47:48.199349 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07de5fe3-24a6-42c4-a326-b7efce5d1a24 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:47:48.205580 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:47:48.217697 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07de5fe3-24a6-42c4-a326-b7efce5d1a24 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 17:47:48.227516 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application [None req-07de5fe3-24a6-42c4-a326-b7efce5d1a24 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 15 17:47:48.227516 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 17:47:48.227516 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 17:47:48.227516 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 17:47:48.227516 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 17:47:48.227516 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 17:47:48.227516 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 17:47:48.227516 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 17:47:48.227516 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 17:47:48.227516 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 17:47:48.227516 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 17:47:48.227516 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 17:47:48.227516 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 17:47:48.227516 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 17:47:48.227516 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 17:47:48.227516 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 17:47:48.228603 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 17:47:48.228603 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 17:47:48.228603 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 17:47:48.228603 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 17:47:48.228603 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 17:47:48.228603 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 17:47:48.228603 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 17:47:48.228603 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 17:47:48.228603 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 17:47:48.228603 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 17:47:48.228603 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 17:47:48.228603 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application with Lock( Sep 15 17:47:48.228603 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 17:47:48.228603 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._enter() Sep 15 17:47:48.228603 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 17:47:48.228603 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 17:47:48.229606 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 17:47:48.229606 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.creator() Sep 15 17:47:48.229606 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 17:47:48.229606 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application created_value = creator( Sep 15 17:47:48.229606 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 17:47:48.229606 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 17:47:48.229606 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 17:47:48.229606 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 17:47:48.229606 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 17:47:48.229606 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 17:47:48.229606 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 15 17:47:48.229606 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Sep 15 17:47:48.231654 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 115/223] 10.222.0.25 () {56 vars in 1096 bytes} [Thu Sep 15 17:47:48 2022] GET /identity/v3/roles/admin => generated 83 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 17:47:48.239427 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07de5fe3-24a6-42c4-a326-b7efce5d1a24 None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:47:48.320467 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7e53a9-e1c6-442e-a9eb-41ee5bcaeeef None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:47:48.365623 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c92a75e-7518-409a-9d12-9724a0aa9fa0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:47:48.366955 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c92a75e-7518-409a-9d12-9724a0aa9fa0 None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:47:48.367658 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c92a75e-7518-409a-9d12-9724a0aa9fa0 None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:47:48.368073 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c92a75e-7518-409a-9d12-9724a0aa9fa0 None admin] PATH_INFO: `/v3/projects/db66614609564cbf9e5fb3c7e35442d4` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:47:48.369723 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c92a75e-7518-409a-9d12-9724a0aa9fa0 None admin] RBAC: Authorizing `identity:get_project(project_id=db66614609564cbf9e5fb3c7e35442d4)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:47:48.371812 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c92a75e-7518-409a-9d12-9724a0aa9fa0 None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:47:48.373693 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 109/224] 10.222.0.25 () {56 vars in 1186 bytes} [Thu Sep 15 17:47:48 2022] GET /identity/v3/projects/db66614609564cbf9e5fb3c7e35442d4 => generated 302 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 17:47:48.374611 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c92a75e-7518-409a-9d12-9724a0aa9fa0 None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:47:48.399749 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07de5fe3-24a6-42c4-a326-b7efce5d1a24 None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:47:48.443218 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63bf5c0-d551-4d19-9873-bc355bac5c26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:47:48.444665 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63bf5c0-d551-4d19-9873-bc355bac5c26 None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:47:48.445421 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63bf5c0-d551-4d19-9873-bc355bac5c26 None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:47:48.445863 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63bf5c0-d551-4d19-9873-bc355bac5c26 None admin] PATH_INFO: `/v3/roles` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:47:48.446812 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b63bf5c0-d551-4d19-9873-bc355bac5c26 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81592) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 17:47:48.447374 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b63bf5c0-d551-4d19-9873-bc355bac5c26 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:47:48.448913 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b63bf5c0-d551-4d19-9873-bc355bac5c26 None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:47:48.461010 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 116/225] 10.222.0.25 () {56 vars in 1099 bytes} [Thu Sep 15 17:47:48 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 17:47:48.466979 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63bf5c0-d551-4d19-9873-bc355bac5c26 None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:47:48.493400 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c92a75e-7518-409a-9d12-9724a0aa9fa0 None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:47:48.504425 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:47:48.505996 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:47:48.533873 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178bef38-102c-4ec0-9614-7b6f7f5a5e8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:47:48.534690 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178bef38-102c-4ec0-9614-7b6f7f5a5e8c None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:47:48.535040 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178bef38-102c-4ec0-9614-7b6f7f5a5e8c None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:47:48.535384 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178bef38-102c-4ec0-9614-7b6f7f5a5e8c None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:47:48.547349 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-178bef38-102c-4ec0-9614-7b6f7f5a5e8c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 17:47:48.552892 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application [None req-178bef38-102c-4ec0-9614-7b6f7f5a5e8c None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 15 17:47:48.552892 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 17:47:48.552892 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 17:47:48.552892 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 17:47:48.552892 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 17:47:48.552892 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 17:47:48.552892 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 17:47:48.552892 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 17:47:48.552892 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 17:47:48.552892 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 17:47:48.552892 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 17:47:48.552892 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 17:47:48.552892 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 17:47:48.552892 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 17:47:48.552892 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 17:47:48.552892 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 17:47:48.553826 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 17:47:48.553826 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 17:47:48.553826 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 17:47:48.553826 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 17:47:48.553826 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 17:47:48.553826 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 17:47:48.553826 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 17:47:48.553826 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 17:47:48.553826 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 17:47:48.553826 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 17:47:48.553826 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 17:47:48.553826 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application with Lock( Sep 15 17:47:48.553826 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 17:47:48.553826 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._enter() Sep 15 17:47:48.553826 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 17:47:48.553826 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 17:47:48.554620 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 17:47:48.554620 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.creator() Sep 15 17:47:48.554620 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 17:47:48.554620 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application created_value = creator( Sep 15 17:47:48.554620 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 17:47:48.554620 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 17:47:48.554620 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 17:47:48.554620 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 17:47:48.554620 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 17:47:48.554620 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 17:47:48.554620 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 15 17:47:48.554620 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Sep 15 17:47:48.559133 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 110/226] 10.222.0.25 () {56 vars in 1114 bytes} [Thu Sep 15 17:47:48 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 17:47:48.561066 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178bef38-102c-4ec0-9614-7b6f7f5a5e8c None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:47:48.600176 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63bf5c0-d551-4d19-9873-bc355bac5c26 None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:47:48.638186 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138fab02-e642-4e80-a540-8fa63ff09fbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:47:48.638867 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138fab02-e642-4e80-a540-8fa63ff09fbe None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:47:48.639193 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138fab02-e642-4e80-a540-8fa63ff09fbe None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:47:48.639540 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138fab02-e642-4e80-a540-8fa63ff09fbe None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:47:48.640376 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138fab02-e642-4e80-a540-8fa63ff09fbe None admin] RBAC: Adding query filter params (role.id=343cc8b1bc7243eebabdf08147e8366d, scope.project.id=db66614609564cbf9e5fb3c7e35442d4, user.id=ce95965c617a4cabbfe2e097fe3363f4) {{(pid=81592) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 17:47:48.640756 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138fab02-e642-4e80-a540-8fa63ff09fbe None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:47:48.642410 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138fab02-e642-4e80-a540-8fa63ff09fbe None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:47:48.649796 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 117/227] 10.222.0.25 () {56 vars in 1374 bytes} [Thu Sep 15 17:47:48 2022] GET /identity/v3/role_assignments?user.id=ce95965c617a4cabbfe2e097fe3363f4&scope.project.id=db66614609564cbf9e5fb3c7e35442d4&role.id=343cc8b1bc7243eebabdf08147e8366d => generated 259 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 17:47:48.650890 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138fab02-e642-4e80-a540-8fa63ff09fbe None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:47:48.702408 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178bef38-102c-4ec0-9614-7b6f7f5a5e8c None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:47:48.787267 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a22858c-acb1-404b-8132-22c645d043d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:47:48.788041 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a22858c-acb1-404b-8132-22c645d043d8 None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:47:48.788391 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a22858c-acb1-404b-8132-22c645d043d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:47:48.788739 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a22858c-acb1-404b-8132-22c645d043d8 None admin] PATH_INFO: `/v3/users/a303232e7f114a67988a8375149b82f2` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:47:48.794147 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a22858c-acb1-404b-8132-22c645d043d8 None admin] RBAC: Authorizing `identity:get_user(user_id=a303232e7f114a67988a8375149b82f2)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:47:48.795395 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:47:48.795852 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a22858c-acb1-404b-8132-22c645d043d8 None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:47:48.798160 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 111/228] 10.222.0.25 () {56 vars in 1177 bytes} [Thu Sep 15 17:47:48 2022] GET /identity/v3/users/a303232e7f114a67988a8375149b82f2 => generated 283 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 17:47:48.805685 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a22858c-acb1-404b-8132-22c645d043d8 None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:47:48.812222 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138fab02-e642-4e80-a540-8fa63ff09fbe None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:47:48.852504 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0c7e8f-bc42-447c-aca1-315a2759d392 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:47:48.853532 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0c7e8f-bc42-447c-aca1-315a2759d392 None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:47:48.853981 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0c7e8f-bc42-447c-aca1-315a2759d392 None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:47:48.854420 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0c7e8f-bc42-447c-aca1-315a2759d392 None admin] PATH_INFO: `/v3/roles` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:47:48.855799 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f0c7e8f-bc42-447c-aca1-315a2759d392 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81592) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 17:47:48.856279 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f0c7e8f-bc42-447c-aca1-315a2759d392 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:47:48.858351 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f0c7e8f-bc42-447c-aca1-315a2759d392 None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:47:48.868525 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 118/229] 10.222.0.25 () {56 vars in 1111 bytes} [Thu Sep 15 17:47:48 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 17:47:48.877966 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0c7e8f-bc42-447c-aca1-315a2759d392 None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:47:48.932976 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:47:48.999482 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0c7e8f-bc42-447c-aca1-315a2759d392 None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:47:49.037769 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b5fe7a-d9d9-4a55-bd74-d90c0d31570f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:47:49.039053 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b5fe7a-d9d9-4a55-bd74-d90c0d31570f None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:47:49.039340 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b5fe7a-d9d9-4a55-bd74-d90c0d31570f None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:47:49.039612 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b5fe7a-d9d9-4a55-bd74-d90c0d31570f None admin] PATH_INFO: `/v3/users/a303232e7f114a67988a8375149b82f2` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:47:49.040789 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b5fe7a-d9d9-4a55-bd74-d90c0d31570f None admin] RBAC: Authorizing `identity:get_user(user_id=a303232e7f114a67988a8375149b82f2)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:47:49.042273 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b5fe7a-d9d9-4a55-bd74-d90c0d31570f None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:47:49.044441 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 119/230] 10.222.0.25 () {56 vars in 1177 bytes} [Thu Sep 15 17:47:48 2022] GET /identity/v3/users/a303232e7f114a67988a8375149b82f2 => generated 283 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 17:47:49.053055 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b5fe7a-d9d9-4a55-bd74-d90c0d31570f None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:47:49.097672 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:47:49.109627 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a22858c-acb1-404b-8132-22c645d043d8 None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:47:49.176100 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91599475-f8e8-4a2c-b68c-90608b2373f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:47:49.177285 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91599475-f8e8-4a2c-b68c-90608b2373f3 None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:47:49.177587 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91599475-f8e8-4a2c-b68c-90608b2373f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:47:49.177859 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91599475-f8e8-4a2c-b68c-90608b2373f3 None admin] PATH_INFO: `/v3/projects/db66614609564cbf9e5fb3c7e35442d4` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:47:49.180249 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91599475-f8e8-4a2c-b68c-90608b2373f3 None admin] RBAC: Authorizing `identity:get_project(project_id=db66614609564cbf9e5fb3c7e35442d4)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:47:49.181752 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91599475-f8e8-4a2c-b68c-90608b2373f3 None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:47:49.184626 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 112/231] 10.222.0.25 () {56 vars in 1186 bytes} [Thu Sep 15 17:47:48 2022] GET /identity/v3/projects/db66614609564cbf9e5fb3c7e35442d4 => generated 302 bytes in 379 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 17:47:49.190950 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91599475-f8e8-4a2c-b68c-90608b2373f3 None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:47:49.238889 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b5fe7a-d9d9-4a55-bd74-d90c0d31570f None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:47:49.302590 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1831a097-0c5f-459e-ad26-31437b26a4df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:47:49.303152 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1831a097-0c5f-459e-ad26-31437b26a4df None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:47:49.303427 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1831a097-0c5f-459e-ad26-31437b26a4df None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:47:49.303699 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1831a097-0c5f-459e-ad26-31437b26a4df None admin] PATH_INFO: `/v3/projects/db66614609564cbf9e5fb3c7e35442d4` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:47:49.306088 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1831a097-0c5f-459e-ad26-31437b26a4df None admin] RBAC: Authorizing `identity:get_project(project_id=db66614609564cbf9e5fb3c7e35442d4)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:47:49.307545 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1831a097-0c5f-459e-ad26-31437b26a4df None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:47:49.315500 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 120/232] 10.222.0.25 () {56 vars in 1186 bytes} [Thu Sep 15 17:47:49 2022] GET /identity/v3/projects/db66614609564cbf9e5fb3c7e35442d4 => generated 302 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 17:47:49.322610 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1831a097-0c5f-459e-ad26-31437b26a4df None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:47:49.371452 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91599475-f8e8-4a2c-b68c-90608b2373f3 None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:47:49.388676 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:47:49.439211 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a043f4b-ec60-4be8-9f20-e82cd6c08332 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:47:49.439889 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a043f4b-ec60-4be8-9f20-e82cd6c08332 None admin] REQUEST_METHOD: `PUT` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:47:49.440166 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a043f4b-ec60-4be8-9f20-e82cd6c08332 None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:47:49.440437 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a043f4b-ec60-4be8-9f20-e82cd6c08332 None admin] PATH_INFO: `/v3/projects/db66614609564cbf9e5fb3c7e35442d4/users/a303232e7f114a67988a8375149b82f2/roles/a9e42be86923434f8af52d3fc07fb4f7` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:47:49.444187 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a043f4b-ec60-4be8-9f20-e82cd6c08332 None admin] RBAC: Authorizing `identity:create_grant(project_id=db66614609564cbf9e5fb3c7e35442d4, user_id=a303232e7f114a67988a8375149b82f2, role_id=a9e42be86923434f8af52d3fc07fb4f7)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:47:49.445679 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a043f4b-ec60-4be8-9f20-e82cd6c08332 None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:47:49.468780 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 113/233] 10.222.0.25 () {58 vars in 1439 bytes} [Thu Sep 15 17:47:49 2022] PUT /identity/v3/projects/db66614609564cbf9e5fb3c7e35442d4/users/a303232e7f114a67988a8375149b82f2/roles/a9e42be86923434f8af52d3fc07fb4f7 => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 17:47:49.479958 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:47:49.491836 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1831a097-0c5f-459e-ad26-31437b26a4df None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:47:49.531055 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c8819e-340f-4c67-96de-97220227b06c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:47:49.531807 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c8819e-340f-4c67-96de-97220227b06c None admin] REQUEST_METHOD: `PUT` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:47:49.532086 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c8819e-340f-4c67-96de-97220227b06c None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:47:49.532363 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c8819e-340f-4c67-96de-97220227b06c None admin] PATH_INFO: `/v3/projects/db66614609564cbf9e5fb3c7e35442d4/users/a303232e7f114a67988a8375149b82f2/roles/0dd1b9f5b7924e20a665ce50d6e34dc7` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:47:49.534939 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c8819e-340f-4c67-96de-97220227b06c None admin] RBAC: Authorizing `identity:create_grant(project_id=db66614609564cbf9e5fb3c7e35442d4, user_id=a303232e7f114a67988a8375149b82f2, role_id=0dd1b9f5b7924e20a665ce50d6e34dc7)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:47:49.536992 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c8819e-340f-4c67-96de-97220227b06c None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:47:49.562413 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 121/234] 10.222.0.25 () {58 vars in 1439 bytes} [Thu Sep 15 17:47:49 2022] PUT /identity/v3/projects/db66614609564cbf9e5fb3c7e35442d4/users/a303232e7f114a67988a8375149b82f2/roles/0dd1b9f5b7924e20a665ce50d6e34dc7 => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 17:47:50.072278 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edeba336-0843-4136-81e8-354af46a9c4b None None] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:47:50.072817 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edeba336-0843-4136-81e8-354af46a9c4b None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:47:50.072817 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edeba336-0843-4136-81e8-354af46a9c4b None None] PATH_INFO: `/` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:47:50.074512 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 114/235] 10.222.0.25 () {54 vars in 927 bytes} [Thu Sep 15 17:47:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 17:47:50.080137 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc57cdda-b765-478c-ad53-f054225f7ce3 None None] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:47:50.080588 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc57cdda-b765-478c-ad53-f054225f7ce3 None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:47:50.080770 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc57cdda-b765-478c-ad53-f054225f7ce3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:47:50.110431 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.auth.core [None req-bc57cdda-b765-478c-ad53-f054225f7ce3 None None] MFA Rules not processed for user `5cfa58ef86774ab7800bf91930bf6028`. Rule list: `[]` (Enabled: `True`). {{(pid=81592) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 17:47:50.111678 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-bc57cdda-b765-478c-ad53-f054225f7ce3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 17:47:50.214908 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 122/236] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Sep 15 17:47:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 15 17:47:50.323082 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7a6ea2-0735-416b-921a-a2355e78cc31 None None] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:47:50.323396 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7a6ea2-0735-416b-921a-a2355e78cc31 None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:47:50.323631 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7a6ea2-0735-416b-921a-a2355e78cc31 None None] PATH_INFO: `/` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:47:50.325147 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 115/237] 10.222.0.25 () {54 vars in 927 bytes} [Thu Sep 15 17:47:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 17:47:50.330475 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8385bf9-f3a3-4852-93eb-68333715f0ee None None] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:47:50.330760 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8385bf9-f3a3-4852-93eb-68333715f0ee None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:47:50.331038 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8385bf9-f3a3-4852-93eb-68333715f0ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:47:50.350212 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.auth.core [None req-b8385bf9-f3a3-4852-93eb-68333715f0ee None None] MFA Rules not processed for user `5cfa58ef86774ab7800bf91930bf6028`. Rule list: `[]` (Enabled: `True`). {{(pid=81592) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 17:47:50.351412 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-b8385bf9-f3a3-4852-93eb-68333715f0ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 17:47:50.444500 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 123/238] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Sep 15 17:47:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 15 17:47:50.554571 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7a6ea2-0735-416b-921a-a2355e78cc31 None None] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:47:50.705447 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7a6ea2-0735-416b-921a-a2355e78cc31 None None] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:47:50.763918 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428f9663-3c81-481a-b678-511707f56e8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:47:50.764568 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428f9663-3c81-481a-b678-511707f56e8c None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:47:50.764847 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428f9663-3c81-481a-b678-511707f56e8c None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:47:50.765118 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428f9663-3c81-481a-b678-511707f56e8c None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:47:50.783780 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428f9663-3c81-481a-b678-511707f56e8c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 17:47:50.789319 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application [None req-428f9663-3c81-481a-b678-511707f56e8c None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 15 17:47:50.789319 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 17:47:50.789319 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 17:47:50.789319 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 17:47:50.789319 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 17:47:50.789319 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 17:47:50.789319 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 17:47:50.789319 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 17:47:50.789319 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 17:47:50.789319 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 17:47:50.789319 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 17:47:50.789319 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 17:47:50.789319 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 17:47:50.789319 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 17:47:50.789319 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 17:47:50.789319 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 17:47:50.790194 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 17:47:50.790194 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 17:47:50.790194 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 17:47:50.790194 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 17:47:50.790194 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 17:47:50.790194 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 17:47:50.790194 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 17:47:50.790194 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 17:47:50.790194 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 17:47:50.790194 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 17:47:50.790194 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 17:47:50.790194 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application with Lock( Sep 15 17:47:50.790194 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 17:47:50.790194 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._enter() Sep 15 17:47:50.790194 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 17:47:50.790194 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 17:47:50.790973 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 17:47:50.790973 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.creator() Sep 15 17:47:50.790973 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 17:47:50.790973 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application created_value = creator( Sep 15 17:47:50.790973 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 17:47:50.790973 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 17:47:50.790973 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 17:47:50.790973 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 17:47:50.790973 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 17:47:50.790973 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 17:47:50.790973 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 15 17:47:50.790973 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Sep 15 17:47:50.790973 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 116/239] 10.222.0.25 () {56 vars in 1099 bytes} [Thu Sep 15 17:47:50 2022] GET /identity/v3/roles/reader => generated 84 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 17:47:50.797241 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8385bf9-f3a3-4852-93eb-68333715f0ee None None] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:47:50.821704 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:47:50.850310 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428f9663-3c81-481a-b678-511707f56e8c None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:47:50.883990 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:47:50.996843 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8385bf9-f3a3-4852-93eb-68333715f0ee None None] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:47:51.037045 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428f9663-3c81-481a-b678-511707f56e8c None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:47:51.050389 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d7bce9-fe20-4554-9135-68337638a83c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:47:51.051002 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d7bce9-fe20-4554-9135-68337638a83c None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:47:51.051343 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d7bce9-fe20-4554-9135-68337638a83c None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:47:51.051619 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d7bce9-fe20-4554-9135-68337638a83c None admin] PATH_INFO: `/v3/roles` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:47:51.052290 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d7bce9-fe20-4554-9135-68337638a83c None admin] RBAC: Adding query filter params (name=reader) {{(pid=81592) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 17:47:51.052592 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d7bce9-fe20-4554-9135-68337638a83c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:47:51.053988 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d7bce9-fe20-4554-9135-68337638a83c None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:47:51.071266 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 124/240] 10.222.0.25 () {56 vars in 1101 bytes} [Thu Sep 15 17:47:50 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 17:47:51.077176 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d7bce9-fe20-4554-9135-68337638a83c None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:47:51.107151 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966f2fe3-adcb-4286-830c-5de692b71fb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:47:51.108547 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966f2fe3-adcb-4286-830c-5de692b71fb6 None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:47:51.109043 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966f2fe3-adcb-4286-830c-5de692b71fb6 None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:47:51.109536 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966f2fe3-adcb-4286-830c-5de692b71fb6 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:47:51.114128 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-966f2fe3-adcb-4286-830c-5de692b71fb6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:47:51.115941 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-966f2fe3-adcb-4286-830c-5de692b71fb6 None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:47:51.118735 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 117/241] 10.222.0.25 () {56 vars in 1108 bytes} [Thu Sep 15 17:47:50 2022] GET /identity/v3/domains/default => generated 199 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 17:47:51.127122 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966f2fe3-adcb-4286-830c-5de692b71fb6 None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:47:51.157970 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:47:51.194754 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d7bce9-fe20-4554-9135-68337638a83c None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:47:51.241225 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3abef2-3e13-40e6-9454-42cba149f544 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:47:51.243690 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3abef2-3e13-40e6-9454-42cba149f544 None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:47:51.243975 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3abef2-3e13-40e6-9454-42cba149f544 None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:47:51.244246 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3abef2-3e13-40e6-9454-42cba149f544 None admin] PATH_INFO: `/v3/users/2ac69b13a8ef40b9b8b044ede1de0f3c` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:47:51.272961 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c3abef2-3e13-40e6-9454-42cba149f544 None admin] RBAC: Authorizing `identity:get_user(user_id=2ac69b13a8ef40b9b8b044ede1de0f3c)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:47:51.275256 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c3abef2-3e13-40e6-9454-42cba149f544 None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:47:51.278160 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 125/242] 10.222.0.25 () {56 vars in 1177 bytes} [Thu Sep 15 17:47:51 2022] GET /identity/v3/users/2ac69b13a8ef40b9b8b044ede1de0f3c => generated 297 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 17:47:51.283168 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3abef2-3e13-40e6-9454-42cba149f544 None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:47:51.326109 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:47:51.334854 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966f2fe3-adcb-4286-830c-5de692b71fb6 None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:47:51.387674 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8e874b-333c-404b-8344-ac85d1b27a09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:47:51.388294 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8e874b-333c-404b-8344-ac85d1b27a09 None admin] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:47:51.388566 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8e874b-333c-404b-8344-ac85d1b27a09 None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:47:51.388838 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8e874b-333c-404b-8344-ac85d1b27a09 None admin] PATH_INFO: `/v3/users` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:47:51.389551 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8e874b-333c-404b-8344-ac85d1b27a09 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:47:51.391760 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8e874b-333c-404b-8344-ac85d1b27a09 None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:47:51.421215 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3abef2-3e13-40e6-9454-42cba149f544 None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:47:51.421422 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 118/243] 10.222.0.25 () {60 vars in 1132 bytes} [Thu Sep 15 17:47:51 2022] POST /identity/v3/users => generated 293 bytes in 294 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 15 17:47:51.422571 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bed960-99de-4213-b81d-e3d20f46f6a2 None None] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:47:51.422852 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bed960-99de-4213-b81d-e3d20f46f6a2 None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:47:51.423409 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bed960-99de-4213-b81d-e3d20f46f6a2 None None] PATH_INFO: `/` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:47:51.425973 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 119/244] 10.222.0.25 () {54 vars in 927 bytes} [Thu Sep 15 17:47:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 17:47:51.434914 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d1e566-f689-4fba-bf93-346d75ad0aa8 None None] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:47:51.435245 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d1e566-f689-4fba-bf93-346d75ad0aa8 None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:47:51.435482 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d1e566-f689-4fba-bf93-346d75ad0aa8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:47:51.483800 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.auth.core [None req-09d1e566-f689-4fba-bf93-346d75ad0aa8 None None] MFA Rules not processed for user `5cfa58ef86774ab7800bf91930bf6028`. Rule list: `[]` (Enabled: `True`). {{(pid=81593) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 17:47:51.485035 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-09d1e566-f689-4fba-bf93-346d75ad0aa8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 17:47:51.493058 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:47:51.504472 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60f9f02-6bd0-413d-9e78-edff60e90bad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:47:51.506508 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60f9f02-6bd0-413d-9e78-edff60e90bad None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:47:51.506791 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60f9f02-6bd0-413d-9e78-edff60e90bad None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:47:51.507062 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60f9f02-6bd0-413d-9e78-edff60e90bad None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:47:51.618344 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 120/245] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Sep 15 17:47:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 15 17:47:51.621281 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60f9f02-6bd0-413d-9e78-edff60e90bad None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:47:51.622841 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60f9f02-6bd0-413d-9e78-edff60e90bad None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:47:51.724928 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 126/246] 10.222.0.25 () {58 vars in 1282 bytes} [Thu Sep 15 17:47:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 442 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 15 17:47:51.730894 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d1e566-f689-4fba-bf93-346d75ad0aa8 None None] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:47:51.824299 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:47:51.852879 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d1e566-f689-4fba-bf93-346d75ad0aa8 None None] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:47:51.891278 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756ab408-740e-47d6-aa24-f6db9f813e68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:47:51.891843 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756ab408-740e-47d6-aa24-f6db9f813e68 None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:47:51.892139 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756ab408-740e-47d6-aa24-f6db9f813e68 None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:47:51.892418 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756ab408-740e-47d6-aa24-f6db9f813e68 None admin] PATH_INFO: `/v3/projects/db66614609564cbf9e5fb3c7e35442d4` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:47:51.895776 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-756ab408-740e-47d6-aa24-f6db9f813e68 None admin] RBAC: Authorizing `identity:get_project(project_id=db66614609564cbf9e5fb3c7e35442d4)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:47:51.897241 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-756ab408-740e-47d6-aa24-f6db9f813e68 None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:47:51.899127 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 121/247] 10.222.0.25 () {56 vars in 1186 bytes} [Thu Sep 15 17:47:51 2022] GET /identity/v3/projects/db66614609564cbf9e5fb3c7e35442d4 => generated 302 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 17:47:51.905010 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60f9f02-6bd0-413d-9e78-edff60e90bad None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:47:51.936088 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756ab408-740e-47d6-aa24-f6db9f813e68 None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:47:51.947626 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:47:52.047694 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60f9f02-6bd0-413d-9e78-edff60e90bad None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:47:52.087135 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e8664c-1b49-4597-80da-d01f327781c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:47:52.087793 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e8664c-1b49-4597-80da-d01f327781c2 None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:47:52.088038 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e8664c-1b49-4597-80da-d01f327781c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:47:52.088305 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e8664c-1b49-4597-80da-d01f327781c2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:47:52.089140 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e8664c-1b49-4597-80da-d01f327781c2 None admin] RBAC: Adding query filter params (role.id=80bb25250ed34dd9a6ed0740bcc3dac6, scope.project.id=db66614609564cbf9e5fb3c7e35442d4, user.id=2ac69b13a8ef40b9b8b044ede1de0f3c) {{(pid=81592) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 17:47:52.089479 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e8664c-1b49-4597-80da-d01f327781c2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:47:52.091048 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e8664c-1b49-4597-80da-d01f327781c2 None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:47:52.093204 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756ab408-740e-47d6-aa24-f6db9f813e68 None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:47:52.097537 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 127/248] 10.222.0.25 () {56 vars in 1374 bytes} [Thu Sep 15 17:47:51 2022] GET /identity/v3/role_assignments?user.id=2ac69b13a8ef40b9b8b044ede1de0f3c&scope.project.id=db66614609564cbf9e5fb3c7e35442d4&role.id=80bb25250ed34dd9a6ed0740bcc3dac6 => generated 259 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 17:47:52.145136 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb81db3-42ed-4e1c-b3a3-563c3414bd52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:47:52.145814 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb81db3-42ed-4e1c-b3a3-563c3414bd52 None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:47:52.146003 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb81db3-42ed-4e1c-b3a3-563c3414bd52 None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:47:52.146273 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb81db3-42ed-4e1c-b3a3-563c3414bd52 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:47:52.160785 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb81db3-42ed-4e1c-b3a3-563c3414bd52 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 17:47:52.165720 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application [None req-3bb81db3-42ed-4e1c-b3a3-563c3414bd52 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 15 17:47:52.165720 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 17:47:52.165720 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 17:47:52.165720 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 17:47:52.165720 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 17:47:52.165720 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 17:47:52.165720 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 17:47:52.165720 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 17:47:52.165720 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 17:47:52.165720 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 17:47:52.165720 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 17:47:52.165720 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 17:47:52.165720 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 17:47:52.165720 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 17:47:52.165720 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 17:47:52.165720 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 17:47:52.166636 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 17:47:52.166636 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 17:47:52.166636 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 17:47:52.166636 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 17:47:52.166636 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 17:47:52.166636 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 17:47:52.166636 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 17:47:52.166636 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 17:47:52.166636 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 17:47:52.166636 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 17:47:52.166636 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 17:47:52.166636 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application with Lock( Sep 15 17:47:52.166636 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 17:47:52.166636 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._enter() Sep 15 17:47:52.166636 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 17:47:52.166636 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 17:47:52.167421 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 17:47:52.167421 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.creator() Sep 15 17:47:52.167421 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 17:47:52.167421 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application created_value = creator( Sep 15 17:47:52.167421 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 17:47:52.167421 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 17:47:52.167421 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 17:47:52.167421 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 17:47:52.167421 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 17:47:52.167421 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 17:47:52.167421 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 15 17:47:52.167421 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Sep 15 17:47:52.167421 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 122/249] 10.222.0.25 () {56 vars in 1099 bytes} [Thu Sep 15 17:47:51 2022] GET /identity/v3/roles/member => generated 84 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 15 17:47:52.174347 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e8664c-1b49-4597-80da-d01f327781c2 None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:47:52.287561 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:47:52.295992 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e8664c-1b49-4597-80da-d01f327781c2 None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:47:52.345894 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6343d911-0b76-4f96-bcfd-f336bde5513f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:47:52.346532 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6343d911-0b76-4f96-bcfd-f336bde5513f None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:47:52.346991 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6343d911-0b76-4f96-bcfd-f336bde5513f None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:47:52.349011 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf29519b-20d6-49d7-af7b-ddc96ac0fcb6 None None] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:47:52.349289 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf29519b-20d6-49d7-af7b-ddc96ac0fcb6 None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:47:52.349579 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf29519b-20d6-49d7-af7b-ddc96ac0fcb6 None None] PATH_INFO: `/` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:47:52.351072 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 123/250] 10.222.0.25 () {54 vars in 927 bytes} [Thu Sep 15 17:47:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 15 17:47:52.352536 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6343d911-0b76-4f96-bcfd-f336bde5513f None admin] PATH_INFO: `/v3/roles` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:47:52.353341 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6343d911-0b76-4f96-bcfd-f336bde5513f None admin] RBAC: Adding query filter params (name=member) {{(pid=81592) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 17:47:52.353658 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6343d911-0b76-4f96-bcfd-f336bde5513f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:47:52.355072 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6343d911-0b76-4f96-bcfd-f336bde5513f None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:47:52.357594 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9b9259-61fd-43c8-9562-733ab1d6750e None None] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:47:52.358200 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9b9259-61fd-43c8-9562-733ab1d6750e None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:47:52.358790 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9b9259-61fd-43c8-9562-733ab1d6750e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:47:52.369441 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 128/251] 10.222.0.25 () {56 vars in 1101 bytes} [Thu Sep 15 17:47:52 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 17:47:52.370931 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6343d911-0b76-4f96-bcfd-f336bde5513f None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:47:52.382817 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.auth.core [None req-2a9b9259-61fd-43c8-9562-733ab1d6750e None None] MFA Rules not processed for user `5cfa58ef86774ab7800bf91930bf6028`. Rule list: `[]` (Enabled: `True`). {{(pid=81593) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 17:47:52.384713 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-2a9b9259-61fd-43c8-9562-733ab1d6750e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 17:47:52.389683 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:47:52.500315 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 124/252] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Sep 15 17:47:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 15 17:47:52.501448 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc05c1fb-28bd-44a3-9430-a39f920725d0 None None] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:47:52.501741 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc05c1fb-28bd-44a3-9430-a39f920725d0 None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:47:52.502017 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc05c1fb-28bd-44a3-9430-a39f920725d0 None None] PATH_INFO: `/` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:47:52.503288 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 125/253] 10.222.0.25 () {54 vars in 927 bytes} [Thu Sep 15 17:47:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 17:47:52.510888 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ebdad5-793f-4402-9a1c-985e903b8d09 None None] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:47:52.511172 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ebdad5-793f-4402-9a1c-985e903b8d09 None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:47:52.511446 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ebdad5-793f-4402-9a1c-985e903b8d09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:47:52.531188 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6343d911-0b76-4f96-bcfd-f336bde5513f None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:47:52.547754 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.auth.core [None req-e7ebdad5-793f-4402-9a1c-985e903b8d09 None None] MFA Rules not processed for user `5cfa58ef86774ab7800bf91930bf6028`. Rule list: `[]` (Enabled: `True`). {{(pid=81593) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 17:47:52.548957 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-e7ebdad5-793f-4402-9a1c-985e903b8d09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 17:47:52.588588 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c940fdcd-2106-4c10-adc0-16cf5c6a7af2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:47:52.589241 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c940fdcd-2106-4c10-adc0-16cf5c6a7af2 None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:47:52.589544 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c940fdcd-2106-4c10-adc0-16cf5c6a7af2 None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:47:52.590086 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c940fdcd-2106-4c10-adc0-16cf5c6a7af2 None admin] PATH_INFO: `/v3/users/ce95965c617a4cabbfe2e097fe3363f4` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:47:52.593221 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c940fdcd-2106-4c10-adc0-16cf5c6a7af2 None admin] RBAC: Authorizing `identity:get_user(user_id=ce95965c617a4cabbfe2e097fe3363f4)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:47:52.594743 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c940fdcd-2106-4c10-adc0-16cf5c6a7af2 None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:47:52.597894 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 129/254] 10.222.0.25 () {56 vars in 1177 bytes} [Thu Sep 15 17:47:52 2022] GET /identity/v3/users/ce95965c617a4cabbfe2e097fe3363f4 => generated 297 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 17:47:52.602289 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c940fdcd-2106-4c10-adc0-16cf5c6a7af2 None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:47:52.646469 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:47:52.710781 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 126/255] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Sep 15 17:47:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 15 17:47:52.744021 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c940fdcd-2106-4c10-adc0-16cf5c6a7af2 None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:47:52.788493 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b69578-798a-42a2-acd2-36164cf14282 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:47:52.789529 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b69578-798a-42a2-acd2-36164cf14282 None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:47:52.790075 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b69578-798a-42a2-acd2-36164cf14282 None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:47:52.790548 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b69578-798a-42a2-acd2-36164cf14282 None admin] PATH_INFO: `/v3/projects/db66614609564cbf9e5fb3c7e35442d4` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:47:52.791951 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b69578-798a-42a2-acd2-36164cf14282 None admin] RBAC: Authorizing `identity:get_project(project_id=db66614609564cbf9e5fb3c7e35442d4)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:47:52.793686 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b69578-798a-42a2-acd2-36164cf14282 None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:47:52.796027 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 130/256] 10.222.0.25 () {56 vars in 1186 bytes} [Thu Sep 15 17:47:52 2022] GET /identity/v3/projects/db66614609564cbf9e5fb3c7e35442d4 => generated 302 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 17:47:52.801987 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ebdad5-793f-4402-9a1c-985e903b8d09 None None] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:47:52.914705 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:47:52.951738 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b69578-798a-42a2-acd2-36164cf14282 None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:47:52.960569 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ebdad5-793f-4402-9a1c-985e903b8d09 None None] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:47:53.048142 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1932d598-0ad4-4e63-b38e-e93eb5c5b3a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:47:53.054487 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1932d598-0ad4-4e63-b38e-e93eb5c5b3a3 None admin] REQUEST_METHOD: `PUT` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:47:53.056233 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1932d598-0ad4-4e63-b38e-e93eb5c5b3a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:47:53.056765 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1932d598-0ad4-4e63-b38e-e93eb5c5b3a3 None admin] PATH_INFO: `/v3/projects/db66614609564cbf9e5fb3c7e35442d4/users/ce95965c617a4cabbfe2e097fe3363f4/roles/343cc8b1bc7243eebabdf08147e8366d` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:47:53.060060 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1932d598-0ad4-4e63-b38e-e93eb5c5b3a3 None admin] RBAC: Authorizing `identity:create_grant(project_id=db66614609564cbf9e5fb3c7e35442d4, user_id=ce95965c617a4cabbfe2e097fe3363f4, role_id=343cc8b1bc7243eebabdf08147e8366d)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:47:53.063127 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1932d598-0ad4-4e63-b38e-e93eb5c5b3a3 None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:47:53.095077 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 127/257] 10.222.0.25 () {58 vars in 1439 bytes} [Thu Sep 15 17:47:52 2022] PUT /identity/v3/projects/db66614609564cbf9e5fb3c7e35442d4/users/ce95965c617a4cabbfe2e097fe3363f4/roles/343cc8b1bc7243eebabdf08147e8366d => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 17:47:53.149394 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:47:53.158575 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1932d598-0ad4-4e63-b38e-e93eb5c5b3a3 None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:47:53.165260 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b69578-798a-42a2-acd2-36164cf14282 None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:47:53.233004 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a453b11a-6517-4750-880b-50cc2948629d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:47:53.233654 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a453b11a-6517-4750-880b-50cc2948629d None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:47:53.233939 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a453b11a-6517-4750-880b-50cc2948629d None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:47:53.234206 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a453b11a-6517-4750-880b-50cc2948629d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:47:53.254395 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a453b11a-6517-4750-880b-50cc2948629d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 17:47:53.260901 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application [None req-a453b11a-6517-4750-880b-50cc2948629d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 15 17:47:53.260901 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 17:47:53.260901 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 17:47:53.260901 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 17:47:53.260901 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 17:47:53.260901 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 17:47:53.260901 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 17:47:53.260901 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 17:47:53.260901 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 17:47:53.260901 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 17:47:53.260901 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 17:47:53.260901 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 17:47:53.260901 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 17:47:53.260901 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 17:47:53.260901 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 17:47:53.260901 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 17:47:53.261849 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 17:47:53.261849 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 17:47:53.261849 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 17:47:53.261849 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 17:47:53.261849 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 17:47:53.261849 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 17:47:53.261849 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 17:47:53.261849 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 17:47:53.261849 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 17:47:53.261849 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 17:47:53.261849 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 17:47:53.261849 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application with Lock( Sep 15 17:47:53.261849 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 17:47:53.261849 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._enter() Sep 15 17:47:53.261849 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 17:47:53.261849 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 17:47:53.262703 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 17:47:53.262703 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.creator() Sep 15 17:47:53.262703 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 17:47:53.262703 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application created_value = creator( Sep 15 17:47:53.262703 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 17:47:53.262703 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 17:47:53.262703 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 17:47:53.262703 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 17:47:53.262703 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 17:47:53.262703 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 17:47:53.262703 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 15 17:47:53.262703 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Sep 15 17:47:53.262703 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 131/258] 10.222.0.25 () {56 vars in 1096 bytes} [Thu Sep 15 17:47:52 2022] GET /identity/v3/roles/admin => generated 83 bytes in 311 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 15 17:47:53.271706 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a453b11a-6517-4750-880b-50cc2948629d None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:47:53.424200 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1932d598-0ad4-4e63-b38e-e93eb5c5b3a3 None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:47:53.448595 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a453b11a-6517-4750-880b-50cc2948629d None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:47:53.481808 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:47:53.502407 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1777938-ad33-42e2-82bb-6666347e0519 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:47:53.503046 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1777938-ad33-42e2-82bb-6666347e0519 None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:47:53.503320 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1777938-ad33-42e2-82bb-6666347e0519 None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:47:53.503588 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1777938-ad33-42e2-82bb-6666347e0519 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:47:53.512141 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae272fff-a158-457b-94de-797f206a89ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:47:53.512760 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae272fff-a158-457b-94de-797f206a89ab None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:47:53.513035 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae272fff-a158-457b-94de-797f206a89ab None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:47:53.513320 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae272fff-a158-457b-94de-797f206a89ab None admin] PATH_INFO: `/v3/roles` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:47:53.514114 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae272fff-a158-457b-94de-797f206a89ab None admin] RBAC: Adding query filter params (name=admin) {{(pid=81592) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 17:47:53.514520 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae272fff-a158-457b-94de-797f206a89ab None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:47:53.515884 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae272fff-a158-457b-94de-797f206a89ab None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:47:53.517455 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1777938-ad33-42e2-82bb-6666347e0519 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 17:47:53.524878 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application [None req-d1777938-ad33-42e2-82bb-6666347e0519 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 15 17:47:53.524878 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 17:47:53.524878 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 17:47:53.524878 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 17:47:53.524878 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 17:47:53.524878 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 17:47:53.524878 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 17:47:53.524878 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 17:47:53.524878 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 17:47:53.524878 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 17:47:53.524878 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 17:47:53.524878 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 17:47:53.524878 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 17:47:53.524878 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 17:47:53.524878 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 17:47:53.524878 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 17:47:53.526058 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 17:47:53.526058 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 17:47:53.526058 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 17:47:53.526058 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 17:47:53.526058 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 17:47:53.526058 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 17:47:53.526058 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 17:47:53.526058 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 17:47:53.526058 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 17:47:53.526058 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 17:47:53.526058 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 17:47:53.526058 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application with Lock( Sep 15 17:47:53.526058 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 17:47:53.526058 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._enter() Sep 15 17:47:53.526058 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 17:47:53.526058 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 17:47:53.527197 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 17:47:53.527197 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.creator() Sep 15 17:47:53.527197 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 17:47:53.527197 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application created_value = creator( Sep 15 17:47:53.527197 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 17:47:53.527197 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 17:47:53.527197 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 17:47:53.527197 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 17:47:53.527197 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 17:47:53.527197 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 17:47:53.527197 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 15 17:47:53.527197 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Sep 15 17:47:53.529108 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 128/259] 10.222.0.25 () {56 vars in 1114 bytes} [Thu Sep 15 17:47:53 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 371 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 17:47:53.534314 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 132/260] 10.222.0.25 () {56 vars in 1099 bytes} [Thu Sep 15 17:47:53 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 17:47:53.535741 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1777938-ad33-42e2-82bb-6666347e0519 None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:47:53.539555 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae272fff-a158-457b-94de-797f206a89ab None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:47:53.568075 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:47:53.687175 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1777938-ad33-42e2-82bb-6666347e0519 None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:47:53.726935 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e57850-6174-4a60-9ef2-cd52b301fbae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:47:53.728191 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e57850-6174-4a60-9ef2-cd52b301fbae None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:47:53.728606 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e57850-6174-4a60-9ef2-cd52b301fbae None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:47:53.729022 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e57850-6174-4a60-9ef2-cd52b301fbae None admin] PATH_INFO: `/v3/roles` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:47:53.730034 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e57850-6174-4a60-9ef2-cd52b301fbae None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81593) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 17:47:53.730860 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e57850-6174-4a60-9ef2-cd52b301fbae None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:47:53.732648 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e57850-6174-4a60-9ef2-cd52b301fbae None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:47:53.742681 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 129/261] 10.222.0.25 () {56 vars in 1111 bytes} [Thu Sep 15 17:47:53 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 17:47:53.750657 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e57850-6174-4a60-9ef2-cd52b301fbae None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:47:53.799318 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae272fff-a158-457b-94de-797f206a89ab None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:47:53.846707 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:47:53.903472 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2d92ca-8110-4b27-8260-f69759c07e3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:47:53.904175 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2d92ca-8110-4b27-8260-f69759c07e3d None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:47:53.904459 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2d92ca-8110-4b27-8260-f69759c07e3d None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:47:53.904735 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2d92ca-8110-4b27-8260-f69759c07e3d None admin] PATH_INFO: `/v3/users/a303232e7f114a67988a8375149b82f2` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:47:53.915735 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e2d92ca-8110-4b27-8260-f69759c07e3d None admin] RBAC: Authorizing `identity:get_user(user_id=a303232e7f114a67988a8375149b82f2)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:47:53.917309 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e2d92ca-8110-4b27-8260-f69759c07e3d None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:47:53.919125 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 133/262] 10.222.0.25 () {56 vars in 1177 bytes} [Thu Sep 15 17:47:53 2022] GET /identity/v3/users/a303232e7f114a67988a8375149b82f2 => generated 283 bytes in 380 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 17:47:53.934375 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2d92ca-8110-4b27-8260-f69759c07e3d None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:47:53.936200 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e57850-6174-4a60-9ef2-cd52b301fbae None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:47:54.012010 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8a5530-2a19-4f77-83f1-21b852b6e740 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:47:54.012661 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8a5530-2a19-4f77-83f1-21b852b6e740 None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:47:54.013094 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8a5530-2a19-4f77-83f1-21b852b6e740 None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:47:54.013564 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8a5530-2a19-4f77-83f1-21b852b6e740 None admin] PATH_INFO: `/v3/users/a303232e7f114a67988a8375149b82f2` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:47:54.016136 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c8a5530-2a19-4f77-83f1-21b852b6e740 None admin] RBAC: Authorizing `identity:get_user(user_id=a303232e7f114a67988a8375149b82f2)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:47:54.017616 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c8a5530-2a19-4f77-83f1-21b852b6e740 None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:47:54.023456 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 130/263] 10.222.0.25 () {56 vars in 1177 bytes} [Thu Sep 15 17:47:53 2022] GET /identity/v3/users/a303232e7f114a67988a8375149b82f2 => generated 283 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 17:47:54.024917 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8a5530-2a19-4f77-83f1-21b852b6e740 None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:47:54.159021 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:47:54.194306 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8a5530-2a19-4f77-83f1-21b852b6e740 None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:47:54.215532 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2d92ca-8110-4b27-8260-f69759c07e3d None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:47:54.216910 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:47:54.239899 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775cf091-e5cd-4bed-a894-105d6ec807a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:47:54.240864 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775cf091-e5cd-4bed-a894-105d6ec807a9 None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:47:54.241397 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775cf091-e5cd-4bed-a894-105d6ec807a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:47:54.241870 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775cf091-e5cd-4bed-a894-105d6ec807a9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:47:54.318148 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434c18d3-e9e8-4976-ac9e-cd9a10db50f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:47:54.319723 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434c18d3-e9e8-4976-ac9e-cd9a10db50f7 None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:47:54.319723 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434c18d3-e9e8-4976-ac9e-cd9a10db50f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:47:54.319723 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434c18d3-e9e8-4976-ac9e-cd9a10db50f7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:47:54.334446 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775cf091-e5cd-4bed-a894-105d6ec807a9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:47:54.336717 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775cf091-e5cd-4bed-a894-105d6ec807a9 None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:47:54.471894 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 131/264] 10.222.0.25 () {58 vars in 1282 bytes} [Thu Sep 15 17:47:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 447 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 15 17:47:54.479112 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775cf091-e5cd-4bed-a894-105d6ec807a9 None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:47:54.527638 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:47:54.530536 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-434c18d3-e9e8-4976-ac9e-cd9a10db50f7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:47:54.532011 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-434c18d3-e9e8-4976-ac9e-cd9a10db50f7 None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:47:54.654779 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:47:54.687785 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 134/265] 10.222.0.25 () {58 vars in 1282 bytes} [Thu Sep 15 17:47:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 754 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 15 17:47:54.699232 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434c18d3-e9e8-4976-ac9e-cd9a10db50f7 None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:47:54.748267 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775cf091-e5cd-4bed-a894-105d6ec807a9 None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:47:54.817159 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434c18d3-e9e8-4976-ac9e-cd9a10db50f7 None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:47:54.863719 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b04c48-5ad7-4962-a314-b2864a1a15d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:47:54.865088 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b04c48-5ad7-4962-a314-b2864a1a15d7 None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:47:54.865539 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b04c48-5ad7-4962-a314-b2864a1a15d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:47:54.866220 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b04c48-5ad7-4962-a314-b2864a1a15d7 None admin] PATH_INFO: `/v3/projects/db66614609564cbf9e5fb3c7e35442d4` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:47:54.867474 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced55292-2335-43c9-be26-27f6c1fb06b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:47:54.868137 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced55292-2335-43c9-be26-27f6c1fb06b5 None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:47:54.868417 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced55292-2335-43c9-be26-27f6c1fb06b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:47:54.868691 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced55292-2335-43c9-be26-27f6c1fb06b5 None admin] PATH_INFO: `/v3/projects/db66614609564cbf9e5fb3c7e35442d4` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:47:54.869352 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b04c48-5ad7-4962-a314-b2864a1a15d7 None admin] RBAC: Authorizing `identity:get_project(project_id=db66614609564cbf9e5fb3c7e35442d4)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:47:54.870976 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b04c48-5ad7-4962-a314-b2864a1a15d7 None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:47:54.872824 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 135/266] 10.222.0.25 () {56 vars in 1186 bytes} [Thu Sep 15 17:47:54 2022] GET /identity/v3/projects/db66614609564cbf9e5fb3c7e35442d4 => generated 302 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 17:47:54.873693 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced55292-2335-43c9-be26-27f6c1fb06b5 None admin] RBAC: Authorizing `identity:get_project(project_id=db66614609564cbf9e5fb3c7e35442d4)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:47:54.875241 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced55292-2335-43c9-be26-27f6c1fb06b5 None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:47:54.877088 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 132/267] 10.222.0.25 () {56 vars in 1186 bytes} [Thu Sep 15 17:47:54 2022] GET /identity/v3/projects/db66614609564cbf9e5fb3c7e35442d4 => generated 302 bytes in 399 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 17:47:54.883196 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b04c48-5ad7-4962-a314-b2864a1a15d7 None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:47:54.885033 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced55292-2335-43c9-be26-27f6c1fb06b5 None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:47:54.940343 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:47:54.997382 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b04c48-5ad7-4962-a314-b2864a1a15d7 None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:47:55.065933 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde4f48a-3de4-4f15-8a93-79257c97bf77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:47:55.066555 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde4f48a-3de4-4f15-8a93-79257c97bf77 None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:47:55.066894 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde4f48a-3de4-4f15-8a93-79257c97bf77 None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:47:55.067162 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde4f48a-3de4-4f15-8a93-79257c97bf77 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:47:55.067901 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde4f48a-3de4-4f15-8a93-79257c97bf77 None admin] RBAC: Adding query filter params (role.id=0dd1b9f5b7924e20a665ce50d6e34dc7, scope.project.id=db66614609564cbf9e5fb3c7e35442d4, user.id=a303232e7f114a67988a8375149b82f2) {{(pid=81592) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 17:47:55.068200 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde4f48a-3de4-4f15-8a93-79257c97bf77 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:47:55.070234 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde4f48a-3de4-4f15-8a93-79257c97bf77 None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:47:55.086925 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 136/268] 10.222.0.25 () {56 vars in 1374 bytes} [Thu Sep 15 17:47:54 2022] GET /identity/v3/role_assignments?user.id=a303232e7f114a67988a8375149b82f2&scope.project.id=db66614609564cbf9e5fb3c7e35442d4&role.id=0dd1b9f5b7924e20a665ce50d6e34dc7 => generated 608 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 17:47:55.109812 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:47:55.117336 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced55292-2335-43c9-be26-27f6c1fb06b5 None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:47:55.171890 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8fb3b5d-0ac0-4453-a980-89e7b85d9f2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:47:55.172512 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fb3b5d-0ac0-4453-a980-89e7b85d9f2d None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:47:55.172782 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fb3b5d-0ac0-4453-a980-89e7b85d9f2d None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:47:55.173053 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fb3b5d-0ac0-4453-a980-89e7b85d9f2d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:47:55.173830 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8fb3b5d-0ac0-4453-a980-89e7b85d9f2d None admin] RBAC: Adding query filter params (role.id=a9e42be86923434f8af52d3fc07fb4f7, scope.project.id=db66614609564cbf9e5fb3c7e35442d4, user.id=a303232e7f114a67988a8375149b82f2) {{(pid=81593) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 17:47:55.174133 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8fb3b5d-0ac0-4453-a980-89e7b85d9f2d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:47:55.175619 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8fb3b5d-0ac0-4453-a980-89e7b85d9f2d None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:47:55.186486 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 133/269] 10.222.0.25 () {56 vars in 1374 bytes} [Thu Sep 15 17:47:54 2022] GET /identity/v3/role_assignments?user.id=a303232e7f114a67988a8375149b82f2&scope.project.id=db66614609564cbf9e5fb3c7e35442d4&role.id=a9e42be86923434f8af52d3fc07fb4f7 => generated 608 bytes in 302 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 17:47:55.264293 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e53c7a-3571-4d07-8795-3c72a1f31324 None None] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:47:55.264643 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e53c7a-3571-4d07-8795-3c72a1f31324 None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:47:55.264848 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e53c7a-3571-4d07-8795-3c72a1f31324 None None] PATH_INFO: `/` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:47:55.266705 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 137/270] 10.222.0.25 () {54 vars in 927 bytes} [Thu Sep 15 17:47:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 17:47:55.275568 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164bb6b1-8876-4bc2-8582-216051742d9a None None] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:47:55.275568 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164bb6b1-8876-4bc2-8582-216051742d9a None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:47:55.275568 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164bb6b1-8876-4bc2-8582-216051742d9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:47:55.304068 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.auth.core [None req-164bb6b1-8876-4bc2-8582-216051742d9a None None] MFA Rules not processed for user `5cfa58ef86774ab7800bf91930bf6028`. Rule list: `[]` (Enabled: `True`). {{(pid=81593) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 17:47:55.305318 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-164bb6b1-8876-4bc2-8582-216051742d9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 17:47:55.326259 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf22504-5281-4b2d-861e-6918e36ca6af None None] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:47:55.326771 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf22504-5281-4b2d-861e-6918e36ca6af None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:47:55.327088 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf22504-5281-4b2d-861e-6918e36ca6af None None] PATH_INFO: `/` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:47:55.329774 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 138/271] 10.222.0.25 () {54 vars in 927 bytes} [Thu Sep 15 17:47:55 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 17:47:55.336155 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966b7eb0-a76e-4915-9d1a-5c9b803f1a09 None None] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:47:55.336373 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966b7eb0-a76e-4915-9d1a-5c9b803f1a09 None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:47:55.337072 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966b7eb0-a76e-4915-9d1a-5c9b803f1a09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:47:55.378442 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.auth.core [None req-966b7eb0-a76e-4915-9d1a-5c9b803f1a09 None None] MFA Rules not processed for user `5cfa58ef86774ab7800bf91930bf6028`. Rule list: `[]` (Enabled: `True`). {{(pid=81592) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 17:47:55.380286 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-966b7eb0-a76e-4915-9d1a-5c9b803f1a09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 17:47:55.448631 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 134/272] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Sep 15 17:47:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 15 17:47:55.510987 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 139/273] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Sep 15 17:47:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 15 17:47:55.599724 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db44b9f-fda1-4dba-9d9e-82b77653b0a9 None None] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:47:55.600085 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db44b9f-fda1-4dba-9d9e-82b77653b0a9 None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:47:55.600273 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db44b9f-fda1-4dba-9d9e-82b77653b0a9 None None] PATH_INFO: `/` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:47:55.601848 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 135/274] 10.222.0.25 () {54 vars in 927 bytes} [Thu Sep 15 17:47:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 17:47:55.615327 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ca27b6-820c-464c-a93f-d19b6d4cf45d None None] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:47:55.615628 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ca27b6-820c-464c-a93f-d19b6d4cf45d None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:47:55.615895 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ca27b6-820c-464c-a93f-d19b6d4cf45d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:47:55.637227 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.auth.core [None req-26ca27b6-820c-464c-a93f-d19b6d4cf45d None None] MFA Rules not processed for user `5cfa58ef86774ab7800bf91930bf6028`. Rule list: `[]` (Enabled: `True`). {{(pid=81592) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 17:47:55.638528 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-26ca27b6-820c-464c-a93f-d19b6d4cf45d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 17:47:55.689250 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:47:55.725840 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 140/275] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Sep 15 17:47:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 15 17:47:55.816373 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db44b9f-fda1-4dba-9d9e-82b77653b0a9 None None] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:47:55.843690 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ca27b6-820c-464c-a93f-d19b6d4cf45d None None] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:47:55.919070 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:47:55.942663 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db44b9f-fda1-4dba-9d9e-82b77653b0a9 None None] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:47:55.982592 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ca27b6-820c-464c-a93f-d19b6d4cf45d None None] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:47:55.986823 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c958c2-ef39-41a4-8f6a-560481765d5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:47:55.987466 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c958c2-ef39-41a4-8f6a-560481765d5b None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:47:55.987741 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c958c2-ef39-41a4-8f6a-560481765d5b None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:47:55.988009 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c958c2-ef39-41a4-8f6a-560481765d5b None admin] PATH_INFO: `/v3/roles/member` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:47:56.001738 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c958c2-ef39-41a4-8f6a-560481765d5b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 17:47:56.008399 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application [None req-e5c958c2-ef39-41a4-8f6a-560481765d5b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 15 17:47:56.008399 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 17:47:56.008399 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 17:47:56.008399 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 17:47:56.008399 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 17:47:56.008399 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 17:47:56.008399 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 17:47:56.008399 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 17:47:56.008399 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 17:47:56.008399 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 17:47:56.008399 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 17:47:56.008399 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 17:47:56.008399 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 17:47:56.008399 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 17:47:56.008399 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 17:47:56.008399 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 17:47:56.009265 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 17:47:56.009265 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 17:47:56.009265 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 17:47:56.009265 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 17:47:56.009265 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 17:47:56.009265 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 17:47:56.009265 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 17:47:56.009265 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 17:47:56.009265 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 17:47:56.009265 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 17:47:56.009265 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 17:47:56.009265 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application with Lock( Sep 15 17:47:56.009265 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 17:47:56.009265 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._enter() Sep 15 17:47:56.009265 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 17:47:56.009265 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 17:47:56.010164 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 17:47:56.010164 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.creator() Sep 15 17:47:56.010164 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 17:47:56.010164 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application created_value = creator( Sep 15 17:47:56.010164 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 17:47:56.010164 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 17:47:56.010164 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 17:47:56.010164 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 17:47:56.010164 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 17:47:56.010164 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 17:47:56.010164 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 15 17:47:56.010164 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Sep 15 17:47:56.010751 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 136/276] 10.222.0.25 () {56 vars in 1099 bytes} [Thu Sep 15 17:47:55 2022] GET /identity/v3/roles/member => generated 84 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 17:47:56.016468 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c958c2-ef39-41a4-8f6a-560481765d5b None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:47:56.021769 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267cab6e-4006-4210-81f0-64686c30ecf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:47:56.022579 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267cab6e-4006-4210-81f0-64686c30ecf8 None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:47:56.023016 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267cab6e-4006-4210-81f0-64686c30ecf8 None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:47:56.023422 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267cab6e-4006-4210-81f0-64686c30ecf8 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:47:56.035268 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267cab6e-4006-4210-81f0-64686c30ecf8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 17:47:56.040990 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application [None req-267cab6e-4006-4210-81f0-64686c30ecf8 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 15 17:47:56.040990 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 17:47:56.040990 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 17:47:56.040990 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 17:47:56.040990 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 17:47:56.040990 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 17:47:56.040990 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 17:47:56.040990 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 17:47:56.040990 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 17:47:56.040990 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 17:47:56.040990 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 17:47:56.040990 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 17:47:56.040990 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 17:47:56.040990 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 17:47:56.040990 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 17:47:56.040990 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 17:47:56.045259 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 17:47:56.045259 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 17:47:56.045259 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 17:47:56.045259 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 17:47:56.045259 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 17:47:56.045259 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 17:47:56.045259 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 17:47:56.045259 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 17:47:56.045259 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 17:47:56.045259 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 17:47:56.045259 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 17:47:56.045259 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application with Lock( Sep 15 17:47:56.045259 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 17:47:56.045259 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._enter() Sep 15 17:47:56.045259 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 17:47:56.045259 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 17:47:56.046073 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 17:47:56.046073 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.creator() Sep 15 17:47:56.046073 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 17:47:56.046073 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application created_value = creator( Sep 15 17:47:56.046073 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 17:47:56.046073 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 17:47:56.046073 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 17:47:56.046073 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 17:47:56.046073 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 17:47:56.046073 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 17:47:56.046073 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 15 17:47:56.046073 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Sep 15 17:47:56.046073 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 141/277] 10.222.0.25 () {56 vars in 1099 bytes} [Thu Sep 15 17:47:55 2022] GET /identity/v3/roles/reader => generated 84 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 15 17:47:56.046073 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267cab6e-4006-4210-81f0-64686c30ecf8 None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:47:56.084004 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:47:56.135279 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c958c2-ef39-41a4-8f6a-560481765d5b None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:47:56.162023 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267cab6e-4006-4210-81f0-64686c30ecf8 None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:47:56.169646 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb41f142-8ac9-442e-be2b-937866a5e86d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:47:56.170273 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb41f142-8ac9-442e-be2b-937866a5e86d None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:47:56.170549 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb41f142-8ac9-442e-be2b-937866a5e86d None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:47:56.170818 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb41f142-8ac9-442e-be2b-937866a5e86d None admin] PATH_INFO: `/v3/roles` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:47:56.171495 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb41f142-8ac9-442e-be2b-937866a5e86d None admin] RBAC: Adding query filter params (name=member) {{(pid=81593) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 17:47:56.171794 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb41f142-8ac9-442e-be2b-937866a5e86d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:47:56.173217 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb41f142-8ac9-442e-be2b-937866a5e86d None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:47:56.183201 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 137/278] 10.222.0.25 () {56 vars in 1101 bytes} [Thu Sep 15 17:47:56 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 17:47:56.184121 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb41f142-8ac9-442e-be2b-937866a5e86d None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:47:56.186722 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:47:56.206166 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7544da5-e4c8-429a-b066-7669ca5dd9b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:47:56.207067 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7544da5-e4c8-429a-b066-7669ca5dd9b3 None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:47:56.207518 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7544da5-e4c8-429a-b066-7669ca5dd9b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:47:56.208105 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7544da5-e4c8-429a-b066-7669ca5dd9b3 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:47:56.209355 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7544da5-e4c8-429a-b066-7669ca5dd9b3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:47:56.210822 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7544da5-e4c8-429a-b066-7669ca5dd9b3 None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:47:56.212805 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 142/279] 10.222.0.25 () {56 vars in 1108 bytes} [Thu Sep 15 17:47:56 2022] GET /identity/v3/domains/default => generated 199 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 17:47:56.213501 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7544da5-e4c8-429a-b066-7669ca5dd9b3 None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:47:56.309429 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb41f142-8ac9-442e-be2b-937866a5e86d None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:47:56.335469 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7544da5-e4c8-429a-b066-7669ca5dd9b3 None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:47:56.338097 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:47:56.351517 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a62d180-c29f-4c17-b50c-6aa381f50665 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:47:56.352212 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a62d180-c29f-4c17-b50c-6aa381f50665 None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:47:56.352577 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a62d180-c29f-4c17-b50c-6aa381f50665 None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:47:56.353014 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a62d180-c29f-4c17-b50c-6aa381f50665 None admin] PATH_INFO: `/v3/roles` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:47:56.353838 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a62d180-c29f-4c17-b50c-6aa381f50665 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81593) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 17:47:56.354152 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a62d180-c29f-4c17-b50c-6aa381f50665 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:47:56.356066 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a62d180-c29f-4c17-b50c-6aa381f50665 None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:47:56.369615 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 138/280] 10.222.0.25 () {56 vars in 1101 bytes} [Thu Sep 15 17:47:56 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 17:47:56.369615 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a62d180-c29f-4c17-b50c-6aa381f50665 None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:47:56.380321 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328434e8-24cf-47b7-b69c-ab8f1e52bef8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:47:56.380955 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328434e8-24cf-47b7-b69c-ab8f1e52bef8 None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:47:56.381235 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328434e8-24cf-47b7-b69c-ab8f1e52bef8 None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:47:56.381550 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328434e8-24cf-47b7-b69c-ab8f1e52bef8 None admin] PATH_INFO: `/v3/users/a3b84d52deb64b62ab9407d66bbc3f06` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:47:56.395522 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328434e8-24cf-47b7-b69c-ab8f1e52bef8 None admin] RBAC: Authorizing `identity:get_user(user_id=a3b84d52deb64b62ab9407d66bbc3f06)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:47:56.396993 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328434e8-24cf-47b7-b69c-ab8f1e52bef8 None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:47:56.398670 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 143/281] 10.222.0.25 () {56 vars in 1177 bytes} [Thu Sep 15 17:47:56 2022] GET /identity/v3/users/a3b84d52deb64b62ab9407d66bbc3f06 => generated 293 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 17:47:56.402876 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c44d0b-0cae-488c-a7fb-3d4992295d62 None None] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:47:56.404409 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c44d0b-0cae-488c-a7fb-3d4992295d62 None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:47:56.404710 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c44d0b-0cae-488c-a7fb-3d4992295d62 None None] PATH_INFO: `/` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:47:56.406294 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 144/282] 10.222.0.25 () {54 vars in 927 bytes} [Thu Sep 15 17:47:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 17:47:56.407057 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c44d0b-0cae-488c-a7fb-3d4992295d62 None None] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:47:56.431103 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:47:56.469939 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a62d180-c29f-4c17-b50c-6aa381f50665 None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:47:56.506551 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5a694c-044d-42de-9028-a8cb7b13077c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:47:56.507262 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5a694c-044d-42de-9028-a8cb7b13077c None admin] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:47:56.507536 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5a694c-044d-42de-9028-a8cb7b13077c None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:47:56.507806 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5a694c-044d-42de-9028-a8cb7b13077c None admin] PATH_INFO: `/v3/users` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:47:56.508457 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c5a694c-044d-42de-9028-a8cb7b13077c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:47:56.509959 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c5a694c-044d-42de-9028-a8cb7b13077c None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:47:56.520992 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c44d0b-0cae-488c-a7fb-3d4992295d62 None None] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:47:56.534025 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 139/283] 10.222.0.25 () {60 vars in 1132 bytes} [Thu Sep 15 17:47:56 2022] POST /identity/v3/users => generated 293 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 17:47:56.535328 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5a694c-044d-42de-9028-a8cb7b13077c None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:47:56.575376 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed98d8e2-0ba9-43a3-9918-91d1fad4d58a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:47:56.576435 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed98d8e2-0ba9-43a3-9918-91d1fad4d58a None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:47:56.576790 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed98d8e2-0ba9-43a3-9918-91d1fad4d58a None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:47:56.577064 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed98d8e2-0ba9-43a3-9918-91d1fad4d58a None admin] PATH_INFO: `/v3/users/2ac69b13a8ef40b9b8b044ede1de0f3c` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:47:56.578897 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed98d8e2-0ba9-43a3-9918-91d1fad4d58a None admin] RBAC: Authorizing `identity:get_user(user_id=2ac69b13a8ef40b9b8b044ede1de0f3c)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:47:56.580950 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed98d8e2-0ba9-43a3-9918-91d1fad4d58a None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:47:56.588596 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 145/284] 10.222.0.25 () {56 vars in 1177 bytes} [Thu Sep 15 17:47:56 2022] GET /identity/v3/users/2ac69b13a8ef40b9b8b044ede1de0f3c => generated 297 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 17:47:56.588596 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30138c17-05fc-486c-9b03-393b67e0ada7 None None] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:47:56.588596 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30138c17-05fc-486c-9b03-393b67e0ada7 None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:47:56.588596 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30138c17-05fc-486c-9b03-393b67e0ada7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:47:56.607807 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.auth.core [None req-30138c17-05fc-486c-9b03-393b67e0ada7 None None] MFA Rules not processed for user `5cfa58ef86774ab7800bf91930bf6028`. Rule list: `[]` (Enabled: `True`). {{(pid=81592) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 17:47:56.609187 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-30138c17-05fc-486c-9b03-393b67e0ada7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 17:47:56.638638 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:47:56.698203 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5a694c-044d-42de-9028-a8cb7b13077c None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:47:56.713433 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 146/285] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Sep 15 17:47:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 15 17:47:56.713433 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30138c17-05fc-486c-9b03-393b67e0ada7 None None] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:47:56.728960 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:47:56.751636 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde31457-4515-485c-afee-f0b4280580a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:47:56.752409 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde31457-4515-485c-afee-f0b4280580a9 None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:47:56.752697 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde31457-4515-485c-afee-f0b4280580a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:47:56.752968 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde31457-4515-485c-afee-f0b4280580a9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:47:56.754077 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde31457-4515-485c-afee-f0b4280580a9 None admin] RBAC: Adding query filter params (role.id=343cc8b1bc7243eebabdf08147e8366d, user.id=a3b84d52deb64b62ab9407d66bbc3f06, scope.system=all) {{(pid=81593) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 17:47:56.754432 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde31457-4515-485c-afee-f0b4280580a9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:47:56.755911 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde31457-4515-485c-afee-f0b4280580a9 None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:47:56.767115 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 140/286] 10.222.0.25 () {56 vars in 1308 bytes} [Thu Sep 15 17:47:56 2022] GET /identity/v3/role_assignments?user.id=a3b84d52deb64b62ab9407d66bbc3f06&scope.system=all&role.id=343cc8b1bc7243eebabdf08147e8366d => generated 226 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 17:47:56.858280 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30138c17-05fc-486c-9b03-393b67e0ada7 None None] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:47:56.901427 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513b0408-9786-4d78-a4f1-47ecbf7da2bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:47:56.902498 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513b0408-9786-4d78-a4f1-47ecbf7da2bf None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:47:56.902984 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513b0408-9786-4d78-a4f1-47ecbf7da2bf None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:47:56.903492 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513b0408-9786-4d78-a4f1-47ecbf7da2bf None admin] PATH_INFO: `/v3/projects/db66614609564cbf9e5fb3c7e35442d4` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:47:56.905017 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513b0408-9786-4d78-a4f1-47ecbf7da2bf None admin] RBAC: Authorizing `identity:get_project(project_id=db66614609564cbf9e5fb3c7e35442d4)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:47:56.906841 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513b0408-9786-4d78-a4f1-47ecbf7da2bf None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:47:56.908935 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 147/287] 10.222.0.25 () {56 vars in 1186 bytes} [Thu Sep 15 17:47:56 2022] GET /identity/v3/projects/db66614609564cbf9e5fb3c7e35442d4 => generated 302 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 17:47:56.916283 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde31457-4515-485c-afee-f0b4280580a9 None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:47:56.999156 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513b0408-9786-4d78-a4f1-47ecbf7da2bf None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:47:57.044965 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:47:57.059978 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde31457-4515-485c-afee-f0b4280580a9 None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:47:57.107722 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e02b3ef-1f4f-488c-ae7f-af59de837557 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:47:57.108848 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e02b3ef-1f4f-488c-ae7f-af59de837557 None admin] REQUEST_METHOD: `PUT` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:47:57.109127 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e02b3ef-1f4f-488c-ae7f-af59de837557 None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:47:57.109501 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e02b3ef-1f4f-488c-ae7f-af59de837557 None admin] PATH_INFO: `/v3/projects/db66614609564cbf9e5fb3c7e35442d4/users/2ac69b13a8ef40b9b8b044ede1de0f3c/roles/80bb25250ed34dd9a6ed0740bcc3dac6` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:47:57.112643 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e02b3ef-1f4f-488c-ae7f-af59de837557 None admin] RBAC: Authorizing `identity:create_grant(project_id=db66614609564cbf9e5fb3c7e35442d4, user_id=2ac69b13a8ef40b9b8b044ede1de0f3c, role_id=80bb25250ed34dd9a6ed0740bcc3dac6)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:47:57.114300 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e02b3ef-1f4f-488c-ae7f-af59de837557 None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:47:57.138100 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 141/288] 10.222.0.25 () {58 vars in 1439 bytes} [Thu Sep 15 17:47:56 2022] PUT /identity/v3/projects/db66614609564cbf9e5fb3c7e35442d4/users/2ac69b13a8ef40b9b8b044ede1de0f3c/roles/80bb25250ed34dd9a6ed0740bcc3dac6 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 17:47:57.153533 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513b0408-9786-4d78-a4f1-47ecbf7da2bf None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:47:57.198694 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97669bb0-38ec-4412-afc7-d7bbcb030a3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:47:57.199811 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97669bb0-38ec-4412-afc7-d7bbcb030a3a None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:47:57.200282 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97669bb0-38ec-4412-afc7-d7bbcb030a3a None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:47:57.200752 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97669bb0-38ec-4412-afc7-d7bbcb030a3a None admin] PATH_INFO: `/v3/roles/member` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:47:57.215778 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97669bb0-38ec-4412-afc7-d7bbcb030a3a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 17:47:57.221940 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application [None req-97669bb0-38ec-4412-afc7-d7bbcb030a3a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 15 17:47:57.221940 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 17:47:57.221940 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 17:47:57.221940 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 17:47:57.221940 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 17:47:57.221940 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 17:47:57.221940 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 17:47:57.221940 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 17:47:57.221940 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 17:47:57.221940 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 17:47:57.221940 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 17:47:57.221940 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 17:47:57.221940 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 17:47:57.221940 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 17:47:57.221940 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 17:47:57.221940 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 17:47:57.223004 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 17:47:57.223004 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 17:47:57.223004 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 17:47:57.223004 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 17:47:57.223004 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 17:47:57.223004 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 17:47:57.223004 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 17:47:57.223004 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 17:47:57.223004 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 17:47:57.223004 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 17:47:57.223004 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 17:47:57.223004 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application with Lock( Sep 15 17:47:57.223004 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 17:47:57.223004 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._enter() Sep 15 17:47:57.223004 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 17:47:57.223004 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 17:47:57.223898 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 17:47:57.223898 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.creator() Sep 15 17:47:57.223898 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 17:47:57.223898 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application created_value = creator( Sep 15 17:47:57.223898 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 17:47:57.223898 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 17:47:57.223898 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 17:47:57.223898 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 17:47:57.223898 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 17:47:57.223898 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 17:47:57.223898 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 15 17:47:57.223898 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Sep 15 17:47:57.226600 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 148/289] 10.222.0.25 () {56 vars in 1099 bytes} [Thu Sep 15 17:47:56 2022] GET /identity/v3/roles/member => generated 84 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 15 17:47:57.234220 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e02b3ef-1f4f-488c-ae7f-af59de837557 None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:47:57.297724 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:47:57.360696 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e02b3ef-1f4f-488c-ae7f-af59de837557 None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:47:57.402763 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195f3868-fd62-4018-b4a2-bdf6c9266a8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:47:57.403392 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195f3868-fd62-4018-b4a2-bdf6c9266a8b None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:47:57.403747 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195f3868-fd62-4018-b4a2-bdf6c9266a8b None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:47:57.404027 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195f3868-fd62-4018-b4a2-bdf6c9266a8b None admin] PATH_INFO: `/v3/roles` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:47:57.404826 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195f3868-fd62-4018-b4a2-bdf6c9266a8b None admin] RBAC: Adding query filter params (name=member) {{(pid=81593) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 17:47:57.405163 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195f3868-fd62-4018-b4a2-bdf6c9266a8b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:47:57.406889 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195f3868-fd62-4018-b4a2-bdf6c9266a8b None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:47:57.418060 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 142/290] 10.222.0.25 () {56 vars in 1101 bytes} [Thu Sep 15 17:47:57 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 17:47:57.424416 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97669bb0-38ec-4412-afc7-d7bbcb030a3a None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:47:57.545264 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:47:57.565846 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97669bb0-38ec-4412-afc7-d7bbcb030a3a None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:47:57.612805 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0a1b20-aef6-4c6d-bc0d-dcca9e4a6dee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:47:57.613383 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0a1b20-aef6-4c6d-bc0d-dcca9e4a6dee None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:47:57.614241 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0a1b20-aef6-4c6d-bc0d-dcca9e4a6dee None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:47:57.614518 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0a1b20-aef6-4c6d-bc0d-dcca9e4a6dee None admin] PATH_INFO: `/v3/users/ce95965c617a4cabbfe2e097fe3363f4` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:47:57.616989 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0a1b20-aef6-4c6d-bc0d-dcca9e4a6dee None admin] RBAC: Authorizing `identity:get_user(user_id=ce95965c617a4cabbfe2e097fe3363f4)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:47:57.618544 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0a1b20-aef6-4c6d-bc0d-dcca9e4a6dee None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:47:57.620282 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 149/291] 10.222.0.25 () {56 vars in 1177 bytes} [Thu Sep 15 17:47:57 2022] GET /identity/v3/users/ce95965c617a4cabbfe2e097fe3363f4 => generated 297 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 17:47:57.626403 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195f3868-fd62-4018-b4a2-bdf6c9266a8b None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:47:57.740176 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195f3868-fd62-4018-b4a2-bdf6c9266a8b None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:47:57.758480 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:47:57.777555 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657dcbb8-fe47-4633-9a5a-6efec0ac791c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:47:57.778223 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657dcbb8-fe47-4633-9a5a-6efec0ac791c None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:47:57.778526 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657dcbb8-fe47-4633-9a5a-6efec0ac791c None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:47:57.778904 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657dcbb8-fe47-4633-9a5a-6efec0ac791c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:47:57.854436 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-657dcbb8-fe47-4633-9a5a-6efec0ac791c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:47:57.856269 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-657dcbb8-fe47-4633-9a5a-6efec0ac791c None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:47:57.966543 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 143/292] 10.222.0.25 () {58 vars in 1282 bytes} [Thu Sep 15 17:47:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 15 17:47:57.974206 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0a1b20-aef6-4c6d-bc0d-dcca9e4a6dee None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:47:58.081683 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0a1b20-aef6-4c6d-bc0d-dcca9e4a6dee None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:47:58.131654 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064843cf-860c-4245-8c1c-3f61f470fceb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:47:58.132308 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064843cf-860c-4245-8c1c-3f61f470fceb None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:47:58.132591 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064843cf-860c-4245-8c1c-3f61f470fceb None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:47:58.132863 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064843cf-860c-4245-8c1c-3f61f470fceb None admin] PATH_INFO: `/v3/projects/db66614609564cbf9e5fb3c7e35442d4` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:47:58.134048 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-064843cf-860c-4245-8c1c-3f61f470fceb None admin] RBAC: Authorizing `identity:get_project(project_id=db66614609564cbf9e5fb3c7e35442d4)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:47:58.135551 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-064843cf-860c-4245-8c1c-3f61f470fceb None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:47:58.137376 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 150/293] 10.222.0.25 () {56 vars in 1186 bytes} [Thu Sep 15 17:47:57 2022] GET /identity/v3/projects/db66614609564cbf9e5fb3c7e35442d4 => generated 302 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 17:47:58.143155 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657dcbb8-fe47-4633-9a5a-6efec0ac791c None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:47:58.152316 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:47:58.251809 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657dcbb8-fe47-4633-9a5a-6efec0ac791c None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:47:58.289208 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9f2932-5845-4ece-96e4-ff5f7216d2be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:47:58.289929 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9f2932-5845-4ece-96e4-ff5f7216d2be None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:47:58.290208 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9f2932-5845-4ece-96e4-ff5f7216d2be None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:47:58.290480 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9f2932-5845-4ece-96e4-ff5f7216d2be None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:47:58.291215 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a9f2932-5845-4ece-96e4-ff5f7216d2be None admin] RBAC: Adding query filter params (role.id=343cc8b1bc7243eebabdf08147e8366d, scope.project.id=db66614609564cbf9e5fb3c7e35442d4, user.id=ce95965c617a4cabbfe2e097fe3363f4) {{(pid=81593) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 17:47:58.291525 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a9f2932-5845-4ece-96e4-ff5f7216d2be None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:47:58.292980 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a9f2932-5845-4ece-96e4-ff5f7216d2be None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:47:58.299615 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 144/294] 10.222.0.25 () {56 vars in 1374 bytes} [Thu Sep 15 17:47:58 2022] GET /identity/v3/role_assignments?user.id=ce95965c617a4cabbfe2e097fe3363f4&scope.project.id=db66614609564cbf9e5fb3c7e35442d4&role.id=343cc8b1bc7243eebabdf08147e8366d => generated 608 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 17:47:59.359394 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6482706-8fa3-441a-84aa-8d0bf4e795bd None None] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:47:59.359913 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6482706-8fa3-441a-84aa-8d0bf4e795bd None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:47:59.359913 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6482706-8fa3-441a-84aa-8d0bf4e795bd None None] PATH_INFO: `/` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:47:59.361416 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 151/295] 10.222.0.25 () {54 vars in 927 bytes} [Thu Sep 15 17:47:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 17:47:59.366747 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034ea40c-5ec5-4f4b-87c8-701e8bcb2069 None None] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:47:59.367162 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034ea40c-5ec5-4f4b-87c8-701e8bcb2069 None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:47:59.367325 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034ea40c-5ec5-4f4b-87c8-701e8bcb2069 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:47:59.386910 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.auth.core [None req-034ea40c-5ec5-4f4b-87c8-701e8bcb2069 None None] MFA Rules not processed for user `5cfa58ef86774ab7800bf91930bf6028`. Rule list: `[]` (Enabled: `True`). {{(pid=81593) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 17:47:59.388160 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-034ea40c-5ec5-4f4b-87c8-701e8bcb2069 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 17:47:59.443291 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d921463-e5b8-4bea-87ba-cb15fe2b98ce None None] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:47:59.443594 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d921463-e5b8-4bea-87ba-cb15fe2b98ce None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:47:59.443833 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d921463-e5b8-4bea-87ba-cb15fe2b98ce None None] PATH_INFO: `/` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:47:59.445155 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 152/296] 10.222.0.25 () {54 vars in 927 bytes} [Thu Sep 15 17:47:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 15 17:47:59.450446 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1e4013-f2eb-43cb-83c7-438cfde0a8c3 None None] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:47:59.450725 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1e4013-f2eb-43cb-83c7-438cfde0a8c3 None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:47:59.450997 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1e4013-f2eb-43cb-83c7-438cfde0a8c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:47:59.461064 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 145/297] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Sep 15 17:47:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 15 17:47:59.465669 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:47:59.469451 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.auth.core [None req-7e1e4013-f2eb-43cb-83c7-438cfde0a8c3 None None] MFA Rules not processed for user `5cfa58ef86774ab7800bf91930bf6028`. Rule list: `[]` (Enabled: `True`). {{(pid=81592) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 17:47:59.470639 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-7e1e4013-f2eb-43cb-83c7-438cfde0a8c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 17:47:59.488312 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:47:59.545411 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 153/298] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Sep 15 17:47:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 15 17:47:59.745861 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc2a3c1-84b3-4a04-a248-d9eba296b23e None None] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:47:59.746653 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc2a3c1-84b3-4a04-a248-d9eba296b23e None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:47:59.746936 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc2a3c1-84b3-4a04-a248-d9eba296b23e None None] PATH_INFO: `/` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:47:59.747500 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1e4013-f2eb-43cb-83c7-438cfde0a8c3 None None] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:47:59.748555 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 146/299] 10.222.0.25 () {54 vars in 927 bytes} [Thu Sep 15 17:47:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 17:47:59.754196 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1431307f-2718-4920-aaa1-410af6a782c3 None None] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:47:59.754482 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1431307f-2718-4920-aaa1-410af6a782c3 None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:47:59.754751 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1431307f-2718-4920-aaa1-410af6a782c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:47:59.773810 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.auth.core [None req-1431307f-2718-4920-aaa1-410af6a782c3 None None] MFA Rules not processed for user `5cfa58ef86774ab7800bf91930bf6028`. Rule list: `[]` (Enabled: `True`). {{(pid=81593) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 17:47:59.775111 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-1431307f-2718-4920-aaa1-410af6a782c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 17:47:59.846854 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 147/300] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Sep 15 17:47:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 15 17:47:59.853313 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155f5e10-0802-4b33-a373-7de9382c01d1 None None] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:47:59.853603 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155f5e10-0802-4b33-a373-7de9382c01d1 None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:47:59.853880 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155f5e10-0802-4b33-a373-7de9382c01d1 None None] PATH_INFO: `/` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:47:59.855310 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 148/301] 10.222.0.25 () {54 vars in 927 bytes} [Thu Sep 15 17:47:59 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 17:47:59.856184 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155f5e10-0802-4b33-a373-7de9382c01d1 None None] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:47:59.857828 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1e4013-f2eb-43cb-83c7-438cfde0a8c3 None None] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:47:59.900108 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e4b01b-b650-4e1a-98a7-5b51e40aeb51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:47:59.900746 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e4b01b-b650-4e1a-98a7-5b51e40aeb51 None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:47:59.901028 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e4b01b-b650-4e1a-98a7-5b51e40aeb51 None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:47:59.901329 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e4b01b-b650-4e1a-98a7-5b51e40aeb51 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:47:59.911936 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e4b01b-b650-4e1a-98a7-5b51e40aeb51 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 17:47:59.916871 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application [None req-e8e4b01b-b650-4e1a-98a7-5b51e40aeb51 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 15 17:47:59.916871 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 17:47:59.916871 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 17:47:59.916871 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 17:47:59.916871 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 17:47:59.916871 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 17:47:59.916871 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 17:47:59.916871 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 17:47:59.916871 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 17:47:59.916871 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 17:47:59.916871 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 17:47:59.916871 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 17:47:59.916871 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 17:47:59.916871 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 17:47:59.916871 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 17:47:59.916871 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 17:47:59.917779 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 17:47:59.917779 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 17:47:59.917779 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 17:47:59.917779 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 17:47:59.917779 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 17:47:59.917779 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 17:47:59.917779 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 17:47:59.917779 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 17:47:59.917779 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 17:47:59.917779 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 17:47:59.917779 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 17:47:59.917779 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application with Lock( Sep 15 17:47:59.917779 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 17:47:59.917779 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._enter() Sep 15 17:47:59.917779 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 17:47:59.917779 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 17:47:59.918928 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 17:47:59.918928 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.creator() Sep 15 17:47:59.918928 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 17:47:59.918928 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application created_value = creator( Sep 15 17:47:59.918928 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 17:47:59.918928 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 17:47:59.918928 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 17:47:59.918928 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 17:47:59.918928 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 17:47:59.918928 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 17:47:59.918928 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 15 17:47:59.918928 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Sep 15 17:47:59.918928 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 154/302] 10.222.0.25 () {56 vars in 1099 bytes} [Thu Sep 15 17:47:59 2022] GET /identity/v3/roles/member => generated 84 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 15 17:47:59.923818 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d9f5f5-3ada-4fda-8130-49e1c821aad1 None None] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:47:59.924311 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d9f5f5-3ada-4fda-8130-49e1c821aad1 None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:47:59.924774 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d9f5f5-3ada-4fda-8130-49e1c821aad1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:47:59.945417 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.auth.core [None req-36d9f5f5-3ada-4fda-8130-49e1c821aad1 None None] MFA Rules not processed for user `5cfa58ef86774ab7800bf91930bf6028`. Rule list: `[]` (Enabled: `True`). {{(pid=81592) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 17:47:59.947284 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-36d9f5f5-3ada-4fda-8130-49e1c821aad1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 17:47:59.955081 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:47:59.970512 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155f5e10-0802-4b33-a373-7de9382c01d1 None None] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:48:00.008574 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:48:00.016759 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef4bda3-234b-4f93-a954-184df1ad8564 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:48:00.017955 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef4bda3-234b-4f93-a954-184df1ad8564 None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:48:00.018452 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef4bda3-234b-4f93-a954-184df1ad8564 None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:48:00.018943 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef4bda3-234b-4f93-a954-184df1ad8564 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:48:00.020844 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 155/303] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Sep 15 17:47:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 15 17:48:00.021585 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d9f5f5-3ada-4fda-8130-49e1c821aad1 None None] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:48:00.048361 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef4bda3-234b-4f93-a954-184df1ad8564 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 17:48:00.056888 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application [None req-5ef4bda3-234b-4f93-a954-184df1ad8564 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 15 17:48:00.056888 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 17:48:00.056888 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 17:48:00.056888 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 17:48:00.056888 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 17:48:00.056888 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 17:48:00.056888 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 17:48:00.056888 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 17:48:00.056888 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 17:48:00.056888 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 17:48:00.056888 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 17:48:00.056888 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 17:48:00.056888 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 17:48:00.056888 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 17:48:00.056888 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 17:48:00.056888 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 17:48:00.057805 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 17:48:00.057805 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 17:48:00.057805 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 17:48:00.057805 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 17:48:00.057805 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 17:48:00.057805 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 17:48:00.057805 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 17:48:00.057805 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 17:48:00.057805 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 17:48:00.057805 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 17:48:00.057805 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 17:48:00.057805 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application with Lock( Sep 15 17:48:00.057805 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 17:48:00.057805 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._enter() Sep 15 17:48:00.057805 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 17:48:00.057805 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 17:48:00.058608 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 17:48:00.058608 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.creator() Sep 15 17:48:00.058608 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 17:48:00.058608 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application created_value = creator( Sep 15 17:48:00.058608 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 17:48:00.058608 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 17:48:00.058608 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 17:48:00.058608 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 17:48:00.058608 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 17:48:00.058608 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 17:48:00.058608 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 15 17:48:00.058608 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Sep 15 17:48:00.061597 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 149/304] 10.222.0.25 () {56 vars in 1099 bytes} [Thu Sep 15 17:47:59 2022] GET /identity/v3/roles/reader => generated 84 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 17:48:00.067699 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef4bda3-234b-4f93-a954-184df1ad8564 None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:48:00.143443 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d9f5f5-3ada-4fda-8130-49e1c821aad1 None None] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:48:00.180235 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c348ee-1872-487f-8d29-43c8a442fe33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:48:00.180841 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c348ee-1872-487f-8d29-43c8a442fe33 None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:48:00.181119 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c348ee-1872-487f-8d29-43c8a442fe33 None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:48:00.181421 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c348ee-1872-487f-8d29-43c8a442fe33 None admin] PATH_INFO: `/v3/roles` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:48:00.182091 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c348ee-1872-487f-8d29-43c8a442fe33 None admin] RBAC: Adding query filter params (name=member) {{(pid=81592) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 17:48:00.182390 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c348ee-1872-487f-8d29-43c8a442fe33 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:48:00.183754 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c348ee-1872-487f-8d29-43c8a442fe33 None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:48:00.190086 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef4bda3-234b-4f93-a954-184df1ad8564 None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:48:00.193764 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 156/305] 10.222.0.25 () {56 vars in 1101 bytes} [Thu Sep 15 17:48:00 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 17:48:00.194554 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c348ee-1872-487f-8d29-43c8a442fe33 None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:48:00.202310 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:48:00.227247 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c14ad9-e2d9-4243-9c28-391a43a8f645 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:48:00.227866 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c14ad9-e2d9-4243-9c28-391a43a8f645 None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:48:00.228140 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c14ad9-e2d9-4243-9c28-391a43a8f645 None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:48:00.228407 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c14ad9-e2d9-4243-9c28-391a43a8f645 None admin] PATH_INFO: `/v3/roles` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:48:00.229070 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c14ad9-e2d9-4243-9c28-391a43a8f645 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81593) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 17:48:00.229400 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c14ad9-e2d9-4243-9c28-391a43a8f645 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:48:00.231026 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c14ad9-e2d9-4243-9c28-391a43a8f645 None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:48:00.239785 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 150/306] 10.222.0.25 () {56 vars in 1101 bytes} [Thu Sep 15 17:48:00 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 17:48:00.240394 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c14ad9-e2d9-4243-9c28-391a43a8f645 None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:48:00.295672 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:48:00.310973 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c348ee-1872-487f-8d29-43c8a442fe33 None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:48:00.343073 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c14ad9-e2d9-4243-9c28-391a43a8f645 None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:48:00.345162 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e22c48-b669-4fb4-a51b-e3ddb2f2d148 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:48:00.345912 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e22c48-b669-4fb4-a51b-e3ddb2f2d148 None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:48:00.346188 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e22c48-b669-4fb4-a51b-e3ddb2f2d148 None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:48:00.346451 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e22c48-b669-4fb4-a51b-e3ddb2f2d148 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:48:00.347824 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e22c48-b669-4fb4-a51b-e3ddb2f2d148 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:48:00.350355 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e22c48-b669-4fb4-a51b-e3ddb2f2d148 None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:48:00.352803 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 157/307] 10.222.0.25 () {56 vars in 1108 bytes} [Thu Sep 15 17:48:00 2022] GET /identity/v3/domains/default => generated 199 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 17:48:00.354077 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e22c48-b669-4fb4-a51b-e3ddb2f2d148 None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:48:00.382767 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd19a763-6452-44df-9488-f3ed95b29a8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:48:00.384705 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd19a763-6452-44df-9488-f3ed95b29a8a None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:48:00.385211 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd19a763-6452-44df-9488-f3ed95b29a8a None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:48:00.385529 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd19a763-6452-44df-9488-f3ed95b29a8a None admin] PATH_INFO: `/v3/users/a3b84d52deb64b62ab9407d66bbc3f06` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:48:00.386878 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd19a763-6452-44df-9488-f3ed95b29a8a None admin] RBAC: Authorizing `identity:get_user(user_id=a3b84d52deb64b62ab9407d66bbc3f06)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:48:00.388352 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd19a763-6452-44df-9488-f3ed95b29a8a None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:48:00.389992 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 151/308] 10.222.0.25 () {56 vars in 1177 bytes} [Thu Sep 15 17:48:00 2022] GET /identity/v3/users/a3b84d52deb64b62ab9407d66bbc3f06 => generated 293 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 17:48:00.393101 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd19a763-6452-44df-9488-f3ed95b29a8a None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:48:00.435869 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:48:00.465780 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e22c48-b669-4fb4-a51b-e3ddb2f2d148 None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:48:00.497074 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd19a763-6452-44df-9488-f3ed95b29a8a None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:48:00.505785 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e65d9e-3641-45d1-abbd-a4f5b187ee74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:48:00.506759 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e65d9e-3641-45d1-abbd-a4f5b187ee74 None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:48:00.507039 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e65d9e-3641-45d1-abbd-a4f5b187ee74 None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:48:00.507313 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e65d9e-3641-45d1-abbd-a4f5b187ee74 None admin] PATH_INFO: `/v3/users/c3154b550b4346979a7f41e5365f922f` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:48:00.516738 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:48:00.520787 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e65d9e-3641-45d1-abbd-a4f5b187ee74 None admin] RBAC: Authorizing `identity:get_user(user_id=c3154b550b4346979a7f41e5365f922f)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:48:00.522249 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e65d9e-3641-45d1-abbd-a4f5b187ee74 None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:48:00.524212 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 158/309] 10.222.0.25 () {56 vars in 1177 bytes} [Thu Sep 15 17:48:00 2022] GET /identity/v3/users/c3154b550b4346979a7f41e5365f922f => generated 293 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 17:48:00.524714 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e65d9e-3641-45d1-abbd-a4f5b187ee74 None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:48:00.538000 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f77ac6-3506-4bd2-a75a-f175a43b7d50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:48:00.538642 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f77ac6-3506-4bd2-a75a-f175a43b7d50 None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:48:00.538925 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f77ac6-3506-4bd2-a75a-f175a43b7d50 None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:48:00.539198 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f77ac6-3506-4bd2-a75a-f175a43b7d50 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:48:00.551703 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f77ac6-3506-4bd2-a75a-f175a43b7d50 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 17:48:00.557811 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application [None req-37f77ac6-3506-4bd2-a75a-f175a43b7d50 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 15 17:48:00.557811 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 17:48:00.557811 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 17:48:00.557811 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 17:48:00.557811 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 17:48:00.557811 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 17:48:00.557811 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 17:48:00.557811 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 17:48:00.557811 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 17:48:00.557811 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 17:48:00.557811 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 17:48:00.557811 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 17:48:00.557811 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 17:48:00.557811 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 17:48:00.557811 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 17:48:00.557811 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 17:48:00.558769 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 17:48:00.558769 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 17:48:00.558769 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 17:48:00.558769 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 17:48:00.558769 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 17:48:00.558769 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 17:48:00.558769 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 17:48:00.558769 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 17:48:00.558769 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 17:48:00.558769 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 17:48:00.558769 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 17:48:00.558769 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application with Lock( Sep 15 17:48:00.558769 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 17:48:00.558769 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._enter() Sep 15 17:48:00.558769 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 17:48:00.558769 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 17:48:00.559599 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 17:48:00.559599 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.creator() Sep 15 17:48:00.559599 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 17:48:00.559599 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application created_value = creator( Sep 15 17:48:00.559599 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 17:48:00.559599 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 17:48:00.559599 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 17:48:00.559599 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 17:48:00.559599 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 17:48:00.559599 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 17:48:00.559599 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 15 17:48:00.559599 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Sep 15 17:48:00.559599 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 152/310] 10.222.0.25 () {56 vars in 1099 bytes} [Thu Sep 15 17:48:00 2022] GET /identity/v3/roles/reader => generated 84 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 17:48:00.560647 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f77ac6-3506-4bd2-a75a-f175a43b7d50 None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:48:00.632633 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e65d9e-3641-45d1-abbd-a4f5b187ee74 None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:48:00.661320 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:48:00.665552 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f77ac6-3506-4bd2-a75a-f175a43b7d50 None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:48:00.667418 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea4181c-322c-4258-a89b-71199e372c35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:48:00.668031 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea4181c-322c-4258-a89b-71199e372c35 None admin] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:48:00.668308 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea4181c-322c-4258-a89b-71199e372c35 None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:48:00.668579 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea4181c-322c-4258-a89b-71199e372c35 None admin] PATH_INFO: `/v3/groups` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:48:00.669210 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea4181c-322c-4258-a89b-71199e372c35 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:48:00.670706 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea4181c-322c-4258-a89b-71199e372c35 None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:48:00.686446 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 159/311] 10.222.0.25 () {60 vars in 1134 bytes} [Thu Sep 15 17:48:00 2022] POST /identity/v3/groups => generated 229 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 17:48:00.690532 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea4181c-322c-4258-a89b-71199e372c35 None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:48:00.705198 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b725eb54-51a0-49ae-b4a7-58050e266bb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:48:00.705908 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b725eb54-51a0-49ae-b4a7-58050e266bb7 None admin] REQUEST_METHOD: `PUT` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:48:00.706184 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b725eb54-51a0-49ae-b4a7-58050e266bb7 None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:48:00.706487 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b725eb54-51a0-49ae-b4a7-58050e266bb7 None admin] PATH_INFO: `/v3/system/users/a3b84d52deb64b62ab9407d66bbc3f06/roles/343cc8b1bc7243eebabdf08147e8366d` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:48:00.708502 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b725eb54-51a0-49ae-b4a7-58050e266bb7 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=a3b84d52deb64b62ab9407d66bbc3f06, role_id=343cc8b1bc7243eebabdf08147e8366d)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:48:00.709984 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b725eb54-51a0-49ae-b4a7-58050e266bb7 None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:48:00.720636 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 153/312] 10.222.0.25 () {58 vars in 1334 bytes} [Thu Sep 15 17:48:00 2022] PUT /identity/v3/system/users/a3b84d52deb64b62ab9407d66bbc3f06/roles/343cc8b1bc7243eebabdf08147e8366d => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 17:48:00.721972 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b725eb54-51a0-49ae-b4a7-58050e266bb7 None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:48:00.782256 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:48:00.858694 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b725eb54-51a0-49ae-b4a7-58050e266bb7 None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:48:00.877509 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea4181c-322c-4258-a89b-71199e372c35 None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:48:00.915177 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0195e981-693d-47d6-b288-f6332d84fa40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:48:00.916407 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0195e981-693d-47d6-b288-f6332d84fa40 None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:48:00.916788 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0195e981-693d-47d6-b288-f6332d84fa40 None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:48:00.917730 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0195e981-693d-47d6-b288-f6332d84fa40 None admin] PATH_INFO: `/v3/roles` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:48:00.917937 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0195e981-693d-47d6-b288-f6332d84fa40 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81593) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 17:48:00.918212 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0195e981-693d-47d6-b288-f6332d84fa40 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:48:00.921062 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0195e981-693d-47d6-b288-f6332d84fa40 None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:48:00.932719 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89676d4b-932f-4107-8c52-ce4d00d7c5aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:48:00.932915 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 154/313] 10.222.0.25 () {56 vars in 1101 bytes} [Thu Sep 15 17:48:00 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 17:48:00.933985 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89676d4b-932f-4107-8c52-ce4d00d7c5aa None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:48:00.933985 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89676d4b-932f-4107-8c52-ce4d00d7c5aa None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:48:00.933985 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89676d4b-932f-4107-8c52-ce4d00d7c5aa None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:48:00.934747 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89676d4b-932f-4107-8c52-ce4d00d7c5aa None admin] RBAC: Adding query filter params (role.id=80bb25250ed34dd9a6ed0740bcc3dac6, user.id=c3154b550b4346979a7f41e5365f922f, scope.system=all) {{(pid=81592) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 17:48:00.935055 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89676d4b-932f-4107-8c52-ce4d00d7c5aa None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:48:00.936497 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89676d4b-932f-4107-8c52-ce4d00d7c5aa None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:48:00.939443 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0195e981-693d-47d6-b288-f6332d84fa40 None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:48:00.942598 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 160/314] 10.222.0.25 () {56 vars in 1308 bytes} [Thu Sep 15 17:48:00 2022] GET /identity/v3/role_assignments?user.id=c3154b550b4346979a7f41e5365f922f&scope.system=all&role.id=80bb25250ed34dd9a6ed0740bcc3dac6 => generated 226 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 17:48:01.063751 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0195e981-693d-47d6-b288-f6332d84fa40 None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:48:01.071899 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:48:01.108217 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1db0a4-2f29-4122-846f-95eb9f9e2b20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:48:01.108983 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1db0a4-2f29-4122-846f-95eb9f9e2b20 None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:48:01.109210 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1db0a4-2f29-4122-846f-95eb9f9e2b20 None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:48:01.109520 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1db0a4-2f29-4122-846f-95eb9f9e2b20 None admin] PATH_INFO: `/v3/users/2ac69b13a8ef40b9b8b044ede1de0f3c` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:48:01.110706 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1db0a4-2f29-4122-846f-95eb9f9e2b20 None admin] RBAC: Authorizing `identity:get_user(user_id=2ac69b13a8ef40b9b8b044ede1de0f3c)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:48:01.112197 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1db0a4-2f29-4122-846f-95eb9f9e2b20 None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:48:01.114925 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 155/315] 10.222.0.25 () {56 vars in 1177 bytes} [Thu Sep 15 17:48:00 2022] GET /identity/v3/users/2ac69b13a8ef40b9b8b044ede1de0f3c => generated 297 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 17:48:01.121400 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89676d4b-932f-4107-8c52-ce4d00d7c5aa None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:48:01.183801 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:48:01.232708 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89676d4b-932f-4107-8c52-ce4d00d7c5aa None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:48:01.274812 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d79a96f-cbc4-4b1e-9be7-6a673bb4d45e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:48:01.275429 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d79a96f-cbc4-4b1e-9be7-6a673bb4d45e None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:48:01.275709 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d79a96f-cbc4-4b1e-9be7-6a673bb4d45e None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:48:01.275981 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d79a96f-cbc4-4b1e-9be7-6a673bb4d45e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:48:01.347649 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d79a96f-cbc4-4b1e-9be7-6a673bb4d45e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:48:01.349686 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d79a96f-cbc4-4b1e-9be7-6a673bb4d45e None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:48:01.404985 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:48:01.452372 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 161/316] 10.222.0.25 () {58 vars in 1282 bytes} [Thu Sep 15 17:48:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 15 17:48:01.458108 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1db0a4-2f29-4122-846f-95eb9f9e2b20 None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:48:01.572092 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1db0a4-2f29-4122-846f-95eb9f9e2b20 None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:48:01.608387 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c98ec4-927d-4497-8807-24b522f9eb8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:48:01.609017 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c98ec4-927d-4497-8807-24b522f9eb8a None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:48:01.609310 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c98ec4-927d-4497-8807-24b522f9eb8a None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:48:01.609601 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c98ec4-927d-4497-8807-24b522f9eb8a None admin] PATH_INFO: `/v3/projects/db66614609564cbf9e5fb3c7e35442d4` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:48:01.610791 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c98ec4-927d-4497-8807-24b522f9eb8a None admin] RBAC: Authorizing `identity:get_project(project_id=db66614609564cbf9e5fb3c7e35442d4)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:48:01.612242 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c98ec4-927d-4497-8807-24b522f9eb8a None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:48:01.614284 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 156/317] 10.222.0.25 () {56 vars in 1186 bytes} [Thu Sep 15 17:48:01 2022] GET /identity/v3/projects/db66614609564cbf9e5fb3c7e35442d4 => generated 302 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 17:48:01.620140 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d79a96f-cbc4-4b1e-9be7-6a673bb4d45e None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:48:01.728193 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d79a96f-cbc4-4b1e-9be7-6a673bb4d45e None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:48:01.763473 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e3b27e-8bcb-4535-8013-2c756a56c218 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:48:01.764083 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e3b27e-8bcb-4535-8013-2c756a56c218 None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:48:01.764364 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e3b27e-8bcb-4535-8013-2c756a56c218 None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:48:01.764634 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e3b27e-8bcb-4535-8013-2c756a56c218 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:48:01.765380 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e3b27e-8bcb-4535-8013-2c756a56c218 None admin] RBAC: Adding query filter params (role.id=80bb25250ed34dd9a6ed0740bcc3dac6, scope.project.id=db66614609564cbf9e5fb3c7e35442d4, user.id=2ac69b13a8ef40b9b8b044ede1de0f3c) {{(pid=81592) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 17:48:01.765690 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e3b27e-8bcb-4535-8013-2c756a56c218 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:48:01.767110 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e3b27e-8bcb-4535-8013-2c756a56c218 None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:48:01.773789 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 162/318] 10.222.0.25 () {56 vars in 1374 bytes} [Thu Sep 15 17:48:01 2022] GET /identity/v3/role_assignments?user.id=2ac69b13a8ef40b9b8b044ede1de0f3c&scope.project.id=db66614609564cbf9e5fb3c7e35442d4&role.id=80bb25250ed34dd9a6ed0740bcc3dac6 => generated 608 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 17:48:02.950124 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f8869f-7f06-46a6-b2d6-624bcd1b460c None None] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:48:02.950615 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f8869f-7f06-46a6-b2d6-624bcd1b460c None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:48:02.950721 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f8869f-7f06-46a6-b2d6-624bcd1b460c None None] PATH_INFO: `/` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:48:02.951997 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 157/319] 10.222.0.25 () {54 vars in 927 bytes} [Thu Sep 15 17:48:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 17:48:02.957417 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81b78b5-12e3-4154-bf13-ff94a757af23 None None] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:48:02.957983 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81b78b5-12e3-4154-bf13-ff94a757af23 None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:48:02.957983 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81b78b5-12e3-4154-bf13-ff94a757af23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:48:02.965576 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cb1677-73b5-4f72-8829-e173fddc64f1 None None] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:48:02.965860 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cb1677-73b5-4f72-8829-e173fddc64f1 None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:48:02.966136 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cb1677-73b5-4f72-8829-e173fddc64f1 None None] PATH_INFO: `/` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:48:02.967590 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 158/320] 10.222.0.25 () {54 vars in 927 bytes} [Thu Sep 15 17:48:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 17:48:02.972393 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45711003-37fa-473b-8003-ee26ebe3c39c None None] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:48:02.973282 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45711003-37fa-473b-8003-ee26ebe3c39c None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:48:02.973469 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45711003-37fa-473b-8003-ee26ebe3c39c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:48:02.976967 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.auth.core [None req-c81b78b5-12e3-4154-bf13-ff94a757af23 None None] MFA Rules not processed for user `5cfa58ef86774ab7800bf91930bf6028`. Rule list: `[]` (Enabled: `True`). {{(pid=81592) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 17:48:02.978335 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-c81b78b5-12e3-4154-bf13-ff94a757af23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 17:48:02.992831 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.auth.core [None req-45711003-37fa-473b-8003-ee26ebe3c39c None None] MFA Rules not processed for user `5cfa58ef86774ab7800bf91930bf6028`. Rule list: `[]` (Enabled: `True`). {{(pid=81593) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 17:48:02.993899 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:48:02.994143 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-45711003-37fa-473b-8003-ee26ebe3c39c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 17:48:03.034101 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:48:03.054610 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 163/321] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Sep 15 17:48:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 15 17:48:03.070733 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 159/322] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Sep 15 17:48:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 15 17:48:03.213816 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337733c8-8b83-4d8a-8553-8bd719fd6d6d None None] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:48:03.214007 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337733c8-8b83-4d8a-8553-8bd719fd6d6d None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:48:03.214280 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337733c8-8b83-4d8a-8553-8bd719fd6d6d None None] PATH_INFO: `/` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:48:03.215626 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 164/323] 10.222.0.25 () {54 vars in 927 bytes} [Thu Sep 15 17:48:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 17:48:03.221028 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae73c1a-ebde-490b-abd4-5b4137371c2f None None] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:48:03.221352 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae73c1a-ebde-490b-abd4-5b4137371c2f None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:48:03.221613 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae73c1a-ebde-490b-abd4-5b4137371c2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:48:03.240931 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.auth.core [None req-1ae73c1a-ebde-490b-abd4-5b4137371c2f None None] MFA Rules not processed for user `5cfa58ef86774ab7800bf91930bf6028`. Rule list: `[]` (Enabled: `True`). {{(pid=81593) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 17:48:03.242141 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-1ae73c1a-ebde-490b-abd4-5b4137371c2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 17:48:03.314080 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 160/324] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Sep 15 17:48:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 15 17:48:03.332039 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337733c8-8b83-4d8a-8553-8bd719fd6d6d None None] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:48:03.340807 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae73c1a-ebde-490b-abd4-5b4137371c2f None None] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:48:03.441353 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337733c8-8b83-4d8a-8553-8bd719fd6d6d None None] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:48:03.445608 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae73c1a-ebde-490b-abd4-5b4137371c2f None None] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:48:03.447247 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:48:03.478971 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e2a108-f0e9-4332-8a12-5134b6770cc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:48:03.479519 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e2a108-f0e9-4332-8a12-5134b6770cc3 None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:48:03.479793 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e2a108-f0e9-4332-8a12-5134b6770cc3 None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:48:03.480062 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e2a108-f0e9-4332-8a12-5134b6770cc3 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:48:03.481436 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e2a108-f0e9-4332-8a12-5134b6770cc3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:48:03.482855 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e2a108-f0e9-4332-8a12-5134b6770cc3 None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:48:03.484893 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 165/325] 10.222.0.25 () {56 vars in 1108 bytes} [Thu Sep 15 17:48:03 2022] GET /identity/v3/domains/default => generated 199 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 17:48:03.485132 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e381d54-be1c-47d3-bb26-ca41ba087199 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:48:03.485802 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e381d54-be1c-47d3-bb26-ca41ba087199 None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:48:03.486083 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e381d54-be1c-47d3-bb26-ca41ba087199 None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:48:03.486365 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e381d54-be1c-47d3-bb26-ca41ba087199 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:48:03.490394 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e2a108-f0e9-4332-8a12-5134b6770cc3 None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:48:03.498553 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e381d54-be1c-47d3-bb26-ca41ba087199 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 17:48:03.504288 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application [None req-2e381d54-be1c-47d3-bb26-ca41ba087199 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 15 17:48:03.504288 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 17:48:03.504288 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 17:48:03.504288 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 17:48:03.504288 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 17:48:03.504288 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 17:48:03.504288 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 17:48:03.504288 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 17:48:03.504288 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 17:48:03.504288 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 17:48:03.504288 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 17:48:03.504288 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 17:48:03.504288 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 17:48:03.504288 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 17:48:03.504288 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 17:48:03.504288 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 17:48:03.505205 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 17:48:03.505205 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 17:48:03.505205 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 17:48:03.505205 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 17:48:03.505205 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 17:48:03.505205 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 17:48:03.505205 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 17:48:03.505205 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 17:48:03.505205 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 17:48:03.505205 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 17:48:03.505205 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 17:48:03.505205 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application with Lock( Sep 15 17:48:03.505205 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 17:48:03.505205 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._enter() Sep 15 17:48:03.505205 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 17:48:03.505205 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 17:48:03.506296 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 17:48:03.506296 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.creator() Sep 15 17:48:03.506296 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 17:48:03.506296 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application created_value = creator( Sep 15 17:48:03.506296 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 17:48:03.506296 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 17:48:03.506296 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 17:48:03.506296 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 17:48:03.506296 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 17:48:03.506296 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 17:48:03.506296 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 15 17:48:03.506296 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Sep 15 17:48:03.509653 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 161/326] 10.222.0.25 () {56 vars in 1099 bytes} [Thu Sep 15 17:48:03 2022] GET /identity/v3/roles/member => generated 84 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 15 17:48:03.510959 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e381d54-be1c-47d3-bb26-ca41ba087199 None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:48:03.521785 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:48:03.620397 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e2a108-f0e9-4332-8a12-5134b6770cc3 None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:48:03.620604 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e381d54-be1c-47d3-bb26-ca41ba087199 None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:48:03.654201 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6361b557-0970-4c5e-95de-ee276e4274bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:48:03.654412 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635517f3-c18e-42f5-88dd-f839e6519110 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:48:03.654808 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6361b557-0970-4c5e-95de-ee276e4274bf None admin] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:48:03.654973 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635517f3-c18e-42f5-88dd-f839e6519110 None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:48:03.655083 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6361b557-0970-4c5e-95de-ee276e4274bf None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:48:03.655247 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635517f3-c18e-42f5-88dd-f839e6519110 None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:48:03.655334 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6361b557-0970-4c5e-95de-ee276e4274bf None admin] PATH_INFO: `/v3/groups` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:48:03.655514 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635517f3-c18e-42f5-88dd-f839e6519110 None admin] PATH_INFO: `/v3/roles` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:48:03.656174 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635517f3-c18e-42f5-88dd-f839e6519110 None admin] RBAC: Adding query filter params (name=member) {{(pid=81593) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 17:48:03.656268 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6361b557-0970-4c5e-95de-ee276e4274bf None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:48:03.656473 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635517f3-c18e-42f5-88dd-f839e6519110 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:48:03.657696 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6361b557-0970-4c5e-95de-ee276e4274bf None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:48:03.657884 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635517f3-c18e-42f5-88dd-f839e6519110 None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:48:03.666193 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 162/327] 10.222.0.25 () {56 vars in 1101 bytes} [Thu Sep 15 17:48:03 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 17:48:03.667029 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635517f3-c18e-42f5-88dd-f839e6519110 None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:48:03.673246 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 166/328] 10.222.0.25 () {60 vars in 1134 bytes} [Thu Sep 15 17:48:03 2022] POST /identity/v3/groups => generated 226 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 17:48:03.678325 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6361b557-0970-4c5e-95de-ee276e4274bf None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:48:03.697709 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:48:03.772369 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:48:03.788408 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635517f3-c18e-42f5-88dd-f839e6519110 None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:48:03.806067 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6361b557-0970-4c5e-95de-ee276e4274bf None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:48:03.835207 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad0ac24-ba31-4029-8b7d-d3b5ce1ea4e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:48:03.836365 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad0ac24-ba31-4029-8b7d-d3b5ce1ea4e6 None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:48:03.836880 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad0ac24-ba31-4029-8b7d-d3b5ce1ea4e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:48:03.837178 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad0ac24-ba31-4029-8b7d-d3b5ce1ea4e6 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:48:03.851932 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad0ac24-ba31-4029-8b7d-d3b5ce1ea4e6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 17:48:03.857641 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application [None req-7ad0ac24-ba31-4029-8b7d-d3b5ce1ea4e6 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 15 17:48:03.857641 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 17:48:03.857641 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 17:48:03.857641 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 17:48:03.857641 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 17:48:03.857641 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 17:48:03.857641 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 17:48:03.857641 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 17:48:03.857641 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 17:48:03.857641 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 17:48:03.857641 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 17:48:03.857641 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 17:48:03.857641 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 17:48:03.857641 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 17:48:03.857641 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 17:48:03.857641 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 17:48:03.858635 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 17:48:03.858635 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 17:48:03.858635 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 17:48:03.858635 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 17:48:03.858635 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 17:48:03.858635 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 17:48:03.858635 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 17:48:03.858635 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 17:48:03.858635 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 17:48:03.858635 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 17:48:03.858635 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 17:48:03.858635 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application with Lock( Sep 15 17:48:03.858635 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 17:48:03.858635 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._enter() Sep 15 17:48:03.858635 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 17:48:03.858635 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 17:48:03.862118 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 17:48:03.862118 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.creator() Sep 15 17:48:03.862118 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 17:48:03.862118 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application created_value = creator( Sep 15 17:48:03.862118 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 17:48:03.862118 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 17:48:03.862118 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 17:48:03.862118 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 17:48:03.862118 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 17:48:03.862118 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 17:48:03.862118 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 15 17:48:03.862118 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Sep 15 17:48:03.862725 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5aee0d-593b-4d2a-9f71-cd2a0e9079ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:48:03.862725 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5aee0d-593b-4d2a-9f71-cd2a0e9079ce None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:48:03.862725 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5aee0d-593b-4d2a-9f71-cd2a0e9079ce None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:48:03.862914 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 163/329] 10.222.0.25 () {56 vars in 1099 bytes} [Thu Sep 15 17:48:03 2022] GET /identity/v3/roles/reader => generated 84 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 17:48:03.862977 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5aee0d-593b-4d2a-9f71-cd2a0e9079ce None admin] PATH_INFO: `/v3/users/a3b84d52deb64b62ab9407d66bbc3f06` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:48:03.862977 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a5aee0d-593b-4d2a-9f71-cd2a0e9079ce None admin] RBAC: Authorizing `identity:get_user(user_id=a3b84d52deb64b62ab9407d66bbc3f06)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:48:03.862977 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a5aee0d-593b-4d2a-9f71-cd2a0e9079ce None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:48:03.865148 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad0ac24-ba31-4029-8b7d-d3b5ce1ea4e6 None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:48:03.868179 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 167/330] 10.222.0.25 () {56 vars in 1177 bytes} [Thu Sep 15 17:48:03 2022] GET /identity/v3/users/a3b84d52deb64b62ab9407d66bbc3f06 => generated 293 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 17:48:03.869418 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5aee0d-593b-4d2a-9f71-cd2a0e9079ce None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:48:03.976408 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:48:03.997564 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad0ac24-ba31-4029-8b7d-d3b5ce1ea4e6 None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:48:04.001422 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5aee0d-593b-4d2a-9f71-cd2a0e9079ce None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:48:04.039652 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39cba3f0-3f99-4545-be4d-4e1a83c9253e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:48:04.040519 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39cba3f0-3f99-4545-be4d-4e1a83c9253e None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:48:04.040662 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4a5252-6cac-496e-ab86-0455ccf5f2d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:48:04.041080 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39cba3f0-3f99-4545-be4d-4e1a83c9253e None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:48:04.041276 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4a5252-6cac-496e-ab86-0455ccf5f2d2 None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:48:04.041663 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39cba3f0-3f99-4545-be4d-4e1a83c9253e None admin] PATH_INFO: `/v3/roles` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:48:04.042354 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4a5252-6cac-496e-ab86-0455ccf5f2d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:48:04.042480 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39cba3f0-3f99-4545-be4d-4e1a83c9253e None admin] RBAC: Adding query filter params (name=reader) {{(pid=81593) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 17:48:04.042655 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4a5252-6cac-496e-ab86-0455ccf5f2d2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:48:04.042840 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39cba3f0-3f99-4545-be4d-4e1a83c9253e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:48:04.043341 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d4a5252-6cac-496e-ab86-0455ccf5f2d2 None admin] RBAC: Adding query filter params (role.id=343cc8b1bc7243eebabdf08147e8366d, user.id=a3b84d52deb64b62ab9407d66bbc3f06, scope.system=all) {{(pid=81592) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 17:48:04.043644 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d4a5252-6cac-496e-ab86-0455ccf5f2d2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:48:04.044238 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39cba3f0-3f99-4545-be4d-4e1a83c9253e None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:48:04.045125 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d4a5252-6cac-496e-ab86-0455ccf5f2d2 None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:48:04.055639 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 164/331] 10.222.0.25 () {56 vars in 1101 bytes} [Thu Sep 15 17:48:03 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 17:48:04.060214 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 168/332] 10.222.0.25 () {56 vars in 1308 bytes} [Thu Sep 15 17:48:03 2022] GET /identity/v3/role_assignments?user.id=a3b84d52deb64b62ab9407d66bbc3f06&scope.system=all&role.id=343cc8b1bc7243eebabdf08147e8366d => generated 510 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 17:48:04.061353 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39cba3f0-3f99-4545-be4d-4e1a83c9253e None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:48:04.196620 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39cba3f0-3f99-4545-be4d-4e1a83c9253e None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:48:04.237585 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37246d29-f939-4858-994b-b0c7e6901bee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:48:04.238249 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37246d29-f939-4858-994b-b0c7e6901bee None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:48:04.239147 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37246d29-f939-4858-994b-b0c7e6901bee None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:48:04.239425 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37246d29-f939-4858-994b-b0c7e6901bee None admin] PATH_INFO: `/v3/users/c3154b550b4346979a7f41e5365f922f` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:48:04.240623 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37246d29-f939-4858-994b-b0c7e6901bee None admin] RBAC: Authorizing `identity:get_user(user_id=c3154b550b4346979a7f41e5365f922f)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:48:04.242196 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37246d29-f939-4858-994b-b0c7e6901bee None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:48:04.243970 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 165/333] 10.222.0.25 () {56 vars in 1177 bytes} [Thu Sep 15 17:48:04 2022] GET /identity/v3/users/c3154b550b4346979a7f41e5365f922f => generated 293 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 17:48:04.249944 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4a5252-6cac-496e-ab86-0455ccf5f2d2 None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:48:04.255835 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:48:04.371481 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4a5252-6cac-496e-ab86-0455ccf5f2d2 None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:48:04.408759 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd169214-e787-47e3-af55-dd3c7f153ad4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:48:04.409504 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd169214-e787-47e3-af55-dd3c7f153ad4 None admin] REQUEST_METHOD: `PUT` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:48:04.409788 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd169214-e787-47e3-af55-dd3c7f153ad4 None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:48:04.410066 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd169214-e787-47e3-af55-dd3c7f153ad4 None admin] PATH_INFO: `/v3/system/users/c3154b550b4346979a7f41e5365f922f/roles/80bb25250ed34dd9a6ed0740bcc3dac6` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:48:04.412043 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd169214-e787-47e3-af55-dd3c7f153ad4 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=c3154b550b4346979a7f41e5365f922f, role_id=80bb25250ed34dd9a6ed0740bcc3dac6)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:48:04.413573 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd169214-e787-47e3-af55-dd3c7f153ad4 None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:48:04.424095 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 169/334] 10.222.0.25 () {58 vars in 1334 bytes} [Thu Sep 15 17:48:04 2022] PUT /identity/v3/system/users/c3154b550b4346979a7f41e5365f922f/roles/80bb25250ed34dd9a6ed0740bcc3dac6 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 17:48:06.266560 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04c55f3-381a-44e9-8cda-c7b9b9e4e014 None None] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:48:06.267079 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04c55f3-381a-44e9-8cda-c7b9b9e4e014 None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:48:06.267079 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04c55f3-381a-44e9-8cda-c7b9b9e4e014 None None] PATH_INFO: `/` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:48:06.268968 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 166/335] 10.222.0.25 () {54 vars in 927 bytes} [Thu Sep 15 17:48:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 17:48:06.284511 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2424661e-c6ee-45ce-b196-7bc50dbcfa06 None None] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:48:06.285666 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2424661e-c6ee-45ce-b196-7bc50dbcfa06 None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:48:06.285666 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2424661e-c6ee-45ce-b196-7bc50dbcfa06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:48:06.322248 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.auth.core [None req-2424661e-c6ee-45ce-b196-7bc50dbcfa06 None None] MFA Rules not processed for user `5cfa58ef86774ab7800bf91930bf6028`. Rule list: `[]` (Enabled: `True`). {{(pid=81592) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 17:48:06.324075 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-2424661e-c6ee-45ce-b196-7bc50dbcfa06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 17:48:06.438126 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:48:06.453067 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 170/336] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Sep 15 17:48:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 15 17:48:07.022398 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74e2967-31dd-4718-806a-c30a51cb2467 None None] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:48:07.022777 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74e2967-31dd-4718-806a-c30a51cb2467 None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:48:07.023182 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74e2967-31dd-4718-806a-c30a51cb2467 None None] PATH_INFO: `/` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:48:07.025757 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 167/337] 10.222.0.25 () {54 vars in 927 bytes} [Thu Sep 15 17:48:07 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 17:48:07.037413 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f9cb33-a754-4461-ae1a-7d1139f1d641 None None] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:48:07.038079 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f9cb33-a754-4461-ae1a-7d1139f1d641 None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:48:07.038603 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f9cb33-a754-4461-ae1a-7d1139f1d641 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:48:07.064319 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.auth.core [None req-d2f9cb33-a754-4461-ae1a-7d1139f1d641 None None] MFA Rules not processed for user `5cfa58ef86774ab7800bf91930bf6028`. Rule list: `[]` (Enabled: `True`). {{(pid=81592) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 17:48:07.066048 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-d2f9cb33-a754-4461-ae1a-7d1139f1d641 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 17:48:07.087913 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74e2967-31dd-4718-806a-c30a51cb2467 None None] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:48:07.119508 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:48:07.236733 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 171/338] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Sep 15 17:48:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 15 17:48:07.288668 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74e2967-31dd-4718-806a-c30a51cb2467 None None] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:48:07.328977 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecdad61b-1d5d-43f1-a237-ad7bec204b0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:48:07.330029 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdad61b-1d5d-43f1-a237-ad7bec204b0b None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:48:07.330532 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdad61b-1d5d-43f1-a237-ad7bec204b0b None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:48:07.331012 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdad61b-1d5d-43f1-a237-ad7bec204b0b None admin] PATH_INFO: `/v3/roles/member` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:48:07.344026 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecdad61b-1d5d-43f1-a237-ad7bec204b0b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 17:48:07.349456 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application [None req-ecdad61b-1d5d-43f1-a237-ad7bec204b0b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 15 17:48:07.349456 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 17:48:07.349456 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 17:48:07.349456 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 17:48:07.349456 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 17:48:07.349456 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 17:48:07.349456 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 17:48:07.349456 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 17:48:07.349456 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 17:48:07.349456 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 17:48:07.349456 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 17:48:07.349456 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 17:48:07.349456 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 17:48:07.349456 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 17:48:07.349456 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 17:48:07.349456 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 17:48:07.350406 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 17:48:07.350406 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 17:48:07.350406 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 17:48:07.350406 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 17:48:07.350406 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 17:48:07.350406 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 17:48:07.350406 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 17:48:07.350406 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 17:48:07.350406 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 17:48:07.350406 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 17:48:07.350406 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 17:48:07.350406 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application with Lock( Sep 15 17:48:07.350406 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 17:48:07.350406 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._enter() Sep 15 17:48:07.350406 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 17:48:07.350406 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 17:48:07.351234 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 17:48:07.351234 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.creator() Sep 15 17:48:07.351234 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 17:48:07.351234 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application created_value = creator( Sep 15 17:48:07.351234 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 17:48:07.351234 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 17:48:07.351234 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 17:48:07.351234 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 17:48:07.351234 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 17:48:07.351234 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 17:48:07.351234 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 15 17:48:07.351234 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Sep 15 17:48:07.354492 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 168/339] 10.222.0.25 () {56 vars in 1099 bytes} [Thu Sep 15 17:48:07 2022] GET /identity/v3/roles/member => generated 84 bytes in 267 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 15 17:48:07.361773 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f9cb33-a754-4461-ae1a-7d1139f1d641 None None] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:48:07.517522 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f9cb33-a754-4461-ae1a-7d1139f1d641 None None] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:48:07.558604 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:48:07.571137 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7054998-4e80-41f8-a5d4-187fab07defb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:48:07.571962 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7054998-4e80-41f8-a5d4-187fab07defb None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:48:07.572431 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7054998-4e80-41f8-a5d4-187fab07defb None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:48:07.572895 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7054998-4e80-41f8-a5d4-187fab07defb None admin] PATH_INFO: `/v3/roles` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:48:07.574170 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7054998-4e80-41f8-a5d4-187fab07defb None admin] RBAC: Adding query filter params (name=member) {{(pid=81592) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 17:48:07.574583 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7054998-4e80-41f8-a5d4-187fab07defb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:48:07.576451 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7054998-4e80-41f8-a5d4-187fab07defb None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:48:07.590211 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 172/340] 10.222.0.25 () {56 vars in 1101 bytes} [Thu Sep 15 17:48:07 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 17:48:07.596929 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecdad61b-1d5d-43f1-a237-ad7bec204b0b None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:48:07.682895 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e83014-521f-4f4d-ab4a-05f4bc8399cc None None] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:48:07.683215 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e83014-521f-4f4d-ab4a-05f4bc8399cc None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:48:07.683887 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e83014-521f-4f4d-ab4a-05f4bc8399cc None None] PATH_INFO: `/` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:48:07.685528 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 173/341] 10.222.0.25 () {54 vars in 927 bytes} [Thu Sep 15 17:48:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 17:48:07.699324 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23ad812-bf92-456b-91a6-e3d5b3b22c35 None None] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:48:07.699961 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23ad812-bf92-456b-91a6-e3d5b3b22c35 None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:48:07.700487 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23ad812-bf92-456b-91a6-e3d5b3b22c35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:48:07.711355 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:48:07.734787 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.auth.core [None req-e23ad812-bf92-456b-91a6-e3d5b3b22c35 None None] MFA Rules not processed for user `5cfa58ef86774ab7800bf91930bf6028`. Rule list: `[]` (Enabled: `True`). {{(pid=81592) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 17:48:07.736346 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-e23ad812-bf92-456b-91a6-e3d5b3b22c35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 17:48:07.753605 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecdad61b-1d5d-43f1-a237-ad7bec204b0b None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:48:07.808268 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca391da9-ea78-4cef-a989-22382621c749 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:48:07.809530 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca391da9-ea78-4cef-a989-22382621c749 None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:48:07.810190 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca391da9-ea78-4cef-a989-22382621c749 None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:48:07.810841 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca391da9-ea78-4cef-a989-22382621c749 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:48:07.858104 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 174/342] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Sep 15 17:48:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 15 17:48:07.858884 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b08089b-a135-4c0b-85b9-1cadeb42b1f5 None None] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:48:07.859466 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b08089b-a135-4c0b-85b9-1cadeb42b1f5 None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:48:07.859852 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b08089b-a135-4c0b-85b9-1cadeb42b1f5 None None] PATH_INFO: `/` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:48:07.862112 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 175/343] 10.222.0.25 () {54 vars in 927 bytes} [Thu Sep 15 17:48:07 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 17:48:07.862991 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b08089b-a135-4c0b-85b9-1cadeb42b1f5 None None] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:48:07.936579 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca391da9-ea78-4cef-a989-22382621c749 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:48:07.938652 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca391da9-ea78-4cef-a989-22382621c749 None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:48:08.059938 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b08089b-a135-4c0b-85b9-1cadeb42b1f5 None None] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:48:08.084573 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:48:08.093954 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:48:08.129968 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c9d714-12f6-4d78-8da6-8d4b7cf779ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:48:08.132628 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c9d714-12f6-4d78-8da6-8d4b7cf779ac None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:48:08.133286 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c9d714-12f6-4d78-8da6-8d4b7cf779ac None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:48:08.134382 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c9d714-12f6-4d78-8da6-8d4b7cf779ac None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:48:08.144664 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 169/344] 10.222.0.25 () {58 vars in 1282 bytes} [Thu Sep 15 17:48:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 549 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 15 17:48:08.150456 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e984e4d-0eec-4d1f-9318-8451a1a70d37 None None] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:48:08.150966 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e984e4d-0eec-4d1f-9318-8451a1a70d37 None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:48:08.151665 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e984e4d-0eec-4d1f-9318-8451a1a70d37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:48:08.165930 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c9d714-12f6-4d78-8da6-8d4b7cf779ac None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 17:48:08.180968 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application [None req-18c9d714-12f6-4d78-8da6-8d4b7cf779ac None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 15 17:48:08.180968 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 17:48:08.180968 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 17:48:08.180968 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 17:48:08.180968 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 17:48:08.180968 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 17:48:08.180968 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 17:48:08.180968 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 17:48:08.180968 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 17:48:08.180968 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 17:48:08.180968 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 17:48:08.180968 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 17:48:08.180968 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 17:48:08.180968 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 17:48:08.180968 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 17:48:08.180968 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 17:48:08.182964 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 17:48:08.182964 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 17:48:08.182964 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 17:48:08.182964 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 17:48:08.182964 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 17:48:08.182964 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 17:48:08.182964 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 17:48:08.182964 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 17:48:08.182964 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 17:48:08.182964 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 17:48:08.182964 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 17:48:08.182964 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application with Lock( Sep 15 17:48:08.182964 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 17:48:08.182964 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._enter() Sep 15 17:48:08.182964 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 17:48:08.182964 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 17:48:08.184843 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 17:48:08.184843 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.creator() Sep 15 17:48:08.184843 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 17:48:08.184843 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application created_value = creator( Sep 15 17:48:08.184843 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 17:48:08.184843 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 17:48:08.184843 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 17:48:08.184843 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 17:48:08.184843 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 17:48:08.184843 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 17:48:08.184843 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 15 17:48:08.184843 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Sep 15 17:48:08.184843 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 176/345] 10.222.0.25 () {56 vars in 1114 bytes} [Thu Sep 15 17:48:07 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 320 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 17:48:08.184843 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c9d714-12f6-4d78-8da6-8d4b7cf779ac None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:48:08.195674 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.auth.core [None req-6e984e4d-0eec-4d1f-9318-8451a1a70d37 None None] MFA Rules not processed for user `5cfa58ef86774ab7800bf91930bf6028`. Rule list: `[]` (Enabled: `True`). {{(pid=81593) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 17:48:08.197132 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-6e984e4d-0eec-4d1f-9318-8451a1a70d37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 17:48:08.328013 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 170/346] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Sep 15 17:48:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 15 17:48:08.328823 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e984e4d-0eec-4d1f-9318-8451a1a70d37 None None] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:48:08.382858 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c9d714-12f6-4d78-8da6-8d4b7cf779ac None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:48:08.452891 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c733242-b052-4717-a899-d0982ebf80c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:48:08.455378 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c733242-b052-4717-a899-d0982ebf80c9 None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:48:08.455843 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c733242-b052-4717-a899-d0982ebf80c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:48:08.457979 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c733242-b052-4717-a899-d0982ebf80c9 None admin] PATH_INFO: `/v3/projects/f18aabde2e1f4bebaec9fb09d1725a11` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:48:08.459490 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c733242-b052-4717-a899-d0982ebf80c9 None admin] RBAC: Authorizing `identity:get_project(project_id=f18aabde2e1f4bebaec9fb09d1725a11)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:48:08.461336 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c733242-b052-4717-a899-d0982ebf80c9 None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:48:08.467095 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 177/347] 10.222.0.25 () {56 vars in 1186 bytes} [Thu Sep 15 17:48:08 2022] GET /identity/v3/projects/f18aabde2e1f4bebaec9fb09d1725a11 => generated 298 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 17:48:08.470646 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c733242-b052-4717-a899-d0982ebf80c9 None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:48:08.523228 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e984e4d-0eec-4d1f-9318-8451a1a70d37 None None] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:48:08.526165 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:48:08.546226 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:48:08.564278 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3276c140-97e6-4050-af55-7015480eaaae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:48:08.564911 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3276c140-97e6-4050-af55-7015480eaaae None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:48:08.565176 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3276c140-97e6-4050-af55-7015480eaaae None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:48:08.565471 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3276c140-97e6-4050-af55-7015480eaaae None admin] PATH_INFO: `/v3/roles` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:48:08.566205 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3276c140-97e6-4050-af55-7015480eaaae None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81593) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 17:48:08.567315 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3276c140-97e6-4050-af55-7015480eaaae None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:48:08.568960 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3276c140-97e6-4050-af55-7015480eaaae None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:48:08.578461 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 171/348] 10.222.0.25 () {56 vars in 1111 bytes} [Thu Sep 15 17:48:08 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 17:48:08.579315 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3276c140-97e6-4050-af55-7015480eaaae None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:48:08.627999 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c733242-b052-4717-a899-d0982ebf80c9 None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:48:08.677715 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e3e840-1452-4fe9-82d9-635d35009651 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:48:08.678813 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e3e840-1452-4fe9-82d9-635d35009651 None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:48:08.679286 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e3e840-1452-4fe9-82d9-635d35009651 None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:48:08.679769 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e3e840-1452-4fe9-82d9-635d35009651 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:48:08.693131 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e3e840-1452-4fe9-82d9-635d35009651 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 17:48:08.698845 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application [None req-c6e3e840-1452-4fe9-82d9-635d35009651 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 15 17:48:08.698845 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 17:48:08.698845 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 17:48:08.698845 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 17:48:08.698845 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 17:48:08.698845 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 17:48:08.698845 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 17:48:08.698845 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 17:48:08.698845 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 17:48:08.698845 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 17:48:08.698845 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 17:48:08.698845 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 17:48:08.698845 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 17:48:08.698845 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 17:48:08.698845 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 17:48:08.698845 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 17:48:08.699754 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 17:48:08.699754 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 17:48:08.699754 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 17:48:08.699754 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 17:48:08.699754 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 17:48:08.699754 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 17:48:08.699754 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 17:48:08.699754 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 17:48:08.699754 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 17:48:08.699754 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 17:48:08.699754 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 17:48:08.699754 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application with Lock( Sep 15 17:48:08.699754 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 17:48:08.699754 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._enter() Sep 15 17:48:08.699754 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 17:48:08.699754 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 17:48:08.700650 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 17:48:08.700650 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.creator() Sep 15 17:48:08.700650 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 17:48:08.700650 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application created_value = creator( Sep 15 17:48:08.700650 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 17:48:08.700650 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 17:48:08.700650 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 17:48:08.700650 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 17:48:08.700650 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 17:48:08.700650 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 17:48:08.700650 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 15 17:48:08.700650 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Sep 15 17:48:08.703486 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 178/349] 10.222.0.25 () {56 vars in 1099 bytes} [Thu Sep 15 17:48:08 2022] GET /identity/v3/roles/member => generated 84 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 17:48:08.708819 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c470c88-8079-4321-a7c3-b652928b8264 None None] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:48:08.708819 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c470c88-8079-4321-a7c3-b652928b8264 None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:48:08.708819 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c470c88-8079-4321-a7c3-b652928b8264 None None] PATH_INFO: `/` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:48:08.708819 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 179/350] 10.222.0.25 () {54 vars in 927 bytes} [Thu Sep 15 17:48:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 17:48:08.709446 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c470c88-8079-4321-a7c3-b652928b8264 None None] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:48:08.721776 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3276c140-97e6-4050-af55-7015480eaaae None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:48:08.761853 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18daa6b2-a09e-4cf1-9bea-25ccb01e8033 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:48:08.762496 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18daa6b2-a09e-4cf1-9bea-25ccb01e8033 None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:48:08.762789 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18daa6b2-a09e-4cf1-9bea-25ccb01e8033 None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:48:08.763056 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18daa6b2-a09e-4cf1-9bea-25ccb01e8033 None admin] PATH_INFO: `/v3/groups/16d3396dd5fc46849d2621b8d90601b3` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:48:08.773492 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18daa6b2-a09e-4cf1-9bea-25ccb01e8033 None admin] RBAC: Authorizing `identity:get_group(group_id=16d3396dd5fc46849d2621b8d90601b3)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:48:08.774534 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18daa6b2-a09e-4cf1-9bea-25ccb01e8033 None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:48:08.776230 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 172/351] 10.222.0.25 () {56 vars in 1180 bytes} [Thu Sep 15 17:48:08 2022] GET /identity/v3/groups/16d3396dd5fc46849d2621b8d90601b3 => generated 226 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 17:48:08.777013 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18daa6b2-a09e-4cf1-9bea-25ccb01e8033 None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:48:08.818393 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:48:08.858098 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c470c88-8079-4321-a7c3-b652928b8264 None None] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:48:08.870305 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:48:08.911826 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8022ce0-0b70-4e13-959e-3577a1d76298 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:48:08.912490 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8022ce0-0b70-4e13-959e-3577a1d76298 None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:48:08.912835 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8022ce0-0b70-4e13-959e-3577a1d76298 None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:48:08.913163 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8022ce0-0b70-4e13-959e-3577a1d76298 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:48:08.939352 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18daa6b2-a09e-4cf1-9bea-25ccb01e8033 None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:48:08.983913 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02da547a-75f6-4478-aeed-59719e93fe46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:48:08.984569 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02da547a-75f6-4478-aeed-59719e93fe46 None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:48:08.984846 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02da547a-75f6-4478-aeed-59719e93fe46 None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:48:08.985117 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02da547a-75f6-4478-aeed-59719e93fe46 None admin] PATH_INFO: `/v3/roles` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:48:08.985841 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02da547a-75f6-4478-aeed-59719e93fe46 None admin] RBAC: Adding query filter params (name=member) {{(pid=81593) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 17:48:08.986175 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02da547a-75f6-4478-aeed-59719e93fe46 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:48:08.988505 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02da547a-75f6-4478-aeed-59719e93fe46 None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:48:09.002339 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 173/352] 10.222.0.25 () {56 vars in 1101 bytes} [Thu Sep 15 17:48:08 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 17:48:09.004858 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba2b193-f8e3-4181-b701-13c6693f36d9 None None] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:48:09.005278 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba2b193-f8e3-4181-b701-13c6693f36d9 None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:48:09.005709 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba2b193-f8e3-4181-b701-13c6693f36d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:48:09.015789 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8022ce0-0b70-4e13-959e-3577a1d76298 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:48:09.017269 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8022ce0-0b70-4e13-959e-3577a1d76298 None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:48:09.032951 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.auth.core [None req-4ba2b193-f8e3-4181-b701-13c6693f36d9 None None] MFA Rules not processed for user `5cfa58ef86774ab7800bf91930bf6028`. Rule list: `[]` (Enabled: `True`). {{(pid=81593) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 17:48:09.036595 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-4ba2b193-f8e3-4181-b701-13c6693f36d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 17:48:09.137411 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 174/353] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Sep 15 17:48:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 15 17:48:09.138171 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba2b193-f8e3-4181-b701-13c6693f36d9 None None] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:48:09.183234 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:48:09.185278 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 180/354] 10.222.0.25 () {58 vars in 1282 bytes} [Thu Sep 15 17:48:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 476 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 15 17:48:09.186556 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8022ce0-0b70-4e13-959e-3577a1d76298 None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:48:09.197504 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:48:09.291091 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba2b193-f8e3-4181-b701-13c6693f36d9 None None] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:48:09.324864 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8022ce0-0b70-4e13-959e-3577a1d76298 None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:48:09.338074 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efcd2d8a-e350-48e3-ad17-5105d4f5f973 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:48:09.339393 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcd2d8a-e350-48e3-ad17-5105d4f5f973 None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:48:09.339816 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcd2d8a-e350-48e3-ad17-5105d4f5f973 None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:48:09.340253 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcd2d8a-e350-48e3-ad17-5105d4f5f973 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:48:09.352726 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efcd2d8a-e350-48e3-ad17-5105d4f5f973 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 17:48:09.358931 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application [None req-efcd2d8a-e350-48e3-ad17-5105d4f5f973 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 15 17:48:09.358931 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 17:48:09.358931 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 17:48:09.358931 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 17:48:09.358931 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 17:48:09.358931 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 17:48:09.358931 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 17:48:09.358931 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 17:48:09.358931 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 17:48:09.358931 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 17:48:09.358931 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 17:48:09.358931 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 17:48:09.358931 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 17:48:09.358931 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 17:48:09.358931 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 17:48:09.358931 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 17:48:09.360005 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 17:48:09.360005 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 17:48:09.360005 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 17:48:09.360005 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 17:48:09.360005 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 17:48:09.360005 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 17:48:09.360005 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 17:48:09.360005 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 17:48:09.360005 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 17:48:09.360005 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 17:48:09.360005 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 17:48:09.360005 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application with Lock( Sep 15 17:48:09.360005 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 17:48:09.360005 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._enter() Sep 15 17:48:09.360005 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 17:48:09.360005 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 17:48:09.360991 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 17:48:09.360991 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.creator() Sep 15 17:48:09.360991 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 17:48:09.360991 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application created_value = creator( Sep 15 17:48:09.360991 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 17:48:09.360991 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 17:48:09.360991 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 17:48:09.360991 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 17:48:09.360991 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 17:48:09.360991 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 17:48:09.360991 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 15 17:48:09.360991 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Sep 15 17:48:09.364218 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 175/355] 10.222.0.25 () {56 vars in 1099 bytes} [Thu Sep 15 17:48:09 2022] GET /identity/v3/roles/reader => generated 84 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 17:48:09.369011 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efcd2d8a-e350-48e3-ad17-5105d4f5f973 None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:48:09.370072 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc5e952-3bb4-41bb-b19f-83b168fd1a04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:48:09.370712 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc5e952-3bb4-41bb-b19f-83b168fd1a04 None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:48:09.370970 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc5e952-3bb4-41bb-b19f-83b168fd1a04 None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:48:09.371239 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc5e952-3bb4-41bb-b19f-83b168fd1a04 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:48:09.371983 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc5e952-3bb4-41bb-b19f-83b168fd1a04 None admin] RBAC: Adding query filter params (group.id=16d3396dd5fc46849d2621b8d90601b3, role.id=343cc8b1bc7243eebabdf08147e8366d, scope.project.id=f18aabde2e1f4bebaec9fb09d1725a11) {{(pid=81592) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 17:48:09.372314 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc5e952-3bb4-41bb-b19f-83b168fd1a04 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:48:09.373904 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc5e952-3bb4-41bb-b19f-83b168fd1a04 None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:48:09.385768 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 181/356] 10.222.0.25 () {56 vars in 1376 bytes} [Thu Sep 15 17:48:09 2022] GET /identity/v3/role_assignments?group.id=16d3396dd5fc46849d2621b8d90601b3&scope.project.id=f18aabde2e1f4bebaec9fb09d1725a11&role.id=343cc8b1bc7243eebabdf08147e8366d => generated 260 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 17:48:09.387533 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc5e952-3bb4-41bb-b19f-83b168fd1a04 None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:48:09.514593 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:48:09.517478 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:48:09.541677 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efcd2d8a-e350-48e3-ad17-5105d4f5f973 None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:48:09.568679 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc5e952-3bb4-41bb-b19f-83b168fd1a04 None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:48:09.593994 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7fe823-7437-44a2-800c-237dfa1d35fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:48:09.594615 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7fe823-7437-44a2-800c-237dfa1d35fa None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:48:09.594888 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7fe823-7437-44a2-800c-237dfa1d35fa None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:48:09.595153 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7fe823-7437-44a2-800c-237dfa1d35fa None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:48:09.616100 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09462c10-298a-4290-9d1c-af568dfd9212 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:48:09.616887 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09462c10-298a-4290-9d1c-af568dfd9212 None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:48:09.617239 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09462c10-298a-4290-9d1c-af568dfd9212 None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:48:09.617622 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09462c10-298a-4290-9d1c-af568dfd9212 None admin] PATH_INFO: `/v3/projects/f18aabde2e1f4bebaec9fb09d1725a11` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:48:09.619109 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09462c10-298a-4290-9d1c-af568dfd9212 None admin] RBAC: Authorizing `identity:get_project(project_id=f18aabde2e1f4bebaec9fb09d1725a11)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:48:09.620662 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09462c10-298a-4290-9d1c-af568dfd9212 None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:48:09.622768 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 182/357] 10.222.0.25 () {56 vars in 1186 bytes} [Thu Sep 15 17:48:09 2022] GET /identity/v3/projects/f18aabde2e1f4bebaec9fb09d1725a11 => generated 298 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 17:48:09.623348 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09462c10-298a-4290-9d1c-af568dfd9212 None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:48:09.698792 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a7fe823-7437-44a2-800c-237dfa1d35fa None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:48:09.700598 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a7fe823-7437-44a2-800c-237dfa1d35fa None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:48:09.780685 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09462c10-298a-4290-9d1c-af568dfd9212 None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:48:09.807769 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:48:09.821142 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ebe78a1-4da9-4f6a-b1fa-d68c3caafd62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:48:09.821797 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebe78a1-4da9-4f6a-b1fa-d68c3caafd62 None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:48:09.822077 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebe78a1-4da9-4f6a-b1fa-d68c3caafd62 None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:48:09.822350 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebe78a1-4da9-4f6a-b1fa-d68c3caafd62 None admin] PATH_INFO: `/v3/roles` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:48:09.823026 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ebe78a1-4da9-4f6a-b1fa-d68c3caafd62 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81592) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 17:48:09.823333 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ebe78a1-4da9-4f6a-b1fa-d68c3caafd62 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:48:09.824710 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ebe78a1-4da9-4f6a-b1fa-d68c3caafd62 None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:48:09.834005 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:48:09.839027 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 183/358] 10.222.0.25 () {56 vars in 1101 bytes} [Thu Sep 15 17:48:09 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 17:48:09.841550 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ebe78a1-4da9-4f6a-b1fa-d68c3caafd62 None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:48:09.845626 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 176/359] 10.222.0.25 () {58 vars in 1282 bytes} [Thu Sep 15 17:48:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 481 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 15 17:48:09.848932 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a2e633-ecf7-4dc1-be18-44f0ade91bb5 None None] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:48:09.849062 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a2e633-ecf7-4dc1-be18-44f0ade91bb5 None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:48:09.849276 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a2e633-ecf7-4dc1-be18-44f0ade91bb5 None None] PATH_INFO: `/` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:48:09.850878 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 177/360] 10.222.0.25 () {54 vars in 927 bytes} [Thu Sep 15 17:48:09 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 17:48:09.851442 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a2e633-ecf7-4dc1-be18-44f0ade91bb5 None None] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:48:09.987811 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ebe78a1-4da9-4f6a-b1fa-d68c3caafd62 None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:48:10.003567 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a2e633-ecf7-4dc1-be18-44f0ade91bb5 None None] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:48:10.043949 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4df4ff-3bf0-49e5-9182-e7ffd0018318 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:48:10.045132 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4df4ff-3bf0-49e5-9182-e7ffd0018318 None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:48:10.045513 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4df4ff-3bf0-49e5-9182-e7ffd0018318 None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:48:10.045790 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4df4ff-3bf0-49e5-9182-e7ffd0018318 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:48:10.052813 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e445e2-739e-4dda-a5db-987ee8a1b2e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:48:10.053649 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e445e2-739e-4dda-a5db-987ee8a1b2e0 None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:48:10.054021 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e445e2-739e-4dda-a5db-987ee8a1b2e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:48:10.054400 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e445e2-739e-4dda-a5db-987ee8a1b2e0 None admin] PATH_INFO: `/v3/groups/16d3396dd5fc46849d2621b8d90601b3` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:48:10.055614 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e445e2-739e-4dda-a5db-987ee8a1b2e0 None admin] RBAC: Authorizing `identity:get_group(group_id=16d3396dd5fc46849d2621b8d90601b3)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:48:10.057146 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e445e2-739e-4dda-a5db-987ee8a1b2e0 None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:48:10.058952 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 178/361] 10.222.0.25 () {56 vars in 1180 bytes} [Thu Sep 15 17:48:09 2022] GET /identity/v3/groups/16d3396dd5fc46849d2621b8d90601b3 => generated 226 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 17:48:10.059879 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e445e2-739e-4dda-a5db-987ee8a1b2e0 None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:48:10.064229 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f4df4ff-3bf0-49e5-9182-e7ffd0018318 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 17:48:10.074957 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application [None req-0f4df4ff-3bf0-49e5-9182-e7ffd0018318 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 15 17:48:10.074957 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 17:48:10.074957 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 17:48:10.074957 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 17:48:10.074957 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 17:48:10.074957 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 17:48:10.074957 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 17:48:10.074957 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 17:48:10.074957 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 17:48:10.074957 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 17:48:10.074957 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 17:48:10.074957 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 17:48:10.074957 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 17:48:10.074957 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 17:48:10.074957 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 17:48:10.074957 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 17:48:10.076707 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 17:48:10.076707 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 17:48:10.076707 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 17:48:10.076707 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 17:48:10.076707 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 17:48:10.076707 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 17:48:10.076707 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 17:48:10.076707 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 17:48:10.076707 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 17:48:10.076707 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 17:48:10.076707 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 17:48:10.076707 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application with Lock( Sep 15 17:48:10.076707 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 17:48:10.076707 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._enter() Sep 15 17:48:10.076707 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 17:48:10.076707 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 17:48:10.079169 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 17:48:10.079169 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.creator() Sep 15 17:48:10.079169 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 17:48:10.079169 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application created_value = creator( Sep 15 17:48:10.079169 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 17:48:10.079169 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 17:48:10.079169 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 17:48:10.079169 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 17:48:10.079169 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 17:48:10.079169 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 17:48:10.079169 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 15 17:48:10.079169 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Sep 15 17:48:10.079169 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 184/362] 10.222.0.25 () {56 vars in 1114 bytes} [Thu Sep 15 17:48:09 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 17:48:10.079169 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4df4ff-3bf0-49e5-9182-e7ffd0018318 None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:48:10.145075 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:48:10.169627 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:48:10.225253 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e445e2-739e-4dda-a5db-987ee8a1b2e0 None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:48:10.230441 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4df4ff-3bf0-49e5-9182-e7ffd0018318 None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:48:10.273539 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db00979b-57c3-4a76-b34a-e2641a57cb93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:48:10.274196 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db00979b-57c3-4a76-b34a-e2641a57cb93 None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:48:10.274535 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db00979b-57c3-4a76-b34a-e2641a57cb93 None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:48:10.274769 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db00979b-57c3-4a76-b34a-e2641a57cb93 None admin] PATH_INFO: `/v3/users/c3154b550b4346979a7f41e5365f922f` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:48:10.276109 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db00979b-57c3-4a76-b34a-e2641a57cb93 None admin] RBAC: Authorizing `identity:get_user(user_id=c3154b550b4346979a7f41e5365f922f)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:48:10.277885 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db00979b-57c3-4a76-b34a-e2641a57cb93 None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:48:10.279666 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 179/363] 10.222.0.25 () {56 vars in 1177 bytes} [Thu Sep 15 17:48:10 2022] GET /identity/v3/users/c3154b550b4346979a7f41e5365f922f => generated 293 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 17:48:10.280708 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a5f558-93cb-4396-9329-76e2d43ec2ca None None] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:48:10.280993 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a5f558-93cb-4396-9329-76e2d43ec2ca None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:48:10.281265 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a5f558-93cb-4396-9329-76e2d43ec2ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:48:10.282359 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640f0c04-8ec4-43e0-bced-5f9a08fd0de1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:48:10.283076 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640f0c04-8ec4-43e0-bced-5f9a08fd0de1 None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:48:10.283421 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640f0c04-8ec4-43e0-bced-5f9a08fd0de1 None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:48:10.283786 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640f0c04-8ec4-43e0-bced-5f9a08fd0de1 None admin] PATH_INFO: `/v3/projects/db66614609564cbf9e5fb3c7e35442d4` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:48:10.285245 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-640f0c04-8ec4-43e0-bced-5f9a08fd0de1 None admin] RBAC: Authorizing `identity:get_project(project_id=db66614609564cbf9e5fb3c7e35442d4)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:48:10.287121 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-640f0c04-8ec4-43e0-bced-5f9a08fd0de1 None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:48:10.288583 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 185/364] 10.222.0.25 () {56 vars in 1186 bytes} [Thu Sep 15 17:48:10 2022] GET /identity/v3/projects/db66614609564cbf9e5fb3c7e35442d4 => generated 302 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 17:48:10.289640 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640f0c04-8ec4-43e0-bced-5f9a08fd0de1 None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:48:10.301740 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.auth.core [None req-a9a5f558-93cb-4396-9329-76e2d43ec2ca None None] MFA Rules not processed for user `5cfa58ef86774ab7800bf91930bf6028`. Rule list: `[]` (Enabled: `True`). {{(pid=81593) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 17:48:10.302957 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-a9a5f558-93cb-4396-9329-76e2d43ec2ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 17:48:10.410455 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 180/365] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Sep 15 17:48:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 15 17:48:10.411266 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a5f558-93cb-4396-9329-76e2d43ec2ca None None] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:48:10.436901 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640f0c04-8ec4-43e0-bced-5f9a08fd0de1 None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:48:10.471586 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:48:10.486375 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a04ea79-f1f9-4be2-b34e-806a9992db7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:48:10.486581 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:48:10.486663 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a04ea79-f1f9-4be2-b34e-806a9992db7e None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:48:10.486663 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a04ea79-f1f9-4be2-b34e-806a9992db7e None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:48:10.486663 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a04ea79-f1f9-4be2-b34e-806a9992db7e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:48:10.487560 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a04ea79-f1f9-4be2-b34e-806a9992db7e None admin] RBAC: Adding query filter params (group.id=16d3396dd5fc46849d2621b8d90601b3, role.id=0dd1b9f5b7924e20a665ce50d6e34dc7, scope.project.id=f18aabde2e1f4bebaec9fb09d1725a11) {{(pid=81592) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 17:48:10.487987 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a04ea79-f1f9-4be2-b34e-806a9992db7e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:48:10.490988 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a04ea79-f1f9-4be2-b34e-806a9992db7e None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:48:10.498731 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 186/366] 10.222.0.25 () {56 vars in 1376 bytes} [Thu Sep 15 17:48:10 2022] GET /identity/v3/role_assignments?group.id=16d3396dd5fc46849d2621b8d90601b3&scope.project.id=f18aabde2e1f4bebaec9fb09d1725a11&role.id=0dd1b9f5b7924e20a665ce50d6e34dc7 => generated 260 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 17:48:10.500041 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a04ea79-f1f9-4be2-b34e-806a9992db7e None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:48:10.581534 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a5f558-93cb-4396-9329-76e2d43ec2ca None None] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:48:10.632284 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3019e23c-bb07-4abb-87c6-dc30ca667e19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:48:10.633512 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3019e23c-bb07-4abb-87c6-dc30ca667e19 None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:48:10.633973 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3019e23c-bb07-4abb-87c6-dc30ca667e19 None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:48:10.634448 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3019e23c-bb07-4abb-87c6-dc30ca667e19 None admin] PATH_INFO: `/v3/roles` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:48:10.635543 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3019e23c-bb07-4abb-87c6-dc30ca667e19 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81593) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 17:48:10.636163 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3019e23c-bb07-4abb-87c6-dc30ca667e19 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:48:10.638725 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3019e23c-bb07-4abb-87c6-dc30ca667e19 None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:48:10.649743 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 181/367] 10.222.0.25 () {56 vars in 1111 bytes} [Thu Sep 15 17:48:10 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 17:48:10.650991 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3019e23c-bb07-4abb-87c6-dc30ca667e19 None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:48:10.725154 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a04ea79-f1f9-4be2-b34e-806a9992db7e None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:48:10.776444 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0b34c3-64c6-4602-9c89-fd945cdacfd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:48:10.777253 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0b34c3-64c6-4602-9c89-fd945cdacfd7 None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:48:10.778079 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0b34c3-64c6-4602-9c89-fd945cdacfd7 None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:48:10.778079 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0b34c3-64c6-4602-9c89-fd945cdacfd7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:48:10.778892 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce0b34c3-64c6-4602-9c89-fd945cdacfd7 None admin] RBAC: Adding query filter params (role.id=80bb25250ed34dd9a6ed0740bcc3dac6, user.id=c3154b550b4346979a7f41e5365f922f, scope.system=all) {{(pid=81592) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 17:48:10.779306 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce0b34c3-64c6-4602-9c89-fd945cdacfd7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:48:10.780889 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce0b34c3-64c6-4602-9c89-fd945cdacfd7 None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:48:10.804317 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 187/368] 10.222.0.25 () {56 vars in 1308 bytes} [Thu Sep 15 17:48:10 2022] GET /identity/v3/role_assignments?user.id=c3154b550b4346979a7f41e5365f922f&scope.system=all&role.id=80bb25250ed34dd9a6ed0740bcc3dac6 => generated 510 bytes in 305 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 17:48:10.806222 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0b34c3-64c6-4602-9c89-fd945cdacfd7 None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:48:10.812463 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3019e23c-bb07-4abb-87c6-dc30ca667e19 None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:48:10.827334 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:48:10.862063 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56a990a-941c-43ca-814b-75f002d7811e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:48:10.862870 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56a990a-941c-43ca-814b-75f002d7811e None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:48:10.864839 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56a990a-941c-43ca-814b-75f002d7811e None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:48:10.864839 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56a990a-941c-43ca-814b-75f002d7811e None admin] PATH_INFO: `/v3/groups/16d3396dd5fc46849d2621b8d90601b3` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:48:10.867250 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56a990a-941c-43ca-814b-75f002d7811e None admin] RBAC: Authorizing `identity:get_group(group_id=16d3396dd5fc46849d2621b8d90601b3)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:48:10.870434 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56a990a-941c-43ca-814b-75f002d7811e None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:48:10.873633 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 182/369] 10.222.0.25 () {56 vars in 1180 bytes} [Thu Sep 15 17:48:10 2022] GET /identity/v3/groups/16d3396dd5fc46849d2621b8d90601b3 => generated 226 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 17:48:10.874669 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56a990a-941c-43ca-814b-75f002d7811e None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:48:10.886647 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:48:10.966824 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0b34c3-64c6-4602-9c89-fd945cdacfd7 None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:48:11.021898 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a6c4ee-1842-48f2-a124-80e2af8553ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:48:11.023757 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a6c4ee-1842-48f2-a124-80e2af8553ed None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:48:11.024399 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a6c4ee-1842-48f2-a124-80e2af8553ed None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:48:11.024882 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a6c4ee-1842-48f2-a124-80e2af8553ed None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:48:11.025842 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56a990a-941c-43ca-814b-75f002d7811e None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:48:11.077090 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71821e68-c6ce-411e-a3f4-79dca56b1ceb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:48:11.078529 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71821e68-c6ce-411e-a3f4-79dca56b1ceb None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:48:11.078945 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71821e68-c6ce-411e-a3f4-79dca56b1ceb None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:48:11.079352 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71821e68-c6ce-411e-a3f4-79dca56b1ceb None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:48:11.096418 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71821e68-c6ce-411e-a3f4-79dca56b1ceb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 17:48:11.102627 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application [None req-71821e68-c6ce-411e-a3f4-79dca56b1ceb None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 15 17:48:11.102627 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 17:48:11.102627 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 17:48:11.102627 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 17:48:11.102627 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 17:48:11.102627 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 17:48:11.102627 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 17:48:11.102627 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 17:48:11.102627 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 17:48:11.102627 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 17:48:11.102627 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 17:48:11.102627 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 17:48:11.102627 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 17:48:11.102627 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 17:48:11.102627 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 17:48:11.102627 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 17:48:11.103527 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 17:48:11.103527 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 17:48:11.103527 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 17:48:11.103527 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 17:48:11.103527 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 17:48:11.103527 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 17:48:11.103527 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 17:48:11.103527 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 17:48:11.103527 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 17:48:11.103527 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 17:48:11.103527 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 17:48:11.103527 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application with Lock( Sep 15 17:48:11.103527 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 17:48:11.103527 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._enter() Sep 15 17:48:11.103527 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 17:48:11.103527 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 17:48:11.104315 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 17:48:11.104315 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.creator() Sep 15 17:48:11.104315 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 17:48:11.104315 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application created_value = creator( Sep 15 17:48:11.104315 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 17:48:11.104315 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 17:48:11.104315 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 17:48:11.104315 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 17:48:11.104315 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 17:48:11.104315 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 17:48:11.104315 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 15 17:48:11.104315 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Sep 15 17:48:11.104315 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 183/370] 10.222.0.25 () {56 vars in 1096 bytes} [Thu Sep 15 17:48:10 2022] GET /identity/v3/roles/admin => generated 83 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 17:48:11.109459 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71821e68-c6ce-411e-a3f4-79dca56b1ceb None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:48:11.115166 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a6c4ee-1842-48f2-a124-80e2af8553ed None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:48:11.116929 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a6c4ee-1842-48f2-a124-80e2af8553ed None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:48:11.166126 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:48:11.197597 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:48:11.257393 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71821e68-c6ce-411e-a3f4-79dca56b1ceb None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:48:11.271948 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 188/371] 10.222.0.25 () {58 vars in 1282 bytes} [Thu Sep 15 17:48:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 467 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 15 17:48:11.277794 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a6c4ee-1842-48f2-a124-80e2af8553ed None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:48:11.311329 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da74fcb9-8540-405e-86c6-c05c636f734e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:48:11.312395 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da74fcb9-8540-405e-86c6-c05c636f734e None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:48:11.313034 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da74fcb9-8540-405e-86c6-c05c636f734e None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:48:11.313604 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da74fcb9-8540-405e-86c6-c05c636f734e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:48:11.314589 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da74fcb9-8540-405e-86c6-c05c636f734e None admin] RBAC: Adding query filter params (group.id=16d3396dd5fc46849d2621b8d90601b3, role.id=343cc8b1bc7243eebabdf08147e8366d, scope.project.id=db66614609564cbf9e5fb3c7e35442d4) {{(pid=81593) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 17:48:11.315215 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da74fcb9-8540-405e-86c6-c05c636f734e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:48:11.317580 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da74fcb9-8540-405e-86c6-c05c636f734e None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:48:11.325500 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 184/372] 10.222.0.25 () {56 vars in 1376 bytes} [Thu Sep 15 17:48:11 2022] GET /identity/v3/role_assignments?group.id=16d3396dd5fc46849d2621b8d90601b3&scope.project.id=db66614609564cbf9e5fb3c7e35442d4&role.id=343cc8b1bc7243eebabdf08147e8366d => generated 260 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 17:48:11.326803 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da74fcb9-8540-405e-86c6-c05c636f734e None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:48:11.409732 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a6c4ee-1842-48f2-a124-80e2af8553ed None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:48:11.454779 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1623fa-abea-4100-8b3e-df96ea8d465c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:48:11.455429 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1623fa-abea-4100-8b3e-df96ea8d465c None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:48:11.455676 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1623fa-abea-4100-8b3e-df96ea8d465c None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:48:11.455952 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1623fa-abea-4100-8b3e-df96ea8d465c None admin] PATH_INFO: `/v3/roles` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:48:11.456634 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1623fa-abea-4100-8b3e-df96ea8d465c None admin] RBAC: Adding query filter params (name=admin) {{(pid=81592) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 17:48:11.461328 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1623fa-abea-4100-8b3e-df96ea8d465c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:48:11.461328 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1623fa-abea-4100-8b3e-df96ea8d465c None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:48:11.469541 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 189/373] 10.222.0.25 () {56 vars in 1099 bytes} [Thu Sep 15 17:48:11 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 17:48:11.475417 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1623fa-abea-4100-8b3e-df96ea8d465c None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:48:11.497783 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:48:11.511016 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da74fcb9-8540-405e-86c6-c05c636f734e None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:48:11.513577 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:48:11.571880 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d06b1a-5604-42ce-b479-db6469c2224b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:48:11.573085 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d06b1a-5604-42ce-b479-db6469c2224b None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:48:11.573790 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d06b1a-5604-42ce-b479-db6469c2224b None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:48:11.574392 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d06b1a-5604-42ce-b479-db6469c2224b None admin] PATH_INFO: `/v3/projects/db66614609564cbf9e5fb3c7e35442d4` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:48:11.578299 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d06b1a-5604-42ce-b479-db6469c2224b None admin] RBAC: Authorizing `identity:get_project(project_id=db66614609564cbf9e5fb3c7e35442d4)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:48:11.579903 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d06b1a-5604-42ce-b479-db6469c2224b None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:48:11.582300 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 185/374] 10.222.0.25 () {56 vars in 1186 bytes} [Thu Sep 15 17:48:11 2022] GET /identity/v3/projects/db66614609564cbf9e5fb3c7e35442d4 => generated 302 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 17:48:11.587731 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d06b1a-5604-42ce-b479-db6469c2224b None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:48:11.600060 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1623fa-abea-4100-8b3e-df96ea8d465c None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:48:11.640680 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855ca3ad-a376-49fc-b261-a7906471d043 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:48:11.641317 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855ca3ad-a376-49fc-b261-a7906471d043 None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:48:11.641796 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855ca3ad-a376-49fc-b261-a7906471d043 None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:48:11.642081 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855ca3ad-a376-49fc-b261-a7906471d043 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:48:11.773858 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-855ca3ad-a376-49fc-b261-a7906471d043 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:48:11.776348 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-855ca3ad-a376-49fc-b261-a7906471d043 None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:48:11.778395 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d06b1a-5604-42ce-b479-db6469c2224b None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:48:11.793936 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:48:11.842767 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9166de5f-53bc-4c84-b461-c4432a41bf03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:48:11.843663 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9166de5f-53bc-4c84-b461-c4432a41bf03 None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:48:11.844180 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9166de5f-53bc-4c84-b461-c4432a41bf03 None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:48:11.844568 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9166de5f-53bc-4c84-b461-c4432a41bf03 None admin] PATH_INFO: `/v3/groups/16d3396dd5fc46849d2621b8d90601b3` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:48:11.846041 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9166de5f-53bc-4c84-b461-c4432a41bf03 None admin] RBAC: Authorizing `identity:get_group(group_id=16d3396dd5fc46849d2621b8d90601b3)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:48:11.848235 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9166de5f-53bc-4c84-b461-c4432a41bf03 None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:48:11.850954 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 186/375] 10.222.0.25 () {56 vars in 1180 bytes} [Thu Sep 15 17:48:11 2022] GET /identity/v3/groups/16d3396dd5fc46849d2621b8d90601b3 => generated 226 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 17:48:11.857385 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9166de5f-53bc-4c84-b461-c4432a41bf03 None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:48:11.911443 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:48:11.921161 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 190/376] 10.222.0.25 () {58 vars in 1282 bytes} [Thu Sep 15 17:48:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 446 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 15 17:48:11.924240 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855ca3ad-a376-49fc-b261-a7906471d043 None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:48:12.027370 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9166de5f-53bc-4c84-b461-c4432a41bf03 None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:48:12.088999 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855ca3ad-a376-49fc-b261-a7906471d043 None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:48:12.103180 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c5d807-7b3c-468b-8782-1cec95af56c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:48:12.104077 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c5d807-7b3c-468b-8782-1cec95af56c6 None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:48:12.104505 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c5d807-7b3c-468b-8782-1cec95af56c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:48:12.104952 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c5d807-7b3c-468b-8782-1cec95af56c6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:48:12.106385 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c5d807-7b3c-468b-8782-1cec95af56c6 None admin] RBAC: Adding query filter params (group.id=16d3396dd5fc46849d2621b8d90601b3, role.id=0dd1b9f5b7924e20a665ce50d6e34dc7, scope.project.id=db66614609564cbf9e5fb3c7e35442d4) {{(pid=81593) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 17:48:12.106960 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c5d807-7b3c-468b-8782-1cec95af56c6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:48:12.109333 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c5d807-7b3c-468b-8782-1cec95af56c6 None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:48:12.109903 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:48:12.127307 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 187/377] 10.222.0.25 () {56 vars in 1376 bytes} [Thu Sep 15 17:48:11 2022] GET /identity/v3/role_assignments?group.id=16d3396dd5fc46849d2621b8d90601b3&scope.project.id=db66614609564cbf9e5fb3c7e35442d4&role.id=0dd1b9f5b7924e20a665ce50d6e34dc7 => generated 260 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 17:48:12.128628 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6727162-d030-4416-b10d-6e8f6dacb4f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:48:12.129791 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6727162-d030-4416-b10d-6e8f6dacb4f7 None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:48:12.130076 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6727162-d030-4416-b10d-6e8f6dacb4f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:48:12.130353 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6727162-d030-4416-b10d-6e8f6dacb4f7 None admin] PATH_INFO: `/v3/projects/e456d0186b2040e49cb0f3fd71d6c972` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:48:12.131525 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6727162-d030-4416-b10d-6e8f6dacb4f7 None admin] RBAC: Authorizing `identity:get_project(project_id=e456d0186b2040e49cb0f3fd71d6c972)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:48:12.133194 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6727162-d030-4416-b10d-6e8f6dacb4f7 None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:48:12.135241 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 191/378] 10.222.0.25 () {56 vars in 1186 bytes} [Thu Sep 15 17:48:11 2022] GET /identity/v3/projects/e456d0186b2040e49cb0f3fd71d6c972 => generated 344 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 17:48:12.140944 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c5d807-7b3c-468b-8782-1cec95af56c6 None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:48:12.157025 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9053f752-3cad-4fc5-bcae-29e540f432b6 None None] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:48:12.157356 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9053f752-3cad-4fc5-bcae-29e540f432b6 None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:48:12.157607 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9053f752-3cad-4fc5-bcae-29e540f432b6 None None] PATH_INFO: `/` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:48:12.159337 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 192/379] 10.222.0.25 () {54 vars in 927 bytes} [Thu Sep 15 17:48:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 15 17:48:12.170051 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7d5719-1c5c-4b8f-9818-5846fb78f00f None None] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:48:12.170509 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7d5719-1c5c-4b8f-9818-5846fb78f00f None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:48:12.170967 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7d5719-1c5c-4b8f-9818-5846fb78f00f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:48:12.197396 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.auth.core [None req-ee7d5719-1c5c-4b8f-9818-5846fb78f00f None None] MFA Rules not processed for user `5cfa58ef86774ab7800bf91930bf6028`. Rule list: `[]` (Enabled: `True`). {{(pid=81592) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 17:48:12.198691 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-ee7d5719-1c5c-4b8f-9818-5846fb78f00f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 17:48:12.296304 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 193/380] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Sep 15 17:48:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 15 17:48:12.322721 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c5d807-7b3c-468b-8782-1cec95af56c6 None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:48:12.325257 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:48:12.393595 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ecceb5-506c-438c-8171-2f9b0c4ccf30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:48:12.394255 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ecceb5-506c-438c-8171-2f9b0c4ccf30 None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:48:12.394564 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ecceb5-506c-438c-8171-2f9b0c4ccf30 None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:48:12.394839 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ecceb5-506c-438c-8171-2f9b0c4ccf30 None admin] PATH_INFO: `/v3/groups/d6e7eea791bb497f9e64d18ec7f4ca38` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:48:12.407512 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ecceb5-506c-438c-8171-2f9b0c4ccf30 None admin] RBAC: Authorizing `identity:get_group(group_id=d6e7eea791bb497f9e64d18ec7f4ca38)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:48:12.409007 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ecceb5-506c-438c-8171-2f9b0c4ccf30 None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:48:12.411139 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 188/381] 10.222.0.25 () {56 vars in 1180 bytes} [Thu Sep 15 17:48:12 2022] GET /identity/v3/groups/d6e7eea791bb497f9e64d18ec7f4ca38 => generated 229 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 17:48:12.417518 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7d5719-1c5c-4b8f-9818-5846fb78f00f None None] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:48:12.565607 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7d5719-1c5c-4b8f-9818-5846fb78f00f None None] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:48:12.581683 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:48:12.622285 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07db046-e0fe-4865-8f68-fb272005adf3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:48:12.623307 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07db046-e0fe-4865-8f68-fb272005adf3 None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:48:12.623798 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07db046-e0fe-4865-8f68-fb272005adf3 None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:48:12.624281 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07db046-e0fe-4865-8f68-fb272005adf3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:48:12.625673 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a07db046-e0fe-4865-8f68-fb272005adf3 None admin] RBAC: Adding query filter params (group.id=d6e7eea791bb497f9e64d18ec7f4ca38, role.id=a9e42be86923434f8af52d3fc07fb4f7, scope.project.id=e456d0186b2040e49cb0f3fd71d6c972) {{(pid=81592) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 17:48:12.626214 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a07db046-e0fe-4865-8f68-fb272005adf3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:48:12.629475 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a07db046-e0fe-4865-8f68-fb272005adf3 None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:48:12.642678 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 194/382] 10.222.0.25 () {56 vars in 1376 bytes} [Thu Sep 15 17:48:12 2022] GET /identity/v3/role_assignments?group.id=d6e7eea791bb497f9e64d18ec7f4ca38&scope.project.id=e456d0186b2040e49cb0f3fd71d6c972&role.id=a9e42be86923434f8af52d3fc07fb4f7 => generated 260 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 17:48:12.761329 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ecceb5-506c-438c-8171-2f9b0c4ccf30 None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:48:12.927989 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ecceb5-506c-438c-8171-2f9b0c4ccf30 None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:48:12.985042 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c24c907-4f38-4f89-af96-807a4e4af227 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:48:12.985717 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c24c907-4f38-4f89-af96-807a4e4af227 None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:48:12.985992 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c24c907-4f38-4f89-af96-807a4e4af227 None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:48:12.986262 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c24c907-4f38-4f89-af96-807a4e4af227 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:48:13.000054 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c24c907-4f38-4f89-af96-807a4e4af227 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 17:48:13.006012 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application [None req-1c24c907-4f38-4f89-af96-807a4e4af227 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 15 17:48:13.006012 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 17:48:13.006012 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 17:48:13.006012 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 17:48:13.006012 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 17:48:13.006012 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 17:48:13.006012 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 17:48:13.006012 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 17:48:13.006012 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 17:48:13.006012 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 17:48:13.006012 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 17:48:13.006012 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 17:48:13.006012 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 17:48:13.006012 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 17:48:13.006012 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 17:48:13.006012 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 17:48:13.006943 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 17:48:13.006943 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 17:48:13.006943 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 17:48:13.006943 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 17:48:13.006943 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 17:48:13.006943 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 17:48:13.006943 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 17:48:13.006943 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 17:48:13.006943 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 17:48:13.006943 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 17:48:13.006943 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 17:48:13.006943 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application with Lock( Sep 15 17:48:13.006943 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 17:48:13.006943 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._enter() Sep 15 17:48:13.006943 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 17:48:13.006943 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 17:48:13.007736 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 17:48:13.007736 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.creator() Sep 15 17:48:13.007736 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 17:48:13.007736 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application created_value = creator( Sep 15 17:48:13.007736 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 17:48:13.007736 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 17:48:13.007736 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 17:48:13.007736 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 17:48:13.007736 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 17:48:13.007736 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 17:48:13.007736 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 15 17:48:13.007736 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Sep 15 17:48:13.007736 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 189/383] 10.222.0.25 () {56 vars in 1099 bytes} [Thu Sep 15 17:48:12 2022] GET /identity/v3/roles/member => generated 84 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 17:48:13.013160 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07db046-e0fe-4865-8f68-fb272005adf3 None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:48:13.176418 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07db046-e0fe-4865-8f68-fb272005adf3 None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:48:13.228828 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4313e7ea-ff25-4cb0-8e34-e45a2d8fdc8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:48:13.229671 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4313e7ea-ff25-4cb0-8e34-e45a2d8fdc8b None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:48:13.230073 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4313e7ea-ff25-4cb0-8e34-e45a2d8fdc8b None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:48:13.230468 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4313e7ea-ff25-4cb0-8e34-e45a2d8fdc8b None admin] PATH_INFO: `/v3/roles` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:48:13.231698 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4313e7ea-ff25-4cb0-8e34-e45a2d8fdc8b None admin] RBAC: Adding query filter params (name=member) {{(pid=81592) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 17:48:13.232140 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4313e7ea-ff25-4cb0-8e34-e45a2d8fdc8b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:48:13.234301 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4313e7ea-ff25-4cb0-8e34-e45a2d8fdc8b None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:48:13.253628 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 195/384] 10.222.0.25 () {56 vars in 1101 bytes} [Thu Sep 15 17:48:13 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 17:48:13.262473 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c24c907-4f38-4f89-af96-807a4e4af227 None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:48:13.334619 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:48:13.478696 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c24c907-4f38-4f89-af96-807a4e4af227 None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:48:13.523516 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec2d647-a7a8-4c50-afd3-4d816e31d17a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:48:13.524600 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec2d647-a7a8-4c50-afd3-4d816e31d17a None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:48:13.525145 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec2d647-a7a8-4c50-afd3-4d816e31d17a None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:48:13.525655 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec2d647-a7a8-4c50-afd3-4d816e31d17a None admin] PATH_INFO: `/v3/groups/16d3396dd5fc46849d2621b8d90601b3` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:48:13.527875 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec2d647-a7a8-4c50-afd3-4d816e31d17a None admin] RBAC: Authorizing `identity:get_group(group_id=16d3396dd5fc46849d2621b8d90601b3)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:48:13.529741 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec2d647-a7a8-4c50-afd3-4d816e31d17a None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:48:13.532894 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 190/385] 10.222.0.25 () {56 vars in 1180 bytes} [Thu Sep 15 17:48:13 2022] GET /identity/v3/groups/16d3396dd5fc46849d2621b8d90601b3 => generated 226 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 17:48:13.543612 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4313e7ea-ff25-4cb0-8e34-e45a2d8fdc8b None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:48:13.625203 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:48:13.727333 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4313e7ea-ff25-4cb0-8e34-e45a2d8fdc8b None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:48:13.740982 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d435732c-72d3-4fa9-9e5c-6c4eb509b622 None None] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:48:13.741788 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d435732c-72d3-4fa9-9e5c-6c4eb509b622 None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:48:13.742261 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d435732c-72d3-4fa9-9e5c-6c4eb509b622 None None] PATH_INFO: `/` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:48:13.744063 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 191/386] 10.222.0.25 () {54 vars in 927 bytes} [Thu Sep 15 17:48:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 15 17:48:13.749511 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4998102-4fe1-4514-83bb-f9c0942536d9 None None] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:48:13.750063 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4998102-4fe1-4514-83bb-f9c0942536d9 None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:48:13.750560 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4998102-4fe1-4514-83bb-f9c0942536d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:48:13.767014 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2429cd14-0c53-4942-af79-5cdf6fd15619 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:48:13.767681 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2429cd14-0c53-4942-af79-5cdf6fd15619 None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:48:13.767990 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2429cd14-0c53-4942-af79-5cdf6fd15619 None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:48:13.768290 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2429cd14-0c53-4942-af79-5cdf6fd15619 None admin] PATH_INFO: `/v3/projects/f18aabde2e1f4bebaec9fb09d1725a11` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:48:13.770042 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2429cd14-0c53-4942-af79-5cdf6fd15619 None admin] RBAC: Authorizing `identity:get_project(project_id=f18aabde2e1f4bebaec9fb09d1725a11)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:48:13.771651 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2429cd14-0c53-4942-af79-5cdf6fd15619 None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:48:13.771967 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.auth.core [None req-d4998102-4fe1-4514-83bb-f9c0942536d9 None None] MFA Rules not processed for user `5cfa58ef86774ab7800bf91930bf6028`. Rule list: `[]` (Enabled: `True`). {{(pid=81593) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 17:48:13.773728 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 196/387] 10.222.0.25 () {56 vars in 1186 bytes} [Thu Sep 15 17:48:13 2022] GET /identity/v3/projects/f18aabde2e1f4bebaec9fb09d1725a11 => generated 298 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 17:48:13.774048 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-d4998102-4fe1-4514-83bb-f9c0942536d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 17:48:13.779858 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2429cd14-0c53-4942-af79-5cdf6fd15619 None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:48:13.898690 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 192/388] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Sep 15 17:48:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 15 17:48:13.928899 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2429cd14-0c53-4942-af79-5cdf6fd15619 None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:48:13.929657 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:48:13.964413 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36fc7315-8ea7-440d-99a5-ee9449d85603 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:48:13.965107 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fc7315-8ea7-440d-99a5-ee9449d85603 None admin] REQUEST_METHOD: `PUT` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:48:13.965421 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fc7315-8ea7-440d-99a5-ee9449d85603 None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:48:13.965696 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fc7315-8ea7-440d-99a5-ee9449d85603 None admin] PATH_INFO: `/v3/projects/f18aabde2e1f4bebaec9fb09d1725a11/groups/16d3396dd5fc46849d2621b8d90601b3/roles/343cc8b1bc7243eebabdf08147e8366d` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:48:13.967893 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36fc7315-8ea7-440d-99a5-ee9449d85603 None admin] RBAC: Authorizing `identity:create_grant(project_id=f18aabde2e1f4bebaec9fb09d1725a11, group_id=16d3396dd5fc46849d2621b8d90601b3, role_id=343cc8b1bc7243eebabdf08147e8366d)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:48:13.969414 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36fc7315-8ea7-440d-99a5-ee9449d85603 None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:48:13.988918 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 197/389] 10.222.0.25 () {58 vars in 1442 bytes} [Thu Sep 15 17:48:13 2022] PUT /identity/v3/projects/f18aabde2e1f4bebaec9fb09d1725a11/groups/16d3396dd5fc46849d2621b8d90601b3/roles/343cc8b1bc7243eebabdf08147e8366d => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 15 17:48:14.306211 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4998102-4fe1-4514-83bb-f9c0942536d9 None None] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:48:14.332628 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:48:14.417754 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4998102-4fe1-4514-83bb-f9c0942536d9 None None] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:48:14.454796 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39cc44e6-c81a-47a1-b78a-8d75806aa104 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:48:14.455446 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39cc44e6-c81a-47a1-b78a-8d75806aa104 None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:48:14.455720 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39cc44e6-c81a-47a1-b78a-8d75806aa104 None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:48:14.456027 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39cc44e6-c81a-47a1-b78a-8d75806aa104 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:48:14.468303 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39cc44e6-c81a-47a1-b78a-8d75806aa104 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 17:48:14.473464 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application [None req-39cc44e6-c81a-47a1-b78a-8d75806aa104 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 15 17:48:14.473464 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 17:48:14.473464 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 17:48:14.473464 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 17:48:14.473464 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 17:48:14.473464 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 17:48:14.473464 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 17:48:14.473464 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 17:48:14.473464 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 17:48:14.473464 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 17:48:14.473464 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 17:48:14.473464 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 17:48:14.473464 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 17:48:14.473464 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 17:48:14.473464 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 17:48:14.473464 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 17:48:14.474389 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 17:48:14.474389 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 17:48:14.474389 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 17:48:14.474389 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 17:48:14.474389 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 17:48:14.474389 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 17:48:14.474389 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 17:48:14.474389 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 17:48:14.474389 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 17:48:14.474389 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 17:48:14.474389 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 17:48:14.474389 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application with Lock( Sep 15 17:48:14.474389 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 17:48:14.474389 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._enter() Sep 15 17:48:14.474389 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 17:48:14.474389 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 17:48:14.475192 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 17:48:14.475192 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.creator() Sep 15 17:48:14.475192 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 17:48:14.475192 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application created_value = creator( Sep 15 17:48:14.475192 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 17:48:14.475192 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 17:48:14.475192 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 17:48:14.475192 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 17:48:14.475192 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 17:48:14.475192 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 17:48:14.475192 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 15 17:48:14.475192 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Sep 15 17:48:14.475192 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 193/390] 10.222.0.25 () {56 vars in 1114 bytes} [Thu Sep 15 17:48:14 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 17:48:14.481214 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36fc7315-8ea7-440d-99a5-ee9449d85603 None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:48:14.589678 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36fc7315-8ea7-440d-99a5-ee9449d85603 None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:48:14.625491 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c50e594-4a89-4b98-b1ab-8ed36b7097df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:48:14.626141 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c50e594-4a89-4b98-b1ab-8ed36b7097df None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:48:14.626365 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c50e594-4a89-4b98-b1ab-8ed36b7097df None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:48:14.626637 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c50e594-4a89-4b98-b1ab-8ed36b7097df None admin] PATH_INFO: `/v3/roles` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:48:14.627305 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c50e594-4a89-4b98-b1ab-8ed36b7097df None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81592) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 17:48:14.627603 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c50e594-4a89-4b98-b1ab-8ed36b7097df None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:48:14.629177 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c50e594-4a89-4b98-b1ab-8ed36b7097df None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:48:14.638245 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 198/391] 10.222.0.25 () {56 vars in 1111 bytes} [Thu Sep 15 17:48:14 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 17:48:14.644209 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39cc44e6-c81a-47a1-b78a-8d75806aa104 None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:48:14.740947 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:48:14.759676 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39cc44e6-c81a-47a1-b78a-8d75806aa104 None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:48:14.798892 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a91ada-2b08-402c-a99c-e9339bd539af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:48:14.799517 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a91ada-2b08-402c-a99c-e9339bd539af None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:48:14.799789 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a91ada-2b08-402c-a99c-e9339bd539af None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:48:14.800102 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a91ada-2b08-402c-a99c-e9339bd539af None admin] PATH_INFO: `/v3/groups/16d3396dd5fc46849d2621b8d90601b3` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:48:14.801316 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a91ada-2b08-402c-a99c-e9339bd539af None admin] RBAC: Authorizing `identity:get_group(group_id=16d3396dd5fc46849d2621b8d90601b3)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:48:14.802858 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a91ada-2b08-402c-a99c-e9339bd539af None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:48:14.804784 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 194/392] 10.222.0.25 () {56 vars in 1180 bytes} [Thu Sep 15 17:48:14 2022] GET /identity/v3/groups/16d3396dd5fc46849d2621b8d90601b3 => generated 226 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 17:48:14.810531 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c50e594-4a89-4b98-b1ab-8ed36b7097df None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:48:14.865798 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:48:14.904077 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5ffe57-3512-45bc-97f3-4e6671d4567f None None] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:48:14.904397 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5ffe57-3512-45bc-97f3-4e6671d4567f None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:48:14.904632 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5ffe57-3512-45bc-97f3-4e6671d4567f None None] PATH_INFO: `/` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:48:14.906043 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 195/393] 10.222.0.25 () {54 vars in 927 bytes} [Thu Sep 15 17:48:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 15 17:48:14.917732 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5031e59e-2a51-4511-a79b-fccd75b615b4 None None] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:48:14.918194 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5031e59e-2a51-4511-a79b-fccd75b615b4 None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:48:14.918642 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5031e59e-2a51-4511-a79b-fccd75b615b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:48:14.928278 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c50e594-4a89-4b98-b1ab-8ed36b7097df None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:48:14.947096 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.auth.core [None req-5031e59e-2a51-4511-a79b-fccd75b615b4 None None] MFA Rules not processed for user `5cfa58ef86774ab7800bf91930bf6028`. Rule list: `[]` (Enabled: `True`). {{(pid=81593) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 17:48:14.948666 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-5031e59e-2a51-4511-a79b-fccd75b615b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 17:48:14.969236 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53905c9-3282-4a0e-af42-76f4bd4380b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:48:14.969901 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53905c9-3282-4a0e-af42-76f4bd4380b4 None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:48:14.970176 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53905c9-3282-4a0e-af42-76f4bd4380b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:48:14.970445 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53905c9-3282-4a0e-af42-76f4bd4380b4 None admin] PATH_INFO: `/v3/projects/f18aabde2e1f4bebaec9fb09d1725a11` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:48:14.972255 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53905c9-3282-4a0e-af42-76f4bd4380b4 None admin] RBAC: Authorizing `identity:get_project(project_id=f18aabde2e1f4bebaec9fb09d1725a11)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:48:14.975011 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53905c9-3282-4a0e-af42-76f4bd4380b4 None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:48:14.981332 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 199/394] 10.222.0.25 () {56 vars in 1186 bytes} [Thu Sep 15 17:48:14 2022] GET /identity/v3/projects/f18aabde2e1f4bebaec9fb09d1725a11 => generated 298 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 17:48:14.984668 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53905c9-3282-4a0e-af42-76f4bd4380b4 None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:48:15.116604 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 196/395] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Sep 15 17:48:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 15 17:48:15.133675 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:48:15.140904 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53905c9-3282-4a0e-af42-76f4bd4380b4 None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:48:15.207959 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd00b988-bec0-4d41-8dbb-005fdb060e13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:48:15.209004 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd00b988-bec0-4d41-8dbb-005fdb060e13 None admin] REQUEST_METHOD: `PUT` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:48:15.209528 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd00b988-bec0-4d41-8dbb-005fdb060e13 None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:48:15.210011 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd00b988-bec0-4d41-8dbb-005fdb060e13 None admin] PATH_INFO: `/v3/projects/f18aabde2e1f4bebaec9fb09d1725a11/groups/16d3396dd5fc46849d2621b8d90601b3/roles/0dd1b9f5b7924e20a665ce50d6e34dc7` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:48:15.215768 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd00b988-bec0-4d41-8dbb-005fdb060e13 None admin] RBAC: Authorizing `identity:create_grant(project_id=f18aabde2e1f4bebaec9fb09d1725a11, group_id=16d3396dd5fc46849d2621b8d90601b3, role_id=0dd1b9f5b7924e20a665ce50d6e34dc7)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:48:15.217579 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd00b988-bec0-4d41-8dbb-005fdb060e13 None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:48:15.238607 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 200/396] 10.222.0.25 () {58 vars in 1442 bytes} [Thu Sep 15 17:48:14 2022] PUT /identity/v3/projects/f18aabde2e1f4bebaec9fb09d1725a11/groups/16d3396dd5fc46849d2621b8d90601b3/roles/0dd1b9f5b7924e20a665ce50d6e34dc7 => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 15 17:48:15.299949 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a4ce2f-0d53-4357-af04-78ce3be66705 None None] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:48:15.300268 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a4ce2f-0d53-4357-af04-78ce3be66705 None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:48:15.301035 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a4ce2f-0d53-4357-af04-78ce3be66705 None None] PATH_INFO: `/` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:48:15.304152 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 197/397] 10.222.0.25 () {54 vars in 927 bytes} [Thu Sep 15 17:48:15 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 17:48:15.310266 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7bbfc3-3845-46a3-b9eb-60aa04d15645 None None] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:48:15.310611 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7bbfc3-3845-46a3-b9eb-60aa04d15645 None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:48:15.310833 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7bbfc3-3845-46a3-b9eb-60aa04d15645 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:48:15.342276 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.auth.core [None req-6b7bbfc3-3845-46a3-b9eb-60aa04d15645 None None] MFA Rules not processed for user `5cfa58ef86774ab7800bf91930bf6028`. Rule list: `[]` (Enabled: `True`). {{(pid=81592) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 17:48:15.343528 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-6b7bbfc3-3845-46a3-b9eb-60aa04d15645 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 17:48:15.447417 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 201/398] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Sep 15 17:48:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 15 17:48:15.507603 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a4ce2f-0d53-4357-af04-78ce3be66705 None None] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:48:15.625708 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:48:15.653992 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a4ce2f-0d53-4357-af04-78ce3be66705 None None] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:48:15.706343 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0ca48c-8e68-4542-92cb-444c3703cbb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:48:15.706993 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0ca48c-8e68-4542-92cb-444c3703cbb6 None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:48:15.707269 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0ca48c-8e68-4542-92cb-444c3703cbb6 None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:48:15.707540 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0ca48c-8e68-4542-92cb-444c3703cbb6 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:48:15.727176 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff0ca48c-8e68-4542-92cb-444c3703cbb6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 17:48:15.732425 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application [None req-ff0ca48c-8e68-4542-92cb-444c3703cbb6 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 15 17:48:15.732425 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 17:48:15.732425 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 17:48:15.732425 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 17:48:15.732425 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 17:48:15.732425 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 17:48:15.732425 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 17:48:15.732425 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 17:48:15.732425 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 17:48:15.732425 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 17:48:15.732425 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 17:48:15.732425 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 17:48:15.732425 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 17:48:15.732425 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 17:48:15.732425 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 17:48:15.732425 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 17:48:15.733416 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 17:48:15.733416 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 17:48:15.733416 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 17:48:15.733416 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 17:48:15.733416 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 17:48:15.733416 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 17:48:15.733416 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 17:48:15.733416 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 17:48:15.733416 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 17:48:15.733416 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 17:48:15.733416 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 17:48:15.733416 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application with Lock( Sep 15 17:48:15.733416 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 17:48:15.733416 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._enter() Sep 15 17:48:15.733416 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 17:48:15.733416 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 17:48:15.734234 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 17:48:15.734234 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.creator() Sep 15 17:48:15.734234 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 17:48:15.734234 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application created_value = creator( Sep 15 17:48:15.734234 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 17:48:15.734234 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 17:48:15.734234 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 17:48:15.734234 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 17:48:15.734234 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 17:48:15.734234 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 17:48:15.734234 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 15 17:48:15.734234 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Sep 15 17:48:15.734234 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 198/399] 10.222.0.25 () {56 vars in 1099 bytes} [Thu Sep 15 17:48:15 2022] GET /identity/v3/roles/member => generated 84 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 17:48:15.741244 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7bbfc3-3845-46a3-b9eb-60aa04d15645 None None] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:48:15.809142 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d065b7-bbaf-44e8-8a5b-b816abd26534 None None] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:48:15.809718 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d065b7-bbaf-44e8-8a5b-b816abd26534 None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:48:15.809718 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d065b7-bbaf-44e8-8a5b-b816abd26534 None None] PATH_INFO: `/` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:48:15.811984 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 199/400] 10.222.0.25 () {54 vars in 927 bytes} [Thu Sep 15 17:48:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 17:48:15.818743 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b37d541-35eb-47fc-994d-b040a43caa4f None None] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:48:15.819317 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b37d541-35eb-47fc-994d-b040a43caa4f None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:48:15.819591 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b37d541-35eb-47fc-994d-b040a43caa4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:48:15.846015 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.auth.core [None req-2b37d541-35eb-47fc-994d-b040a43caa4f None None] MFA Rules not processed for user `5cfa58ef86774ab7800bf91930bf6028`. Rule list: `[]` (Enabled: `True`). {{(pid=81593) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 17:48:15.847232 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-2b37d541-35eb-47fc-994d-b040a43caa4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 17:48:15.872746 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:48:15.897856 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7bbfc3-3845-46a3-b9eb-60aa04d15645 None None] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:48:15.973720 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05eb09f8-f667-4414-8c83-2c48330784fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:48:15.973920 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 200/401] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Sep 15 17:48:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 15 17:48:15.973920 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b37d541-35eb-47fc-994d-b040a43caa4f None None] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:48:15.974497 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05eb09f8-f667-4414-8c83-2c48330784fa None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:48:15.974888 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05eb09f8-f667-4414-8c83-2c48330784fa None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:48:15.975241 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05eb09f8-f667-4414-8c83-2c48330784fa None admin] PATH_INFO: `/v3/roles` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:48:15.976982 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05eb09f8-f667-4414-8c83-2c48330784fa None admin] RBAC: Adding query filter params (name=member) {{(pid=81592) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 17:48:15.976982 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05eb09f8-f667-4414-8c83-2c48330784fa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:48:15.978875 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05eb09f8-f667-4414-8c83-2c48330784fa None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:48:16.009241 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 202/402] 10.222.0.25 () {56 vars in 1101 bytes} [Thu Sep 15 17:48:15 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 17:48:16.014514 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05eb09f8-f667-4414-8c83-2c48330784fa None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:48:16.055331 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:48:16.120097 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b37d541-35eb-47fc-994d-b040a43caa4f None None] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:48:16.187076 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8a8a64-0f0d-4e27-b308-01971c7b68b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:48:16.187844 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8a8a64-0f0d-4e27-b308-01971c7b68b2 None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:48:16.188122 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8a8a64-0f0d-4e27-b308-01971c7b68b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:48:16.188394 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8a8a64-0f0d-4e27-b308-01971c7b68b2 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:48:16.215527 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8a8a64-0f0d-4e27-b308-01971c7b68b2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 17:48:16.227512 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05eb09f8-f667-4414-8c83-2c48330784fa None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:48:16.229282 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application [None req-fd8a8a64-0f0d-4e27-b308-01971c7b68b2 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 15 17:48:16.229282 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 17:48:16.229282 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 17:48:16.229282 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 17:48:16.229282 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 17:48:16.229282 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 17:48:16.229282 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 17:48:16.229282 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 17:48:16.229282 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 17:48:16.229282 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 17:48:16.229282 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 17:48:16.229282 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 17:48:16.229282 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 17:48:16.229282 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 17:48:16.229282 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 17:48:16.229282 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 17:48:16.231226 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 17:48:16.231226 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 17:48:16.231226 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 17:48:16.231226 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 17:48:16.231226 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 17:48:16.231226 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 17:48:16.231226 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 17:48:16.231226 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 17:48:16.231226 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 17:48:16.231226 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 17:48:16.231226 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 17:48:16.231226 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application with Lock( Sep 15 17:48:16.231226 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 17:48:16.231226 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._enter() Sep 15 17:48:16.231226 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 17:48:16.231226 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 17:48:16.232727 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 17:48:16.232727 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.creator() Sep 15 17:48:16.232727 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 17:48:16.232727 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application created_value = creator( Sep 15 17:48:16.232727 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 17:48:16.232727 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 17:48:16.232727 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 17:48:16.232727 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 17:48:16.232727 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 17:48:16.232727 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 17:48:16.232727 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 15 17:48:16.232727 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Sep 15 17:48:16.236537 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 201/403] 10.222.0.25 () {56 vars in 1114 bytes} [Thu Sep 15 17:48:15 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 267 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 17:48:16.244359 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8a8a64-0f0d-4e27-b308-01971c7b68b2 None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:48:16.311990 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c75c8c0-03fd-44d6-82c4-abea33a027f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:48:16.312819 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c75c8c0-03fd-44d6-82c4-abea33a027f1 None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:48:16.312819 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c75c8c0-03fd-44d6-82c4-abea33a027f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:48:16.314615 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c75c8c0-03fd-44d6-82c4-abea33a027f1 None admin] PATH_INFO: `/v3/groups/16d3396dd5fc46849d2621b8d90601b3` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:48:16.318242 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c75c8c0-03fd-44d6-82c4-abea33a027f1 None admin] RBAC: Authorizing `identity:get_group(group_id=16d3396dd5fc46849d2621b8d90601b3)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:48:16.320078 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c75c8c0-03fd-44d6-82c4-abea33a027f1 None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:48:16.323486 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 203/404] 10.222.0.25 () {56 vars in 1180 bytes} [Thu Sep 15 17:48:16 2022] GET /identity/v3/groups/16d3396dd5fc46849d2621b8d90601b3 => generated 226 bytes in 309 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 17:48:16.324838 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c75c8c0-03fd-44d6-82c4-abea33a027f1 None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:48:16.345897 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:48:16.413269 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8a8a64-0f0d-4e27-b308-01971c7b68b2 None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:48:16.447540 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:48:16.454739 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbe1cf4-1503-40d3-a8f0-1ac9b3d70460 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:48:16.455590 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbe1cf4-1503-40d3-a8f0-1ac9b3d70460 None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:48:16.456077 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbe1cf4-1503-40d3-a8f0-1ac9b3d70460 None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:48:16.456484 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbe1cf4-1503-40d3-a8f0-1ac9b3d70460 None admin] PATH_INFO: `/v3/roles` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:48:16.456753 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c75c8c0-03fd-44d6-82c4-abea33a027f1 None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:48:16.457544 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bbe1cf4-1503-40d3-a8f0-1ac9b3d70460 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81593) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 17:48:16.458077 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bbe1cf4-1503-40d3-a8f0-1ac9b3d70460 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:48:16.459863 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bbe1cf4-1503-40d3-a8f0-1ac9b3d70460 None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:48:16.469851 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 202/405] 10.222.0.25 () {56 vars in 1111 bytes} [Thu Sep 15 17:48:16 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 17:48:16.471110 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbe1cf4-1503-40d3-a8f0-1ac9b3d70460 None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:48:16.498400 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3466a2-e12a-459a-889a-ad6d56a77b09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:48:16.499048 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3466a2-e12a-459a-889a-ad6d56a77b09 None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:48:16.499328 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3466a2-e12a-459a-889a-ad6d56a77b09 None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:48:16.499600 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3466a2-e12a-459a-889a-ad6d56a77b09 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:48:16.512036 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3466a2-e12a-459a-889a-ad6d56a77b09 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 17:48:16.518860 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application [None req-4f3466a2-e12a-459a-889a-ad6d56a77b09 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 15 17:48:16.518860 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 17:48:16.518860 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 17:48:16.518860 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 17:48:16.518860 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 17:48:16.518860 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 17:48:16.518860 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 17:48:16.518860 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 17:48:16.518860 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 17:48:16.518860 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 17:48:16.518860 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 17:48:16.518860 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 17:48:16.518860 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 17:48:16.518860 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 17:48:16.518860 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 17:48:16.518860 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 17:48:16.520574 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 17:48:16.520574 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 17:48:16.520574 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 17:48:16.520574 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 17:48:16.520574 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 17:48:16.520574 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 17:48:16.520574 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 17:48:16.520574 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 17:48:16.520574 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 17:48:16.520574 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 17:48:16.520574 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 17:48:16.520574 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application with Lock( Sep 15 17:48:16.520574 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 17:48:16.520574 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._enter() Sep 15 17:48:16.520574 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 17:48:16.520574 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 17:48:16.521390 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 17:48:16.521390 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.creator() Sep 15 17:48:16.521390 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 17:48:16.521390 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application created_value = creator( Sep 15 17:48:16.521390 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 17:48:16.521390 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 17:48:16.521390 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 17:48:16.521390 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 17:48:16.521390 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 17:48:16.521390 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 17:48:16.521390 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 15 17:48:16.521390 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Sep 15 17:48:16.521390 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 204/406] 10.222.0.25 () {56 vars in 1096 bytes} [Thu Sep 15 17:48:16 2022] GET /identity/v3/roles/admin => generated 83 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 17:48:16.522058 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3466a2-e12a-459a-889a-ad6d56a77b09 None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:48:16.609645 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbe1cf4-1503-40d3-a8f0-1ac9b3d70460 None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:48:16.610461 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:48:16.640272 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3466a2-e12a-459a-889a-ad6d56a77b09 None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:48:16.660237 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151f31eb-4b25-4bcd-93e6-76246394264a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:48:16.661287 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151f31eb-4b25-4bcd-93e6-76246394264a None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:48:16.661827 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151f31eb-4b25-4bcd-93e6-76246394264a None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:48:16.662287 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151f31eb-4b25-4bcd-93e6-76246394264a None admin] PATH_INFO: `/v3/projects/db66614609564cbf9e5fb3c7e35442d4` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:48:16.663742 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151f31eb-4b25-4bcd-93e6-76246394264a None admin] RBAC: Authorizing `identity:get_project(project_id=db66614609564cbf9e5fb3c7e35442d4)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:48:16.665661 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151f31eb-4b25-4bcd-93e6-76246394264a None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:48:16.668105 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 203/407] 10.222.0.25 () {56 vars in 1186 bytes} [Thu Sep 15 17:48:16 2022] GET /identity/v3/projects/db66614609564cbf9e5fb3c7e35442d4 => generated 302 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 17:48:16.669148 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151f31eb-4b25-4bcd-93e6-76246394264a None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:48:16.678697 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a070eafb-a5b7-47af-8ccb-0b4d0a6d38ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:48:16.679339 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a070eafb-a5b7-47af-8ccb-0b4d0a6d38ac None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:48:16.679623 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a070eafb-a5b7-47af-8ccb-0b4d0a6d38ac None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:48:16.679903 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a070eafb-a5b7-47af-8ccb-0b4d0a6d38ac None admin] PATH_INFO: `/v3/groups/16d3396dd5fc46849d2621b8d90601b3` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:48:16.681773 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a070eafb-a5b7-47af-8ccb-0b4d0a6d38ac None admin] RBAC: Authorizing `identity:get_group(group_id=16d3396dd5fc46849d2621b8d90601b3)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:48:16.682828 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a070eafb-a5b7-47af-8ccb-0b4d0a6d38ac None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:48:16.684417 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 205/408] 10.222.0.25 () {56 vars in 1180 bytes} [Thu Sep 15 17:48:16 2022] GET /identity/v3/groups/16d3396dd5fc46849d2621b8d90601b3 => generated 226 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 17:48:16.685167 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a070eafb-a5b7-47af-8ccb-0b4d0a6d38ac None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:48:16.742346 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:48:16.789757 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151f31eb-4b25-4bcd-93e6-76246394264a None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:48:16.805020 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a070eafb-a5b7-47af-8ccb-0b4d0a6d38ac None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:48:16.837363 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcfbdd0e-0437-4915-af29-3d992b332f4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:48:16.838155 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfbdd0e-0437-4915-af29-3d992b332f4d None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:48:16.838509 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfbdd0e-0437-4915-af29-3d992b332f4d None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:48:16.838803 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfbdd0e-0437-4915-af29-3d992b332f4d None admin] PATH_INFO: `/v3/roles` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:48:16.839486 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcfbdd0e-0437-4915-af29-3d992b332f4d None admin] RBAC: Adding query filter params (name=admin) {{(pid=81593) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 17:48:16.839789 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcfbdd0e-0437-4915-af29-3d992b332f4d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:48:16.841198 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcfbdd0e-0437-4915-af29-3d992b332f4d None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:48:16.852710 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 204/409] 10.222.0.25 () {56 vars in 1099 bytes} [Thu Sep 15 17:48:16 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 17:48:16.853695 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcfbdd0e-0437-4915-af29-3d992b332f4d None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:48:16.856619 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c27e79d-de8c-41a2-ad8a-c1964257e9a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:48:16.857984 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c27e79d-de8c-41a2-ad8a-c1964257e9a8 None admin] REQUEST_METHOD: `PUT` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:48:16.858493 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c27e79d-de8c-41a2-ad8a-c1964257e9a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:48:16.858958 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c27e79d-de8c-41a2-ad8a-c1964257e9a8 None admin] PATH_INFO: `/v3/projects/db66614609564cbf9e5fb3c7e35442d4/groups/16d3396dd5fc46849d2621b8d90601b3/roles/343cc8b1bc7243eebabdf08147e8366d` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:48:16.861126 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c27e79d-de8c-41a2-ad8a-c1964257e9a8 None admin] RBAC: Authorizing `identity:create_grant(project_id=db66614609564cbf9e5fb3c7e35442d4, group_id=16d3396dd5fc46849d2621b8d90601b3, role_id=343cc8b1bc7243eebabdf08147e8366d)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:48:16.862823 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c27e79d-de8c-41a2-ad8a-c1964257e9a8 None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:48:16.881571 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 206/410] 10.222.0.25 () {58 vars in 1442 bytes} [Thu Sep 15 17:48:16 2022] PUT /identity/v3/projects/db66614609564cbf9e5fb3c7e35442d4/groups/16d3396dd5fc46849d2621b8d90601b3/roles/343cc8b1bc7243eebabdf08147e8366d => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 17:48:16.883120 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c27e79d-de8c-41a2-ad8a-c1964257e9a8 None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:48:16.888094 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:48:16.989201 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcfbdd0e-0437-4915-af29-3d992b332f4d None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:48:17.020471 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:48:17.036296 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c27e79d-de8c-41a2-ad8a-c1964257e9a8 None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:48:17.036603 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef254cee-89ae-47ae-961f-2c79d1b18d72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:48:17.037422 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef254cee-89ae-47ae-961f-2c79d1b18d72 None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:48:17.037805 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef254cee-89ae-47ae-961f-2c79d1b18d72 None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:48:17.038180 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef254cee-89ae-47ae-961f-2c79d1b18d72 None admin] PATH_INFO: `/v3/projects/db66614609564cbf9e5fb3c7e35442d4` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:48:17.039610 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef254cee-89ae-47ae-961f-2c79d1b18d72 None admin] RBAC: Authorizing `identity:get_project(project_id=db66614609564cbf9e5fb3c7e35442d4)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:48:17.041402 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef254cee-89ae-47ae-961f-2c79d1b18d72 None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:48:17.043530 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 205/411] 10.222.0.25 () {56 vars in 1186 bytes} [Thu Sep 15 17:48:16 2022] GET /identity/v3/projects/db66614609564cbf9e5fb3c7e35442d4 => generated 302 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 17:48:17.045066 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc295cb3-594c-4b50-b619-21ff50d21efd None None] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:48:17.045536 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc295cb3-594c-4b50-b619-21ff50d21efd None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:48:17.045881 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc295cb3-594c-4b50-b619-21ff50d21efd None None] PATH_INFO: `/` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:48:17.047768 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 206/412] 10.222.0.25 () {54 vars in 927 bytes} [Thu Sep 15 17:48:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 17:48:17.059273 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd8a02e-4b2a-4385-9147-ad8cd6a3905c None None] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:48:17.059622 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd8a02e-4b2a-4385-9147-ad8cd6a3905c None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:48:17.059944 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd8a02e-4b2a-4385-9147-ad8cd6a3905c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:48:17.089036 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.auth.core [None req-9bd8a02e-4b2a-4385-9147-ad8cd6a3905c None None] MFA Rules not processed for user `5cfa58ef86774ab7800bf91930bf6028`. Rule list: `[]` (Enabled: `True`). {{(pid=81593) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 17:48:17.090362 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a2cfaa-1ddb-4904-924c-c3c4a84ac2ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:48:17.091050 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-9bd8a02e-4b2a-4385-9147-ad8cd6a3905c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 17:48:17.091449 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a2cfaa-1ddb-4904-924c-c3c4a84ac2ef None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:48:17.091868 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a2cfaa-1ddb-4904-924c-c3c4a84ac2ef None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:48:17.092344 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a2cfaa-1ddb-4904-924c-c3c4a84ac2ef None admin] PATH_INFO: `/v3/groups/d6e7eea791bb497f9e64d18ec7f4ca38` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:48:17.093804 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a2cfaa-1ddb-4904-924c-c3c4a84ac2ef None admin] RBAC: Authorizing `identity:get_group(group_id=d6e7eea791bb497f9e64d18ec7f4ca38)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:48:17.097215 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a2cfaa-1ddb-4904-924c-c3c4a84ac2ef None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:48:17.100526 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 207/413] 10.222.0.25 () {56 vars in 1180 bytes} [Thu Sep 15 17:48:16 2022] GET /identity/v3/groups/d6e7eea791bb497f9e64d18ec7f4ca38 => generated 229 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 17:48:17.101806 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a2cfaa-1ddb-4904-924c-c3c4a84ac2ef None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:48:17.191020 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 207/414] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Sep 15 17:48:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 15 17:48:17.193701 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd8a02e-4b2a-4385-9147-ad8cd6a3905c None None] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:48:17.280336 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:48:17.383864 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a2cfaa-1ddb-4904-924c-c3c4a84ac2ef None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:48:17.396865 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd8a02e-4b2a-4385-9147-ad8cd6a3905c None None] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:48:17.431363 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:48:17.455187 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26597ec2-68f3-47a8-9bc4-7e55040493ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:48:17.455844 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26597ec2-68f3-47a8-9bc4-7e55040493ee None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:48:17.456120 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26597ec2-68f3-47a8-9bc4-7e55040493ee None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:48:17.456391 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26597ec2-68f3-47a8-9bc4-7e55040493ee None admin] PATH_INFO: `/v3/projects/e456d0186b2040e49cb0f3fd71d6c972` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:48:17.458747 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d480ead-365c-4e68-bc89-6b180cb62ba9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:48:17.459422 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d480ead-365c-4e68-bc89-6b180cb62ba9 None admin] REQUEST_METHOD: `PUT` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:48:17.459689 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d480ead-365c-4e68-bc89-6b180cb62ba9 None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:48:17.459955 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d480ead-365c-4e68-bc89-6b180cb62ba9 None admin] PATH_INFO: `/v3/projects/db66614609564cbf9e5fb3c7e35442d4/groups/16d3396dd5fc46849d2621b8d90601b3/roles/0dd1b9f5b7924e20a665ce50d6e34dc7` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:48:17.461088 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26597ec2-68f3-47a8-9bc4-7e55040493ee None admin] RBAC: Authorizing `identity:get_project(project_id=e456d0186b2040e49cb0f3fd71d6c972)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:48:17.463097 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26597ec2-68f3-47a8-9bc4-7e55040493ee None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:48:17.465099 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 208/415] 10.222.0.25 () {56 vars in 1186 bytes} [Thu Sep 15 17:48:17 2022] GET /identity/v3/projects/e456d0186b2040e49cb0f3fd71d6c972 => generated 344 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 17:48:17.466539 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d480ead-365c-4e68-bc89-6b180cb62ba9 None admin] RBAC: Authorizing `identity:create_grant(project_id=db66614609564cbf9e5fb3c7e35442d4, group_id=16d3396dd5fc46849d2621b8d90601b3, role_id=0dd1b9f5b7924e20a665ce50d6e34dc7)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:48:17.468331 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d480ead-365c-4e68-bc89-6b180cb62ba9 None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:48:17.471916 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26597ec2-68f3-47a8-9bc4-7e55040493ee None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:48:17.497833 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 208/416] 10.222.0.25 () {58 vars in 1442 bytes} [Thu Sep 15 17:48:17 2022] PUT /identity/v3/projects/db66614609564cbf9e5fb3c7e35442d4/groups/16d3396dd5fc46849d2621b8d90601b3/roles/0dd1b9f5b7924e20a665ce50d6e34dc7 => generated 0 bytes in 397 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 17:48:17.633624 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26597ec2-68f3-47a8-9bc4-7e55040493ee None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:48:17.692953 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748b6f59-a65a-4fc7-8006-ec33e1564295 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:48:17.693700 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748b6f59-a65a-4fc7-8006-ec33e1564295 None admin] REQUEST_METHOD: `PUT` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:48:17.693820 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748b6f59-a65a-4fc7-8006-ec33e1564295 None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:48:17.694075 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748b6f59-a65a-4fc7-8006-ec33e1564295 None admin] PATH_INFO: `/v3/projects/e456d0186b2040e49cb0f3fd71d6c972/groups/d6e7eea791bb497f9e64d18ec7f4ca38/roles/a9e42be86923434f8af52d3fc07fb4f7` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:48:17.700669 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748b6f59-a65a-4fc7-8006-ec33e1564295 None admin] RBAC: Authorizing `identity:create_grant(project_id=e456d0186b2040e49cb0f3fd71d6c972, group_id=d6e7eea791bb497f9e64d18ec7f4ca38, role_id=a9e42be86923434f8af52d3fc07fb4f7)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:48:17.702245 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748b6f59-a65a-4fc7-8006-ec33e1564295 None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:48:17.717599 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 209/417] 10.222.0.25 () {58 vars in 1442 bytes} [Thu Sep 15 17:48:17 2022] PUT /identity/v3/projects/e456d0186b2040e49cb0f3fd71d6c972/groups/d6e7eea791bb497f9e64d18ec7f4ca38/roles/a9e42be86923434f8af52d3fc07fb4f7 => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 17:48:17.727333 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d480ead-365c-4e68-bc89-6b180cb62ba9 None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:48:17.890402 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d480ead-365c-4e68-bc89-6b180cb62ba9 None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:48:17.947662 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:48:17.958486 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec74d46b-4ce6-4186-9245-3814df7f0234 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:48:17.959146 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec74d46b-4ce6-4186-9245-3814df7f0234 None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:48:17.959422 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec74d46b-4ce6-4186-9245-3814df7f0234 None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:48:17.959690 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec74d46b-4ce6-4186-9245-3814df7f0234 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:48:17.982953 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec74d46b-4ce6-4186-9245-3814df7f0234 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 17:48:17.995324 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application [None req-ec74d46b-4ce6-4186-9245-3814df7f0234 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 15 17:48:17.995324 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 17:48:17.995324 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 17:48:17.995324 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 17:48:17.995324 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 17:48:17.995324 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 17:48:17.995324 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 17:48:17.995324 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 17:48:17.995324 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 17:48:17.995324 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 17:48:17.995324 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 17:48:17.995324 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 17:48:17.995324 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 17:48:17.995324 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 17:48:17.995324 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 17:48:17.995324 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 17:48:17.996476 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 17:48:17.996476 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 17:48:17.996476 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 17:48:17.996476 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 17:48:17.996476 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 17:48:17.996476 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 17:48:17.996476 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 17:48:17.996476 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 17:48:17.996476 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 17:48:17.996476 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 17:48:17.996476 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 17:48:17.996476 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application with Lock( Sep 15 17:48:17.996476 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 17:48:17.996476 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._enter() Sep 15 17:48:17.996476 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 17:48:17.996476 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 17:48:17.997325 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 17:48:17.997325 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.creator() Sep 15 17:48:17.997325 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 17:48:17.997325 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application created_value = creator( Sep 15 17:48:17.997325 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 17:48:17.997325 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 17:48:17.997325 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 17:48:17.997325 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 17:48:17.997325 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 17:48:17.997325 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 17:48:17.997325 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 15 17:48:17.997325 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Sep 15 17:48:18.000009 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 209/418] 10.222.0.25 () {56 vars in 1099 bytes} [Thu Sep 15 17:48:17 2022] GET /identity/v3/roles/member => generated 84 bytes in 274 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 17:48:18.008273 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748b6f59-a65a-4fc7-8006-ec33e1564295 None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:48:18.079124 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caab552e-ced8-4e4a-9c03-35cdb69e8a21 None None] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:48:18.080609 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caab552e-ced8-4e4a-9c03-35cdb69e8a21 None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:48:18.081903 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caab552e-ced8-4e4a-9c03-35cdb69e8a21 None None] PATH_INFO: `/` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:48:18.085275 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 210/419] 10.222.0.25 () {54 vars in 927 bytes} [Thu Sep 15 17:48:18 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 17:48:18.094279 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f346458-b1cb-41f7-9d7e-317641205da0 None None] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:48:18.094886 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f346458-b1cb-41f7-9d7e-317641205da0 None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:48:18.095557 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f346458-b1cb-41f7-9d7e-317641205da0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:48:18.103494 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:48:18.132988 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.auth.core [None req-1f346458-b1cb-41f7-9d7e-317641205da0 None None] MFA Rules not processed for user `5cfa58ef86774ab7800bf91930bf6028`. Rule list: `[]` (Enabled: `True`). {{(pid=81592) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 17:48:18.135766 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-1f346458-b1cb-41f7-9d7e-317641205da0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 17:48:18.178261 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748b6f59-a65a-4fc7-8006-ec33e1564295 None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:48:18.243578 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2da4148-7481-4df0-8de5-39b90dce7cba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:48:18.244196 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2da4148-7481-4df0-8de5-39b90dce7cba None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:48:18.245719 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2da4148-7481-4df0-8de5-39b90dce7cba None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:48:18.246004 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2da4148-7481-4df0-8de5-39b90dce7cba None admin] PATH_INFO: `/v3/roles` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:48:18.246678 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2da4148-7481-4df0-8de5-39b90dce7cba None admin] RBAC: Adding query filter params (name=member) {{(pid=81593) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 17:48:18.246976 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2da4148-7481-4df0-8de5-39b90dce7cba None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:48:18.248475 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2da4148-7481-4df0-8de5-39b90dce7cba None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:48:18.264471 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 211/420] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Sep 15 17:48:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 15 17:48:18.266936 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 210/421] 10.222.0.25 () {56 vars in 1101 bytes} [Thu Sep 15 17:48:18 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 17:48:18.273127 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f346458-b1cb-41f7-9d7e-317641205da0 None None] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:48:18.386267 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f346458-b1cb-41f7-9d7e-317641205da0 None None] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:48:18.408806 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:48:18.431275 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5880b49-5e9c-488a-bd84-100dd5492174 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:48:18.431901 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5880b49-5e9c-488a-bd84-100dd5492174 None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:48:18.432178 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5880b49-5e9c-488a-bd84-100dd5492174 None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:48:18.432443 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5880b49-5e9c-488a-bd84-100dd5492174 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:48:18.519666 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5880b49-5e9c-488a-bd84-100dd5492174 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:48:18.521106 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5880b49-5e9c-488a-bd84-100dd5492174 None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:48:18.591800 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2da4148-7481-4df0-8de5-39b90dce7cba None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:48:18.688634 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 212/422] 10.222.0.25 () {58 vars in 1282 bytes} [Thu Sep 15 17:48:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 416 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 15 17:48:18.698017 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5880b49-5e9c-488a-bd84-100dd5492174 None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:48:18.750499 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:48:18.765712 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2da4148-7481-4df0-8de5-39b90dce7cba None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:48:18.809715 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:48:18.865782 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1427e3-7428-4a72-8558-902048efd9ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:48:18.866510 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1427e3-7428-4a72-8558-902048efd9ac None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:48:18.866821 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1427e3-7428-4a72-8558-902048efd9ac None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:48:18.867398 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1427e3-7428-4a72-8558-902048efd9ac None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:48:18.892432 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a1427e3-7428-4a72-8558-902048efd9ac None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 17:48:18.898550 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application [None req-0a1427e3-7428-4a72-8558-902048efd9ac None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 15 17:48:18.898550 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 17:48:18.898550 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 17:48:18.898550 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 17:48:18.898550 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 17:48:18.898550 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 17:48:18.898550 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 17:48:18.898550 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 17:48:18.898550 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 17:48:18.898550 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 17:48:18.898550 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 17:48:18.898550 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 17:48:18.898550 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 17:48:18.898550 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 17:48:18.898550 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 17:48:18.898550 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 17:48:18.900143 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 17:48:18.900143 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 17:48:18.900143 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 17:48:18.900143 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 17:48:18.900143 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 17:48:18.900143 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 17:48:18.900143 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 17:48:18.900143 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 17:48:18.900143 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 17:48:18.900143 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 17:48:18.900143 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 17:48:18.900143 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application with Lock( Sep 15 17:48:18.900143 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 17:48:18.900143 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._enter() Sep 15 17:48:18.900143 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 17:48:18.900143 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 17:48:18.901086 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 17:48:18.901086 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.creator() Sep 15 17:48:18.901086 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 17:48:18.901086 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application created_value = creator( Sep 15 17:48:18.901086 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 17:48:18.901086 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 17:48:18.901086 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 17:48:18.901086 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 17:48:18.901086 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 17:48:18.901086 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 17:48:18.901086 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 15 17:48:18.901086 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Sep 15 17:48:18.901086 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 211/423] 10.222.0.25 () {56 vars in 1114 bytes} [Thu Sep 15 17:48:18 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 308 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 17:48:18.917781 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1427e3-7428-4a72-8558-902048efd9ac None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:48:18.977907 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5880b49-5e9c-488a-bd84-100dd5492174 None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:48:19.058822 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a83fc9-1339-453e-be16-ceb054d62d54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:48:19.060948 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a83fc9-1339-453e-be16-ceb054d62d54 None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:48:19.062005 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a83fc9-1339-453e-be16-ceb054d62d54 None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:48:19.065075 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a83fc9-1339-453e-be16-ceb054d62d54 None admin] PATH_INFO: `/v3/projects/f18aabde2e1f4bebaec9fb09d1725a11` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:48:19.074181 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a83fc9-1339-453e-be16-ceb054d62d54 None admin] RBAC: Authorizing `identity:get_project(project_id=f18aabde2e1f4bebaec9fb09d1725a11)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:48:19.076711 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a83fc9-1339-453e-be16-ceb054d62d54 None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:48:19.079109 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 213/424] 10.222.0.25 () {56 vars in 1186 bytes} [Thu Sep 15 17:48:18 2022] GET /identity/v3/projects/f18aabde2e1f4bebaec9fb09d1725a11 => generated 298 bytes in 382 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 17:48:19.086350 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a83fc9-1339-453e-be16-ceb054d62d54 None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:48:19.124184 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1427e3-7428-4a72-8558-902048efd9ac None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:48:19.172544 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd0761d-5374-4ec7-86c5-bb50bbe0c618 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:48:19.173731 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd0761d-5374-4ec7-86c5-bb50bbe0c618 None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:48:19.174208 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd0761d-5374-4ec7-86c5-bb50bbe0c618 None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:48:19.174671 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd0761d-5374-4ec7-86c5-bb50bbe0c618 None admin] PATH_INFO: `/v3/roles` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:48:19.176079 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd0761d-5374-4ec7-86c5-bb50bbe0c618 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81593) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 17:48:19.176597 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd0761d-5374-4ec7-86c5-bb50bbe0c618 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:48:19.178397 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd0761d-5374-4ec7-86c5-bb50bbe0c618 None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:48:19.188447 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 212/425] 10.222.0.25 () {56 vars in 1111 bytes} [Thu Sep 15 17:48:18 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 17:48:19.195173 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd0761d-5374-4ec7-86c5-bb50bbe0c618 None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:48:19.237765 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:48:19.288266 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:48:19.322921 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a83fc9-1339-453e-be16-ceb054d62d54 None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:48:19.378306 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd0761d-5374-4ec7-86c5-bb50bbe0c618 None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:48:19.412265 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b97c8c-1646-444f-ba5f-eb74d804d35b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:48:19.413009 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b97c8c-1646-444f-ba5f-eb74d804d35b None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:48:19.413477 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b97c8c-1646-444f-ba5f-eb74d804d35b None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:48:19.413762 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b97c8c-1646-444f-ba5f-eb74d804d35b None admin] PATH_INFO: `/v3/groups/16d3396dd5fc46849d2621b8d90601b3` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:48:19.422541 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b97c8c-1646-444f-ba5f-eb74d804d35b None admin] RBAC: Authorizing `identity:get_group(group_id=16d3396dd5fc46849d2621b8d90601b3)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:48:19.423643 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b97c8c-1646-444f-ba5f-eb74d804d35b None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:48:19.425734 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 214/426] 10.222.0.25 () {56 vars in 1180 bytes} [Thu Sep 15 17:48:19 2022] GET /identity/v3/groups/16d3396dd5fc46849d2621b8d90601b3 => generated 226 bytes in 340 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 17:48:19.431335 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09038f1-0935-41a8-85bb-d08b358f177c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:48:19.431792 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b97c8c-1646-444f-ba5f-eb74d804d35b None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:48:19.432999 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09038f1-0935-41a8-85bb-d08b358f177c None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:48:19.433636 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09038f1-0935-41a8-85bb-d08b358f177c None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:48:19.434126 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09038f1-0935-41a8-85bb-d08b358f177c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:48:19.529499 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a09038f1-0935-41a8-85bb-d08b358f177c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:48:19.531328 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a09038f1-0935-41a8-85bb-d08b358f177c None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:48:19.571952 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:48:19.687339 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 213/427] 10.222.0.25 () {58 vars in 1282 bytes} [Thu Sep 15 17:48:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 493 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 15 17:48:19.693831 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09038f1-0935-41a8-85bb-d08b358f177c None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:48:19.724957 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b97c8c-1646-444f-ba5f-eb74d804d35b None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:48:19.784527 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7965a26f-1285-459d-b469-b39d64e846e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:48:19.786527 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7965a26f-1285-459d-b469-b39d64e846e3 None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:48:19.787694 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7965a26f-1285-459d-b469-b39d64e846e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:48:19.798813 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7965a26f-1285-459d-b469-b39d64e846e3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:48:19.800023 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7965a26f-1285-459d-b469-b39d64e846e3 None admin] RBAC: Adding query filter params (group.id=16d3396dd5fc46849d2621b8d90601b3, role.id=343cc8b1bc7243eebabdf08147e8366d, scope.project.id=f18aabde2e1f4bebaec9fb09d1725a11) {{(pid=81592) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 17:48:19.800610 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7965a26f-1285-459d-b469-b39d64e846e3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:48:19.802384 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7965a26f-1285-459d-b469-b39d64e846e3 None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:48:19.817172 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 215/428] 10.222.0.25 () {56 vars in 1376 bytes} [Thu Sep 15 17:48:19 2022] GET /identity/v3/role_assignments?group.id=16d3396dd5fc46849d2621b8d90601b3&scope.project.id=f18aabde2e1f4bebaec9fb09d1725a11&role.id=343cc8b1bc7243eebabdf08147e8366d => generated 611 bytes in 386 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 17:48:19.901934 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09038f1-0935-41a8-85bb-d08b358f177c None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:48:19.981992 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c0f0be-b440-45db-a1dc-2c0fa6b4c452 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:48:19.982676 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c0f0be-b440-45db-a1dc-2c0fa6b4c452 None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:48:19.983019 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c0f0be-b440-45db-a1dc-2c0fa6b4c452 None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:48:19.983371 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c0f0be-b440-45db-a1dc-2c0fa6b4c452 None admin] PATH_INFO: `/v3/projects/f18aabde2e1f4bebaec9fb09d1725a11` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:48:19.988884 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c0f0be-b440-45db-a1dc-2c0fa6b4c452 None admin] RBAC: Authorizing `identity:get_project(project_id=f18aabde2e1f4bebaec9fb09d1725a11)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:48:19.990881 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c0f0be-b440-45db-a1dc-2c0fa6b4c452 None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:48:19.993363 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 214/429] 10.222.0.25 () {56 vars in 1186 bytes} [Thu Sep 15 17:48:19 2022] GET /identity/v3/projects/f18aabde2e1f4bebaec9fb09d1725a11 => generated 298 bytes in 300 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 17:48:20.000546 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7965a26f-1285-459d-b469-b39d64e846e3 None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:48:20.028756 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a886340-4da3-4137-bb05-69c873d152e4 None None] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:48:20.029079 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a886340-4da3-4137-bb05-69c873d152e4 None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:48:20.029326 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a886340-4da3-4137-bb05-69c873d152e4 None None] PATH_INFO: `/` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:48:20.030974 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 215/430] 10.222.0.25 () {54 vars in 927 bytes} [Thu Sep 15 17:48:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 15 17:48:20.041169 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c495f96c-dcb2-48d9-b3e1-1aa5f889f5c1 None None] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:48:20.041629 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c495f96c-dcb2-48d9-b3e1-1aa5f889f5c1 None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:48:20.042041 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c495f96c-dcb2-48d9-b3e1-1aa5f889f5c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:48:20.053902 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:48:20.057323 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:48:20.075677 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.auth.core [None req-c495f96c-dcb2-48d9-b3e1-1aa5f889f5c1 None None] MFA Rules not processed for user `5cfa58ef86774ab7800bf91930bf6028`. Rule list: `[]` (Enabled: `True`). {{(pid=81593) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 17:48:20.077556 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-c495f96c-dcb2-48d9-b3e1-1aa5f889f5c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 17:48:20.201000 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 216/431] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Sep 15 17:48:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 15 17:48:20.207821 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7965a26f-1285-459d-b469-b39d64e846e3 None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:48:20.252335 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0848c15d-d1b1-4107-b648-331e9c2e7326 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:48:20.252984 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0848c15d-d1b1-4107-b648-331e9c2e7326 None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:48:20.253264 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0848c15d-d1b1-4107-b648-331e9c2e7326 None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:48:20.253599 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0848c15d-d1b1-4107-b648-331e9c2e7326 None admin] PATH_INFO: `/v3/groups/16d3396dd5fc46849d2621b8d90601b3` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:48:20.254736 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0848c15d-d1b1-4107-b648-331e9c2e7326 None admin] RBAC: Authorizing `identity:get_group(group_id=16d3396dd5fc46849d2621b8d90601b3)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:48:20.256184 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0848c15d-d1b1-4107-b648-331e9c2e7326 None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:48:20.258131 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 216/432] 10.222.0.25 () {56 vars in 1180 bytes} [Thu Sep 15 17:48:19 2022] GET /identity/v3/groups/16d3396dd5fc46849d2621b8d90601b3 => generated 226 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 17:48:20.263568 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c495f96c-dcb2-48d9-b3e1-1aa5f889f5c1 None None] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:48:20.381709 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6504f43-0bf7-4684-a776-a9c8c1bed39a None None] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:48:20.382199 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6504f43-0bf7-4684-a776-a9c8c1bed39a None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:48:20.382555 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6504f43-0bf7-4684-a776-a9c8c1bed39a None None] PATH_INFO: `/` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:48:20.386101 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 217/433] 10.222.0.25 () {54 vars in 927 bytes} [Thu Sep 15 17:48:20 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 17:48:20.391432 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c495f96c-dcb2-48d9-b3e1-1aa5f889f5c1 None None] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:48:20.392735 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55717432-8e51-4e15-b4df-4df6999bdc7a None None] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:48:20.393025 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55717432-8e51-4e15-b4df-4df6999bdc7a None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:48:20.393330 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55717432-8e51-4e15-b4df-4df6999bdc7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:48:20.421644 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.auth.core [None req-55717432-8e51-4e15-b4df-4df6999bdc7a None None] MFA Rules not processed for user `5cfa58ef86774ab7800bf91930bf6028`. Rule list: `[]` (Enabled: `True`). {{(pid=81592) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 17:48:20.422928 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-55717432-8e51-4e15-b4df-4df6999bdc7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 17:48:20.437708 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:48:20.447411 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd796c63-23ab-4d5c-aaac-6bbb34c6631b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:48:20.448133 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd796c63-23ab-4d5c-aaac-6bbb34c6631b None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:48:20.448634 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd796c63-23ab-4d5c-aaac-6bbb34c6631b None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:48:20.449133 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd796c63-23ab-4d5c-aaac-6bbb34c6631b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:48:20.450183 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd796c63-23ab-4d5c-aaac-6bbb34c6631b None admin] RBAC: Adding query filter params (group.id=16d3396dd5fc46849d2621b8d90601b3, role.id=0dd1b9f5b7924e20a665ce50d6e34dc7, scope.project.id=f18aabde2e1f4bebaec9fb09d1725a11) {{(pid=81593) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 17:48:20.450673 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd796c63-23ab-4d5c-aaac-6bbb34c6631b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:48:20.452524 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd796c63-23ab-4d5c-aaac-6bbb34c6631b None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:48:20.460445 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 217/434] 10.222.0.25 () {56 vars in 1376 bytes} [Thu Sep 15 17:48:20 2022] GET /identity/v3/role_assignments?group.id=16d3396dd5fc46849d2621b8d90601b3&scope.project.id=f18aabde2e1f4bebaec9fb09d1725a11&role.id=0dd1b9f5b7924e20a665ce50d6e34dc7 => generated 611 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 17:48:20.527207 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 218/435] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Sep 15 17:48:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 15 17:48:20.557364 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd796c63-23ab-4d5c-aaac-6bbb34c6631b None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:48:20.685483 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52380973-b632-41d0-b6a8-f02505eb6d7b None None] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:48:20.686191 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52380973-b632-41d0-b6a8-f02505eb6d7b None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:48:20.686798 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52380973-b632-41d0-b6a8-f02505eb6d7b None None] PATH_INFO: `/` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:48:20.688711 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 219/436] 10.222.0.25 () {54 vars in 927 bytes} [Thu Sep 15 17:48:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 17:48:20.694918 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7e8467-1674-4d82-a8d8-5576da81e074 None None] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:48:20.695545 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7e8467-1674-4d82-a8d8-5576da81e074 None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:48:20.696299 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7e8467-1674-4d82-a8d8-5576da81e074 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:48:20.700628 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd796c63-23ab-4d5c-aaac-6bbb34c6631b None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:48:20.736452 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.auth.core [None req-cc7e8467-1674-4d82-a8d8-5576da81e074 None None] MFA Rules not processed for user `5cfa58ef86774ab7800bf91930bf6028`. Rule list: `[]` (Enabled: `True`). {{(pid=81592) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 17:48:20.739266 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-cc7e8467-1674-4d82-a8d8-5576da81e074 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 17:48:20.745089 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b94c0c-9ac6-410e-9861-24279bac6786 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:48:20.745834 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b94c0c-9ac6-410e-9861-24279bac6786 None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:48:20.746155 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b94c0c-9ac6-410e-9861-24279bac6786 None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:48:20.746385 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b94c0c-9ac6-410e-9861-24279bac6786 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:48:20.760091 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b94c0c-9ac6-410e-9861-24279bac6786 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 17:48:20.765818 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:48:20.766994 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application [None req-f0b94c0c-9ac6-410e-9861-24279bac6786 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 15 17:48:20.766994 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 17:48:20.766994 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 17:48:20.766994 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 17:48:20.766994 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 17:48:20.766994 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 17:48:20.766994 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 17:48:20.766994 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 17:48:20.766994 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 17:48:20.766994 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 17:48:20.766994 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 17:48:20.766994 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 17:48:20.766994 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 17:48:20.766994 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 17:48:20.766994 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 17:48:20.766994 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 17:48:20.768710 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 17:48:20.768710 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 17:48:20.768710 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 17:48:20.768710 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 17:48:20.768710 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 17:48:20.768710 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 17:48:20.768710 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 17:48:20.768710 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 17:48:20.768710 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 17:48:20.768710 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 17:48:20.768710 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 17:48:20.768710 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application with Lock( Sep 15 17:48:20.768710 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 17:48:20.768710 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._enter() Sep 15 17:48:20.768710 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 17:48:20.768710 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 17:48:20.770430 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 17:48:20.770430 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.creator() Sep 15 17:48:20.770430 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 17:48:20.770430 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application created_value = creator( Sep 15 17:48:20.770430 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 17:48:20.770430 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 17:48:20.770430 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 17:48:20.770430 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 17:48:20.770430 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 17:48:20.770430 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 17:48:20.770430 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 15 17:48:20.770430 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Sep 15 17:48:20.771784 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 218/437] 10.222.0.25 () {56 vars in 1099 bytes} [Thu Sep 15 17:48:20 2022] GET /identity/v3/roles/member => generated 84 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 17:48:20.782051 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b94c0c-9ac6-410e-9861-24279bac6786 None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:48:20.853732 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 220/438] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Sep 15 17:48:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 15 17:48:20.866504 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:48:20.868835 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7e8467-1674-4d82-a8d8-5576da81e074 None None] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:48:20.947205 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b94c0c-9ac6-410e-9861-24279bac6786 None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:48:20.992068 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c27697-8d30-42ae-85d1-1ac3c582239d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:48:20.992698 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c27697-8d30-42ae-85d1-1ac3c582239d None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:48:20.992978 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c27697-8d30-42ae-85d1-1ac3c582239d None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:48:20.993249 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c27697-8d30-42ae-85d1-1ac3c582239d None admin] PATH_INFO: `/v3/roles` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:48:20.994016 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c27697-8d30-42ae-85d1-1ac3c582239d None admin] RBAC: Adding query filter params (name=member) {{(pid=81593) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 17:48:20.994896 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c27697-8d30-42ae-85d1-1ac3c582239d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:48:20.996616 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c27697-8d30-42ae-85d1-1ac3c582239d None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:48:21.008315 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 219/439] 10.222.0.25 () {56 vars in 1101 bytes} [Thu Sep 15 17:48:20 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 17:48:21.014111 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7e8467-1674-4d82-a8d8-5576da81e074 None None] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:48:21.015199 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c27697-8d30-42ae-85d1-1ac3c582239d None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:48:21.075783 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30bbf82f-0f2e-49c9-a80a-3844cd8f2895 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:48:21.076370 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bbf82f-0f2e-49c9-a80a-3844cd8f2895 None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:48:21.076653 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bbf82f-0f2e-49c9-a80a-3844cd8f2895 None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:48:21.076927 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bbf82f-0f2e-49c9-a80a-3844cd8f2895 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:48:21.091582 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30bbf82f-0f2e-49c9-a80a-3844cd8f2895 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 17:48:21.098553 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application [None req-30bbf82f-0f2e-49c9-a80a-3844cd8f2895 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 15 17:48:21.098553 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 17:48:21.098553 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 17:48:21.098553 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 17:48:21.098553 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 17:48:21.098553 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 17:48:21.098553 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 17:48:21.098553 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 17:48:21.098553 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 17:48:21.098553 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 17:48:21.098553 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 17:48:21.098553 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 17:48:21.098553 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 17:48:21.098553 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 17:48:21.098553 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 17:48:21.098553 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 17:48:21.099497 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 17:48:21.099497 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 17:48:21.099497 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 17:48:21.099497 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 17:48:21.099497 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 17:48:21.099497 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 17:48:21.099497 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 17:48:21.099497 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 17:48:21.099497 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 17:48:21.099497 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 17:48:21.099497 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 17:48:21.099497 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application with Lock( Sep 15 17:48:21.099497 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 17:48:21.099497 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._enter() Sep 15 17:48:21.099497 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 17:48:21.099497 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 17:48:21.100285 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 17:48:21.100285 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.creator() Sep 15 17:48:21.100285 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 17:48:21.100285 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application created_value = creator( Sep 15 17:48:21.100285 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 17:48:21.100285 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 17:48:21.100285 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 17:48:21.100285 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 17:48:21.100285 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 17:48:21.100285 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 17:48:21.100285 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 15 17:48:21.100285 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Sep 15 17:48:21.100285 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 221/440] 10.222.0.25 () {56 vars in 1114 bytes} [Thu Sep 15 17:48:20 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 17:48:21.107193 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30bbf82f-0f2e-49c9-a80a-3844cd8f2895 None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:48:21.125321 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:48:21.162166 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c27697-8d30-42ae-85d1-1ac3c582239d None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:48:21.183156 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:48:21.201569 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7a18b4-5f0e-43bf-af93-f78979ffb93f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:48:21.202216 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7a18b4-5f0e-43bf-af93-f78979ffb93f None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:48:21.202450 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7a18b4-5f0e-43bf-af93-f78979ffb93f None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:48:21.202678 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7a18b4-5f0e-43bf-af93-f78979ffb93f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:48:21.235241 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30bbf82f-0f2e-49c9-a80a-3844cd8f2895 None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:48:21.272985 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb7a18b4-5f0e-43bf-af93-f78979ffb93f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:48:21.274780 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb7a18b4-5f0e-43bf-af93-f78979ffb93f None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:48:21.276034 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b377feeb-6c08-4d9b-a849-ad9afb3aee75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:48:21.276739 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b377feeb-6c08-4d9b-a849-ad9afb3aee75 None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:48:21.277073 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b377feeb-6c08-4d9b-a849-ad9afb3aee75 None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:48:21.277424 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b377feeb-6c08-4d9b-a849-ad9afb3aee75 None admin] PATH_INFO: `/v3/roles` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:48:21.278210 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b377feeb-6c08-4d9b-a849-ad9afb3aee75 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81592) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 17:48:21.278542 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b377feeb-6c08-4d9b-a849-ad9afb3aee75 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:48:21.280165 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b377feeb-6c08-4d9b-a849-ad9afb3aee75 None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:48:21.294740 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 222/441] 10.222.0.25 () {56 vars in 1111 bytes} [Thu Sep 15 17:48:21 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 17:48:21.294740 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b377feeb-6c08-4d9b-a849-ad9afb3aee75 None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:48:21.372642 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:48:21.397262 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 220/442] 10.222.0.25 () {58 vars in 1282 bytes} [Thu Sep 15 17:48:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 383 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 15 17:48:21.398564 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7a18b4-5f0e-43bf-af93-f78979ffb93f None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:48:21.411777 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b377feeb-6c08-4d9b-a849-ad9afb3aee75 None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:48:21.420847 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:48:21.449575 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04276261-8f0a-43e2-b939-56a011ee6bfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:48:21.450239 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04276261-8f0a-43e2-b939-56a011ee6bfb None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:48:21.450519 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04276261-8f0a-43e2-b939-56a011ee6bfb None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:48:21.450791 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04276261-8f0a-43e2-b939-56a011ee6bfb None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:48:21.462860 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04276261-8f0a-43e2-b939-56a011ee6bfb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 17:48:21.468416 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application [None req-04276261-8f0a-43e2-b939-56a011ee6bfb None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 15 17:48:21.468416 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 17:48:21.468416 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 17:48:21.468416 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 17:48:21.468416 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 17:48:21.468416 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 17:48:21.468416 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 17:48:21.468416 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 17:48:21.468416 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 17:48:21.468416 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 17:48:21.468416 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 17:48:21.468416 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 17:48:21.468416 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 17:48:21.468416 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 17:48:21.468416 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 17:48:21.468416 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 17:48:21.469434 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 17:48:21.469434 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 17:48:21.469434 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 17:48:21.469434 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 17:48:21.469434 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 17:48:21.469434 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 17:48:21.469434 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 17:48:21.469434 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 17:48:21.469434 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 17:48:21.469434 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 17:48:21.469434 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 17:48:21.469434 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application with Lock( Sep 15 17:48:21.469434 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 17:48:21.469434 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._enter() Sep 15 17:48:21.469434 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 17:48:21.469434 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 17:48:21.470265 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 17:48:21.470265 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.creator() Sep 15 17:48:21.470265 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 17:48:21.470265 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application created_value = creator( Sep 15 17:48:21.470265 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 17:48:21.470265 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 17:48:21.470265 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 17:48:21.470265 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 17:48:21.470265 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 17:48:21.470265 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 17:48:21.470265 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 15 17:48:21.470265 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Sep 15 17:48:21.470265 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 223/443] 10.222.0.25 () {56 vars in 1096 bytes} [Thu Sep 15 17:48:21 2022] GET /identity/v3/roles/admin => generated 83 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 17:48:21.470947 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04276261-8f0a-43e2-b939-56a011ee6bfb None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:48:21.518827 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7a18b4-5f0e-43bf-af93-f78979ffb93f None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:48:21.558703 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307b3266-ec5d-46e6-95e8-e001be61303d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:48:21.559545 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307b3266-ec5d-46e6-95e8-e001be61303d None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:48:21.559689 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307b3266-ec5d-46e6-95e8-e001be61303d None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:48:21.559868 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307b3266-ec5d-46e6-95e8-e001be61303d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:48:21.591225 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04276261-8f0a-43e2-b939-56a011ee6bfb None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:48:21.622862 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:48:21.629850 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406bc1b3-ef9c-4e70-aaa6-737ff5bbd9e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:48:21.630692 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406bc1b3-ef9c-4e70-aaa6-737ff5bbd9e2 None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:48:21.630914 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406bc1b3-ef9c-4e70-aaa6-737ff5bbd9e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:48:21.631268 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406bc1b3-ef9c-4e70-aaa6-737ff5bbd9e2 None admin] PATH_INFO: `/v3/projects/db66614609564cbf9e5fb3c7e35442d4` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:48:21.632360 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-307b3266-ec5d-46e6-95e8-e001be61303d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:48:21.632596 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-406bc1b3-ef9c-4e70-aaa6-737ff5bbd9e2 None admin] RBAC: Authorizing `identity:get_project(project_id=db66614609564cbf9e5fb3c7e35442d4)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:48:21.633868 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-307b3266-ec5d-46e6-95e8-e001be61303d None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:48:21.634357 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-406bc1b3-ef9c-4e70-aaa6-737ff5bbd9e2 None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:48:21.636730 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 224/444] 10.222.0.25 () {56 vars in 1186 bytes} [Thu Sep 15 17:48:21 2022] GET /identity/v3/projects/db66614609564cbf9e5fb3c7e35442d4 => generated 302 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 17:48:21.637362 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406bc1b3-ef9c-4e70-aaa6-737ff5bbd9e2 None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:48:21.658666 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:48:21.753638 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 221/445] 10.222.0.25 () {58 vars in 1282 bytes} [Thu Sep 15 17:48:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 15 17:48:21.754525 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307b3266-ec5d-46e6-95e8-e001be61303d None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:48:21.777256 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406bc1b3-ef9c-4e70-aaa6-737ff5bbd9e2 None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:48:21.822711 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbea7889-a950-4a9c-9212-0c8b07b1d4a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:48:21.823427 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbea7889-a950-4a9c-9212-0c8b07b1d4a1 None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:48:21.823768 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbea7889-a950-4a9c-9212-0c8b07b1d4a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:48:21.824095 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbea7889-a950-4a9c-9212-0c8b07b1d4a1 None admin] PATH_INFO: `/v3/roles` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:48:21.824908 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbea7889-a950-4a9c-9212-0c8b07b1d4a1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81592) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 17:48:21.825265 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbea7889-a950-4a9c-9212-0c8b07b1d4a1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:48:21.826975 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbea7889-a950-4a9c-9212-0c8b07b1d4a1 None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:48:21.837414 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 225/446] 10.222.0.25 () {56 vars in 1099 bytes} [Thu Sep 15 17:48:21 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 17:48:21.838389 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbea7889-a950-4a9c-9212-0c8b07b1d4a1 None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:48:21.868680 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307b3266-ec5d-46e6-95e8-e001be61303d None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:48:21.898732 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:48:21.908950 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e437b7-0b0b-4ed2-bcaf-0a0db9cde37b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:48:21.909688 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e437b7-0b0b-4ed2-bcaf-0a0db9cde37b None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:48:21.910516 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e437b7-0b0b-4ed2-bcaf-0a0db9cde37b None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:48:21.910788 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e437b7-0b0b-4ed2-bcaf-0a0db9cde37b None admin] PATH_INFO: `/v3/groups/16d3396dd5fc46849d2621b8d90601b3` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:48:21.911928 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e437b7-0b0b-4ed2-bcaf-0a0db9cde37b None admin] RBAC: Authorizing `identity:get_group(group_id=16d3396dd5fc46849d2621b8d90601b3)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:48:21.913413 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e437b7-0b0b-4ed2-bcaf-0a0db9cde37b None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:48:21.915139 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 222/447] 10.222.0.25 () {56 vars in 1180 bytes} [Thu Sep 15 17:48:21 2022] GET /identity/v3/groups/16d3396dd5fc46849d2621b8d90601b3 => generated 226 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 17:48:21.916048 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e437b7-0b0b-4ed2-bcaf-0a0db9cde37b None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:48:21.921314 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:48:21.960404 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbea7889-a950-4a9c-9212-0c8b07b1d4a1 None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:48:22.003552 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837929d8-54ff-419c-919c-661fd1fe74cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:48:22.004218 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837929d8-54ff-419c-919c-661fd1fe74cc None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:48:22.004495 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837929d8-54ff-419c-919c-661fd1fe74cc None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:48:22.004769 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837929d8-54ff-419c-919c-661fd1fe74cc None admin] PATH_INFO: `/v3/projects/db66614609564cbf9e5fb3c7e35442d4` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:48:22.006185 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-837929d8-54ff-419c-919c-661fd1fe74cc None admin] RBAC: Authorizing `identity:get_project(project_id=db66614609564cbf9e5fb3c7e35442d4)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:48:22.007687 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-837929d8-54ff-419c-919c-661fd1fe74cc None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:48:22.009906 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 226/448] 10.222.0.25 () {56 vars in 1186 bytes} [Thu Sep 15 17:48:21 2022] GET /identity/v3/projects/db66614609564cbf9e5fb3c7e35442d4 => generated 302 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 17:48:22.010512 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837929d8-54ff-419c-919c-661fd1fe74cc None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:48:22.047884 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e437b7-0b0b-4ed2-bcaf-0a0db9cde37b None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:48:22.090473 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27fcd48-7b7f-4d62-a8dd-b34c5f17cf7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:48:22.091088 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27fcd48-7b7f-4d62-a8dd-b34c5f17cf7b None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:48:22.091360 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27fcd48-7b7f-4d62-a8dd-b34c5f17cf7b None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:48:22.091632 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27fcd48-7b7f-4d62-a8dd-b34c5f17cf7b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:48:22.133987 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837929d8-54ff-419c-919c-661fd1fe74cc None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:48:22.151282 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:48:22.162341 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:48:22.167316 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e27fcd48-7b7f-4d62-a8dd-b34c5f17cf7b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:48:22.168789 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e27fcd48-7b7f-4d62-a8dd-b34c5f17cf7b None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:48:22.170421 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf70657-717b-4f2b-a8c9-ad6646f77f43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:48:22.171197 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf70657-717b-4f2b-a8c9-ad6646f77f43 None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:48:22.172295 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf70657-717b-4f2b-a8c9-ad6646f77f43 None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:48:22.172589 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf70657-717b-4f2b-a8c9-ad6646f77f43 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:48:22.173337 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf70657-717b-4f2b-a8c9-ad6646f77f43 None admin] RBAC: Adding query filter params (group.id=16d3396dd5fc46849d2621b8d90601b3, role.id=343cc8b1bc7243eebabdf08147e8366d, scope.project.id=db66614609564cbf9e5fb3c7e35442d4) {{(pid=81592) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 17:48:22.173649 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf70657-717b-4f2b-a8c9-ad6646f77f43 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:48:22.175054 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf70657-717b-4f2b-a8c9-ad6646f77f43 None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:48:22.181017 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 227/449] 10.222.0.25 () {56 vars in 1376 bytes} [Thu Sep 15 17:48:22 2022] GET /identity/v3/role_assignments?group.id=16d3396dd5fc46849d2621b8d90601b3&scope.project.id=db66614609564cbf9e5fb3c7e35442d4&role.id=343cc8b1bc7243eebabdf08147e8366d => generated 611 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 17:48:22.181821 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf70657-717b-4f2b-a8c9-ad6646f77f43 None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:48:22.298139 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 223/450] 10.222.0.25 () {58 vars in 1282 bytes} [Thu Sep 15 17:48:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 382 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 15 17:48:22.303937 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27fcd48-7b7f-4d62-a8dd-b34c5f17cf7b None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:48:22.311838 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf70657-717b-4f2b-a8c9-ad6646f77f43 None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:48:22.364117 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d65d0b8-dcae-4533-8354-02792134ed2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:48:22.364764 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d65d0b8-dcae-4533-8354-02792134ed2f None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:48:22.365063 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d65d0b8-dcae-4533-8354-02792134ed2f None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:48:22.365362 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d65d0b8-dcae-4533-8354-02792134ed2f None admin] PATH_INFO: `/v3/groups/16d3396dd5fc46849d2621b8d90601b3` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:48:22.366501 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d65d0b8-dcae-4533-8354-02792134ed2f None admin] RBAC: Authorizing `identity:get_group(group_id=16d3396dd5fc46849d2621b8d90601b3)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:48:22.367970 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d65d0b8-dcae-4533-8354-02792134ed2f None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:48:22.369679 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 228/451] 10.222.0.25 () {56 vars in 1180 bytes} [Thu Sep 15 17:48:22 2022] GET /identity/v3/groups/16d3396dd5fc46849d2621b8d90601b3 => generated 226 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 17:48:22.376305 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d65d0b8-dcae-4533-8354-02792134ed2f None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:48:22.415811 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:48:22.435381 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27fcd48-7b7f-4d62-a8dd-b34c5f17cf7b None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:48:22.450226 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:48:22.491036 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27ea6a6-7809-4b98-a29a-9350d67053e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:48:22.492483 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27ea6a6-7809-4b98-a29a-9350d67053e7 None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:48:22.492762 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27ea6a6-7809-4b98-a29a-9350d67053e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:48:22.493275 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27ea6a6-7809-4b98-a29a-9350d67053e7 None admin] PATH_INFO: `/v3/projects/e456d0186b2040e49cb0f3fd71d6c972` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:48:22.494897 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27ea6a6-7809-4b98-a29a-9350d67053e7 None admin] RBAC: Authorizing `identity:get_project(project_id=e456d0186b2040e49cb0f3fd71d6c972)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:48:22.496344 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27ea6a6-7809-4b98-a29a-9350d67053e7 None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:48:22.498866 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 224/452] 10.222.0.25 () {56 vars in 1186 bytes} [Thu Sep 15 17:48:22 2022] GET /identity/v3/projects/e456d0186b2040e49cb0f3fd71d6c972 => generated 344 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 17:48:22.506933 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27ea6a6-7809-4b98-a29a-9350d67053e7 None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:48:22.521371 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d65d0b8-dcae-4533-8354-02792134ed2f None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:48:22.573459 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6726efb-f308-4d08-92e0-25dac99e237c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:48:22.574164 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6726efb-f308-4d08-92e0-25dac99e237c None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:48:22.574496 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6726efb-f308-4d08-92e0-25dac99e237c None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:48:22.574823 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6726efb-f308-4d08-92e0-25dac99e237c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:48:22.575702 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6726efb-f308-4d08-92e0-25dac99e237c None admin] RBAC: Adding query filter params (group.id=16d3396dd5fc46849d2621b8d90601b3, role.id=0dd1b9f5b7924e20a665ce50d6e34dc7, scope.project.id=db66614609564cbf9e5fb3c7e35442d4) {{(pid=81592) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 17:48:22.576019 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6726efb-f308-4d08-92e0-25dac99e237c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:48:22.577843 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6726efb-f308-4d08-92e0-25dac99e237c None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:48:22.586157 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 229/453] 10.222.0.25 () {56 vars in 1376 bytes} [Thu Sep 15 17:48:22 2022] GET /identity/v3/role_assignments?group.id=16d3396dd5fc46849d2621b8d90601b3&scope.project.id=db66614609564cbf9e5fb3c7e35442d4&role.id=0dd1b9f5b7924e20a665ce50d6e34dc7 => generated 611 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 17:48:22.631488 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27ea6a6-7809-4b98-a29a-9350d67053e7 None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:48:22.670327 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01846487-82bc-4dae-9939-ead587d11914 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:48:22.670884 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01846487-82bc-4dae-9939-ead587d11914 None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:48:22.671169 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01846487-82bc-4dae-9939-ead587d11914 None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:48:22.671439 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01846487-82bc-4dae-9939-ead587d11914 None admin] PATH_INFO: `/v3/groups/d6e7eea791bb497f9e64d18ec7f4ca38` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:48:22.672622 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01846487-82bc-4dae-9939-ead587d11914 None admin] RBAC: Authorizing `identity:get_group(group_id=d6e7eea791bb497f9e64d18ec7f4ca38)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:48:22.674113 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01846487-82bc-4dae-9939-ead587d11914 None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:48:22.675757 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 225/454] 10.222.0.25 () {56 vars in 1180 bytes} [Thu Sep 15 17:48:22 2022] GET /identity/v3/groups/d6e7eea791bb497f9e64d18ec7f4ca38 => generated 229 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 17:48:22.682242 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6726efb-f308-4d08-92e0-25dac99e237c None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:48:22.790110 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6726efb-f308-4d08-92e0-25dac99e237c None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:48:22.814890 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:48:22.828227 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c17a72-ddfe-43d2-89ff-37e43f59f804 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:48:22.828833 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c17a72-ddfe-43d2-89ff-37e43f59f804 None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:48:22.831143 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c17a72-ddfe-43d2-89ff-37e43f59f804 None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:48:22.831143 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c17a72-ddfe-43d2-89ff-37e43f59f804 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:48:22.831143 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c17a72-ddfe-43d2-89ff-37e43f59f804 None admin] RBAC: Adding query filter params (group.id=d6e7eea791bb497f9e64d18ec7f4ca38, role.id=a9e42be86923434f8af52d3fc07fb4f7, scope.project.id=e456d0186b2040e49cb0f3fd71d6c972) {{(pid=81592) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 17:48:22.831143 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c17a72-ddfe-43d2-89ff-37e43f59f804 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:48:22.832772 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c17a72-ddfe-43d2-89ff-37e43f59f804 None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:48:22.839753 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 230/455] 10.222.0.25 () {56 vars in 1376 bytes} [Thu Sep 15 17:48:22 2022] GET /identity/v3/role_assignments?group.id=d6e7eea791bb497f9e64d18ec7f4ca38&scope.project.id=e456d0186b2040e49cb0f3fd71d6c972&role.id=a9e42be86923434f8af52d3fc07fb4f7 => generated 611 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 17:48:25.866241 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70c7fe1-b611-4723-b1b7-d0bac72ac0ef None None] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:48:25.866756 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70c7fe1-b611-4723-b1b7-d0bac72ac0ef None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:48:25.866864 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70c7fe1-b611-4723-b1b7-d0bac72ac0ef None None] PATH_INFO: `/` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:48:25.869050 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 226/456] 10.222.0.25 () {54 vars in 927 bytes} [Thu Sep 15 17:48:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 17:48:25.874350 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1e8519-3a5d-4161-a8fc-a77eb7366be5 None None] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:48:25.875247 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1e8519-3a5d-4161-a8fc-a77eb7366be5 None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:48:25.875739 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1e8519-3a5d-4161-a8fc-a77eb7366be5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:48:25.910865 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.auth.core [None req-dc1e8519-3a5d-4161-a8fc-a77eb7366be5 None None] MFA Rules not processed for user `5cfa58ef86774ab7800bf91930bf6028`. Rule list: `[]` (Enabled: `True`). {{(pid=81592) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 17:48:25.912536 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-dc1e8519-3a5d-4161-a8fc-a77eb7366be5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 17:48:26.028903 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e83f8df-dc31-4d3f-b71a-a9266cdea742 None None] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:48:26.029245 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e83f8df-dc31-4d3f-b71a-a9266cdea742 None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:48:26.029488 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e83f8df-dc31-4d3f-b71a-a9266cdea742 None None] PATH_INFO: `/` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:48:26.031054 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 227/457] 10.222.0.25 () {54 vars in 927 bytes} [Thu Sep 15 17:48:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 17:48:26.036420 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3ba45c-7224-4d54-92b6-9130ae6f3b50 None None] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:48:26.036698 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3ba45c-7224-4d54-92b6-9130ae6f3b50 None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:48:26.036966 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3ba45c-7224-4d54-92b6-9130ae6f3b50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:48:26.037468 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 231/458] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Sep 15 17:48:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 15 17:48:26.066896 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.auth.core [None req-ac3ba45c-7224-4d54-92b6-9130ae6f3b50 None None] MFA Rules not processed for user `5cfa58ef86774ab7800bf91930bf6028`. Rule list: `[]` (Enabled: `True`). {{(pid=81593) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 17:48:26.068169 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-ac3ba45c-7224-4d54-92b6-9130ae6f3b50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 17:48:26.095432 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:48:26.164071 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 228/459] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Sep 15 17:48:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 15 17:48:26.307858 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287db349-f5d4-4cfc-9e2b-5e51585543a7 None None] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:48:26.308547 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287db349-f5d4-4cfc-9e2b-5e51585543a7 None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:48:26.309038 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287db349-f5d4-4cfc-9e2b-5e51585543a7 None None] PATH_INFO: `/` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:48:26.311001 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 232/460] 10.222.0.25 () {54 vars in 927 bytes} [Thu Sep 15 17:48:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 17:48:26.318807 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec263e8-6b00-4de6-a6c8-3bf743b8bac2 None None] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:48:26.319121 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec263e8-6b00-4de6-a6c8-3bf743b8bac2 None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:48:26.319375 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec263e8-6b00-4de6-a6c8-3bf743b8bac2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:48:26.346499 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.auth.core [None req-dec263e8-6b00-4de6-a6c8-3bf743b8bac2 None None] MFA Rules not processed for user `5cfa58ef86774ab7800bf91930bf6028`. Rule list: `[]` (Enabled: `True`). {{(pid=81593) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 17:48:26.348235 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-dec263e8-6b00-4de6-a6c8-3bf743b8bac2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 17:48:26.439799 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 229/461] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Sep 15 17:48:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 15 17:48:26.465699 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287db349-f5d4-4cfc-9e2b-5e51585543a7 None None] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:48:26.638422 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287db349-f5d4-4cfc-9e2b-5e51585543a7 None None] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:48:26.678850 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:48:26.684392 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f78dd0-622b-4fae-9ef3-ea83fbc02aab None None] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:48:26.685157 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f78dd0-622b-4fae-9ef3-ea83fbc02aab None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:48:26.685754 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f78dd0-622b-4fae-9ef3-ea83fbc02aab None None] PATH_INFO: `/` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:48:26.687920 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 230/462] 10.222.0.25 () {54 vars in 927 bytes} [Thu Sep 15 17:48:26 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 17:48:26.694555 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39947cec-61f9-4b25-a2df-d27e91b951eb None None] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:48:26.695306 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39947cec-61f9-4b25-a2df-d27e91b951eb None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:48:26.695989 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39947cec-61f9-4b25-a2df-d27e91b951eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:48:26.711751 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44bc27e2-5a6c-4ec8-b1af-523a838d4f3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:48:26.712392 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bc27e2-5a6c-4ec8-b1af-523a838d4f3d None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:48:26.712668 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bc27e2-5a6c-4ec8-b1af-523a838d4f3d None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:48:26.717346 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bc27e2-5a6c-4ec8-b1af-523a838d4f3d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:48:26.734201 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44bc27e2-5a6c-4ec8-b1af-523a838d4f3d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:48:26.735776 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44bc27e2-5a6c-4ec8-b1af-523a838d4f3d None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:48:26.737218 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.auth.core [None req-39947cec-61f9-4b25-a2df-d27e91b951eb None None] MFA Rules not processed for user `5cfa58ef86774ab7800bf91930bf6028`. Rule list: `[]` (Enabled: `True`). {{(pid=81593) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 17:48:26.738515 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-39947cec-61f9-4b25-a2df-d27e91b951eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 17:48:26.761758 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application [None req-44bc27e2-5a6c-4ec8-b1af-523a838d4f3d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 17:48:26.761758 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 17:48:26.761758 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 17:48:26.761758 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 17:48:26.761758 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 17:48:26.761758 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 17:48:26.761758 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 17:48:26.761758 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 17:48:26.761758 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 17:48:26.761758 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 17:48:26.761758 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 17:48:26.761758 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 17:48:26.761758 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 15 17:48:26.761758 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 15 17:48:26.761758 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 15 17:48:26.761758 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 15 17:48:26.763210 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 17:48:26.763210 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 17:48:26.763210 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 17:48:26.763210 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 17:48:26.763210 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 17:48:26.763210 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 17:48:26.763210 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 17:48:26.763210 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application with Lock( Sep 15 17:48:26.763210 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 17:48:26.763210 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._enter() Sep 15 17:48:26.763210 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 17:48:26.763210 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 17:48:26.763210 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 17:48:26.763210 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.creator() Sep 15 17:48:26.763210 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 17:48:26.763210 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application created_value = creator( Sep 15 17:48:26.763210 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 15 17:48:26.764606 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 15 17:48:26.764606 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 17:48:26.764606 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Sep 15 17:48:26.764606 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 233/463] 10.222.0.25 () {56 vars in 1108 bytes} [Thu Sep 15 17:48:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 298 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 17:48:26.771178 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44bc27e2-5a6c-4ec8-b1af-523a838d4f3d None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:48:26.837059 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 231/464] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Sep 15 17:48:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 15 17:48:26.837969 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39947cec-61f9-4b25-a2df-d27e91b951eb None None] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:48:26.859552 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:48:26.944836 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44bc27e2-5a6c-4ec8-b1af-523a838d4f3d None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:48:26.986848 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39947cec-61f9-4b25-a2df-d27e91b951eb None None] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:48:26.997632 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c28434-4cc4-4600-92be-30abecf7be9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:48:26.998536 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c28434-4cc4-4600-92be-30abecf7be9e None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:48:26.998963 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c28434-4cc4-4600-92be-30abecf7be9e None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:48:26.999379 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c28434-4cc4-4600-92be-30abecf7be9e None admin] PATH_INFO: `/v3/domains` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:48:27.000282 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c28434-4cc4-4600-92be-30abecf7be9e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81592) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 17:48:27.000748 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c28434-4cc4-4600-92be-30abecf7be9e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:48:27.002569 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c28434-4cc4-4600-92be-30abecf7be9e None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:48:27.017435 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 234/465] 10.222.0.25 () {56 vars in 1109 bytes} [Thu Sep 15 17:48:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 17:48:27.018644 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c28434-4cc4-4600-92be-30abecf7be9e None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:48:27.040610 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5e5397-8093-4e67-b5b3-24455bdac0e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:48:27.041751 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5e5397-8093-4e67-b5b3-24455bdac0e1 None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:48:27.042302 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5e5397-8093-4e67-b5b3-24455bdac0e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:48:27.042827 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5e5397-8093-4e67-b5b3-24455bdac0e1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:48:27.054524 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:48:27.056796 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5e5397-8093-4e67-b5b3-24455bdac0e1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:48:27.060122 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5e5397-8093-4e67-b5b3-24455bdac0e1 None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:48:27.081576 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application [None req-de5e5397-8093-4e67-b5b3-24455bdac0e1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 17:48:27.081576 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 17:48:27.081576 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 17:48:27.081576 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 17:48:27.081576 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 17:48:27.081576 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 17:48:27.081576 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 17:48:27.081576 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 17:48:27.081576 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 17:48:27.081576 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 17:48:27.081576 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 17:48:27.081576 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 17:48:27.081576 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 15 17:48:27.081576 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 15 17:48:27.081576 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 15 17:48:27.081576 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 15 17:48:27.082516 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 17:48:27.082516 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 17:48:27.082516 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 17:48:27.082516 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 17:48:27.082516 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 17:48:27.082516 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 17:48:27.082516 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 17:48:27.082516 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application with Lock( Sep 15 17:48:27.082516 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 17:48:27.082516 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._enter() Sep 15 17:48:27.082516 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 17:48:27.082516 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 17:48:27.082516 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 17:48:27.082516 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.creator() Sep 15 17:48:27.082516 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 17:48:27.082516 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application created_value = creator( Sep 15 17:48:27.082516 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 15 17:48:27.083423 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 15 17:48:27.083423 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 17:48:27.083423 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Sep 15 17:48:27.085365 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 232/466] 10.222.0.25 () {56 vars in 1108 bytes} [Thu Sep 15 17:48:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 17:48:27.086435 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5e5397-8093-4e67-b5b3-24455bdac0e1 None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:48:27.160434 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c28434-4cc4-4600-92be-30abecf7be9e None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:48:27.167722 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:48:27.198284 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2bc3415-12f5-4de6-afc2-85aa21ac6990 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:48:27.198830 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bc3415-12f5-4de6-afc2-85aa21ac6990 None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:48:27.199105 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bc3415-12f5-4de6-afc2-85aa21ac6990 None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:48:27.199373 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bc3415-12f5-4de6-afc2-85aa21ac6990 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:48:27.211288 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2bc3415-12f5-4de6-afc2-85aa21ac6990 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:48:27.212742 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2bc3415-12f5-4de6-afc2-85aa21ac6990 None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:48:27.213696 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5e5397-8093-4e67-b5b3-24455bdac0e1 None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:48:27.232420 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application [None req-c2bc3415-12f5-4de6-afc2-85aa21ac6990 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 17:48:27.232420 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 17:48:27.232420 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 17:48:27.232420 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 17:48:27.232420 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 17:48:27.232420 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 17:48:27.232420 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 17:48:27.232420 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 17:48:27.232420 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 17:48:27.232420 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 17:48:27.232420 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 17:48:27.232420 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 17:48:27.232420 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 15 17:48:27.232420 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 15 17:48:27.232420 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 15 17:48:27.232420 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 15 17:48:27.233624 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 17:48:27.233624 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 17:48:27.233624 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 17:48:27.233624 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 17:48:27.233624 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 17:48:27.233624 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 17:48:27.233624 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 17:48:27.233624 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application with Lock( Sep 15 17:48:27.233624 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 17:48:27.233624 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._enter() Sep 15 17:48:27.233624 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 17:48:27.233624 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 17:48:27.233624 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 17:48:27.233624 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.creator() Sep 15 17:48:27.233624 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 17:48:27.233624 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application created_value = creator( Sep 15 17:48:27.233624 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 15 17:48:27.234465 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 15 17:48:27.234465 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 17:48:27.234465 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Sep 15 17:48:27.234465 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 235/467] 10.222.0.25 () {56 vars in 1108 bytes} [Thu Sep 15 17:48:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 17:48:27.234676 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2bc3415-12f5-4de6-afc2-85aa21ac6990 None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:48:27.262478 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07162edc-6d3b-4ef2-9897-de4a0cc9678a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:48:27.263180 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07162edc-6d3b-4ef2-9897-de4a0cc9678a None admin] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:48:27.263553 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07162edc-6d3b-4ef2-9897-de4a0cc9678a None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:48:27.263853 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07162edc-6d3b-4ef2-9897-de4a0cc9678a None admin] PATH_INFO: `/v3/users` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:48:27.264583 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07162edc-6d3b-4ef2-9897-de4a0cc9678a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:48:27.266131 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07162edc-6d3b-4ef2-9897-de4a0cc9678a None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:48:27.289526 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 233/468] 10.222.0.25 () {60 vars in 1132 bytes} [Thu Sep 15 17:48:27 2022] POST /identity/v3/users => generated 246 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 17:48:27.290470 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07162edc-6d3b-4ef2-9897-de4a0cc9678a None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:48:27.344496 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:48:27.378377 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2bc3415-12f5-4de6-afc2-85aa21ac6990 None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:48:27.436654 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49adc51-6afc-4442-8725-414b79f7ad5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:48:27.437405 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49adc51-6afc-4442-8725-414b79f7ad5a None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:48:27.437724 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49adc51-6afc-4442-8725-414b79f7ad5a None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:48:27.438022 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49adc51-6afc-4442-8725-414b79f7ad5a None admin] PATH_INFO: `/v3/domains` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:48:27.438763 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d49adc51-6afc-4442-8725-414b79f7ad5a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81592) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 17:48:27.439110 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d49adc51-6afc-4442-8725-414b79f7ad5a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:48:27.440669 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d49adc51-6afc-4442-8725-414b79f7ad5a None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:48:27.442067 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07162edc-6d3b-4ef2-9897-de4a0cc9678a None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:48:27.459651 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 236/469] 10.222.0.25 () {56 vars in 1109 bytes} [Thu Sep 15 17:48:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 17:48:27.460443 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49adc51-6afc-4442-8725-414b79f7ad5a None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:48:27.474855 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:48:27.496112 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06981ce9-d577-4767-9c53-59dcda2796da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:48:27.496762 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06981ce9-d577-4767-9c53-59dcda2796da None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:48:27.497045 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06981ce9-d577-4767-9c53-59dcda2796da None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:48:27.498020 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06981ce9-d577-4767-9c53-59dcda2796da None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:48:27.519377 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06981ce9-d577-4767-9c53-59dcda2796da None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:48:27.520219 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06981ce9-d577-4767-9c53-59dcda2796da None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:48:27.537900 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application [None req-06981ce9-d577-4767-9c53-59dcda2796da None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 17:48:27.537900 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 17:48:27.537900 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 17:48:27.537900 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 17:48:27.537900 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 17:48:27.537900 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 17:48:27.537900 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 17:48:27.537900 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 17:48:27.537900 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 17:48:27.537900 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 17:48:27.537900 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 17:48:27.537900 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 17:48:27.537900 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 15 17:48:27.537900 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 15 17:48:27.537900 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 15 17:48:27.537900 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 15 17:48:27.538847 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 17:48:27.538847 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 17:48:27.538847 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 17:48:27.538847 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 17:48:27.538847 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 17:48:27.538847 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 17:48:27.538847 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 17:48:27.538847 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application with Lock( Sep 15 17:48:27.538847 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 17:48:27.538847 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._enter() Sep 15 17:48:27.538847 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 17:48:27.538847 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 17:48:27.538847 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 17:48:27.538847 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.creator() Sep 15 17:48:27.538847 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 17:48:27.538847 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application created_value = creator( Sep 15 17:48:27.538847 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 15 17:48:27.539693 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 15 17:48:27.539693 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 17:48:27.539693 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Sep 15 17:48:27.541540 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 234/470] 10.222.0.25 () {56 vars in 1108 bytes} [Thu Sep 15 17:48:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 17:48:27.542948 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c2e4b0-63ab-4c90-b6fe-51c33d210a49 None None] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:48:27.543415 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c2e4b0-63ab-4c90-b6fe-51c33d210a49 None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:48:27.543856 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c2e4b0-63ab-4c90-b6fe-51c33d210a49 None None] PATH_INFO: `/` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:48:27.545352 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 235/471] 10.222.0.25 () {54 vars in 927 bytes} [Thu Sep 15 17:48:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 17:48:27.546200 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c2e4b0-63ab-4c90-b6fe-51c33d210a49 None None] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:48:27.611896 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49adc51-6afc-4442-8725-414b79f7ad5a None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:48:27.651984 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a3aa02-c530-4fae-9094-ad12dc8f68c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:48:27.652597 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a3aa02-c530-4fae-9094-ad12dc8f68c5 None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:48:27.652874 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a3aa02-c530-4fae-9094-ad12dc8f68c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:48:27.653209 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a3aa02-c530-4fae-9094-ad12dc8f68c5 None admin] PATH_INFO: `/v3/domains` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:48:27.653899 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a3aa02-c530-4fae-9094-ad12dc8f68c5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81592) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 17:48:27.654232 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a3aa02-c530-4fae-9094-ad12dc8f68c5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:48:27.655604 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a3aa02-c530-4fae-9094-ad12dc8f68c5 None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:48:27.668270 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c2e4b0-63ab-4c90-b6fe-51c33d210a49 None None] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:48:27.669104 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 237/472] 10.222.0.25 () {56 vars in 1109 bytes} [Thu Sep 15 17:48:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 17:48:27.674554 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a3aa02-c530-4fae-9094-ad12dc8f68c5 None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:48:27.678919 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:48:27.707913 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2784f88-786e-49e4-b95c-9ca390db8edb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:48:27.707913 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2784f88-786e-49e4-b95c-9ca390db8edb None admin] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:48:27.707913 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2784f88-786e-49e4-b95c-9ca390db8edb None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:48:27.708313 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2784f88-786e-49e4-b95c-9ca390db8edb None admin] PATH_INFO: `/v3/users` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:48:27.708804 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2784f88-786e-49e4-b95c-9ca390db8edb None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:48:27.710337 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2784f88-786e-49e4-b95c-9ca390db8edb None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:48:27.741031 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 236/473] 10.222.0.25 () {60 vars in 1132 bytes} [Thu Sep 15 17:48:27 2022] POST /identity/v3/users => generated 248 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 17:48:27.741031 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ed49c1-c65d-491d-b334-56719f52bc1b None None] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:48:27.741031 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ed49c1-c65d-491d-b334-56719f52bc1b None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:48:27.741031 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ed49c1-c65d-491d-b334-56719f52bc1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:48:27.761156 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.auth.core [None req-69ed49c1-c65d-491d-b334-56719f52bc1b None None] MFA Rules not processed for user `5cfa58ef86774ab7800bf91930bf6028`. Rule list: `[]` (Enabled: `True`). {{(pid=81593) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 17:48:27.763694 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-69ed49c1-c65d-491d-b334-56719f52bc1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 17:48:27.813385 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:48:27.822113 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a3aa02-c530-4fae-9094-ad12dc8f68c5 None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:48:27.870992 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed92704e-6017-4902-a42a-d98e6b8d6af8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:48:27.871604 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed92704e-6017-4902-a42a-d98e6b8d6af8 None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:48:27.871891 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed92704e-6017-4902-a42a-d98e6b8d6af8 None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:48:27.872168 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed92704e-6017-4902-a42a-d98e6b8d6af8 None admin] PATH_INFO: `/v3/domains` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:48:27.873045 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed92704e-6017-4902-a42a-d98e6b8d6af8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81592) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 17:48:27.873371 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed92704e-6017-4902-a42a-d98e6b8d6af8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:48:27.875472 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed92704e-6017-4902-a42a-d98e6b8d6af8 None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:48:27.882611 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 237/474] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Sep 15 17:48:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 15 17:48:27.883538 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ed49c1-c65d-491d-b334-56719f52bc1b None None] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:48:27.890946 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 238/475] 10.222.0.25 () {56 vars in 1109 bytes} [Thu Sep 15 17:48:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 17:48:27.896797 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed92704e-6017-4902-a42a-d98e6b8d6af8 None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:48:27.989347 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:48:28.038273 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed92704e-6017-4902-a42a-d98e6b8d6af8 None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:48:28.041935 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ed49c1-c65d-491d-b334-56719f52bc1b None None] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:48:28.087066 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66b4932-522a-4392-9c52-4c2dcbbfe613 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:48:28.087687 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66b4932-522a-4392-9c52-4c2dcbbfe613 None admin] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:48:28.088017 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66b4932-522a-4392-9c52-4c2dcbbfe613 None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:48:28.088294 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66b4932-522a-4392-9c52-4c2dcbbfe613 None admin] PATH_INFO: `/v3/users` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:48:28.090375 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66b4932-522a-4392-9c52-4c2dcbbfe613 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:48:28.090529 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66b4932-522a-4392-9c52-4c2dcbbfe613 None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:48:28.103971 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f8ce2b-6520-490f-ab9b-a7f941ac1540 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:48:28.105635 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f8ce2b-6520-490f-ab9b-a7f941ac1540 None admin] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:48:28.106410 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f8ce2b-6520-490f-ab9b-a7f941ac1540 None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:48:28.107144 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f8ce2b-6520-490f-ab9b-a7f941ac1540 None admin] PATH_INFO: `/v3/users` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:48:28.108242 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f8ce2b-6520-490f-ab9b-a7f941ac1540 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:48:28.110873 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f8ce2b-6520-490f-ab9b-a7f941ac1540 None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:48:28.120487 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 239/476] 10.222.0.25 () {60 vars in 1132 bytes} [Thu Sep 15 17:48:27 2022] POST /identity/v3/users => generated 249 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 17:48:28.150083 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 238/477] 10.222.0.25 () {60 vars in 1132 bytes} [Thu Sep 15 17:48:27 2022] POST /identity/v3/users => generated 248 bytes in 267 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 17:48:28.204353 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66b4932-522a-4392-9c52-4c2dcbbfe613 None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:48:28.355636 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66b4932-522a-4392-9c52-4c2dcbbfe613 None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:48:28.382881 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:48:28.403667 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c4d5d9-1507-4f99-8c03-51dc192a01a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:48:28.404295 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c4d5d9-1507-4f99-8c03-51dc192a01a1 None admin] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:48:28.404571 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c4d5d9-1507-4f99-8c03-51dc192a01a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:48:28.404841 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c4d5d9-1507-4f99-8c03-51dc192a01a1 None admin] PATH_INFO: `/v3/roles` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:48:28.405582 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c4d5d9-1507-4f99-8c03-51dc192a01a1 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:48:28.407007 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c4d5d9-1507-4f99-8c03-51dc192a01a1 None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:48:28.416096 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.sql.core [None req-40c4d5d9-1507-4f99-8c03-51dc192a01a1 None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Sep 15 17:48:28.416096 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Sep 15 17:48:28.416096 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [parameters: {'id': 'fdd7093cd3a149ac8f8d5575053fb4a1', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Sep 15 17:48:28.416096 dv-cinder-835384-27-smb devstack@keystone.service[81592]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81592) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Sep 15 17:48:28.434611 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application [None req-40c4d5d9-1507-4f99-8c03-51dc192a01a1 None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Sep 15 17:48:28.434611 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 17:48:28.434611 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 15 17:48:28.434611 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 15 17:48:28.434611 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 15 17:48:28.434611 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 15 17:48:28.434611 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 15 17:48:28.434611 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application result = self._query(query) Sep 15 17:48:28.434611 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 15 17:48:28.434611 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application conn.query(q) Sep 15 17:48:28.434611 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 15 17:48:28.434611 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 15 17:48:28.434611 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 15 17:48:28.434611 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application result.read() Sep 15 17:48:28.434611 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 15 17:48:28.435601 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 15 17:48:28.435601 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 15 17:48:28.435601 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 15 17:48:28.435601 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 15 17:48:28.435601 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 15 17:48:28.435601 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 15 17:48:28.435601 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 15 17:48:28.435601 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Sep 15 17:48:28.435601 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Sep 15 17:48:28.435601 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Sep 15 17:48:28.435601 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Sep 15 17:48:28.435601 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 17:48:28.435601 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Sep 15 17:48:28.435601 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return method(*args, **kwargs) Sep 15 17:48:28.435601 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Sep 15 17:48:28.435601 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return ref.to_dict() Sep 15 17:48:28.435601 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 15 17:48:28.435601 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application next(self.gen) Sep 15 17:48:28.438556 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Sep 15 17:48:28.438556 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application yield resource Sep 15 17:48:28.438556 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 15 17:48:28.438556 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application next(self.gen) Sep 15 17:48:28.438556 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Sep 15 17:48:28.438556 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application self.session.rollback() Sep 15 17:48:28.438556 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 15 17:48:28.438556 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application self.force_reraise() Sep 15 17:48:28.438556 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 15 17:48:28.438556 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application raise self.value Sep 15 17:48:28.438556 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Sep 15 17:48:28.438556 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Sep 15 17:48:28.438556 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Sep 15 17:48:28.438556 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application session.commit() Sep 15 17:48:28.438556 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Sep 15 17:48:28.438556 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Sep 15 17:48:28.438556 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Sep 15 17:48:28.439875 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application self._prepare_impl() Sep 15 17:48:28.439875 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Sep 15 17:48:28.439875 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application self.session.flush() Sep 15 17:48:28.439875 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Sep 15 17:48:28.439875 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application self._flush(objects) Sep 15 17:48:28.439875 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Sep 15 17:48:28.439875 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Sep 15 17:48:28.439875 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Sep 15 17:48:28.439875 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application compat.raise_( Sep 15 17:48:28.439875 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 15 17:48:28.439875 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application raise exception Sep 15 17:48:28.439875 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Sep 15 17:48:28.439875 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application flush_context.execute() Sep 15 17:48:28.439875 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Sep 15 17:48:28.439875 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application rec.execute(self) Sep 15 17:48:28.439875 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Sep 15 17:48:28.439875 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Sep 15 17:48:28.442029 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Sep 15 17:48:28.442029 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application _emit_insert_statements( Sep 15 17:48:28.442029 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Sep 15 17:48:28.442029 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application c = connection._execute_20( Sep 15 17:48:28.442029 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Sep 15 17:48:28.442029 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Sep 15 17:48:28.442029 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Sep 15 17:48:28.442029 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Sep 15 17:48:28.442029 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Sep 15 17:48:28.442029 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application ret = self._execute_context( Sep 15 17:48:28.442029 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Sep 15 17:48:28.442029 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Sep 15 17:48:28.442029 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Sep 15 17:48:28.442029 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Sep 15 17:48:28.442029 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 15 17:48:28.442029 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application raise exception Sep 15 17:48:28.444455 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 15 17:48:28.444455 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 15 17:48:28.444455 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 15 17:48:28.444455 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 15 17:48:28.444455 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 15 17:48:28.444455 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application result = self._query(query) Sep 15 17:48:28.444455 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 15 17:48:28.444455 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application conn.query(q) Sep 15 17:48:28.444455 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 15 17:48:28.444455 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 15 17:48:28.444455 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 15 17:48:28.444455 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application result.read() Sep 15 17:48:28.444455 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 15 17:48:28.444455 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 15 17:48:28.444455 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 15 17:48:28.444455 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 15 17:48:28.448655 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 15 17:48:28.448655 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 15 17:48:28.448655 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 15 17:48:28.448655 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 15 17:48:28.448655 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Sep 15 17:48:28.448655 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Sep 15 17:48:28.448655 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application [parameters: {'id': 'fdd7093cd3a149ac8f8d5575053fb4a1', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Sep 15 17:48:28.448655 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Sep 15 17:48:28.448655 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Sep 15 17:48:28.448655 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 15 17:48:28.448655 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Sep 15 17:48:28.448655 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 17:48:28.448655 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 17:48:28.448655 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 17:48:28.448655 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 17:48:28.448655 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 17:48:28.451459 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 17:48:28.451459 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 17:48:28.451459 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 17:48:28.451459 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 17:48:28.451459 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 17:48:28.451459 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 17:48:28.451459 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Sep 15 17:48:28.451459 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Sep 15 17:48:28.451459 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 17:48:28.451459 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 17:48:28.451459 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Sep 15 17:48:28.451459 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Sep 15 17:48:28.451459 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Sep 15 17:48:28.451459 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Sep 15 17:48:28.451459 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Sep 15 17:48:28.451459 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Sep 15 17:48:28.454422 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 240/478] 10.222.0.25 () {60 vars in 1131 bytes} [Thu Sep 15 17:48:28 2022] POST /identity/v3/roles => generated 144 bytes in 232 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Sep 15 17:48:28.454630 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f8ce2b-6520-490f-ab9b-a7f941ac1540 None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:48:28.466883 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:48:28.576067 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f8ce2b-6520-490f-ab9b-a7f941ac1540 None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:48:28.614121 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20ea1d1-a75c-42fb-b3b0-e759b12a12cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:48:28.614695 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20ea1d1-a75c-42fb-b3b0-e759b12a12cf None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:48:28.615029 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20ea1d1-a75c-42fb-b3b0-e759b12a12cf None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:48:28.615306 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20ea1d1-a75c-42fb-b3b0-e759b12a12cf None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:48:28.626956 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20ea1d1-a75c-42fb-b3b0-e759b12a12cf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 17:48:28.632989 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application [None req-a20ea1d1-a75c-42fb-b3b0-e759b12a12cf None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 15 17:48:28.632989 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 17:48:28.632989 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 17:48:28.632989 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 17:48:28.632989 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 17:48:28.632989 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 17:48:28.632989 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 17:48:28.632989 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 17:48:28.632989 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 17:48:28.632989 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 17:48:28.632989 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 17:48:28.632989 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 17:48:28.632989 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 17:48:28.632989 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 17:48:28.632989 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 17:48:28.632989 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 17:48:28.633911 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 17:48:28.633911 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 17:48:28.633911 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 17:48:28.633911 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 17:48:28.633911 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 17:48:28.633911 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 17:48:28.633911 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 17:48:28.633911 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 17:48:28.633911 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 17:48:28.633911 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 17:48:28.633911 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 17:48:28.633911 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application with Lock( Sep 15 17:48:28.633911 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 17:48:28.633911 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._enter() Sep 15 17:48:28.633911 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 17:48:28.633911 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 17:48:28.635113 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 17:48:28.635113 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.creator() Sep 15 17:48:28.635113 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 17:48:28.635113 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application created_value = creator( Sep 15 17:48:28.635113 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 17:48:28.635113 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 17:48:28.635113 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 17:48:28.635113 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 17:48:28.635113 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 17:48:28.635113 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 17:48:28.635113 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 15 17:48:28.635113 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Sep 15 17:48:28.635113 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 239/479] 10.222.0.25 () {56 vars in 1114 bytes} [Thu Sep 15 17:48:28 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 17:48:28.640253 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c4d5d9-1507-4f99-8c03-51dc192a01a1 None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:48:28.760777 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c4d5d9-1507-4f99-8c03-51dc192a01a1 None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:48:28.797418 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb1badb-0588-4557-b126-2acdb0a909bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:48:28.798036 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb1badb-0588-4557-b126-2acdb0a909bd None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:48:28.798316 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb1badb-0588-4557-b126-2acdb0a909bd None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:48:28.798586 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb1badb-0588-4557-b126-2acdb0a909bd None admin] PATH_INFO: `/v3/roles` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:48:28.799258 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb1badb-0588-4557-b126-2acdb0a909bd None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81592) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 17:48:28.799559 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb1badb-0588-4557-b126-2acdb0a909bd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:48:28.800989 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb1badb-0588-4557-b126-2acdb0a909bd None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:48:28.810285 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 241/480] 10.222.0.25 () {56 vars in 1111 bytes} [Thu Sep 15 17:48:28 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 17:48:30.031604 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1766d5-c7d2-4479-9ffa-b91337fb6a90 None None] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:48:30.032259 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1766d5-c7d2-4479-9ffa-b91337fb6a90 None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:48:30.032259 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1766d5-c7d2-4479-9ffa-b91337fb6a90 None None] PATH_INFO: `/` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:48:30.033678 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 240/481] 10.222.0.25 () {54 vars in 927 bytes} [Thu Sep 15 17:48:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 17:48:30.039805 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ad8276-2c43-4a06-8c59-bbaf72ef6452 None None] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:48:30.040697 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ad8276-2c43-4a06-8c59-bbaf72ef6452 None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:48:30.041181 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ad8276-2c43-4a06-8c59-bbaf72ef6452 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:48:30.070392 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.auth.core [None req-11ad8276-2c43-4a06-8c59-bbaf72ef6452 None None] MFA Rules not processed for user `5cfa58ef86774ab7800bf91930bf6028`. Rule list: `[]` (Enabled: `True`). {{(pid=81592) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 17:48:30.072213 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-11ad8276-2c43-4a06-8c59-bbaf72ef6452 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 17:48:30.130585 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:48:30.175896 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 242/482] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Sep 15 17:48:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 15 17:48:30.553567 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1766d5-c7d2-4479-9ffa-b91337fb6a90 None None] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:48:30.685707 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:48:30.720325 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1766d5-c7d2-4479-9ffa-b91337fb6a90 None None] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:48:30.762927 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4925b5-ddf6-4cae-9e85-60f6f8008828 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:48:30.763561 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4925b5-ddf6-4cae-9e85-60f6f8008828 None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:48:30.763831 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4925b5-ddf6-4cae-9e85-60f6f8008828 None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:48:30.764100 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4925b5-ddf6-4cae-9e85-60f6f8008828 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:48:30.775908 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b4925b5-ddf6-4cae-9e85-60f6f8008828 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 17:48:30.781186 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application [None req-0b4925b5-ddf6-4cae-9e85-60f6f8008828 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 15 17:48:30.781186 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 17:48:30.781186 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 17:48:30.781186 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 17:48:30.781186 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 17:48:30.781186 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 17:48:30.781186 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 17:48:30.781186 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 17:48:30.781186 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 17:48:30.781186 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 17:48:30.781186 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 17:48:30.781186 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 17:48:30.781186 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 17:48:30.781186 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 17:48:30.781186 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 17:48:30.781186 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 17:48:30.782202 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 17:48:30.782202 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 17:48:30.782202 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 17:48:30.782202 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 17:48:30.782202 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 17:48:30.782202 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 17:48:30.782202 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 17:48:30.782202 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 17:48:30.782202 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 17:48:30.782202 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 17:48:30.782202 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 17:48:30.782202 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application with Lock( Sep 15 17:48:30.782202 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 17:48:30.782202 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._enter() Sep 15 17:48:30.782202 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 17:48:30.782202 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 17:48:30.783452 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 17:48:30.783452 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.creator() Sep 15 17:48:30.783452 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 17:48:30.783452 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application created_value = creator( Sep 15 17:48:30.783452 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 17:48:30.783452 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 17:48:30.783452 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 17:48:30.783452 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 17:48:30.783452 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 17:48:30.783452 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 17:48:30.783452 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 15 17:48:30.783452 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Sep 15 17:48:30.783452 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 241/483] 10.222.0.25 () {56 vars in 1102 bytes} [Thu Sep 15 17:48:30 2022] GET /identity/v3/roles/service => generated 85 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 17:48:30.792531 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ad8276-2c43-4a06-8c59-bbaf72ef6452 None None] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:48:30.951879 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ad8276-2c43-4a06-8c59-bbaf72ef6452 None None] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:48:30.961563 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26423ea-ebd0-40b0-8a39-cdb88d25c6ff None None] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:48:30.961843 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26423ea-ebd0-40b0-8a39-cdb88d25c6ff None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:48:30.962118 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26423ea-ebd0-40b0-8a39-cdb88d25c6ff None None] PATH_INFO: `/` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:48:30.963843 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 242/484] 10.222.0.25 () {54 vars in 927 bytes} [Thu Sep 15 17:48:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 15 17:48:30.969676 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea8c371-e5b4-43a3-b8e9-2ee525c6c674 None None] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:48:30.970104 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea8c371-e5b4-43a3-b8e9-2ee525c6c674 None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:48:30.970485 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea8c371-e5b4-43a3-b8e9-2ee525c6c674 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:48:31.008150 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.auth.core [None req-cea8c371-e5b4-43a3-b8e9-2ee525c6c674 None None] MFA Rules not processed for user `5cfa58ef86774ab7800bf91930bf6028`. Rule list: `[]` (Enabled: `True`). {{(pid=81593) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 17:48:31.010186 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-cea8c371-e5b4-43a3-b8e9-2ee525c6c674 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 17:48:31.015602 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7737f1-9859-4a04-9c85-5f8b87ad0297 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:48:31.016468 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7737f1-9859-4a04-9c85-5f8b87ad0297 None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:48:31.016954 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7737f1-9859-4a04-9c85-5f8b87ad0297 None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:48:31.017393 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7737f1-9859-4a04-9c85-5f8b87ad0297 None admin] PATH_INFO: `/v3/roles` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:48:31.018255 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7737f1-9859-4a04-9c85-5f8b87ad0297 None admin] RBAC: Adding query filter params (name=service) {{(pid=81592) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 17:48:31.019221 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7737f1-9859-4a04-9c85-5f8b87ad0297 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:48:31.020846 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7737f1-9859-4a04-9c85-5f8b87ad0297 None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:48:31.042666 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 243/485] 10.222.0.25 () {56 vars in 1103 bytes} [Thu Sep 15 17:48:30 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 17:48:31.050954 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7737f1-9859-4a04-9c85-5f8b87ad0297 None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:48:31.118792 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:48:31.131366 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 243/486] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Sep 15 17:48:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 15 17:48:31.133324 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a6652c-22ce-458c-9a3f-94cc1fa9b8a1 None None] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:48:31.133801 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a6652c-22ce-458c-9a3f-94cc1fa9b8a1 None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:48:31.134316 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a6652c-22ce-458c-9a3f-94cc1fa9b8a1 None None] PATH_INFO: `/` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:48:31.135842 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 244/487] 10.222.0.25 () {54 vars in 927 bytes} [Thu Sep 15 17:48:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 17:48:31.142337 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c6e7e2-7e81-4a28-9b0d-6535f99f031f None None] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:48:31.142337 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c6e7e2-7e81-4a28-9b0d-6535f99f031f None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:48:31.142337 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c6e7e2-7e81-4a28-9b0d-6535f99f031f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:48:31.165095 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.auth.core [None req-b5c6e7e2-7e81-4a28-9b0d-6535f99f031f None None] MFA Rules not processed for user `5cfa58ef86774ab7800bf91930bf6028`. Rule list: `[]` (Enabled: `True`). {{(pid=81593) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 17:48:31.166805 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-b5c6e7e2-7e81-4a28-9b0d-6535f99f031f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 17:48:31.207218 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7737f1-9859-4a04-9c85-5f8b87ad0297 None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:48:31.247850 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:48:31.251809 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0f6c93-a76e-435a-bfff-e59afbbf0185 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:48:31.252701 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0f6c93-a76e-435a-bfff-e59afbbf0185 None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:48:31.253021 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0f6c93-a76e-435a-bfff-e59afbbf0185 None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:48:31.253440 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0f6c93-a76e-435a-bfff-e59afbbf0185 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:48:31.259455 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 245/488] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Sep 15 17:48:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 15 17:48:31.260898 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cca5716-fec0-4a5b-a823-4d97d0fe09c5 None None] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:48:31.261242 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cca5716-fec0-4a5b-a823-4d97d0fe09c5 None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:48:31.261648 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cca5716-fec0-4a5b-a823-4d97d0fe09c5 None None] PATH_INFO: `/` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:48:31.263270 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 246/489] 10.222.0.25 () {54 vars in 927 bytes} [Thu Sep 15 17:48:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 17:48:31.268453 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0c44a8-8271-43b3-bdcc-03d99a687d78 None None] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:48:31.269421 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0c44a8-8271-43b3-bdcc-03d99a687d78 None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:48:31.269767 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0c44a8-8271-43b3-bdcc-03d99a687d78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:48:31.279499 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec0f6c93-a76e-435a-bfff-e59afbbf0185 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:48:31.280960 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec0f6c93-a76e-435a-bfff-e59afbbf0185 None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:48:31.306195 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.auth.core [None req-7e0c44a8-8271-43b3-bdcc-03d99a687d78 None None] MFA Rules not processed for user `5cfa58ef86774ab7800bf91930bf6028`. Rule list: `[]` (Enabled: `True`). {{(pid=81593) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 17:48:31.307393 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-7e0c44a8-8271-43b3-bdcc-03d99a687d78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 17:48:31.314959 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application [None req-ec0f6c93-a76e-435a-bfff-e59afbbf0185 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 17:48:31.314959 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 17:48:31.314959 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 17:48:31.314959 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 17:48:31.314959 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 17:48:31.314959 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 17:48:31.314959 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 17:48:31.314959 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 17:48:31.314959 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 17:48:31.314959 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 17:48:31.314959 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 17:48:31.314959 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 17:48:31.314959 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 15 17:48:31.314959 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 15 17:48:31.314959 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 15 17:48:31.314959 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 15 17:48:31.316509 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 17:48:31.316509 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 17:48:31.316509 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 17:48:31.316509 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 17:48:31.316509 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 17:48:31.316509 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 17:48:31.316509 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 17:48:31.316509 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application with Lock( Sep 15 17:48:31.316509 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 17:48:31.316509 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._enter() Sep 15 17:48:31.316509 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 17:48:31.316509 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 17:48:31.316509 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 17:48:31.316509 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.creator() Sep 15 17:48:31.316509 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 17:48:31.316509 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application created_value = creator( Sep 15 17:48:31.316509 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 15 17:48:31.317379 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 15 17:48:31.317379 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 17:48:31.317379 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Sep 15 17:48:31.317379 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 244/490] 10.222.0.25 () {56 vars in 1108 bytes} [Thu Sep 15 17:48:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 267 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 15 17:48:31.323378 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0f6c93-a76e-435a-bfff-e59afbbf0185 None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:48:31.422103 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 247/491] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Sep 15 17:48:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 15 17:48:31.466419 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:48:31.482169 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0c44a8-8271-43b3-bdcc-03d99a687d78 None None] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:48:31.486244 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0f6c93-a76e-435a-bfff-e59afbbf0185 None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:48:31.557690 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9447e73e-6b54-4746-8662-8a76b76f2536 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:48:31.562179 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9447e73e-6b54-4746-8662-8a76b76f2536 None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:48:31.562672 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9447e73e-6b54-4746-8662-8a76b76f2536 None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:48:31.563135 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9447e73e-6b54-4746-8662-8a76b76f2536 None admin] PATH_INFO: `/v3/domains` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:48:31.564005 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9447e73e-6b54-4746-8662-8a76b76f2536 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81592) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 17:48:31.564555 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9447e73e-6b54-4746-8662-8a76b76f2536 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:48:31.568637 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9447e73e-6b54-4746-8662-8a76b76f2536 None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:48:31.586560 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 245/492] 10.222.0.25 () {56 vars in 1109 bytes} [Thu Sep 15 17:48:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 17:48:31.587815 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9447e73e-6b54-4746-8662-8a76b76f2536 None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:48:31.655747 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0c44a8-8271-43b3-bdcc-03d99a687d78 None None] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:48:31.688283 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:48:31.701922 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551198e1-393c-4792-ab67-7625adc27e12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:48:31.702948 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551198e1-393c-4792-ab67-7625adc27e12 None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:48:31.703427 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551198e1-393c-4792-ab67-7625adc27e12 None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:48:31.703924 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551198e1-393c-4792-ab67-7625adc27e12 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:48:31.717061 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551198e1-393c-4792-ab67-7625adc27e12 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 17:48:31.717426 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9447e73e-6b54-4746-8662-8a76b76f2536 None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:48:31.724658 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application [None req-551198e1-393c-4792-ab67-7625adc27e12 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 15 17:48:31.724658 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 17:48:31.724658 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 17:48:31.724658 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 17:48:31.724658 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 17:48:31.724658 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 17:48:31.724658 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 17:48:31.724658 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 17:48:31.724658 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 17:48:31.724658 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 17:48:31.724658 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 17:48:31.724658 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 17:48:31.724658 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 17:48:31.724658 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 17:48:31.724658 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 17:48:31.724658 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 17:48:31.725650 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 17:48:31.725650 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 17:48:31.725650 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 17:48:31.725650 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 17:48:31.725650 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 17:48:31.725650 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 17:48:31.725650 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 17:48:31.725650 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 17:48:31.725650 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 17:48:31.725650 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 17:48:31.725650 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 17:48:31.725650 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application with Lock( Sep 15 17:48:31.725650 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 17:48:31.725650 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._enter() Sep 15 17:48:31.725650 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 17:48:31.725650 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 17:48:31.726460 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 17:48:31.726460 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.creator() Sep 15 17:48:31.726460 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 17:48:31.726460 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application created_value = creator( Sep 15 17:48:31.726460 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 17:48:31.726460 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 17:48:31.726460 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 17:48:31.726460 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 17:48:31.726460 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 17:48:31.726460 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 17:48:31.726460 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 15 17:48:31.726460 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Sep 15 17:48:31.729162 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 248/493] 10.222.0.25 () {56 vars in 1102 bytes} [Thu Sep 15 17:48:31 2022] GET /identity/v3/roles/service => generated 85 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 17:48:31.730298 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551198e1-393c-4792-ab67-7625adc27e12 None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:48:31.763849 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63006df7-b7c1-4ef3-b9b2-0d2ac05fd1ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:48:31.764533 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63006df7-b7c1-4ef3-b9b2-0d2ac05fd1ab None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:48:31.765401 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63006df7-b7c1-4ef3-b9b2-0d2ac05fd1ab None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:48:31.765844 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63006df7-b7c1-4ef3-b9b2-0d2ac05fd1ab None admin] PATH_INFO: `/v3/roles/service` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:48:31.782673 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63006df7-b7c1-4ef3-b9b2-0d2ac05fd1ab None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 17:48:31.789834 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application [None req-63006df7-b7c1-4ef3-b9b2-0d2ac05fd1ab None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 15 17:48:31.789834 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 17:48:31.789834 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 17:48:31.789834 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 17:48:31.789834 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 17:48:31.789834 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 17:48:31.789834 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 17:48:31.789834 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 17:48:31.789834 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 17:48:31.789834 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 17:48:31.789834 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 17:48:31.789834 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 17:48:31.789834 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 17:48:31.789834 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 17:48:31.789834 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 17:48:31.789834 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 17:48:31.791103 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 17:48:31.791103 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 17:48:31.791103 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 17:48:31.791103 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 17:48:31.791103 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 17:48:31.791103 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 17:48:31.791103 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 17:48:31.791103 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 17:48:31.791103 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 17:48:31.791103 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 17:48:31.791103 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 17:48:31.791103 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application with Lock( Sep 15 17:48:31.791103 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 17:48:31.791103 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._enter() Sep 15 17:48:31.791103 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 17:48:31.791103 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 17:48:31.792254 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 17:48:31.792254 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.creator() Sep 15 17:48:31.792254 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 17:48:31.792254 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application created_value = creator( Sep 15 17:48:31.792254 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 17:48:31.792254 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 17:48:31.792254 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 17:48:31.792254 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 17:48:31.792254 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 17:48:31.792254 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 17:48:31.792254 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 15 17:48:31.792254 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Sep 15 17:48:31.792254 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 246/494] 10.222.0.25 () {56 vars in 1102 bytes} [Thu Sep 15 17:48:31 2022] GET /identity/v3/roles/service => generated 85 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 17:48:31.792254 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63006df7-b7c1-4ef3-b9b2-0d2ac05fd1ab None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:48:31.805627 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:48:31.863100 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551198e1-393c-4792-ab67-7625adc27e12 None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:48:31.904563 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9bf337-84a5-49f5-a4ed-c9cb7d854019 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:48:31.905315 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9bf337-84a5-49f5-a4ed-c9cb7d854019 None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:48:31.905627 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9bf337-84a5-49f5-a4ed-c9cb7d854019 None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:48:31.905959 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9bf337-84a5-49f5-a4ed-c9cb7d854019 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:48:31.914584 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c9bf337-84a5-49f5-a4ed-c9cb7d854019 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:48:31.916259 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c9bf337-84a5-49f5-a4ed-c9cb7d854019 None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:48:31.931507 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application [None req-3c9bf337-84a5-49f5-a4ed-c9cb7d854019 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 15 17:48:31.931507 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 17:48:31.931507 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 17:48:31.931507 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 17:48:31.931507 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 17:48:31.931507 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 17:48:31.931507 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 17:48:31.931507 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 17:48:31.931507 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 17:48:31.931507 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 17:48:31.931507 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 17:48:31.931507 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 17:48:31.931507 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 15 17:48:31.931507 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 15 17:48:31.931507 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 15 17:48:31.931507 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 15 17:48:31.932421 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 17:48:31.932421 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 17:48:31.932421 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 15 17:48:31.932421 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 15 17:48:31.932421 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 15 17:48:31.932421 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 15 17:48:31.932421 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 17:48:31.932421 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 17:48:31.932421 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 17:48:31.932421 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 17:48:31.932421 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 17:48:31.932421 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application with Lock( Sep 15 17:48:31.932421 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 17:48:31.932421 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._enter() Sep 15 17:48:31.932421 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 17:48:31.932421 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 17:48:31.932421 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 17:48:31.932421 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.creator() Sep 15 17:48:31.938587 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 17:48:31.938587 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application created_value = creator( Sep 15 17:48:31.938587 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 15 17:48:31.938587 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 15 17:48:31.938587 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 15 17:48:31.938587 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 15 17:48:31.938587 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 15 17:48:31.938587 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 15 17:48:31.938587 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 15 17:48:31.938587 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Sep 15 17:48:31.938587 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 249/495] 10.222.0.25 () {56 vars in 1093 bytes} [Thu Sep 15 17:48:31 2022] GET /identity/v3/users/nova => generated 82 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 17:48:31.938587 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9bf337-84a5-49f5-a4ed-c9cb7d854019 None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:48:31.939254 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63006df7-b7c1-4ef3-b9b2-0d2ac05fd1ab None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:48:31.977246 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361b565d-46d6-4245-9b49-7ac900a9bb84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:48:31.977790 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361b565d-46d6-4245-9b49-7ac900a9bb84 None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:48:31.978094 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361b565d-46d6-4245-9b49-7ac900a9bb84 None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:48:31.978371 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361b565d-46d6-4245-9b49-7ac900a9bb84 None admin] PATH_INFO: `/v3/roles` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:48:31.979139 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-361b565d-46d6-4245-9b49-7ac900a9bb84 None admin] RBAC: Adding query filter params (name=service) {{(pid=81592) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 17:48:31.979458 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-361b565d-46d6-4245-9b49-7ac900a9bb84 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:48:31.981142 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-361b565d-46d6-4245-9b49-7ac900a9bb84 None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:48:31.986805 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:48:31.990094 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 247/496] 10.222.0.25 () {56 vars in 1103 bytes} [Thu Sep 15 17:48:31 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 17:48:31.990094 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361b565d-46d6-4245-9b49-7ac900a9bb84 None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:48:32.060533 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9bf337-84a5-49f5-a4ed-c9cb7d854019 None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:48:32.077282 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:48:32.119220 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3909e6d-d5d4-41b8-8bd9-0d76e023e0f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:48:32.120113 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3909e6d-d5d4-41b8-8bd9-0d76e023e0f4 None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:48:32.120449 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3909e6d-d5d4-41b8-8bd9-0d76e023e0f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:48:32.120773 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3909e6d-d5d4-41b8-8bd9-0d76e023e0f4 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:48:32.123572 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361b565d-46d6-4245-9b49-7ac900a9bb84 None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:48:32.140140 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3909e6d-d5d4-41b8-8bd9-0d76e023e0f4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 17:48:32.145555 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application [None req-d3909e6d-d5d4-41b8-8bd9-0d76e023e0f4 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 15 17:48:32.145555 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 17:48:32.145555 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 17:48:32.145555 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 17:48:32.145555 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 17:48:32.145555 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 17:48:32.145555 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 17:48:32.145555 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 17:48:32.145555 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 17:48:32.145555 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 17:48:32.145555 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 17:48:32.145555 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 17:48:32.145555 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 17:48:32.145555 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 17:48:32.145555 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 17:48:32.145555 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 17:48:32.146764 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 17:48:32.146764 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 17:48:32.146764 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 17:48:32.146764 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 17:48:32.146764 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 17:48:32.146764 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 17:48:32.146764 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 17:48:32.146764 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 17:48:32.146764 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 17:48:32.146764 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 17:48:32.146764 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 17:48:32.146764 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application with Lock( Sep 15 17:48:32.146764 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 17:48:32.146764 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._enter() Sep 15 17:48:32.146764 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 17:48:32.146764 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 17:48:32.147696 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 17:48:32.147696 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.creator() Sep 15 17:48:32.147696 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 17:48:32.147696 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application created_value = creator( Sep 15 17:48:32.147696 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 17:48:32.147696 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 17:48:32.147696 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 17:48:32.147696 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 17:48:32.147696 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 17:48:32.147696 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 17:48:32.147696 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 15 17:48:32.147696 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Sep 15 17:48:32.147696 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 250/497] 10.222.0.25 () {56 vars in 1102 bytes} [Thu Sep 15 17:48:31 2022] GET /identity/v3/roles/service => generated 85 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 17:48:32.148490 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3909e6d-d5d4-41b8-8bd9-0d76e023e0f4 None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:48:32.167501 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ff081f-f78c-45f1-9658-63527e26bb38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:48:32.168113 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ff081f-f78c-45f1-9658-63527e26bb38 None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:48:32.168792 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ff081f-f78c-45f1-9658-63527e26bb38 None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:48:32.168792 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ff081f-f78c-45f1-9658-63527e26bb38 None admin] PATH_INFO: `/v3/roles` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:48:32.169332 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ff081f-f78c-45f1-9658-63527e26bb38 None admin] RBAC: Adding query filter params (name=service) {{(pid=81592) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 17:48:32.169638 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ff081f-f78c-45f1-9658-63527e26bb38 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:48:32.171130 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ff081f-f78c-45f1-9658-63527e26bb38 None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:48:32.182600 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 248/498] 10.222.0.25 () {56 vars in 1103 bytes} [Thu Sep 15 17:48:31 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 17:48:32.183868 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fb7cff-bced-4e45-8440-a34ace911faa None None] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:48:32.184154 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fb7cff-bced-4e45-8440-a34ace911faa None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:48:32.184513 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fb7cff-bced-4e45-8440-a34ace911faa None None] PATH_INFO: `/` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:48:32.185741 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 249/499] 10.222.0.25 () {54 vars in 927 bytes} [Thu Sep 15 17:48:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 17:48:32.186464 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01fb7cff-bced-4e45-8440-a34ace911faa None None] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:48:32.256400 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3909e6d-d5d4-41b8-8bd9-0d76e023e0f4 None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:48:32.260849 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:48:32.299560 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f0d0ac-ee8c-4aa0-93c8-c9425cb978ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:48:32.300576 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f0d0ac-ee8c-4aa0-93c8-c9425cb978ce None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:48:32.301017 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f0d0ac-ee8c-4aa0-93c8-c9425cb978ce None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:48:32.301459 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f0d0ac-ee8c-4aa0-93c8-c9425cb978ce None admin] PATH_INFO: `/v3/users` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:48:32.302514 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f0d0ac-ee8c-4aa0-93c8-c9425cb978ce None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81593) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 17:48:32.302954 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f0d0ac-ee8c-4aa0-93c8-c9425cb978ce None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:48:32.304831 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f0d0ac-ee8c-4aa0-93c8-c9425cb978ce None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:48:32.314871 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01fb7cff-bced-4e45-8440-a34ace911faa None None] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:48:32.345964 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 251/500] 10.222.0.25 () {56 vars in 1133 bytes} [Thu Sep 15 17:48:32 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 17:48:32.346970 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f0d0ac-ee8c-4aa0-93c8-c9425cb978ce None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:48:32.358606 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:48:32.364229 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a7662f-6ba9-49fd-827b-5f3e4e0b0a1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:48:32.365023 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a7662f-6ba9-49fd-827b-5f3e4e0b0a1a None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:48:32.365314 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a7662f-6ba9-49fd-827b-5f3e4e0b0a1a None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:48:32.365617 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a7662f-6ba9-49fd-827b-5f3e4e0b0a1a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:48:32.378629 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a7662f-6ba9-49fd-827b-5f3e4e0b0a1a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:48:32.380109 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a7662f-6ba9-49fd-827b-5f3e4e0b0a1a None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:48:32.395241 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application [None req-95a7662f-6ba9-49fd-827b-5f3e4e0b0a1a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 17:48:32.395241 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 17:48:32.395241 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 17:48:32.395241 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 17:48:32.395241 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 17:48:32.395241 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 17:48:32.395241 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 17:48:32.395241 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 17:48:32.395241 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 17:48:32.395241 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 17:48:32.395241 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 17:48:32.395241 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 17:48:32.395241 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 15 17:48:32.395241 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 15 17:48:32.395241 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 15 17:48:32.395241 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 15 17:48:32.397038 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 17:48:32.397038 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 17:48:32.397038 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 17:48:32.397038 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 17:48:32.397038 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 17:48:32.397038 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 17:48:32.397038 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 17:48:32.397038 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application with Lock( Sep 15 17:48:32.397038 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 17:48:32.397038 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._enter() Sep 15 17:48:32.397038 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 17:48:32.397038 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 17:48:32.397038 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 17:48:32.397038 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.creator() Sep 15 17:48:32.397038 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 17:48:32.397038 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application created_value = creator( Sep 15 17:48:32.397038 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 15 17:48:32.399237 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 15 17:48:32.399237 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 17:48:32.399237 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Sep 15 17:48:32.399237 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 250/501] 10.222.0.25 () {56 vars in 1108 bytes} [Thu Sep 15 17:48:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 17:48:32.399661 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a7662f-6ba9-49fd-827b-5f3e4e0b0a1a None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:48:32.490223 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f0d0ac-ee8c-4aa0-93c8-c9425cb978ce None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:48:32.529139 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f4e1c9-d64a-4744-87dc-49b31523f254 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:48:32.529797 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f4e1c9-d64a-4744-87dc-49b31523f254 None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:48:32.530058 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a7662f-6ba9-49fd-827b-5f3e4e0b0a1a None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:48:32.530163 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f4e1c9-d64a-4744-87dc-49b31523f254 None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:48:32.530413 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f4e1c9-d64a-4744-87dc-49b31523f254 None admin] PATH_INFO: `/v3/roles` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:48:32.531208 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f4e1c9-d64a-4744-87dc-49b31523f254 None admin] RBAC: Adding query filter params (name=service) {{(pid=81593) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 17:48:32.531569 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f4e1c9-d64a-4744-87dc-49b31523f254 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:48:32.533143 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f4e1c9-d64a-4744-87dc-49b31523f254 None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:48:32.544082 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 252/502] 10.222.0.25 () {56 vars in 1103 bytes} [Thu Sep 15 17:48:32 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 17:48:32.545468 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f36493-8e1e-4165-a750-18ab02b0a44f None None] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:48:32.545750 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f36493-8e1e-4165-a750-18ab02b0a44f None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:48:32.546025 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f36493-8e1e-4165-a750-18ab02b0a44f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:48:32.566611 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.auth.core [None req-42f36493-8e1e-4165-a750-18ab02b0a44f None None] MFA Rules not processed for user `5cfa58ef86774ab7800bf91930bf6028`. Rule list: `[]` (Enabled: `True`). {{(pid=81593) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 17:48:32.567820 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-42f36493-8e1e-4165-a750-18ab02b0a44f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 17:48:32.572565 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f06e03-bef0-4c52-9dbf-6b7aa838bb73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:48:32.573208 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f06e03-bef0-4c52-9dbf-6b7aa838bb73 None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:48:32.573512 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f06e03-bef0-4c52-9dbf-6b7aa838bb73 None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:48:32.573787 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f06e03-bef0-4c52-9dbf-6b7aa838bb73 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:48:32.584987 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:48:32.585926 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f06e03-bef0-4c52-9dbf-6b7aa838bb73 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:48:32.588429 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f06e03-bef0-4c52-9dbf-6b7aa838bb73 None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:48:32.609044 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application [None req-a8f06e03-bef0-4c52-9dbf-6b7aa838bb73 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 17:48:32.609044 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 17:48:32.609044 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 17:48:32.609044 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 17:48:32.609044 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 17:48:32.609044 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 17:48:32.609044 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 17:48:32.609044 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 17:48:32.609044 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 17:48:32.609044 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 17:48:32.609044 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 17:48:32.609044 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 17:48:32.609044 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 15 17:48:32.609044 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 15 17:48:32.609044 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 15 17:48:32.609044 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 15 17:48:32.610329 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 17:48:32.610329 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 17:48:32.610329 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 17:48:32.610329 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 17:48:32.610329 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 17:48:32.610329 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 17:48:32.610329 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 17:48:32.610329 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application with Lock( Sep 15 17:48:32.610329 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 17:48:32.610329 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._enter() Sep 15 17:48:32.610329 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 17:48:32.610329 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 17:48:32.610329 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 17:48:32.610329 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.creator() Sep 15 17:48:32.610329 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 17:48:32.610329 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application created_value = creator( Sep 15 17:48:32.610329 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 15 17:48:32.611178 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 15 17:48:32.611178 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 17:48:32.611178 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Sep 15 17:48:32.611178 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 251/503] 10.222.0.25 () {56 vars in 1108 bytes} [Thu Sep 15 17:48:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 17:48:32.611587 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f06e03-bef0-4c52-9dbf-6b7aa838bb73 None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:48:32.640251 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 253/504] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Sep 15 17:48:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 15 17:48:32.641344 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f36493-8e1e-4165-a750-18ab02b0a44f None None] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:48:32.660147 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:48:32.735672 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f06e03-bef0-4c52-9dbf-6b7aa838bb73 None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:48:32.752732 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f36493-8e1e-4165-a750-18ab02b0a44f None None] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:48:32.776337 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63a2d91-4915-4ced-9552-37552ff1a5cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:48:32.776949 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63a2d91-4915-4ced-9552-37552ff1a5cf None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:48:32.777273 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63a2d91-4915-4ced-9552-37552ff1a5cf None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:48:32.777630 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63a2d91-4915-4ced-9552-37552ff1a5cf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:48:32.797116 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590e0e1f-6c93-446b-ac5b-107bbdf4eeab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:48:32.798093 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590e0e1f-6c93-446b-ac5b-107bbdf4eeab None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:48:32.798581 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590e0e1f-6c93-446b-ac5b-107bbdf4eeab None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:48:32.799047 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590e0e1f-6c93-446b-ac5b-107bbdf4eeab None admin] PATH_INFO: `/v3/domains` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:48:32.799850 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-590e0e1f-6c93-446b-ac5b-107bbdf4eeab None admin] RBAC: Adding query filter params (name=Default) {{(pid=81593) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 17:48:32.800838 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-590e0e1f-6c93-446b-ac5b-107bbdf4eeab None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:48:32.802400 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-590e0e1f-6c93-446b-ac5b-107bbdf4eeab None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:48:32.820785 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 254/505] 10.222.0.25 () {56 vars in 1109 bytes} [Thu Sep 15 17:48:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 17:48:32.822018 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590e0e1f-6c93-446b-ac5b-107bbdf4eeab None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:48:32.843341 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:48:32.866378 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b63a2d91-4915-4ced-9552-37552ff1a5cf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:48:32.867840 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b63a2d91-4915-4ced-9552-37552ff1a5cf None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:48:32.910465 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:48:32.972449 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590e0e1f-6c93-446b-ac5b-107bbdf4eeab None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:48:32.993055 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 252/506] 10.222.0.25 () {58 vars in 1282 bytes} [Thu Sep 15 17:48:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 382 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 15 17:48:32.993944 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63a2d91-4915-4ced-9552-37552ff1a5cf None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:48:33.007790 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b256b244-0091-4c6a-a824-0321207288fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:48:33.008423 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b256b244-0091-4c6a-a824-0321207288fe None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:48:33.008707 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b256b244-0091-4c6a-a824-0321207288fe None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:48:33.008975 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b256b244-0091-4c6a-a824-0321207288fe None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:48:33.019704 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b256b244-0091-4c6a-a824-0321207288fe None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:48:33.020816 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b256b244-0091-4c6a-a824-0321207288fe None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:48:33.037708 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application [None req-b256b244-0091-4c6a-a824-0321207288fe None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 17:48:33.037708 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 17:48:33.037708 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 17:48:33.037708 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 17:48:33.037708 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 17:48:33.037708 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 17:48:33.037708 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 17:48:33.037708 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 17:48:33.037708 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 17:48:33.037708 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 17:48:33.037708 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 17:48:33.037708 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 17:48:33.037708 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 15 17:48:33.037708 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 15 17:48:33.037708 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 15 17:48:33.037708 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 15 17:48:33.038891 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 17:48:33.038891 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 17:48:33.038891 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 17:48:33.038891 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 17:48:33.038891 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 17:48:33.038891 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 17:48:33.038891 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 17:48:33.038891 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application with Lock( Sep 15 17:48:33.038891 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 17:48:33.038891 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._enter() Sep 15 17:48:33.038891 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 17:48:33.038891 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 17:48:33.038891 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 17:48:33.038891 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.creator() Sep 15 17:48:33.038891 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 17:48:33.038891 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application created_value = creator( Sep 15 17:48:33.038891 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 15 17:48:33.039955 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 15 17:48:33.039955 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 17:48:33.039955 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Sep 15 17:48:33.039955 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 255/507] 10.222.0.25 () {56 vars in 1108 bytes} [Thu Sep 15 17:48:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 17:48:33.039955 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b256b244-0091-4c6a-a824-0321207288fe None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:48:33.113455 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:48:33.118280 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63a2d91-4915-4ced-9552-37552ff1a5cf None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:48:33.152158 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b256b244-0091-4c6a-a824-0321207288fe None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:48:33.165531 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e86b35-034d-4ff1-b5e8-62005cb7caa0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:48:33.166179 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e86b35-034d-4ff1-b5e8-62005cb7caa0 None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:48:33.166429 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e86b35-034d-4ff1-b5e8-62005cb7caa0 None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:48:33.166708 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e86b35-034d-4ff1-b5e8-62005cb7caa0 None admin] PATH_INFO: `/v3/domains` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:48:33.167367 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e86b35-034d-4ff1-b5e8-62005cb7caa0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81592) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 17:48:33.167669 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e86b35-034d-4ff1-b5e8-62005cb7caa0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:48:33.169058 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e86b35-034d-4ff1-b5e8-62005cb7caa0 None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:48:33.171799 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:48:33.182761 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 253/508] 10.222.0.25 () {56 vars in 1109 bytes} [Thu Sep 15 17:48:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 17:48:33.183601 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e86b35-034d-4ff1-b5e8-62005cb7caa0 None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:48:33.189580 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc699183-ed92-426e-baaa-56e12f95fd40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:48:33.190208 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc699183-ed92-426e-baaa-56e12f95fd40 None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:48:33.190500 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc699183-ed92-426e-baaa-56e12f95fd40 None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:48:33.191288 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc699183-ed92-426e-baaa-56e12f95fd40 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:48:33.199795 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc699183-ed92-426e-baaa-56e12f95fd40 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:48:33.201347 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc699183-ed92-426e-baaa-56e12f95fd40 None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:48:33.213830 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application [None req-fc699183-ed92-426e-baaa-56e12f95fd40 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 15 17:48:33.213830 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 17:48:33.213830 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 17:48:33.213830 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 17:48:33.213830 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 17:48:33.213830 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 17:48:33.213830 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 17:48:33.213830 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 17:48:33.213830 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 17:48:33.213830 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 17:48:33.213830 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 17:48:33.213830 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 17:48:33.213830 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 15 17:48:33.213830 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 15 17:48:33.213830 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 15 17:48:33.213830 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 15 17:48:33.214975 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 17:48:33.214975 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 17:48:33.214975 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 15 17:48:33.214975 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 15 17:48:33.214975 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 15 17:48:33.214975 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 15 17:48:33.214975 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 17:48:33.214975 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 17:48:33.214975 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 17:48:33.214975 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 17:48:33.214975 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 17:48:33.214975 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application with Lock( Sep 15 17:48:33.214975 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 17:48:33.214975 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._enter() Sep 15 17:48:33.214975 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 17:48:33.214975 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 17:48:33.214975 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 17:48:33.214975 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.creator() Sep 15 17:48:33.217083 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 17:48:33.217083 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application created_value = creator( Sep 15 17:48:33.217083 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 15 17:48:33.217083 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 15 17:48:33.217083 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 15 17:48:33.217083 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 15 17:48:33.217083 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 15 17:48:33.217083 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 15 17:48:33.217083 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 15 17:48:33.217083 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Sep 15 17:48:33.217083 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 256/509] 10.222.0.25 () {56 vars in 1099 bytes} [Thu Sep 15 17:48:33 2022] GET /identity/v3/users/cinder => generated 84 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 17:48:33.217083 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc699183-ed92-426e-baaa-56e12f95fd40 None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:48:33.300934 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e86b35-034d-4ff1-b5e8-62005cb7caa0 None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:48:33.336455 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc699183-ed92-426e-baaa-56e12f95fd40 None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:48:33.337433 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948c9712-4d15-4ab8-bf44-33df1a972bdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:48:33.338072 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948c9712-4d15-4ab8-bf44-33df1a972bdb None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:48:33.338349 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948c9712-4d15-4ab8-bf44-33df1a972bdb None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:48:33.338621 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948c9712-4d15-4ab8-bf44-33df1a972bdb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:48:33.351885 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948c9712-4d15-4ab8-bf44-33df1a972bdb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:48:33.354210 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948c9712-4d15-4ab8-bf44-33df1a972bdb None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:48:33.365091 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:48:33.372737 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application [None req-948c9712-4d15-4ab8-bf44-33df1a972bdb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 17:48:33.372737 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 17:48:33.372737 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 17:48:33.372737 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 17:48:33.372737 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 17:48:33.372737 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 17:48:33.372737 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 17:48:33.372737 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 17:48:33.372737 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 17:48:33.372737 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 17:48:33.372737 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 17:48:33.372737 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 17:48:33.372737 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 15 17:48:33.372737 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 15 17:48:33.372737 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 15 17:48:33.372737 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 15 17:48:33.374060 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 17:48:33.374060 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 17:48:33.374060 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 17:48:33.374060 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 17:48:33.374060 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 17:48:33.374060 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 17:48:33.374060 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 17:48:33.374060 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application with Lock( Sep 15 17:48:33.374060 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 17:48:33.374060 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._enter() Sep 15 17:48:33.374060 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 17:48:33.374060 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 17:48:33.374060 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 17:48:33.374060 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.creator() Sep 15 17:48:33.374060 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 17:48:33.374060 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application created_value = creator( Sep 15 17:48:33.374060 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 15 17:48:33.376097 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 15 17:48:33.376097 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 17:48:33.376097 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Sep 15 17:48:33.376097 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 254/510] 10.222.0.25 () {56 vars in 1108 bytes} [Thu Sep 15 17:48:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 17:48:33.376097 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948c9712-4d15-4ab8-bf44-33df1a972bdb None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:48:33.376897 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4a8bdf-fc33-4871-9b5c-5384ce5eaf23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:48:33.377830 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4a8bdf-fc33-4871-9b5c-5384ce5eaf23 None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:48:33.378255 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4a8bdf-fc33-4871-9b5c-5384ce5eaf23 None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:48:33.378643 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4a8bdf-fc33-4871-9b5c-5384ce5eaf23 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:48:33.390860 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4a8bdf-fc33-4871-9b5c-5384ce5eaf23 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:48:33.392470 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4a8bdf-fc33-4871-9b5c-5384ce5eaf23 None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:48:33.407752 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application [None req-6b4a8bdf-fc33-4871-9b5c-5384ce5eaf23 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 17:48:33.407752 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 17:48:33.407752 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 17:48:33.407752 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 17:48:33.407752 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 17:48:33.407752 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 17:48:33.407752 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 17:48:33.407752 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 17:48:33.407752 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 17:48:33.407752 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 17:48:33.407752 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 17:48:33.407752 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 17:48:33.407752 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 15 17:48:33.407752 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 15 17:48:33.407752 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 15 17:48:33.407752 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 15 17:48:33.408698 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 17:48:33.408698 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 17:48:33.408698 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 17:48:33.408698 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 17:48:33.408698 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 17:48:33.408698 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 17:48:33.408698 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 17:48:33.408698 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application with Lock( Sep 15 17:48:33.408698 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 17:48:33.408698 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._enter() Sep 15 17:48:33.408698 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 17:48:33.408698 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 17:48:33.408698 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 17:48:33.408698 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.creator() Sep 15 17:48:33.408698 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 17:48:33.408698 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application created_value = creator( Sep 15 17:48:33.408698 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 15 17:48:33.410234 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 15 17:48:33.410234 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 17:48:33.410234 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Sep 15 17:48:33.410234 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 257/511] 10.222.0.25 () {56 vars in 1108 bytes} [Thu Sep 15 17:48:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 17:48:33.410507 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4a8bdf-fc33-4871-9b5c-5384ce5eaf23 None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:48:33.440684 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:48:33.506044 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948c9712-4d15-4ab8-bf44-33df1a972bdb None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:48:33.522172 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4a8bdf-fc33-4871-9b5c-5384ce5eaf23 None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:48:33.541898 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645a6864-8bd1-4598-b2db-41ff21a34156 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:48:33.542572 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645a6864-8bd1-4598-b2db-41ff21a34156 None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:48:33.542892 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645a6864-8bd1-4598-b2db-41ff21a34156 None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:48:33.543204 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645a6864-8bd1-4598-b2db-41ff21a34156 None admin] PATH_INFO: `/v3/domains` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:48:33.543929 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-645a6864-8bd1-4598-b2db-41ff21a34156 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81592) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 17:48:33.544261 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-645a6864-8bd1-4598-b2db-41ff21a34156 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:48:33.545853 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-645a6864-8bd1-4598-b2db-41ff21a34156 None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:48:33.559395 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 255/512] 10.222.0.25 () {56 vars in 1109 bytes} [Thu Sep 15 17:48:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 17:48:33.560285 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645a6864-8bd1-4598-b2db-41ff21a34156 None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:48:33.563929 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c426fb5-0cd2-4304-99b2-b5f9d546c564 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:48:33.564677 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c426fb5-0cd2-4304-99b2-b5f9d546c564 None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:48:33.565154 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c426fb5-0cd2-4304-99b2-b5f9d546c564 None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:48:33.566087 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c426fb5-0cd2-4304-99b2-b5f9d546c564 None admin] PATH_INFO: `/v3/users/glance` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:48:33.574607 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c426fb5-0cd2-4304-99b2-b5f9d546c564 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:48:33.576143 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c426fb5-0cd2-4304-99b2-b5f9d546c564 None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:48:33.589940 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application [None req-2c426fb5-0cd2-4304-99b2-b5f9d546c564 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Sep 15 17:48:33.589940 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 17:48:33.589940 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 17:48:33.589940 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 17:48:33.589940 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 17:48:33.589940 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 17:48:33.589940 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 17:48:33.589940 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 17:48:33.589940 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 17:48:33.589940 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 17:48:33.589940 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 17:48:33.589940 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 17:48:33.589940 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 15 17:48:33.589940 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 15 17:48:33.589940 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 15 17:48:33.589940 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 15 17:48:33.591089 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 17:48:33.591089 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 17:48:33.591089 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 15 17:48:33.591089 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 15 17:48:33.591089 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 15 17:48:33.591089 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 15 17:48:33.591089 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 17:48:33.591089 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 17:48:33.591089 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 17:48:33.591089 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 17:48:33.591089 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 17:48:33.591089 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application with Lock( Sep 15 17:48:33.591089 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 17:48:33.591089 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._enter() Sep 15 17:48:33.591089 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 17:48:33.591089 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 17:48:33.591089 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 17:48:33.591089 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.creator() Sep 15 17:48:33.597175 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 17:48:33.597175 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application created_value = creator( Sep 15 17:48:33.597175 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 15 17:48:33.597175 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 15 17:48:33.597175 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 15 17:48:33.597175 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 15 17:48:33.597175 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 15 17:48:33.597175 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 15 17:48:33.597175 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Sep 15 17:48:33.597175 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Sep 15 17:48:33.597175 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 258/513] 10.222.0.25 () {56 vars in 1099 bytes} [Thu Sep 15 17:48:33 2022] GET /identity/v3/users/glance => generated 84 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 17:48:33.597175 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c426fb5-0cd2-4304-99b2-b5f9d546c564 None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:48:33.635929 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:48:33.671175 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645a6864-8bd1-4598-b2db-41ff21a34156 None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:48:33.681232 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:48:33.709086 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c426fb5-0cd2-4304-99b2-b5f9d546c564 None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:48:33.718856 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938d4985-8479-49a3-b44a-2056dd71d8d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:48:33.719636 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938d4985-8479-49a3-b44a-2056dd71d8d5 None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:48:33.720017 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938d4985-8479-49a3-b44a-2056dd71d8d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:48:33.720378 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938d4985-8479-49a3-b44a-2056dd71d8d5 None admin] PATH_INFO: `/v3/users` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:48:33.721507 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938d4985-8479-49a3-b44a-2056dd71d8d5 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81592) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 17:48:33.721991 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938d4985-8479-49a3-b44a-2056dd71d8d5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:48:33.724472 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938d4985-8479-49a3-b44a-2056dd71d8d5 None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:48:33.748093 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba760d1-286c-4938-8ae6-54bfc449fc4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:48:33.748812 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba760d1-286c-4938-8ae6-54bfc449fc4f None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:48:33.749091 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba760d1-286c-4938-8ae6-54bfc449fc4f None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:48:33.749392 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba760d1-286c-4938-8ae6-54bfc449fc4f None admin] PATH_INFO: `/v3/domains` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:48:33.750040 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba760d1-286c-4938-8ae6-54bfc449fc4f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81593) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 17:48:33.750343 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba760d1-286c-4938-8ae6-54bfc449fc4f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:48:33.751717 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba760d1-286c-4938-8ae6-54bfc449fc4f None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:48:33.769735 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 259/514] 10.222.0.25 () {56 vars in 1109 bytes} [Thu Sep 15 17:48:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 17:48:33.769735 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba760d1-286c-4938-8ae6-54bfc449fc4f None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:48:33.776624 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 256/515] 10.222.0.25 () {56 vars in 1137 bytes} [Thu Sep 15 17:48:33 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 17:48:33.777572 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938d4985-8479-49a3-b44a-2056dd71d8d5 None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:48:33.891773 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:48:33.896467 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba760d1-286c-4938-8ae6-54bfc449fc4f None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:48:33.899588 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938d4985-8479-49a3-b44a-2056dd71d8d5 None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:48:33.936324 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d14a828-6752-4bf0-bd97-b17d527c2d0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:48:33.937097 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d14a828-6752-4bf0-bd97-b17d527c2d0a None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:48:33.937578 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d14a828-6752-4bf0-bd97-b17d527c2d0a None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:48:33.937742 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24479159-514a-4e68-a6d5-559a1d7351fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:48:33.938014 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d14a828-6752-4bf0-bd97-b17d527c2d0a None admin] PATH_INFO: `/v3/domains` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:48:33.938207 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24479159-514a-4e68-a6d5-559a1d7351fc None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:48:33.938489 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24479159-514a-4e68-a6d5-559a1d7351fc None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:48:33.938755 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24479159-514a-4e68-a6d5-559a1d7351fc None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:48:33.939032 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d14a828-6752-4bf0-bd97-b17d527c2d0a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81593) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 17:48:33.939495 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d14a828-6752-4bf0-bd97-b17d527c2d0a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:48:33.941644 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d14a828-6752-4bf0-bd97-b17d527c2d0a None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:48:33.946931 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24479159-514a-4e68-a6d5-559a1d7351fc None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:48:33.948396 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24479159-514a-4e68-a6d5-559a1d7351fc None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:48:33.954971 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 260/516] 10.222.0.25 () {56 vars in 1109 bytes} [Thu Sep 15 17:48:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 17:48:33.955979 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d14a828-6752-4bf0-bd97-b17d527c2d0a None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:48:33.962565 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application [None req-24479159-514a-4e68-a6d5-559a1d7351fc None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Sep 15 17:48:33.962565 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 17:48:33.962565 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 17:48:33.962565 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 17:48:33.962565 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 17:48:33.962565 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 17:48:33.962565 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 17:48:33.962565 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 17:48:33.962565 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 17:48:33.962565 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 17:48:33.962565 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 17:48:33.962565 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 17:48:33.962565 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 15 17:48:33.962565 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 15 17:48:33.962565 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 15 17:48:33.962565 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 15 17:48:33.963496 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 17:48:33.963496 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 17:48:33.963496 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 15 17:48:33.963496 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 15 17:48:33.963496 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 15 17:48:33.963496 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 15 17:48:33.963496 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 17:48:33.963496 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 17:48:33.963496 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 17:48:33.963496 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 17:48:33.963496 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 17:48:33.963496 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application with Lock( Sep 15 17:48:33.963496 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 17:48:33.963496 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._enter() Sep 15 17:48:33.963496 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 17:48:33.963496 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 17:48:33.963496 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 17:48:33.963496 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.creator() Sep 15 17:48:33.964398 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 17:48:33.964398 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application created_value = creator( Sep 15 17:48:33.964398 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 15 17:48:33.964398 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 15 17:48:33.964398 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 15 17:48:33.964398 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 15 17:48:33.964398 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 15 17:48:33.964398 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 15 17:48:33.964398 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Sep 15 17:48:33.964398 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Sep 15 17:48:33.964398 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 257/517] 10.222.0.25 () {56 vars in 1102 bytes} [Thu Sep 15 17:48:33 2022] GET /identity/v3/users/neutron => generated 85 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 17:48:33.964964 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24479159-514a-4e68-a6d5-559a1d7351fc None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:48:33.996421 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:48:34.080939 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d14a828-6752-4bf0-bd97-b17d527c2d0a None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:48:34.089148 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24479159-514a-4e68-a6d5-559a1d7351fc None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:48:34.115214 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927c6676-b50a-4c1d-a9cc-c657fd677413 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:48:34.115832 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927c6676-b50a-4c1d-a9cc-c657fd677413 None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:48:34.116114 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927c6676-b50a-4c1d-a9cc-c657fd677413 None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:48:34.116397 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927c6676-b50a-4c1d-a9cc-c657fd677413 None admin] PATH_INFO: `/v3/users` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:48:34.117128 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-927c6676-b50a-4c1d-a9cc-c657fd677413 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81593) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 17:48:34.117470 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-927c6676-b50a-4c1d-a9cc-c657fd677413 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:48:34.118968 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-927c6676-b50a-4c1d-a9cc-c657fd677413 None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:48:34.138975 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 261/518] 10.222.0.25 () {56 vars in 1137 bytes} [Thu Sep 15 17:48:33 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 17:48:34.139824 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927c6676-b50a-4c1d-a9cc-c657fd677413 None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:48:34.139957 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c334c6e-610e-4c68-9e3b-a512d306d569 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:48:34.140554 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c334c6e-610e-4c68-9e3b-a512d306d569 None admin] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:48:34.140836 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c334c6e-610e-4c68-9e3b-a512d306d569 None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:48:34.141107 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c334c6e-610e-4c68-9e3b-a512d306d569 None admin] PATH_INFO: `/v3/users` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:48:34.141844 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c334c6e-610e-4c68-9e3b-a512d306d569 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:48:34.143230 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c334c6e-610e-4c68-9e3b-a512d306d569 None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:48:34.161412 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:48:34.185329 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 258/519] 10.222.0.25 () {60 vars in 1132 bytes} [Thu Sep 15 17:48:33 2022] POST /identity/v3/users => generated 247 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 17:48:34.185329 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c334c6e-610e-4c68-9e3b-a512d306d569 None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:48:34.264736 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927c6676-b50a-4c1d-a9cc-c657fd677413 None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:48:34.280795 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:48:34.308240 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c334c6e-610e-4c68-9e3b-a512d306d569 None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:48:34.310017 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56a9f80-76c9-4e6a-a420-a358bdb93176 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:48:34.310651 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56a9f80-76c9-4e6a-a420-a358bdb93176 None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:48:34.310930 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56a9f80-76c9-4e6a-a420-a358bdb93176 None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:48:34.311202 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56a9f80-76c9-4e6a-a420-a358bdb93176 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:48:34.359663 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30e35b3-880f-4188-bf23-76f9642325b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:48:34.360305 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30e35b3-880f-4188-bf23-76f9642325b5 None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:48:34.360584 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30e35b3-880f-4188-bf23-76f9642325b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:48:34.360863 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30e35b3-880f-4188-bf23-76f9642325b5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:48:34.369738 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d30e35b3-880f-4188-bf23-76f9642325b5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:48:34.372760 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d30e35b3-880f-4188-bf23-76f9642325b5 None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:48:34.388473 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application [None req-d30e35b3-880f-4188-bf23-76f9642325b5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 15 17:48:34.388473 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 17:48:34.388473 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 17:48:34.388473 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 17:48:34.388473 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 17:48:34.388473 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 17:48:34.388473 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 17:48:34.388473 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 17:48:34.388473 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 17:48:34.388473 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 17:48:34.388473 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 17:48:34.388473 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 17:48:34.388473 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 15 17:48:34.388473 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 15 17:48:34.388473 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 15 17:48:34.389901 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 15 17:48:34.389901 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 17:48:34.389901 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 17:48:34.389901 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 17:48:34.389901 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 17:48:34.389901 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 17:48:34.389901 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 17:48:34.389901 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 17:48:34.389901 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application with Lock( Sep 15 17:48:34.389901 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 17:48:34.389901 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._enter() Sep 15 17:48:34.389901 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 17:48:34.389901 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 17:48:34.389901 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 17:48:34.389901 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.creator() Sep 15 17:48:34.389901 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 17:48:34.389901 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application created_value = creator( Sep 15 17:48:34.391201 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 15 17:48:34.391201 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 15 17:48:34.391201 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 15 17:48:34.391201 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 15 17:48:34.391201 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 15 17:48:34.391201 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 15 17:48:34.391201 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 15 17:48:34.391201 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Sep 15 17:48:34.391201 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 259/520] 10.222.0.25 () {56 vars in 1111 bytes} [Thu Sep 15 17:48:34 2022] GET /identity/v3/projects/service => generated 88 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 17:48:34.391201 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30e35b3-880f-4188-bf23-76f9642325b5 None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:48:34.407723 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b56a9f80-76c9-4e6a-a420-a358bdb93176 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:48:34.409108 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b56a9f80-76c9-4e6a-a420-a358bdb93176 None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:48:34.430943 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:48:34.521769 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30e35b3-880f-4188-bf23-76f9642325b5 None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:48:34.540151 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 262/521] 10.222.0.25 () {58 vars in 1282 bytes} [Thu Sep 15 17:48:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 396 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 15 17:48:34.540151 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56a9f80-76c9-4e6a-a420-a358bdb93176 None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:48:34.572297 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2fbb6f0-9dc1-4efd-bc35-ef5d30e4477b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:48:34.572914 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fbb6f0-9dc1-4efd-bc35-ef5d30e4477b None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:48:34.573192 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fbb6f0-9dc1-4efd-bc35-ef5d30e4477b None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:48:34.573492 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fbb6f0-9dc1-4efd-bc35-ef5d30e4477b None admin] PATH_INFO: `/v3/users` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:48:34.574233 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2fbb6f0-9dc1-4efd-bc35-ef5d30e4477b None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81592) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 17:48:34.574531 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2fbb6f0-9dc1-4efd-bc35-ef5d30e4477b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:48:34.575967 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2fbb6f0-9dc1-4efd-bc35-ef5d30e4477b None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:48:34.595453 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:48:34.604639 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 260/522] 10.222.0.25 () {56 vars in 1139 bytes} [Thu Sep 15 17:48:34 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 17:48:34.606195 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2fbb6f0-9dc1-4efd-bc35-ef5d30e4477b None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:48:34.663228 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56a9f80-76c9-4e6a-a420-a358bdb93176 None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:48:34.686446 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:48:34.707979 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfaf3e0f-8b3c-4011-9ec2-a0a062827516 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:48:34.708834 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfaf3e0f-8b3c-4011-9ec2-a0a062827516 None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:48:34.709266 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfaf3e0f-8b3c-4011-9ec2-a0a062827516 None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:48:34.709562 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfaf3e0f-8b3c-4011-9ec2-a0a062827516 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:48:34.729346 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2fbb6f0-9dc1-4efd-bc35-ef5d30e4477b None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:48:34.774042 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f9fc36-6b0c-491c-9eb0-d6d1cbaa7a10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:48:34.774677 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f9fc36-6b0c-491c-9eb0-d6d1cbaa7a10 None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:48:34.774947 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f9fc36-6b0c-491c-9eb0-d6d1cbaa7a10 None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:48:34.775252 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f9fc36-6b0c-491c-9eb0-d6d1cbaa7a10 None admin] PATH_INFO: `/v3/projects` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:48:34.775964 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f9fc36-6b0c-491c-9eb0-d6d1cbaa7a10 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81592) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 17:48:34.777795 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f9fc36-6b0c-491c-9eb0-d6d1cbaa7a10 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:48:34.777795 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f9fc36-6b0c-491c-9eb0-d6d1cbaa7a10 None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:48:34.796491 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 261/523] 10.222.0.25 () {56 vars in 1148 bytes} [Thu Sep 15 17:48:34 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 17:48:34.797210 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f9fc36-6b0c-491c-9eb0-d6d1cbaa7a10 None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:48:34.823553 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfaf3e0f-8b3c-4011-9ec2-a0a062827516 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:48:34.825305 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfaf3e0f-8b3c-4011-9ec2-a0a062827516 None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:48:34.880475 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:48:34.945545 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f9fc36-6b0c-491c-9eb0-d6d1cbaa7a10 None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:48:34.955708 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 263/524] 10.222.0.25 () {58 vars in 1282 bytes} [Thu Sep 15 17:48:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 419 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 15 17:48:34.956785 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfaf3e0f-8b3c-4011-9ec2-a0a062827516 None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:48:34.979096 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:48:34.995755 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3cbf4f0-d570-4505-8e00-cc9f14d01369 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:48:34.996393 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cbf4f0-d570-4505-8e00-cc9f14d01369 None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:48:34.996674 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cbf4f0-d570-4505-8e00-cc9f14d01369 None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:48:34.996957 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cbf4f0-d570-4505-8e00-cc9f14d01369 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:48:35.009568 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3cbf4f0-d570-4505-8e00-cc9f14d01369 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:48:35.011063 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3cbf4f0-d570-4505-8e00-cc9f14d01369 None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:48:35.027694 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application [None req-c3cbf4f0-d570-4505-8e00-cc9f14d01369 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 17:48:35.027694 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 17:48:35.027694 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 17:48:35.027694 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 17:48:35.027694 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 17:48:35.027694 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 17:48:35.027694 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 17:48:35.027694 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 17:48:35.027694 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 17:48:35.027694 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 17:48:35.027694 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 17:48:35.027694 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 17:48:35.027694 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 15 17:48:35.027694 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 15 17:48:35.027694 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 15 17:48:35.027694 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 15 17:48:35.029028 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 17:48:35.029028 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 17:48:35.029028 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 17:48:35.029028 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 17:48:35.029028 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 17:48:35.029028 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 17:48:35.029028 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 17:48:35.029028 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application with Lock( Sep 15 17:48:35.029028 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 17:48:35.029028 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._enter() Sep 15 17:48:35.029028 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 17:48:35.029028 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 17:48:35.029028 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 17:48:35.029028 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.creator() Sep 15 17:48:35.029028 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 17:48:35.029028 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application created_value = creator( Sep 15 17:48:35.029028 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 15 17:48:35.029915 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 15 17:48:35.029915 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 17:48:35.029915 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Sep 15 17:48:35.029915 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 262/525] 10.222.0.25 () {56 vars in 1108 bytes} [Thu Sep 15 17:48:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 17:48:35.029915 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3cbf4f0-d570-4505-8e00-cc9f14d01369 None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:48:35.101259 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfaf3e0f-8b3c-4011-9ec2-a0a062827516 None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:48:35.175330 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51fe726-e859-44b6-87e1-7240b193f2e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:48:35.176393 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51fe726-e859-44b6-87e1-7240b193f2e1 None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:48:35.177111 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51fe726-e859-44b6-87e1-7240b193f2e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:48:35.177433 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51fe726-e859-44b6-87e1-7240b193f2e1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:48:35.183714 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3cbf4f0-d570-4505-8e00-cc9f14d01369 None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:48:35.201641 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:48:35.229927 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c7b025-1de4-4780-a53e-58dbb2fb6144 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:48:35.231100 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c7b025-1de4-4780-a53e-58dbb2fb6144 None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:48:35.231606 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c7b025-1de4-4780-a53e-58dbb2fb6144 None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:48:35.232042 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c7b025-1de4-4780-a53e-58dbb2fb6144 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:48:35.233127 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c7b025-1de4-4780-a53e-58dbb2fb6144 None admin] RBAC: Adding query filter params (role.id=17e337d9acf148e99d6c50170293fa05, scope.project.id=1213c0d1b584404ba3998e136f166e89, user.id=fe2244818e4d4dca9c424cd078653e6a) {{(pid=81592) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 17:48:35.233658 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c7b025-1de4-4780-a53e-58dbb2fb6144 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:48:35.235401 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c7b025-1de4-4780-a53e-58dbb2fb6144 None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:48:35.257323 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 263/526] 10.222.0.25 () {56 vars in 1374 bytes} [Thu Sep 15 17:48:35 2022] GET /identity/v3/role_assignments?user.id=fe2244818e4d4dca9c424cd078653e6a&scope.project.id=1213c0d1b584404ba3998e136f166e89&role.id=17e337d9acf148e99d6c50170293fa05 => generated 259 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 17:48:35.257323 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c7b025-1de4-4780-a53e-58dbb2fb6144 None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:48:35.310554 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d51fe726-e859-44b6-87e1-7240b193f2e1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:48:35.314022 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d51fe726-e859-44b6-87e1-7240b193f2e1 None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:48:35.343526 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:48:35.440621 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c7b025-1de4-4780-a53e-58dbb2fb6144 None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:48:35.461657 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 264/527] 10.222.0.25 () {58 vars in 1282 bytes} [Thu Sep 15 17:48:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 505 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 15 17:48:35.462850 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51fe726-e859-44b6-87e1-7240b193f2e1 None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:48:35.498042 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410eeeee-7d93-45f1-919b-db265d22bd08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:48:35.498628 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410eeeee-7d93-45f1-919b-db265d22bd08 None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:48:35.498911 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410eeeee-7d93-45f1-919b-db265d22bd08 None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:48:35.499188 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410eeeee-7d93-45f1-919b-db265d22bd08 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:48:35.512818 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410eeeee-7d93-45f1-919b-db265d22bd08 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:48:35.514377 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410eeeee-7d93-45f1-919b-db265d22bd08 None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:48:35.533202 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application [None req-410eeeee-7d93-45f1-919b-db265d22bd08 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 17:48:35.533202 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 17:48:35.533202 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 17:48:35.533202 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 17:48:35.533202 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 17:48:35.533202 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 17:48:35.533202 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 17:48:35.533202 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 17:48:35.533202 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 17:48:35.533202 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 17:48:35.533202 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 17:48:35.533202 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 17:48:35.533202 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 15 17:48:35.533202 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 15 17:48:35.533202 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 15 17:48:35.533202 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 15 17:48:35.534305 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 17:48:35.534305 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 17:48:35.534305 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 17:48:35.534305 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 17:48:35.534305 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 17:48:35.534305 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 17:48:35.534305 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 17:48:35.534305 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application with Lock( Sep 15 17:48:35.534305 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 17:48:35.534305 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._enter() Sep 15 17:48:35.534305 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 17:48:35.534305 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 17:48:35.534305 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 17:48:35.534305 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.creator() Sep 15 17:48:35.534305 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 17:48:35.534305 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application created_value = creator( Sep 15 17:48:35.534305 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 15 17:48:35.535172 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 15 17:48:35.535172 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 17:48:35.535172 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Sep 15 17:48:35.540067 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 264/528] 10.222.0.25 () {56 vars in 1108 bytes} [Thu Sep 15 17:48:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 284 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 17:48:35.541443 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410eeeee-7d93-45f1-919b-db265d22bd08 None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:48:35.586352 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:48:35.597047 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51fe726-e859-44b6-87e1-7240b193f2e1 None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:48:35.618724 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:48:35.648950 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245b0982-e564-483d-af12-6816c2329ffc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:48:35.649941 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245b0982-e564-483d-af12-6816c2329ffc None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:48:35.650399 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245b0982-e564-483d-af12-6816c2329ffc None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:48:35.650814 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245b0982-e564-483d-af12-6816c2329ffc None admin] PATH_INFO: `/v3/domains` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:48:35.651801 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245b0982-e564-483d-af12-6816c2329ffc None admin] RBAC: Adding query filter params (name=Default) {{(pid=81593) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 17:48:35.652251 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245b0982-e564-483d-af12-6816c2329ffc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:48:35.654522 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245b0982-e564-483d-af12-6816c2329ffc None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:48:35.671962 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 265/529] 10.222.0.25 () {56 vars in 1109 bytes} [Thu Sep 15 17:48:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 17:48:35.672828 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245b0982-e564-483d-af12-6816c2329ffc None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:48:35.702763 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410eeeee-7d93-45f1-919b-db265d22bd08 None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:48:35.747702 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764b235b-2531-40c4-9dd4-735da26cd6d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:48:35.748482 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764b235b-2531-40c4-9dd4-735da26cd6d6 None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:48:35.748852 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764b235b-2531-40c4-9dd4-735da26cd6d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:48:35.749173 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764b235b-2531-40c4-9dd4-735da26cd6d6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:48:35.762056 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-764b235b-2531-40c4-9dd4-735da26cd6d6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:48:35.764630 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-764b235b-2531-40c4-9dd4-735da26cd6d6 None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:48:35.788599 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application [None req-764b235b-2531-40c4-9dd4-735da26cd6d6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 17:48:35.788599 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 17:48:35.788599 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 17:48:35.788599 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 17:48:35.788599 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 17:48:35.788599 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 17:48:35.788599 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 17:48:35.788599 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 17:48:35.788599 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 17:48:35.788599 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 17:48:35.788599 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 17:48:35.788599 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 17:48:35.788599 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 15 17:48:35.788599 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 15 17:48:35.788599 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 15 17:48:35.788599 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 15 17:48:35.790579 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 17:48:35.790579 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 17:48:35.790579 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 17:48:35.790579 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 17:48:35.790579 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 17:48:35.790579 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 17:48:35.790579 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 17:48:35.790579 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application with Lock( Sep 15 17:48:35.790579 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 17:48:35.790579 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._enter() Sep 15 17:48:35.790579 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 17:48:35.790579 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 17:48:35.790579 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 17:48:35.790579 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.creator() Sep 15 17:48:35.790579 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 17:48:35.790579 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application created_value = creator( Sep 15 17:48:35.790579 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 15 17:48:35.791708 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 15 17:48:35.791708 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 17:48:35.791708 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Sep 15 17:48:35.791708 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 265/530] 10.222.0.25 () {56 vars in 1108 bytes} [Thu Sep 15 17:48:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 17:48:35.791708 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764b235b-2531-40c4-9dd4-735da26cd6d6 None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:48:35.797550 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245b0982-e564-483d-af12-6816c2329ffc None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:48:35.858663 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00653a83-19b5-425d-9d19-f016fc3bb7c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:48:35.859480 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00653a83-19b5-425d-9d19-f016fc3bb7c4 None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:48:35.859654 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00653a83-19b5-425d-9d19-f016fc3bb7c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:48:35.859895 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00653a83-19b5-425d-9d19-f016fc3bb7c4 None admin] PATH_INFO: `/v3/domains` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:48:35.860574 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00653a83-19b5-425d-9d19-f016fc3bb7c4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81593) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 17:48:35.860884 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00653a83-19b5-425d-9d19-f016fc3bb7c4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:48:35.863204 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00653a83-19b5-425d-9d19-f016fc3bb7c4 None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:48:35.881832 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 266/531] 10.222.0.25 () {56 vars in 1109 bytes} [Thu Sep 15 17:48:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 17:48:35.883695 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00653a83-19b5-425d-9d19-f016fc3bb7c4 None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:48:35.912647 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:48:35.945277 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764b235b-2531-40c4-9dd4-735da26cd6d6 None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:48:35.957901 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:48:35.990516 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9cf5b4-bd12-4c3f-9e30-77c18f6d4678 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:48:35.991874 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9cf5b4-bd12-4c3f-9e30-77c18f6d4678 None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:48:35.992614 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9cf5b4-bd12-4c3f-9e30-77c18f6d4678 None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:48:35.993318 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9cf5b4-bd12-4c3f-9e30-77c18f6d4678 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:48:36.002768 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f9cf5b4-bd12-4c3f-9e30-77c18f6d4678 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:48:36.005380 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f9cf5b4-bd12-4c3f-9e30-77c18f6d4678 None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:48:36.025849 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application [None req-8f9cf5b4-bd12-4c3f-9e30-77c18f6d4678 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 15 17:48:36.025849 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 17:48:36.025849 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 17:48:36.025849 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 17:48:36.025849 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 17:48:36.025849 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 17:48:36.025849 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 17:48:36.025849 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 17:48:36.025849 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 17:48:36.025849 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 17:48:36.025849 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 17:48:36.025849 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 17:48:36.025849 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 15 17:48:36.025849 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 15 17:48:36.025849 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 15 17:48:36.026760 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 15 17:48:36.026760 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 17:48:36.026760 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 17:48:36.026760 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 17:48:36.026760 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 17:48:36.026760 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 17:48:36.026760 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 17:48:36.026760 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 17:48:36.026760 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application with Lock( Sep 15 17:48:36.026760 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 17:48:36.026760 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._enter() Sep 15 17:48:36.026760 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 17:48:36.026760 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 17:48:36.026760 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 17:48:36.026760 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.creator() Sep 15 17:48:36.026760 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 17:48:36.026760 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application created_value = creator( Sep 15 17:48:36.027632 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 15 17:48:36.027632 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 15 17:48:36.027632 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 15 17:48:36.027632 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 15 17:48:36.027632 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 15 17:48:36.027632 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 15 17:48:36.027632 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 15 17:48:36.027632 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Sep 15 17:48:36.027632 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 266/532] 10.222.0.25 () {56 vars in 1111 bytes} [Thu Sep 15 17:48:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 17:48:36.028590 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9cf5b4-bd12-4c3f-9e30-77c18f6d4678 None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:48:36.043426 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00653a83-19b5-425d-9d19-f016fc3bb7c4 None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:48:36.084816 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465fb805-61ee-4100-bd88-e6b412904f2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:48:36.085833 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465fb805-61ee-4100-bd88-e6b412904f2a None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:48:36.086295 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465fb805-61ee-4100-bd88-e6b412904f2a None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:48:36.086743 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465fb805-61ee-4100-bd88-e6b412904f2a None admin] PATH_INFO: `/v3/domains` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:48:36.087594 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-465fb805-61ee-4100-bd88-e6b412904f2a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81593) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 17:48:36.088079 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-465fb805-61ee-4100-bd88-e6b412904f2a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:48:36.090036 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-465fb805-61ee-4100-bd88-e6b412904f2a None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:48:36.104441 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 267/533] 10.222.0.25 () {56 vars in 1109 bytes} [Thu Sep 15 17:48:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 17:48:36.105650 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465fb805-61ee-4100-bd88-e6b412904f2a None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:48:36.193100 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9cf5b4-bd12-4c3f-9e30-77c18f6d4678 None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:48:36.213676 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:48:36.224382 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465fb805-61ee-4100-bd88-e6b412904f2a None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:48:36.241646 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a9a181-a8c3-43ec-8a8c-960567252af3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:48:36.242227 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a9a181-a8c3-43ec-8a8c-960567252af3 None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:48:36.242788 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a9a181-a8c3-43ec-8a8c-960567252af3 None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:48:36.243299 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a9a181-a8c3-43ec-8a8c-960567252af3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:48:36.255776 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a9a181-a8c3-43ec-8a8c-960567252af3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:48:36.258733 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a9a181-a8c3-43ec-8a8c-960567252af3 None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:48:36.263690 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:48:36.268426 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955fa257-0af6-43cb-bea1-57b08b8b26c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:48:36.269878 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955fa257-0af6-43cb-bea1-57b08b8b26c2 None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:48:36.270337 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955fa257-0af6-43cb-bea1-57b08b8b26c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:48:36.270804 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955fa257-0af6-43cb-bea1-57b08b8b26c2 None admin] PATH_INFO: `/v3/projects` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:48:36.271692 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-955fa257-0af6-43cb-bea1-57b08b8b26c2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81593) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 17:48:36.272351 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-955fa257-0af6-43cb-bea1-57b08b8b26c2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:48:36.274187 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-955fa257-0af6-43cb-bea1-57b08b8b26c2 None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:48:36.280927 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application [None req-e5a9a181-a8c3-43ec-8a8c-960567252af3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 15 17:48:36.280927 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 17:48:36.280927 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 17:48:36.280927 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 17:48:36.280927 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 17:48:36.280927 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 17:48:36.280927 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 17:48:36.280927 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 17:48:36.280927 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 17:48:36.280927 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 17:48:36.280927 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 17:48:36.280927 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 17:48:36.280927 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 15 17:48:36.280927 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 15 17:48:36.280927 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 15 17:48:36.281948 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 15 17:48:36.281948 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 17:48:36.281948 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 17:48:36.281948 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 17:48:36.281948 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 17:48:36.281948 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 17:48:36.281948 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 17:48:36.281948 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 17:48:36.281948 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application with Lock( Sep 15 17:48:36.281948 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 17:48:36.281948 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._enter() Sep 15 17:48:36.281948 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 17:48:36.281948 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 17:48:36.281948 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 17:48:36.281948 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.creator() Sep 15 17:48:36.281948 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 17:48:36.281948 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application created_value = creator( Sep 15 17:48:36.282782 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 15 17:48:36.282782 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 15 17:48:36.282782 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 15 17:48:36.282782 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 15 17:48:36.282782 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 15 17:48:36.282782 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 15 17:48:36.282782 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 15 17:48:36.282782 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Sep 15 17:48:36.282782 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 267/534] 10.222.0.25 () {56 vars in 1111 bytes} [Thu Sep 15 17:48:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 17:48:36.283604 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a9a181-a8c3-43ec-8a8c-960567252af3 None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:48:36.296871 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 268/535] 10.222.0.25 () {56 vars in 1148 bytes} [Thu Sep 15 17:48:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 17:48:36.298108 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955fa257-0af6-43cb-bea1-57b08b8b26c2 None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:48:36.404668 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a9a181-a8c3-43ec-8a8c-960567252af3 None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:48:36.425415 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955fa257-0af6-43cb-bea1-57b08b8b26c2 None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:48:36.443975 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06bac2c1-6456-401d-82bd-f806e2d447b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:48:36.444606 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bac2c1-6456-401d-82bd-f806e2d447b9 None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:48:36.444884 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bac2c1-6456-401d-82bd-f806e2d447b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:48:36.445193 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bac2c1-6456-401d-82bd-f806e2d447b9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:48:36.453557 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06bac2c1-6456-401d-82bd-f806e2d447b9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:48:36.455864 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06bac2c1-6456-401d-82bd-f806e2d447b9 None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:48:36.466793 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d03846-135d-4d1c-99cf-a358265a7235 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:48:36.467725 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d03846-135d-4d1c-99cf-a358265a7235 None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:48:36.468204 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d03846-135d-4d1c-99cf-a358265a7235 None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:48:36.468696 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d03846-135d-4d1c-99cf-a358265a7235 None admin] PATH_INFO: `/v3/projects` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:48:36.469643 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d03846-135d-4d1c-99cf-a358265a7235 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81593) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 17:48:36.470150 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d03846-135d-4d1c-99cf-a358265a7235 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:48:36.471890 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d03846-135d-4d1c-99cf-a358265a7235 None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:48:36.476561 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application [None req-06bac2c1-6456-401d-82bd-f806e2d447b9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 15 17:48:36.476561 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 17:48:36.476561 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 17:48:36.476561 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 17:48:36.476561 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 17:48:36.476561 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 17:48:36.476561 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 17:48:36.476561 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 17:48:36.476561 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 17:48:36.476561 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 17:48:36.476561 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 17:48:36.476561 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 17:48:36.476561 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 15 17:48:36.476561 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 15 17:48:36.476561 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 15 17:48:36.477541 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 15 17:48:36.477541 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 17:48:36.477541 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 17:48:36.477541 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 17:48:36.477541 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 17:48:36.477541 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 17:48:36.477541 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 17:48:36.477541 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 17:48:36.477541 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application with Lock( Sep 15 17:48:36.477541 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 17:48:36.477541 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._enter() Sep 15 17:48:36.477541 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 17:48:36.477541 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 17:48:36.477541 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 17:48:36.477541 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.creator() Sep 15 17:48:36.477541 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 17:48:36.477541 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application created_value = creator( Sep 15 17:48:36.478372 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 15 17:48:36.478372 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 15 17:48:36.478372 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 15 17:48:36.478372 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 15 17:48:36.478372 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 15 17:48:36.478372 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 15 17:48:36.478372 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 15 17:48:36.478372 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Sep 15 17:48:36.482942 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 268/536] 10.222.0.25 () {56 vars in 1111 bytes} [Thu Sep 15 17:48:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 17:48:36.484484 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06bac2c1-6456-401d-82bd-f806e2d447b9 None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:48:36.492224 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 269/537] 10.222.0.25 () {56 vars in 1148 bytes} [Thu Sep 15 17:48:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 17:48:36.494291 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d03846-135d-4d1c-99cf-a358265a7235 None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:48:36.523663 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:48:36.564664 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:48:36.615700 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06bac2c1-6456-401d-82bd-f806e2d447b9 None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:48:36.638303 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d03846-135d-4d1c-99cf-a358265a7235 None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:48:36.656886 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e66bb36-90a3-429d-ab58-a463f16f7c35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:48:36.657960 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e66bb36-90a3-429d-ab58-a463f16f7c35 None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:48:36.658435 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e66bb36-90a3-429d-ab58-a463f16f7c35 None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:48:36.658899 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e66bb36-90a3-429d-ab58-a463f16f7c35 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:48:36.659851 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e66bb36-90a3-429d-ab58-a463f16f7c35 None admin] RBAC: Adding query filter params (role.id=17e337d9acf148e99d6c50170293fa05, scope.project.id=1213c0d1b584404ba3998e136f166e89, user.id=1b232e7a841145ba93c6d8462ccb751a) {{(pid=81592) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 17:48:36.660383 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e66bb36-90a3-429d-ab58-a463f16f7c35 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:48:36.662552 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e66bb36-90a3-429d-ab58-a463f16f7c35 None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:48:36.670442 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 269/538] 10.222.0.25 () {56 vars in 1374 bytes} [Thu Sep 15 17:48:36 2022] GET /identity/v3/role_assignments?user.id=1b232e7a841145ba93c6d8462ccb751a&scope.project.id=1213c0d1b584404ba3998e136f166e89&role.id=17e337d9acf148e99d6c50170293fa05 => generated 259 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 17:48:36.671638 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e66bb36-90a3-429d-ab58-a463f16f7c35 None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:48:36.685259 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299b4339-faca-4a14-97b4-450207e9bbee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:48:36.685986 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299b4339-faca-4a14-97b4-450207e9bbee None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:48:36.686263 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299b4339-faca-4a14-97b4-450207e9bbee None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:48:36.686528 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299b4339-faca-4a14-97b4-450207e9bbee None admin] PATH_INFO: `/v3/projects` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:48:36.687252 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-299b4339-faca-4a14-97b4-450207e9bbee None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81593) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 17:48:36.687555 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-299b4339-faca-4a14-97b4-450207e9bbee None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:48:36.689148 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-299b4339-faca-4a14-97b4-450207e9bbee None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:48:36.726023 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 270/539] 10.222.0.25 () {56 vars in 1148 bytes} [Thu Sep 15 17:48:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 17:48:36.738824 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299b4339-faca-4a14-97b4-450207e9bbee None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:48:36.885744 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:48:36.893089 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e66bb36-90a3-429d-ab58-a463f16f7c35 None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:48:36.920758 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299b4339-faca-4a14-97b4-450207e9bbee None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:48:36.928160 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:48:36.944217 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023a0313-9b5e-4161-ba59-8ea5b097db40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:48:36.945808 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023a0313-9b5e-4161-ba59-8ea5b097db40 None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:48:36.946330 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023a0313-9b5e-4161-ba59-8ea5b097db40 None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:48:36.947005 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023a0313-9b5e-4161-ba59-8ea5b097db40 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:48:36.947922 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-023a0313-9b5e-4161-ba59-8ea5b097db40 None admin] RBAC: Adding query filter params (role.id=17e337d9acf148e99d6c50170293fa05, scope.project.id=1213c0d1b584404ba3998e136f166e89, user.id=c194f79928aa4a4d94619c417b4e39e9) {{(pid=81592) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 17:48:36.948497 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-023a0313-9b5e-4161-ba59-8ea5b097db40 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:48:36.950191 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-023a0313-9b5e-4161-ba59-8ea5b097db40 None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:48:36.965335 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 270/540] 10.222.0.25 () {56 vars in 1374 bytes} [Thu Sep 15 17:48:36 2022] GET /identity/v3/role_assignments?user.id=c194f79928aa4a4d94619c417b4e39e9&scope.project.id=1213c0d1b584404ba3998e136f166e89&role.id=17e337d9acf148e99d6c50170293fa05 => generated 259 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 17:48:36.965335 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b0021a-7f1f-4a08-98d1-d0d7cf88f137 None None] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:48:36.965335 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b0021a-7f1f-4a08-98d1-d0d7cf88f137 None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:48:36.965335 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b0021a-7f1f-4a08-98d1-d0d7cf88f137 None None] PATH_INFO: `/` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:48:36.968635 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 271/541] 10.222.0.25 () {54 vars in 927 bytes} [Thu Sep 15 17:48:36 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 17:48:36.976465 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a494e73a-f667-4e02-a33c-0da6c31c89e8 None None] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:48:36.976772 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a494e73a-f667-4e02-a33c-0da6c31c89e8 None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:48:36.976971 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a494e73a-f667-4e02-a33c-0da6c31c89e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:48:36.987185 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2726c8-357b-42ca-b244-eb4c226b20ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:48:36.988305 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2726c8-357b-42ca-b244-eb4c226b20ed None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:48:36.988584 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2726c8-357b-42ca-b244-eb4c226b20ed None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:48:36.988854 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2726c8-357b-42ca-b244-eb4c226b20ed None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:48:36.989633 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2726c8-357b-42ca-b244-eb4c226b20ed None admin] RBAC: Adding query filter params (role.id=17e337d9acf148e99d6c50170293fa05, scope.project.id=1213c0d1b584404ba3998e136f166e89, user.id=a32274b4781b40fea9f28da8a9bde5ca) {{(pid=81593) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 17:48:36.989944 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2726c8-357b-42ca-b244-eb4c226b20ed None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:48:36.992164 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2726c8-357b-42ca-b244-eb4c226b20ed None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:48:37.007403 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 271/542] 10.222.0.25 () {56 vars in 1374 bytes} [Thu Sep 15 17:48:36 2022] GET /identity/v3/role_assignments?user.id=a32274b4781b40fea9f28da8a9bde5ca&scope.project.id=1213c0d1b584404ba3998e136f166e89&role.id=17e337d9acf148e99d6c50170293fa05 => generated 259 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 17:48:37.009771 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.auth.core [None req-a494e73a-f667-4e02-a33c-0da6c31c89e8 None None] MFA Rules not processed for user `5cfa58ef86774ab7800bf91930bf6028`. Rule list: `[]` (Enabled: `True`). {{(pid=81592) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 17:48:37.011005 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-a494e73a-f667-4e02-a33c-0da6c31c89e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 17:48:37.142282 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 272/543] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Sep 15 17:48:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 15 17:48:37.571851 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2726c8-357b-42ca-b244-eb4c226b20ed None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:48:37.710971 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9be13b-cc77-4b7b-b84c-b897864e2621 None None] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:48:37.711710 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9be13b-cc77-4b7b-b84c-b897864e2621 None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:48:37.711710 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9be13b-cc77-4b7b-b84c-b897864e2621 None None] PATH_INFO: `/` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:48:37.714145 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2726c8-357b-42ca-b244-eb4c226b20ed None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:48:37.714566 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 273/544] 10.222.0.25 () {54 vars in 927 bytes} [Thu Sep 15 17:48:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 17:48:37.718987 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b49821-eea8-44f9-bbbf-ae328dcb2535 None None] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:48:37.719338 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b49821-eea8-44f9-bbbf-ae328dcb2535 None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:48:37.719566 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b49821-eea8-44f9-bbbf-ae328dcb2535 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:48:37.739554 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.auth.core [None req-84b49821-eea8-44f9-bbbf-ae328dcb2535 None None] MFA Rules not processed for user `5cfa58ef86774ab7800bf91930bf6028`. Rule list: `[]` (Enabled: `True`). {{(pid=81592) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 17:48:37.740767 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-84b49821-eea8-44f9-bbbf-ae328dcb2535 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 17:48:37.783382 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b90d8c-1df0-49d6-a301-015df2e4b78a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:48:37.784031 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b90d8c-1df0-49d6-a301-015df2e4b78a None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:48:37.784402 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b90d8c-1df0-49d6-a301-015df2e4b78a None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:48:37.784672 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b90d8c-1df0-49d6-a301-015df2e4b78a None admin] PATH_INFO: `/v3/roles/service` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:48:37.809013 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b90d8c-1df0-49d6-a301-015df2e4b78a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 17:48:37.815159 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application [None req-93b90d8c-1df0-49d6-a301-015df2e4b78a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 15 17:48:37.815159 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 17:48:37.815159 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 17:48:37.815159 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 17:48:37.815159 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 17:48:37.815159 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 17:48:37.815159 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 17:48:37.815159 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 17:48:37.815159 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 17:48:37.815159 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 17:48:37.815159 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 17:48:37.815159 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 17:48:37.815159 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 17:48:37.815159 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 17:48:37.815159 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 17:48:37.815159 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 17:48:37.816994 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 17:48:37.816994 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 17:48:37.816994 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 17:48:37.816994 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 17:48:37.816994 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 17:48:37.816994 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 17:48:37.816994 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 17:48:37.816994 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 17:48:37.816994 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 17:48:37.816994 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 17:48:37.816994 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 17:48:37.816994 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application with Lock( Sep 15 17:48:37.816994 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 17:48:37.816994 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._enter() Sep 15 17:48:37.816994 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 17:48:37.816994 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 17:48:37.817866 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 17:48:37.817866 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.creator() Sep 15 17:48:37.817866 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 17:48:37.817866 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application created_value = creator( Sep 15 17:48:37.817866 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 17:48:37.817866 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 17:48:37.817866 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 17:48:37.817866 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 17:48:37.817866 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 17:48:37.817866 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 17:48:37.817866 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 15 17:48:37.817866 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Sep 15 17:48:37.817866 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 272/545] 10.222.0.25 () {56 vars in 1102 bytes} [Thu Sep 15 17:48:37 2022] GET /identity/v3/roles/service => generated 85 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 17:48:37.817866 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:48:37.826928 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b90d8c-1df0-49d6-a301-015df2e4b78a None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:48:37.864052 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 274/546] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Sep 15 17:48:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 15 17:48:38.010683 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b90d8c-1df0-49d6-a301-015df2e4b78a None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:48:38.058927 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50720dd-807b-4d85-8014-70271948eae5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:48:38.059548 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50720dd-807b-4d85-8014-70271948eae5 None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:48:38.059831 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50720dd-807b-4d85-8014-70271948eae5 None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:48:38.060105 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50720dd-807b-4d85-8014-70271948eae5 None admin] PATH_INFO: `/v3/roles` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:48:38.060782 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50720dd-807b-4d85-8014-70271948eae5 None admin] RBAC: Adding query filter params (name=service) {{(pid=81593) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 17:48:38.061093 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50720dd-807b-4d85-8014-70271948eae5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:48:38.062547 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50720dd-807b-4d85-8014-70271948eae5 None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:48:38.073718 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 273/547] 10.222.0.25 () {56 vars in 1103 bytes} [Thu Sep 15 17:48:37 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 17:48:38.079714 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b49821-eea8-44f9-bbbf-ae328dcb2535 None None] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:48:38.179659 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50720dd-807b-4d85-8014-70271948eae5 None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:48:38.180109 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:48:38.278570 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b49821-eea8-44f9-bbbf-ae328dcb2535 None None] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:48:38.296688 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:48:38.317470 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530344ef-3d3f-44f5-889b-e27ab8311ef6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:48:38.318108 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530344ef-3d3f-44f5-889b-e27ab8311ef6 None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:48:38.318384 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530344ef-3d3f-44f5-889b-e27ab8311ef6 None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:48:38.318650 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530344ef-3d3f-44f5-889b-e27ab8311ef6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:48:38.329948 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-530344ef-3d3f-44f5-889b-e27ab8311ef6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:48:38.331886 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-530344ef-3d3f-44f5-889b-e27ab8311ef6 None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:48:38.348553 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application [None req-530344ef-3d3f-44f5-889b-e27ab8311ef6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 17:48:38.348553 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 17:48:38.348553 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 17:48:38.348553 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 17:48:38.348553 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 17:48:38.348553 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 17:48:38.348553 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 17:48:38.348553 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 17:48:38.348553 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 17:48:38.348553 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 17:48:38.348553 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 17:48:38.348553 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 17:48:38.348553 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 15 17:48:38.348553 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 15 17:48:38.348553 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 15 17:48:38.348553 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 15 17:48:38.350568 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 17:48:38.350568 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 17:48:38.350568 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 17:48:38.350568 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 17:48:38.350568 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 17:48:38.350568 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 17:48:38.350568 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 17:48:38.350568 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application with Lock( Sep 15 17:48:38.350568 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 17:48:38.350568 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._enter() Sep 15 17:48:38.350568 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 17:48:38.350568 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 17:48:38.350568 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 17:48:38.350568 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.creator() Sep 15 17:48:38.350568 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 17:48:38.350568 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application created_value = creator( Sep 15 17:48:38.350568 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 15 17:48:38.352411 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 15 17:48:38.352411 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 17:48:38.352411 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Sep 15 17:48:38.352411 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 275/548] 10.222.0.25 () {56 vars in 1108 bytes} [Thu Sep 15 17:48:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 271 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 17:48:38.356353 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530344ef-3d3f-44f5-889b-e27ab8311ef6 None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:48:38.376408 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50720dd-807b-4d85-8014-70271948eae5 None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:48:38.450017 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34eb01dc-a02a-4641-b798-906e338f3ab2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:48:38.450659 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34eb01dc-a02a-4641-b798-906e338f3ab2 None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:48:38.450931 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34eb01dc-a02a-4641-b798-906e338f3ab2 None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:48:38.451451 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34eb01dc-a02a-4641-b798-906e338f3ab2 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:48:38.472349 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34eb01dc-a02a-4641-b798-906e338f3ab2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 17:48:38.483319 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application [None req-34eb01dc-a02a-4641-b798-906e338f3ab2 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 15 17:48:38.483319 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 17:48:38.483319 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 17:48:38.483319 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 17:48:38.483319 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 17:48:38.483319 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 17:48:38.483319 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 17:48:38.483319 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 17:48:38.483319 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 17:48:38.483319 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 17:48:38.483319 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 17:48:38.483319 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 17:48:38.483319 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 17:48:38.483319 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 17:48:38.483319 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 17:48:38.483319 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 17:48:38.484876 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 17:48:38.484876 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 17:48:38.484876 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 17:48:38.484876 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 17:48:38.484876 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 17:48:38.484876 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 17:48:38.484876 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 17:48:38.484876 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 17:48:38.484876 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 17:48:38.484876 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 17:48:38.484876 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 17:48:38.484876 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application with Lock( Sep 15 17:48:38.484876 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 17:48:38.484876 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._enter() Sep 15 17:48:38.484876 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 17:48:38.484876 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 17:48:38.485876 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 17:48:38.485876 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.creator() Sep 15 17:48:38.485876 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 17:48:38.485876 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application created_value = creator( Sep 15 17:48:38.485876 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 17:48:38.485876 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 17:48:38.485876 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 17:48:38.485876 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 17:48:38.485876 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 17:48:38.485876 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 17:48:38.485876 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 15 17:48:38.485876 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Sep 15 17:48:38.485876 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 274/549] 10.222.0.25 () {56 vars in 1102 bytes} [Thu Sep 15 17:48:38 2022] GET /identity/v3/roles/service => generated 85 bytes in 305 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 15 17:48:38.494644 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34eb01dc-a02a-4641-b798-906e338f3ab2 None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:48:38.569494 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:48:38.573282 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530344ef-3d3f-44f5-889b-e27ab8311ef6 None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:48:38.620243 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87161a0-8f40-4e2b-aea1-2c196357c7e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:48:38.620778 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87161a0-8f40-4e2b-aea1-2c196357c7e9 None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:48:38.621053 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87161a0-8f40-4e2b-aea1-2c196357c7e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:48:38.621338 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87161a0-8f40-4e2b-aea1-2c196357c7e9 None admin] PATH_INFO: `/v3/domains` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:48:38.621999 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87161a0-8f40-4e2b-aea1-2c196357c7e9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81592) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 17:48:38.622298 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87161a0-8f40-4e2b-aea1-2c196357c7e9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:48:38.623666 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87161a0-8f40-4e2b-aea1-2c196357c7e9 None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:48:38.647563 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 276/550] 10.222.0.25 () {56 vars in 1109 bytes} [Thu Sep 15 17:48:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 17:48:38.652880 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87161a0-8f40-4e2b-aea1-2c196357c7e9 None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:48:38.713744 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34eb01dc-a02a-4641-b798-906e338f3ab2 None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:48:38.761414 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:48:38.786050 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3856dc-dca9-4dcd-a9e4-00018a9b2883 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:48:38.786664 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3856dc-dca9-4dcd-a9e4-00018a9b2883 None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:48:38.786941 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3856dc-dca9-4dcd-a9e4-00018a9b2883 None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:48:38.787212 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3856dc-dca9-4dcd-a9e4-00018a9b2883 None admin] PATH_INFO: `/v3/roles` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:48:38.787889 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3856dc-dca9-4dcd-a9e4-00018a9b2883 None admin] RBAC: Adding query filter params (name=service) {{(pid=81593) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 17:48:38.788193 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3856dc-dca9-4dcd-a9e4-00018a9b2883 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:48:38.789608 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3856dc-dca9-4dcd-a9e4-00018a9b2883 None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:48:38.810090 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 275/551] 10.222.0.25 () {56 vars in 1103 bytes} [Thu Sep 15 17:48:38 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 316 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 17:48:38.816636 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3856dc-dca9-4dcd-a9e4-00018a9b2883 None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:48:38.877018 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87161a0-8f40-4e2b-aea1-2c196357c7e9 None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:48:38.936211 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3856dc-dca9-4dcd-a9e4-00018a9b2883 None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:48:38.977577 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4266e21-6e70-44bb-8fed-900a50d0e8f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:48:38.978226 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4266e21-6e70-44bb-8fed-900a50d0e8f8 None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:48:38.978544 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4266e21-6e70-44bb-8fed-900a50d0e8f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:48:38.978764 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4266e21-6e70-44bb-8fed-900a50d0e8f8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:48:38.990063 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd67e01-bbac-47cc-9d82-c7ec7ea7cc60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:48:38.990728 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd67e01-bbac-47cc-9d82-c7ec7ea7cc60 None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:48:38.990837 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4266e21-6e70-44bb-8fed-900a50d0e8f8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:48:38.991007 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd67e01-bbac-47cc-9d82-c7ec7ea7cc60 None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:48:38.991285 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd67e01-bbac-47cc-9d82-c7ec7ea7cc60 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:48:38.992338 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4266e21-6e70-44bb-8fed-900a50d0e8f8 None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:48:39.008313 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application [None req-d4266e21-6e70-44bb-8fed-900a50d0e8f8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 17:48:39.008313 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 17:48:39.008313 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 17:48:39.008313 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 17:48:39.008313 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 17:48:39.008313 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 17:48:39.008313 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 17:48:39.008313 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 17:48:39.008313 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 17:48:39.008313 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 17:48:39.008313 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 17:48:39.008313 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 17:48:39.008313 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 15 17:48:39.008313 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 15 17:48:39.008313 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 15 17:48:39.008313 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 15 17:48:39.009421 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 17:48:39.009421 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 17:48:39.009421 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 17:48:39.009421 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 17:48:39.009421 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 17:48:39.009421 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 17:48:39.009421 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 17:48:39.009421 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application with Lock( Sep 15 17:48:39.009421 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 17:48:39.009421 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._enter() Sep 15 17:48:39.009421 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 17:48:39.009421 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 17:48:39.009421 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 17:48:39.009421 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.creator() Sep 15 17:48:39.009421 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 17:48:39.009421 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application created_value = creator( Sep 15 17:48:39.009421 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 15 17:48:39.010868 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 15 17:48:39.010868 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 17:48:39.010868 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Sep 15 17:48:39.010868 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 276/552] 10.222.0.25 () {56 vars in 1108 bytes} [Thu Sep 15 17:48:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 17:48:39.011131 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd67e01-bbac-47cc-9d82-c7ec7ea7cc60 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:48:39.011964 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd67e01-bbac-47cc-9d82-c7ec7ea7cc60 None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:48:39.015297 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4266e21-6e70-44bb-8fed-900a50d0e8f8 None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:48:39.039701 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application [None req-cfd67e01-bbac-47cc-9d82-c7ec7ea7cc60 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 15 17:48:39.039701 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 17:48:39.039701 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 17:48:39.039701 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 17:48:39.039701 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 17:48:39.039701 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 17:48:39.039701 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 17:48:39.039701 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 17:48:39.039701 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 17:48:39.039701 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 17:48:39.039701 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 17:48:39.039701 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 17:48:39.039701 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 15 17:48:39.039701 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 15 17:48:39.039701 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 15 17:48:39.039701 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 15 17:48:39.041320 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 17:48:39.041320 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 17:48:39.041320 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 15 17:48:39.041320 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 15 17:48:39.041320 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 15 17:48:39.041320 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 15 17:48:39.041320 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 17:48:39.041320 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 17:48:39.041320 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 17:48:39.041320 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 17:48:39.041320 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 17:48:39.041320 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application with Lock( Sep 15 17:48:39.041320 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 17:48:39.041320 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._enter() Sep 15 17:48:39.041320 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 17:48:39.041320 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 17:48:39.041320 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 17:48:39.041320 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.creator() Sep 15 17:48:39.043045 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 17:48:39.043045 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application created_value = creator( Sep 15 17:48:39.043045 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 15 17:48:39.043045 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 15 17:48:39.043045 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 15 17:48:39.043045 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 15 17:48:39.043045 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 15 17:48:39.043045 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 15 17:48:39.043045 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 15 17:48:39.043045 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Sep 15 17:48:39.050809 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 277/553] 10.222.0.25 () {56 vars in 1096 bytes} [Thu Sep 15 17:48:38 2022] GET /identity/v3/users/swift => generated 83 bytes in 398 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 15 17:48:39.056710 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd67e01-bbac-47cc-9d82-c7ec7ea7cc60 None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:48:39.057980 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:48:39.122709 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4266e21-6e70-44bb-8fed-900a50d0e8f8 None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:48:39.129528 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:48:39.165724 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae605234-4fe6-4650-98b7-d26702c628ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:48:39.166346 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae605234-4fe6-4650-98b7-d26702c628ae None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:48:39.166627 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae605234-4fe6-4650-98b7-d26702c628ae None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:48:39.166900 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae605234-4fe6-4650-98b7-d26702c628ae None admin] PATH_INFO: `/v3/domains` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:48:39.167664 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae605234-4fe6-4650-98b7-d26702c628ae None admin] RBAC: Adding query filter params (name=Default) {{(pid=81593) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 17:48:39.167970 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae605234-4fe6-4650-98b7-d26702c628ae None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:48:39.169410 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae605234-4fe6-4650-98b7-d26702c628ae None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:48:39.183313 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 277/554] 10.222.0.25 () {56 vars in 1109 bytes} [Thu Sep 15 17:48:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 17:48:39.188678 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae605234-4fe6-4650-98b7-d26702c628ae None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:48:39.314387 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:48:39.324446 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae605234-4fe6-4650-98b7-d26702c628ae None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:48:39.341403 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd67e01-bbac-47cc-9d82-c7ec7ea7cc60 None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:48:39.373663 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d70865-e7b1-4dd9-9858-f231ec953b5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:48:39.374307 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d70865-e7b1-4dd9-9858-f231ec953b5e None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:48:39.374581 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d70865-e7b1-4dd9-9858-f231ec953b5e None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:48:39.374852 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d70865-e7b1-4dd9-9858-f231ec953b5e None admin] PATH_INFO: `/v3/users/nova` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:48:39.397094 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d70865-e7b1-4dd9-9858-f231ec953b5e None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:48:39.398566 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d70865-e7b1-4dd9-9858-f231ec953b5e None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:48:39.424359 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application [None req-46d70865-e7b1-4dd9-9858-f231ec953b5e None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 15 17:48:39.424359 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 17:48:39.424359 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 17:48:39.424359 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 17:48:39.424359 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 17:48:39.424359 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 17:48:39.424359 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 17:48:39.424359 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 17:48:39.424359 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 17:48:39.424359 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 17:48:39.424359 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 17:48:39.424359 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 17:48:39.424359 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 15 17:48:39.424359 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 15 17:48:39.424359 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 15 17:48:39.424359 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 15 17:48:39.426798 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 17:48:39.426798 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 17:48:39.426798 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 15 17:48:39.426798 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 15 17:48:39.426798 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 15 17:48:39.426798 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 15 17:48:39.426798 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 17:48:39.426798 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 17:48:39.426798 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 17:48:39.426798 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 17:48:39.426798 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 17:48:39.426798 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application with Lock( Sep 15 17:48:39.426798 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 17:48:39.426798 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._enter() Sep 15 17:48:39.426798 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 17:48:39.426798 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 17:48:39.426798 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 17:48:39.426798 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.creator() Sep 15 17:48:39.430044 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 17:48:39.430044 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application created_value = creator( Sep 15 17:48:39.430044 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 15 17:48:39.430044 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 15 17:48:39.430044 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 15 17:48:39.430044 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 15 17:48:39.430044 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 15 17:48:39.430044 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 15 17:48:39.430044 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 15 17:48:39.430044 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Sep 15 17:48:39.430044 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 278/555] 10.222.0.25 () {56 vars in 1093 bytes} [Thu Sep 15 17:48:39 2022] GET /identity/v3/users/nova => generated 82 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 15 17:48:39.431817 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b2fe3d-bfae-48d5-b91a-23e497fe0844 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:48:39.431817 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b2fe3d-bfae-48d5-b91a-23e497fe0844 None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:48:39.431817 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b2fe3d-bfae-48d5-b91a-23e497fe0844 None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:48:39.431817 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b2fe3d-bfae-48d5-b91a-23e497fe0844 None admin] PATH_INFO: `/v3/users` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:48:39.432533 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b2fe3d-bfae-48d5-b91a-23e497fe0844 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81592) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 17:48:39.432533 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b2fe3d-bfae-48d5-b91a-23e497fe0844 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:48:39.437351 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b2fe3d-bfae-48d5-b91a-23e497fe0844 None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:48:39.439659 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d70865-e7b1-4dd9-9858-f231ec953b5e None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:48:39.470445 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 278/556] 10.222.0.25 () {56 vars in 1135 bytes} [Thu Sep 15 17:48:39 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 414 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 17:48:39.476761 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b2fe3d-bfae-48d5-b91a-23e497fe0844 None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:48:39.597031 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d70865-e7b1-4dd9-9858-f231ec953b5e None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:48:39.602837 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:48:39.628399 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b2fe3d-bfae-48d5-b91a-23e497fe0844 None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:48:39.640275 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f868c182-84d5-4c22-bbb9-ebf71bd0a16e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:48:39.641320 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f868c182-84d5-4c22-bbb9-ebf71bd0a16e None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:48:39.641748 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f868c182-84d5-4c22-bbb9-ebf71bd0a16e None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:48:39.642190 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f868c182-84d5-4c22-bbb9-ebf71bd0a16e None admin] PATH_INFO: `/v3/users` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:48:39.643106 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f868c182-84d5-4c22-bbb9-ebf71bd0a16e None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81593) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 17:48:39.644142 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f868c182-84d5-4c22-bbb9-ebf71bd0a16e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:48:39.646016 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f868c182-84d5-4c22-bbb9-ebf71bd0a16e None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:48:39.668862 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930656d0-ceaf-435c-a798-59d3b1383114 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:48:39.669442 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930656d0-ceaf-435c-a798-59d3b1383114 None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:48:39.669727 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930656d0-ceaf-435c-a798-59d3b1383114 None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:48:39.670057 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930656d0-ceaf-435c-a798-59d3b1383114 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:48:39.675164 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 279/557] 10.222.0.25 () {56 vars in 1133 bytes} [Thu Sep 15 17:48:39 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 17:48:39.675164 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df1bfc6-270e-465f-a607-6dc01b41be38 None None] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:48:39.675437 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df1bfc6-270e-465f-a607-6dc01b41be38 None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:48:39.675681 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df1bfc6-270e-465f-a607-6dc01b41be38 None None] PATH_INFO: `/` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:48:39.677086 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 280/558] 10.222.0.25 () {54 vars in 927 bytes} [Thu Sep 15 17:48:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 17:48:39.679579 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df1bfc6-270e-465f-a607-6dc01b41be38 None None] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:48:39.699607 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:48:39.770885 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-930656d0-ceaf-435c-a798-59d3b1383114 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:48:39.772391 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-930656d0-ceaf-435c-a798-59d3b1383114 None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:48:39.818758 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df1bfc6-270e-465f-a607-6dc01b41be38 None None] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:48:39.857601 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607e3bda-4f2c-4935-a312-e2b337ab7b89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:48:39.858485 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607e3bda-4f2c-4935-a312-e2b337ab7b89 None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:48:39.858769 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607e3bda-4f2c-4935-a312-e2b337ab7b89 None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:48:39.859043 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607e3bda-4f2c-4935-a312-e2b337ab7b89 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:48:39.873939 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607e3bda-4f2c-4935-a312-e2b337ab7b89 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:48:39.876062 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607e3bda-4f2c-4935-a312-e2b337ab7b89 None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:48:39.878740 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:48:39.898070 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application [None req-607e3bda-4f2c-4935-a312-e2b337ab7b89 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 17:48:39.898070 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 17:48:39.898070 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 17:48:39.898070 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 17:48:39.898070 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 17:48:39.898070 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 17:48:39.898070 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 17:48:39.898070 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 17:48:39.898070 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 17:48:39.898070 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 17:48:39.898070 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 17:48:39.898070 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 17:48:39.898070 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 15 17:48:39.898070 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 15 17:48:39.898070 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 15 17:48:39.898070 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 15 17:48:39.899144 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 17:48:39.899144 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 17:48:39.899144 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 17:48:39.899144 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 17:48:39.899144 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 17:48:39.899144 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 17:48:39.899144 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 17:48:39.899144 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application with Lock( Sep 15 17:48:39.899144 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 17:48:39.899144 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._enter() Sep 15 17:48:39.899144 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 17:48:39.899144 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 17:48:39.899144 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 17:48:39.899144 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.creator() Sep 15 17:48:39.899144 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 17:48:39.899144 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application created_value = creator( Sep 15 17:48:39.899144 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 15 17:48:39.900082 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 15 17:48:39.900082 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 17:48:39.900082 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Sep 15 17:48:39.900082 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 281/559] 10.222.0.25 () {56 vars in 1108 bytes} [Thu Sep 15 17:48:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 17:48:39.900928 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad0893c-38a8-4c34-a8e1-2e72e3fff7a7 None None] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:48:39.900928 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad0893c-38a8-4c34-a8e1-2e72e3fff7a7 None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:48:39.901406 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad0893c-38a8-4c34-a8e1-2e72e3fff7a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:48:39.920546 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 279/560] 10.222.0.25 () {58 vars in 1282 bytes} [Thu Sep 15 17:48:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 444 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 15 17:48:39.922180 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee6b0e2-9d88-468c-b1bf-4b9904e22df8 None None] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:48:39.922463 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee6b0e2-9d88-468c-b1bf-4b9904e22df8 None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:48:39.922736 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee6b0e2-9d88-468c-b1bf-4b9904e22df8 None None] PATH_INFO: `/` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:48:39.928532 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 280/561] 10.222.0.25 () {54 vars in 927 bytes} [Thu Sep 15 17:48:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 17:48:39.928532 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee6b0e2-9d88-468c-b1bf-4b9904e22df8 None None] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:48:39.931617 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.auth.core [None req-0ad0893c-38a8-4c34-a8e1-2e72e3fff7a7 None None] MFA Rules not processed for user `5cfa58ef86774ab7800bf91930bf6028`. Rule list: `[]` (Enabled: `True`). {{(pid=81593) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 17:48:39.932893 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-0ad0893c-38a8-4c34-a8e1-2e72e3fff7a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 17:48:40.000312 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:48:40.010948 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 282/562] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Sep 15 17:48:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 15 17:48:40.018315 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad0893c-38a8-4c34-a8e1-2e72e3fff7a7 None None] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:48:40.057414 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee6b0e2-9d88-468c-b1bf-4b9904e22df8 None None] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:48:40.106442 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961c7184-3ebf-476d-b6bc-431dfa336971 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:48:40.108294 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961c7184-3ebf-476d-b6bc-431dfa336971 None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:48:40.108294 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961c7184-3ebf-476d-b6bc-431dfa336971 None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:48:40.108488 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961c7184-3ebf-476d-b6bc-431dfa336971 None admin] PATH_INFO: `/v3/domains` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:48:40.109083 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961c7184-3ebf-476d-b6bc-431dfa336971 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81592) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 17:48:40.109412 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961c7184-3ebf-476d-b6bc-431dfa336971 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:48:40.110787 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961c7184-3ebf-476d-b6bc-431dfa336971 None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:48:40.129752 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 281/563] 10.222.0.25 () {56 vars in 1109 bytes} [Thu Sep 15 17:48:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 17:48:40.129752 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91c83fa-b231-44ca-be59-9f95cdce295d None None] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:48:40.129752 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91c83fa-b231-44ca-be59-9f95cdce295d None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:48:40.129752 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91c83fa-b231-44ca-be59-9f95cdce295d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:48:40.144594 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad0893c-38a8-4c34-a8e1-2e72e3fff7a7 None None] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:48:40.149354 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.auth.core [None req-b91c83fa-b231-44ca-be59-9f95cdce295d None None] MFA Rules not processed for user `5cfa58ef86774ab7800bf91930bf6028`. Rule list: `[]` (Enabled: `True`). {{(pid=81592) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 17:48:40.153063 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-b91c83fa-b231-44ca-be59-9f95cdce295d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 17:48:40.184789 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b64b2a-c005-41e7-819b-5e62a4d5e3b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:48:40.185392 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b64b2a-c005-41e7-819b-5e62a4d5e3b9 None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:48:40.185658 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b64b2a-c005-41e7-819b-5e62a4d5e3b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:48:40.185928 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b64b2a-c005-41e7-819b-5e62a4d5e3b9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:48:40.187695 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:48:40.198098 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b64b2a-c005-41e7-819b-5e62a4d5e3b9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:48:40.199939 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b64b2a-c005-41e7-819b-5e62a4d5e3b9 None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:48:40.217307 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application [None req-20b64b2a-c005-41e7-819b-5e62a4d5e3b9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 17:48:40.217307 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 17:48:40.217307 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 17:48:40.217307 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 17:48:40.217307 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 17:48:40.217307 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 17:48:40.217307 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 17:48:40.217307 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 17:48:40.217307 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 17:48:40.217307 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 17:48:40.217307 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 17:48:40.217307 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 17:48:40.217307 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 15 17:48:40.217307 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 15 17:48:40.217307 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 15 17:48:40.217307 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 15 17:48:40.218509 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 17:48:40.218509 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 17:48:40.218509 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 17:48:40.218509 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 17:48:40.218509 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 17:48:40.218509 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 17:48:40.218509 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 17:48:40.218509 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application with Lock( Sep 15 17:48:40.218509 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 17:48:40.218509 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._enter() Sep 15 17:48:40.218509 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 17:48:40.218509 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 17:48:40.218509 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 17:48:40.218509 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.creator() Sep 15 17:48:40.218509 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 17:48:40.218509 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application created_value = creator( Sep 15 17:48:40.218509 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 15 17:48:40.219603 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 15 17:48:40.219603 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 17:48:40.219603 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Sep 15 17:48:40.220272 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 283/564] 10.222.0.25 () {56 vars in 1108 bytes} [Thu Sep 15 17:48:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 17:48:40.221595 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7169565-95a7-4689-92ec-90defdf755b1 None None] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:48:40.222379 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7169565-95a7-4689-92ec-90defdf755b1 None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:48:40.222656 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7169565-95a7-4689-92ec-90defdf755b1 None None] PATH_INFO: `/` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:48:40.224061 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 284/565] 10.222.0.25 () {54 vars in 927 bytes} [Thu Sep 15 17:48:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 17:48:40.228748 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7169565-95a7-4689-92ec-90defdf755b1 None None] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:48:40.249324 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 282/566] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Sep 15 17:48:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 15 17:48:40.249324 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91c83fa-b231-44ca-be59-9f95cdce295d None None] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:48:40.298901 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:48:40.365983 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7169565-95a7-4689-92ec-90defdf755b1 None None] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:48:40.381641 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91c83fa-b231-44ca-be59-9f95cdce295d None None] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:48:40.410680 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4b3995-96a7-424c-9b57-1bf09c42d04f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:48:40.411648 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4b3995-96a7-424c-9b57-1bf09c42d04f None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:48:40.412070 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4b3995-96a7-424c-9b57-1bf09c42d04f None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:48:40.412348 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4b3995-96a7-424c-9b57-1bf09c42d04f None admin] PATH_INFO: `/v3/projects/service` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:48:40.419984 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b4b3995-96a7-424c-9b57-1bf09c42d04f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:48:40.420359 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbf711b-f1d2-49c8-ac28-ec6ea1d182f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:48:40.420970 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbf711b-f1d2-49c8-ac28-ec6ea1d182f5 None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:48:40.421248 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbf711b-f1d2-49c8-ac28-ec6ea1d182f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:48:40.421484 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b4b3995-96a7-424c-9b57-1bf09c42d04f None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:48:40.421584 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbf711b-f1d2-49c8-ac28-ec6ea1d182f5 None admin] PATH_INFO: `/v3/domains` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:48:40.422212 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dbf711b-f1d2-49c8-ac28-ec6ea1d182f5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81592) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 17:48:40.422511 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dbf711b-f1d2-49c8-ac28-ec6ea1d182f5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:48:40.423869 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dbf711b-f1d2-49c8-ac28-ec6ea1d182f5 None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:48:40.434246 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application [None req-7b4b3995-96a7-424c-9b57-1bf09c42d04f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 15 17:48:40.434246 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 17:48:40.434246 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 17:48:40.434246 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 17:48:40.434246 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 17:48:40.434246 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 17:48:40.434246 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 17:48:40.434246 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 17:48:40.434246 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 17:48:40.434246 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 17:48:40.434246 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 17:48:40.434246 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 17:48:40.434246 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 15 17:48:40.434246 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 15 17:48:40.434246 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 15 17:48:40.435299 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 15 17:48:40.435299 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 17:48:40.435299 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 17:48:40.435299 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 17:48:40.435299 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 17:48:40.435299 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 17:48:40.435299 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 17:48:40.435299 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 17:48:40.435299 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application with Lock( Sep 15 17:48:40.435299 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 17:48:40.435299 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._enter() Sep 15 17:48:40.435299 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 17:48:40.435299 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 17:48:40.435299 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 17:48:40.435299 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.creator() Sep 15 17:48:40.435299 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 17:48:40.435299 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application created_value = creator( Sep 15 17:48:40.436237 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 15 17:48:40.436237 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 15 17:48:40.436237 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 15 17:48:40.436237 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 15 17:48:40.436237 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 15 17:48:40.436237 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 15 17:48:40.436237 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 15 17:48:40.436237 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Sep 15 17:48:40.436237 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 285/567] 10.222.0.25 () {56 vars in 1111 bytes} [Thu Sep 15 17:48:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 17:48:40.437350 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc07d78-d61e-4c21-b152-a7c718995a3c None None] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:48:40.437350 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc07d78-d61e-4c21-b152-a7c718995a3c None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:48:40.437519 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc07d78-d61e-4c21-b152-a7c718995a3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:48:40.447329 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 283/568] 10.222.0.25 () {56 vars in 1109 bytes} [Thu Sep 15 17:48:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 17:48:40.447329 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbf711b-f1d2-49c8-ac28-ec6ea1d182f5 None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:48:40.456796 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.auth.core [None req-9dc07d78-d61e-4c21-b152-a7c718995a3c None None] MFA Rules not processed for user `5cfa58ef86774ab7800bf91930bf6028`. Rule list: `[]` (Enabled: `True`). {{(pid=81593) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 17:48:40.458018 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-9dc07d78-d61e-4c21-b152-a7c718995a3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 17:48:40.484745 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:48:40.542560 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 286/569] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Sep 15 17:48:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 15 17:48:40.543411 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc07d78-d61e-4c21-b152-a7c718995a3c None None] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:48:40.576568 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbf711b-f1d2-49c8-ac28-ec6ea1d182f5 None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:48:40.585541 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:48:40.622541 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7144f8cd-a11a-4e23-a093-3519fffd2e48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:48:40.624279 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7144f8cd-a11a-4e23-a093-3519fffd2e48 None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:48:40.624279 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7144f8cd-a11a-4e23-a093-3519fffd2e48 None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:48:40.624279 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7144f8cd-a11a-4e23-a093-3519fffd2e48 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:48:40.639138 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7144f8cd-a11a-4e23-a093-3519fffd2e48 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 17:48:40.644978 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application [None req-7144f8cd-a11a-4e23-a093-3519fffd2e48 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 15 17:48:40.644978 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 17:48:40.644978 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 17:48:40.644978 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 17:48:40.644978 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 17:48:40.644978 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 17:48:40.644978 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 17:48:40.644978 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 17:48:40.644978 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 17:48:40.644978 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 17:48:40.644978 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 17:48:40.644978 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 17:48:40.644978 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 17:48:40.644978 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 17:48:40.644978 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 17:48:40.644978 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 17:48:40.645925 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 17:48:40.645925 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 17:48:40.645925 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 17:48:40.645925 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 17:48:40.645925 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 17:48:40.645925 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 17:48:40.645925 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 17:48:40.645925 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 17:48:40.645925 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 17:48:40.645925 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 17:48:40.645925 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 17:48:40.645925 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application with Lock( Sep 15 17:48:40.645925 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 17:48:40.645925 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._enter() Sep 15 17:48:40.645925 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 17:48:40.645925 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 17:48:40.646763 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 17:48:40.646763 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.creator() Sep 15 17:48:40.646763 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 17:48:40.646763 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application created_value = creator( Sep 15 17:48:40.646763 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 17:48:40.646763 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 17:48:40.646763 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 17:48:40.646763 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 17:48:40.646763 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 17:48:40.646763 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 17:48:40.646763 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 15 17:48:40.646763 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Sep 15 17:48:40.651050 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 284/570] 10.222.0.25 () {56 vars in 1102 bytes} [Thu Sep 15 17:48:40 2022] GET /identity/v3/roles/service => generated 85 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 17:48:40.651915 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7144f8cd-a11a-4e23-a093-3519fffd2e48 None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:48:40.672905 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc07d78-d61e-4c21-b152-a7c718995a3c None None] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:48:40.713256 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c61689-48ea-4e96-bfe9-f7d9334d61c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:48:40.713811 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c61689-48ea-4e96-bfe9-f7d9334d61c8 None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:48:40.714086 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c61689-48ea-4e96-bfe9-f7d9334d61c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:48:40.714358 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c61689-48ea-4e96-bfe9-f7d9334d61c8 None admin] PATH_INFO: `/v3/projects` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:48:40.715056 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c61689-48ea-4e96-bfe9-f7d9334d61c8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81593) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 17:48:40.715359 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c61689-48ea-4e96-bfe9-f7d9334d61c8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:48:40.716823 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c61689-48ea-4e96-bfe9-f7d9334d61c8 None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:48:40.729644 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 287/571] 10.222.0.25 () {56 vars in 1148 bytes} [Thu Sep 15 17:48:40 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 17:48:40.730476 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c61689-48ea-4e96-bfe9-f7d9334d61c8 None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:48:40.759877 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:48:40.776378 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7144f8cd-a11a-4e23-a093-3519fffd2e48 None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:48:40.818593 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e197f0-8d91-4910-91e8-636acb56a5ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:48:40.819230 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e197f0-8d91-4910-91e8-636acb56a5ed None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:48:40.819506 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e197f0-8d91-4910-91e8-636acb56a5ed None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:48:40.819773 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e197f0-8d91-4910-91e8-636acb56a5ed None admin] PATH_INFO: `/v3/projects/service` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:48:40.830445 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e197f0-8d91-4910-91e8-636acb56a5ed None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:48:40.832443 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e197f0-8d91-4910-91e8-636acb56a5ed None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:48:40.844307 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application [None req-c9e197f0-8d91-4910-91e8-636acb56a5ed None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 15 17:48:40.844307 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 17:48:40.844307 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 17:48:40.844307 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 17:48:40.844307 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 17:48:40.844307 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 17:48:40.844307 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 17:48:40.844307 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 17:48:40.844307 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 17:48:40.844307 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 17:48:40.844307 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 17:48:40.844307 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 17:48:40.844307 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 15 17:48:40.844307 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 15 17:48:40.844307 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 15 17:48:40.845261 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 15 17:48:40.845261 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 17:48:40.845261 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 17:48:40.845261 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 17:48:40.845261 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 17:48:40.845261 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 17:48:40.845261 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 17:48:40.845261 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 17:48:40.845261 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application with Lock( Sep 15 17:48:40.845261 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 17:48:40.845261 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._enter() Sep 15 17:48:40.845261 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 17:48:40.845261 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 17:48:40.845261 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 17:48:40.845261 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.creator() Sep 15 17:48:40.845261 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 17:48:40.845261 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application created_value = creator( Sep 15 17:48:40.851748 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 15 17:48:40.851748 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 15 17:48:40.851748 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 15 17:48:40.851748 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 15 17:48:40.851748 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 15 17:48:40.851748 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 15 17:48:40.851748 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 15 17:48:40.851748 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Sep 15 17:48:40.852175 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:48:40.852583 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 285/572] 10.222.0.25 () {56 vars in 1111 bytes} [Thu Sep 15 17:48:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 17:48:40.852583 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e197f0-8d91-4910-91e8-636acb56a5ed None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:48:40.856664 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c61689-48ea-4e96-bfe9-f7d9334d61c8 None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:48:40.895626 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5273c9-d108-45af-b25d-b7136f8bcda9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:48:40.896565 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5273c9-d108-45af-b25d-b7136f8bcda9 None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:48:40.896987 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5273c9-d108-45af-b25d-b7136f8bcda9 None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:48:40.897429 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5273c9-d108-45af-b25d-b7136f8bcda9 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:48:40.913455 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d5273c9-d108-45af-b25d-b7136f8bcda9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 17:48:40.922067 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application [None req-4d5273c9-d108-45af-b25d-b7136f8bcda9 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 15 17:48:40.922067 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 17:48:40.922067 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 17:48:40.922067 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 17:48:40.922067 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 17:48:40.922067 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 17:48:40.922067 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 17:48:40.922067 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 17:48:40.922067 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 17:48:40.922067 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 17:48:40.922067 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 17:48:40.922067 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 17:48:40.922067 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 17:48:40.922067 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 17:48:40.922067 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 17:48:40.922067 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 17:48:40.923544 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 17:48:40.923544 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 17:48:40.923544 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 17:48:40.923544 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 17:48:40.923544 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 17:48:40.923544 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 17:48:40.923544 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 17:48:40.923544 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 17:48:40.923544 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 17:48:40.923544 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 17:48:40.923544 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 17:48:40.923544 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application with Lock( Sep 15 17:48:40.923544 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 17:48:40.923544 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._enter() Sep 15 17:48:40.923544 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 17:48:40.923544 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 17:48:40.924386 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 17:48:40.924386 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.creator() Sep 15 17:48:40.924386 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 17:48:40.924386 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application created_value = creator( Sep 15 17:48:40.924386 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 17:48:40.924386 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 17:48:40.924386 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 17:48:40.924386 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 17:48:40.924386 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 17:48:40.924386 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 17:48:40.924386 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 15 17:48:40.924386 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Sep 15 17:48:40.924386 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 288/573] 10.222.0.25 () {56 vars in 1102 bytes} [Thu Sep 15 17:48:40 2022] GET /identity/v3/roles/service => generated 85 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 17:48:40.925407 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5273c9-d108-45af-b25d-b7136f8bcda9 None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:48:40.952850 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e197f0-8d91-4910-91e8-636acb56a5ed None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:48:40.989714 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c31c549-73e1-41f0-b6cc-63fdda89cee1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:48:40.990322 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c31c549-73e1-41f0-b6cc-63fdda89cee1 None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:48:40.990597 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c31c549-73e1-41f0-b6cc-63fdda89cee1 None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:48:40.990868 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c31c549-73e1-41f0-b6cc-63fdda89cee1 None admin] PATH_INFO: `/v3/roles` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:48:40.991538 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c31c549-73e1-41f0-b6cc-63fdda89cee1 None admin] RBAC: Adding query filter params (name=service) {{(pid=81592) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 17:48:40.991843 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c31c549-73e1-41f0-b6cc-63fdda89cee1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:48:40.993194 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c31c549-73e1-41f0-b6cc-63fdda89cee1 None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:48:41.002373 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 286/574] 10.222.0.25 () {56 vars in 1103 bytes} [Thu Sep 15 17:48:40 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 17:48:41.003222 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c31c549-73e1-41f0-b6cc-63fdda89cee1 None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:48:41.025938 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:48:41.053040 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5273c9-d108-45af-b25d-b7136f8bcda9 None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:48:41.089652 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd31f92-84a1-41ed-898f-a551dae5af5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:48:41.090312 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd31f92-84a1-41ed-898f-a551dae5af5a None admin] REQUEST_METHOD: `PUT` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:48:41.090593 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd31f92-84a1-41ed-898f-a551dae5af5a None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:48:41.090868 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd31f92-84a1-41ed-898f-a551dae5af5a None admin] PATH_INFO: `/v3/projects/1213c0d1b584404ba3998e136f166e89/users/fe2244818e4d4dca9c424cd078653e6a/roles/17e337d9acf148e99d6c50170293fa05` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:48:41.111586 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd31f92-84a1-41ed-898f-a551dae5af5a None admin] RBAC: Authorizing `identity:create_grant(project_id=1213c0d1b584404ba3998e136f166e89, user_id=fe2244818e4d4dca9c424cd078653e6a, role_id=17e337d9acf148e99d6c50170293fa05)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:48:41.113562 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd31f92-84a1-41ed-898f-a551dae5af5a None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:48:41.120261 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c31c549-73e1-41f0-b6cc-63fdda89cee1 None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:48:41.130434 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 289/575] 10.222.0.25 () {58 vars in 1439 bytes} [Thu Sep 15 17:48:40 2022] PUT /identity/v3/projects/1213c0d1b584404ba3998e136f166e89/users/fe2244818e4d4dca9c424cd078653e6a/roles/17e337d9acf148e99d6c50170293fa05 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 17:48:41.131380 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd31f92-84a1-41ed-898f-a551dae5af5a None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:48:41.142408 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:48:41.179936 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6d7afa-0419-4e4d-b68e-aec1e27d067e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:48:41.180574 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6d7afa-0419-4e4d-b68e-aec1e27d067e None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:48:41.180856 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6d7afa-0419-4e4d-b68e-aec1e27d067e None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:48:41.181129 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6d7afa-0419-4e4d-b68e-aec1e27d067e None admin] PATH_INFO: `/v3/roles/service` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:48:41.204106 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a6d7afa-0419-4e4d-b68e-aec1e27d067e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 17:48:41.210224 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application [None req-9a6d7afa-0419-4e4d-b68e-aec1e27d067e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 15 17:48:41.210224 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 17:48:41.210224 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 17:48:41.210224 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 17:48:41.210224 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 17:48:41.210224 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 17:48:41.210224 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 17:48:41.210224 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 17:48:41.210224 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 17:48:41.210224 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 17:48:41.210224 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 17:48:41.210224 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 17:48:41.210224 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 17:48:41.210224 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 17:48:41.210224 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 17:48:41.210224 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 17:48:41.211360 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 17:48:41.211360 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 17:48:41.211360 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 17:48:41.211360 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 17:48:41.211360 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 17:48:41.211360 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 17:48:41.211360 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 17:48:41.211360 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 17:48:41.211360 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 17:48:41.211360 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 17:48:41.211360 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 17:48:41.211360 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application with Lock( Sep 15 17:48:41.211360 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 17:48:41.211360 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._enter() Sep 15 17:48:41.211360 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 17:48:41.211360 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 17:48:41.212859 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 17:48:41.212859 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.creator() Sep 15 17:48:41.212859 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 17:48:41.212859 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application created_value = creator( Sep 15 17:48:41.212859 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 17:48:41.212859 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 17:48:41.212859 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 17:48:41.212859 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 17:48:41.212859 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 17:48:41.212859 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 17:48:41.212859 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 15 17:48:41.212859 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Sep 15 17:48:41.212859 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 287/576] 10.222.0.25 () {56 vars in 1102 bytes} [Thu Sep 15 17:48:41 2022] GET /identity/v3/roles/service => generated 85 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 17:48:41.212859 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6d7afa-0419-4e4d-b68e-aec1e27d067e None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:48:41.272973 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd31f92-84a1-41ed-898f-a551dae5af5a None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:48:41.318043 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:48:41.320938 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf45ae9-01f0-4c07-ad14-6a77840c7146 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:48:41.323199 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf45ae9-01f0-4c07-ad14-6a77840c7146 None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:48:41.323199 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf45ae9-01f0-4c07-ad14-6a77840c7146 None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:48:41.323199 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf45ae9-01f0-4c07-ad14-6a77840c7146 None admin] PATH_INFO: `/v3/projects` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:48:41.323916 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf45ae9-01f0-4c07-ad14-6a77840c7146 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81593) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 17:48:41.324297 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf45ae9-01f0-4c07-ad14-6a77840c7146 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:48:41.325925 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf45ae9-01f0-4c07-ad14-6a77840c7146 None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:48:41.339768 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 290/577] 10.222.0.25 () {56 vars in 1148 bytes} [Thu Sep 15 17:48:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 17:48:41.340734 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf45ae9-01f0-4c07-ad14-6a77840c7146 None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:48:41.377603 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6d7afa-0419-4e4d-b68e-aec1e27d067e None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:48:41.418937 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2400d31-a7cd-4550-90ad-9e67f1d2b5b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:48:41.419859 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2400d31-a7cd-4550-90ad-9e67f1d2b5b9 None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:48:41.420299 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2400d31-a7cd-4550-90ad-9e67f1d2b5b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:48:41.420716 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2400d31-a7cd-4550-90ad-9e67f1d2b5b9 None admin] PATH_INFO: `/v3/roles` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:48:41.421841 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2400d31-a7cd-4550-90ad-9e67f1d2b5b9 None admin] RBAC: Adding query filter params (name=service) {{(pid=81592) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 17:48:41.422334 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2400d31-a7cd-4550-90ad-9e67f1d2b5b9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:48:41.425245 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2400d31-a7cd-4550-90ad-9e67f1d2b5b9 None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:48:41.426887 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:48:41.436913 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 288/578] 10.222.0.25 () {56 vars in 1103 bytes} [Thu Sep 15 17:48:41 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 17:48:41.437805 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2400d31-a7cd-4550-90ad-9e67f1d2b5b9 None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:48:41.482737 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf45ae9-01f0-4c07-ad14-6a77840c7146 None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:48:41.533888 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491f9b2b-fabe-44af-b465-bcb8564b5147 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:48:41.534490 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491f9b2b-fabe-44af-b465-bcb8564b5147 None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:48:41.534765 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491f9b2b-fabe-44af-b465-bcb8564b5147 None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:48:41.535038 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491f9b2b-fabe-44af-b465-bcb8564b5147 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:48:41.547108 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491f9b2b-fabe-44af-b465-bcb8564b5147 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:48:41.548622 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491f9b2b-fabe-44af-b465-bcb8564b5147 None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:48:41.565162 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application [None req-491f9b2b-fabe-44af-b465-bcb8564b5147 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 17:48:41.565162 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 17:48:41.565162 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 17:48:41.565162 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 17:48:41.565162 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 17:48:41.565162 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 17:48:41.565162 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 17:48:41.565162 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 17:48:41.565162 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 17:48:41.565162 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 17:48:41.565162 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 17:48:41.565162 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 17:48:41.565162 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 15 17:48:41.565162 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 15 17:48:41.565162 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 15 17:48:41.565162 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 15 17:48:41.566802 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 17:48:41.566802 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 17:48:41.566802 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 17:48:41.566802 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 17:48:41.566802 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 17:48:41.566802 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 17:48:41.566802 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 17:48:41.566802 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application with Lock( Sep 15 17:48:41.566802 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 17:48:41.566802 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._enter() Sep 15 17:48:41.566802 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 17:48:41.566802 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 17:48:41.566802 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 17:48:41.566802 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.creator() Sep 15 17:48:41.566802 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 17:48:41.566802 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application created_value = creator( Sep 15 17:48:41.566802 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 15 17:48:41.567691 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 15 17:48:41.567691 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 17:48:41.567691 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Sep 15 17:48:41.567859 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2400d31-a7cd-4550-90ad-9e67f1d2b5b9 None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:48:41.567932 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 291/579] 10.222.0.25 () {56 vars in 1108 bytes} [Thu Sep 15 17:48:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 17:48:41.567932 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491f9b2b-fabe-44af-b465-bcb8564b5147 None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:48:41.603177 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:48:41.610358 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167db688-a7a0-4226-b04b-4598a3e76dec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:48:41.610975 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167db688-a7a0-4226-b04b-4598a3e76dec None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:48:41.611254 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167db688-a7a0-4226-b04b-4598a3e76dec None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:48:41.611530 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167db688-a7a0-4226-b04b-4598a3e76dec None admin] PATH_INFO: `/v3/roles` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:48:41.612747 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167db688-a7a0-4226-b04b-4598a3e76dec None admin] RBAC: Adding query filter params (name=service) {{(pid=81592) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 17:48:41.613054 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167db688-a7a0-4226-b04b-4598a3e76dec None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:48:41.614461 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167db688-a7a0-4226-b04b-4598a3e76dec None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:48:41.623058 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 289/580] 10.222.0.25 () {56 vars in 1103 bytes} [Thu Sep 15 17:48:41 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 17:48:41.623883 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167db688-a7a0-4226-b04b-4598a3e76dec None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:48:41.706902 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491f9b2b-fabe-44af-b465-bcb8564b5147 None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:48:41.730357 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:48:41.747204 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b244fc4e-7809-4887-a803-57411dbb286c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:48:41.747839 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b244fc4e-7809-4887-a803-57411dbb286c None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:48:41.748113 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b244fc4e-7809-4887-a803-57411dbb286c None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:48:41.748379 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b244fc4e-7809-4887-a803-57411dbb286c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:48:41.749103 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b244fc4e-7809-4887-a803-57411dbb286c None admin] RBAC: Adding query filter params (role.id=17e337d9acf148e99d6c50170293fa05, scope.project.id=1213c0d1b584404ba3998e136f166e89, user.id=685f7ad4c6fe4c878d542dddd6d81593) {{(pid=81593) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 17:48:41.749447 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b244fc4e-7809-4887-a803-57411dbb286c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:48:41.750885 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b244fc4e-7809-4887-a803-57411dbb286c None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:48:41.758168 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 292/581] 10.222.0.25 () {56 vars in 1374 bytes} [Thu Sep 15 17:48:41 2022] GET /identity/v3/role_assignments?user.id=685f7ad4c6fe4c878d542dddd6d81593&scope.project.id=1213c0d1b584404ba3998e136f166e89&role.id=17e337d9acf148e99d6c50170293fa05 => generated 259 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 17:48:41.759011 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b244fc4e-7809-4887-a803-57411dbb286c None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:48:41.760342 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167db688-a7a0-4226-b04b-4598a3e76dec None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:48:41.812547 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd9b1e1-2d07-43c5-bb7d-c0346f165d6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:48:41.813872 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd9b1e1-2d07-43c5-bb7d-c0346f165d6f None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:48:41.814363 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd9b1e1-2d07-43c5-bb7d-c0346f165d6f None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:48:41.816402 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd9b1e1-2d07-43c5-bb7d-c0346f165d6f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:48:41.832461 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd9b1e1-2d07-43c5-bb7d-c0346f165d6f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:48:41.834698 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd9b1e1-2d07-43c5-bb7d-c0346f165d6f None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:48:41.854705 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application [None req-ccd9b1e1-2d07-43c5-bb7d-c0346f165d6f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 17:48:41.854705 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 17:48:41.854705 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 17:48:41.854705 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 17:48:41.854705 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 17:48:41.854705 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 17:48:41.854705 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 17:48:41.854705 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 17:48:41.854705 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 17:48:41.854705 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 17:48:41.854705 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 17:48:41.854705 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 17:48:41.854705 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 15 17:48:41.854705 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 15 17:48:41.854705 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 15 17:48:41.854705 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 15 17:48:41.855982 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 17:48:41.855982 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 17:48:41.855982 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 17:48:41.855982 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 17:48:41.855982 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 17:48:41.855982 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 17:48:41.855982 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 17:48:41.855982 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application with Lock( Sep 15 17:48:41.855982 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 17:48:41.855982 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._enter() Sep 15 17:48:41.855982 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 17:48:41.855982 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 17:48:41.855982 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 17:48:41.855982 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.creator() Sep 15 17:48:41.855982 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 17:48:41.855982 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application created_value = creator( Sep 15 17:48:41.855982 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 15 17:48:41.856854 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 15 17:48:41.856854 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 17:48:41.856854 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Sep 15 17:48:41.859938 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 290/582] 10.222.0.25 () {56 vars in 1108 bytes} [Thu Sep 15 17:48:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 17:48:41.861099 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd9b1e1-2d07-43c5-bb7d-c0346f165d6f None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:48:41.916025 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b244fc4e-7809-4887-a803-57411dbb286c None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:48:41.927348 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:48:41.956353 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80a4540-63ac-46c6-be1c-5afde166dadb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:48:41.957205 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80a4540-63ac-46c6-be1c-5afde166dadb None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:48:41.957663 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80a4540-63ac-46c6-be1c-5afde166dadb None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:48:41.958601 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80a4540-63ac-46c6-be1c-5afde166dadb None admin] PATH_INFO: `/v3/domains` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:48:41.958827 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d80a4540-63ac-46c6-be1c-5afde166dadb None admin] RBAC: Adding query filter params (name=Default) {{(pid=81593) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 17:48:41.959232 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d80a4540-63ac-46c6-be1c-5afde166dadb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:48:41.960758 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d80a4540-63ac-46c6-be1c-5afde166dadb None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:48:41.976333 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 293/583] 10.222.0.25 () {56 vars in 1109 bytes} [Thu Sep 15 17:48:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 17:48:41.977417 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80a4540-63ac-46c6-be1c-5afde166dadb None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:48:42.003921 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd9b1e1-2d07-43c5-bb7d-c0346f165d6f None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:48:42.052830 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:48:42.057593 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6439cd0b-5d37-4c34-83f4-c2c8418fc0bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:48:42.058477 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6439cd0b-5d37-4c34-83f4-c2c8418fc0bf None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:48:42.058904 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6439cd0b-5d37-4c34-83f4-c2c8418fc0bf None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:48:42.059326 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6439cd0b-5d37-4c34-83f4-c2c8418fc0bf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:48:42.075387 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6439cd0b-5d37-4c34-83f4-c2c8418fc0bf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:48:42.078519 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6439cd0b-5d37-4c34-83f4-c2c8418fc0bf None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:48:42.101596 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application [None req-6439cd0b-5d37-4c34-83f4-c2c8418fc0bf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 17:48:42.101596 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 17:48:42.101596 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 17:48:42.101596 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 17:48:42.101596 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 17:48:42.101596 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 17:48:42.101596 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 17:48:42.101596 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 17:48:42.101596 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 17:48:42.101596 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 17:48:42.101596 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 17:48:42.101596 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 17:48:42.101596 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 15 17:48:42.101596 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 15 17:48:42.101596 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 15 17:48:42.101596 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 15 17:48:42.102614 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 17:48:42.102614 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 17:48:42.102614 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 17:48:42.102614 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 17:48:42.102614 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 17:48:42.102614 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 17:48:42.102614 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 17:48:42.102614 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application with Lock( Sep 15 17:48:42.102614 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 17:48:42.102614 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._enter() Sep 15 17:48:42.102614 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 17:48:42.102614 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 17:48:42.102614 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 17:48:42.102614 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.creator() Sep 15 17:48:42.102614 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 17:48:42.102614 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application created_value = creator( Sep 15 17:48:42.102614 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 15 17:48:42.103496 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 15 17:48:42.103496 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 17:48:42.103496 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Sep 15 17:48:42.110149 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 291/584] 10.222.0.25 () {56 vars in 1108 bytes} [Thu Sep 15 17:48:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 17:48:42.111668 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6439cd0b-5d37-4c34-83f4-c2c8418fc0bf None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:48:42.137020 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80a4540-63ac-46c6-be1c-5afde166dadb None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:48:42.183900 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e21f3d6-28e6-4511-9512-f5af06388046 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:48:42.185252 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e21f3d6-28e6-4511-9512-f5af06388046 None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:48:42.185834 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e21f3d6-28e6-4511-9512-f5af06388046 None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:48:42.186312 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e21f3d6-28e6-4511-9512-f5af06388046 None admin] PATH_INFO: `/v3/domains` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:48:42.187299 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e21f3d6-28e6-4511-9512-f5af06388046 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81593) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 17:48:42.188094 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e21f3d6-28e6-4511-9512-f5af06388046 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:48:42.190281 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e21f3d6-28e6-4511-9512-f5af06388046 None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:48:42.205690 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 294/585] 10.222.0.25 () {56 vars in 1109 bytes} [Thu Sep 15 17:48:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 17:48:42.208018 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e21f3d6-28e6-4511-9512-f5af06388046 None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:48:42.232547 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:48:42.236768 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6439cd0b-5d37-4c34-83f4-c2c8418fc0bf None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:48:42.284909 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b142c5-7c46-4110-b6b2-32e1d65c23f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:48:42.286472 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b142c5-7c46-4110-b6b2-32e1d65c23f1 None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:48:42.286965 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b142c5-7c46-4110-b6b2-32e1d65c23f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:48:42.287667 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b142c5-7c46-4110-b6b2-32e1d65c23f1 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:48:42.300355 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b142c5-7c46-4110-b6b2-32e1d65c23f1 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:48:42.302176 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b142c5-7c46-4110-b6b2-32e1d65c23f1 None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:48:42.318887 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application [None req-f8b142c5-7c46-4110-b6b2-32e1d65c23f1 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 15 17:48:42.318887 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 17:48:42.318887 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 17:48:42.318887 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 17:48:42.318887 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 17:48:42.318887 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 17:48:42.318887 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 17:48:42.318887 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 17:48:42.318887 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 17:48:42.318887 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 17:48:42.318887 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 17:48:42.318887 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 17:48:42.318887 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 15 17:48:42.318887 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 15 17:48:42.318887 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 15 17:48:42.318887 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 15 17:48:42.319912 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 17:48:42.319912 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 17:48:42.319912 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 15 17:48:42.319912 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 15 17:48:42.319912 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 15 17:48:42.319912 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 15 17:48:42.319912 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 17:48:42.319912 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 17:48:42.319912 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 17:48:42.319912 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 17:48:42.319912 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 17:48:42.319912 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application with Lock( Sep 15 17:48:42.319912 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 17:48:42.319912 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._enter() Sep 15 17:48:42.319912 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 17:48:42.319912 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 17:48:42.319912 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 17:48:42.319912 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.creator() Sep 15 17:48:42.320884 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 17:48:42.320884 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application created_value = creator( Sep 15 17:48:42.320884 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 15 17:48:42.320884 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 15 17:48:42.320884 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 15 17:48:42.320884 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 15 17:48:42.320884 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 15 17:48:42.320884 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 15 17:48:42.320884 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 15 17:48:42.320884 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Sep 15 17:48:42.323067 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 292/586] 10.222.0.25 () {56 vars in 1099 bytes} [Thu Sep 15 17:48:42 2022] GET /identity/v3/users/cinder => generated 84 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 17:48:42.324667 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b142c5-7c46-4110-b6b2-32e1d65c23f1 None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:48:42.339690 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e21f3d6-28e6-4511-9512-f5af06388046 None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:48:42.343616 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:48:42.385371 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0ebb9b-dcf6-44c6-a6af-f45a397bc582 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:48:42.386423 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0ebb9b-dcf6-44c6-a6af-f45a397bc582 None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:48:42.386900 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0ebb9b-dcf6-44c6-a6af-f45a397bc582 None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:48:42.387403 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0ebb9b-dcf6-44c6-a6af-f45a397bc582 None admin] PATH_INFO: `/v3/domains` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:48:42.388273 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0ebb9b-dcf6-44c6-a6af-f45a397bc582 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81593) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 17:48:42.388796 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0ebb9b-dcf6-44c6-a6af-f45a397bc582 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:48:42.390405 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0ebb9b-dcf6-44c6-a6af-f45a397bc582 None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:48:42.405695 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 295/587] 10.222.0.25 () {56 vars in 1109 bytes} [Thu Sep 15 17:48:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 17:48:42.406896 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0ebb9b-dcf6-44c6-a6af-f45a397bc582 None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:48:42.464866 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b142c5-7c46-4110-b6b2-32e1d65c23f1 None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:48:42.509781 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf2e212-af67-462b-b483-4451e5891b55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:48:42.510714 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf2e212-af67-462b-b483-4451e5891b55 None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:48:42.511001 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf2e212-af67-462b-b483-4451e5891b55 None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:48:42.511280 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf2e212-af67-462b-b483-4451e5891b55 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:48:42.521470 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf2e212-af67-462b-b483-4451e5891b55 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:48:42.522950 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf2e212-af67-462b-b483-4451e5891b55 None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:48:42.535752 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application [None req-ecf2e212-af67-462b-b483-4451e5891b55 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Sep 15 17:48:42.535752 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 17:48:42.535752 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 17:48:42.535752 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 17:48:42.535752 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 17:48:42.535752 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 17:48:42.535752 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 17:48:42.535752 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 17:48:42.535752 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 17:48:42.535752 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 17:48:42.535752 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 17:48:42.535752 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 17:48:42.535752 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 15 17:48:42.535752 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 15 17:48:42.535752 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 15 17:48:42.535752 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 15 17:48:42.536725 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 17:48:42.536725 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 17:48:42.536725 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 15 17:48:42.536725 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 15 17:48:42.536725 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 15 17:48:42.536725 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 15 17:48:42.536725 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 17:48:42.536725 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 17:48:42.536725 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 17:48:42.536725 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 17:48:42.536725 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 17:48:42.536725 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application with Lock( Sep 15 17:48:42.536725 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 17:48:42.536725 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._enter() Sep 15 17:48:42.536725 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 17:48:42.536725 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 17:48:42.536725 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 17:48:42.536725 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.creator() Sep 15 17:48:42.537700 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 17:48:42.537700 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application created_value = creator( Sep 15 17:48:42.537700 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 15 17:48:42.537700 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 15 17:48:42.537700 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 15 17:48:42.537700 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 15 17:48:42.537700 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 15 17:48:42.537700 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 15 17:48:42.537700 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Sep 15 17:48:42.537700 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Sep 15 17:48:42.538231 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 293/588] 10.222.0.25 () {56 vars in 1102 bytes} [Thu Sep 15 17:48:42 2022] GET /identity/v3/users/neutron => generated 85 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 17:48:42.538807 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf2e212-af67-462b-b483-4451e5891b55 None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:48:42.567470 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:48:42.579251 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0ebb9b-dcf6-44c6-a6af-f45a397bc582 None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:48:42.646402 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884ff3ed-2b9d-453c-be39-87162766383e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:48:42.647830 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884ff3ed-2b9d-453c-be39-87162766383e None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:48:42.648557 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884ff3ed-2b9d-453c-be39-87162766383e None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:48:42.648999 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884ff3ed-2b9d-453c-be39-87162766383e None admin] PATH_INFO: `/v3/users` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:48:42.650625 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-884ff3ed-2b9d-453c-be39-87162766383e None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81593) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 17:48:42.651612 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-884ff3ed-2b9d-453c-be39-87162766383e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:48:42.654080 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-884ff3ed-2b9d-453c-be39-87162766383e None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:48:42.671006 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf2e212-af67-462b-b483-4451e5891b55 None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:48:42.694267 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 296/589] 10.222.0.25 () {56 vars in 1137 bytes} [Thu Sep 15 17:48:42 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 17:48:42.697831 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884ff3ed-2b9d-453c-be39-87162766383e None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:48:42.756269 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:48:42.756468 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a474484-76ea-4fb7-ab80-b3761e5bfd2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:48:42.757105 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a474484-76ea-4fb7-ab80-b3761e5bfd2b None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:48:42.757406 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a474484-76ea-4fb7-ab80-b3761e5bfd2b None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:48:42.757683 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a474484-76ea-4fb7-ab80-b3761e5bfd2b None admin] PATH_INFO: `/v3/users/glance` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:48:42.776777 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a474484-76ea-4fb7-ab80-b3761e5bfd2b None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:48:42.779923 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a474484-76ea-4fb7-ab80-b3761e5bfd2b None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:48:42.801917 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application [None req-9a474484-76ea-4fb7-ab80-b3761e5bfd2b None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Sep 15 17:48:42.801917 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 17:48:42.801917 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 17:48:42.801917 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 17:48:42.801917 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 17:48:42.801917 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 17:48:42.801917 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 17:48:42.801917 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 17:48:42.801917 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 17:48:42.801917 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 17:48:42.801917 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 17:48:42.801917 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 17:48:42.801917 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 15 17:48:42.801917 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 15 17:48:42.801917 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 15 17:48:42.801917 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 15 17:48:42.802921 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 17:48:42.802921 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 17:48:42.802921 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 15 17:48:42.802921 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 15 17:48:42.802921 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 15 17:48:42.802921 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 15 17:48:42.802921 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 17:48:42.802921 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 17:48:42.802921 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 17:48:42.802921 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 17:48:42.802921 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 17:48:42.802921 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application with Lock( Sep 15 17:48:42.802921 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 17:48:42.802921 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._enter() Sep 15 17:48:42.802921 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 17:48:42.802921 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 17:48:42.802921 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 17:48:42.802921 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.creator() Sep 15 17:48:42.803862 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 17:48:42.803862 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application created_value = creator( Sep 15 17:48:42.803862 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 15 17:48:42.803862 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 15 17:48:42.803862 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 15 17:48:42.803862 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 15 17:48:42.803862 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 15 17:48:42.803862 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 15 17:48:42.803862 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Sep 15 17:48:42.803862 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Sep 15 17:48:42.812156 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 294/590] 10.222.0.25 () {56 vars in 1099 bytes} [Thu Sep 15 17:48:42 2022] GET /identity/v3/users/glance => generated 84 bytes in 267 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 17:48:42.819308 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a474484-76ea-4fb7-ab80-b3761e5bfd2b None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:48:42.955298 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884ff3ed-2b9d-453c-be39-87162766383e None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:48:43.011132 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9affd473-059f-4659-86dd-03d2d4b23fdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:48:43.012071 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9affd473-059f-4659-86dd-03d2d4b23fdf None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:48:43.012502 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9affd473-059f-4659-86dd-03d2d4b23fdf None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:48:43.012937 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9affd473-059f-4659-86dd-03d2d4b23fdf None admin] PATH_INFO: `/v3/users` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:48:43.014207 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9affd473-059f-4659-86dd-03d2d4b23fdf None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81593) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 17:48:43.014702 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9affd473-059f-4659-86dd-03d2d4b23fdf None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:48:43.017801 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9affd473-059f-4659-86dd-03d2d4b23fdf None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:48:43.023376 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:48:43.041655 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 297/591] 10.222.0.25 () {56 vars in 1139 bytes} [Thu Sep 15 17:48:42 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 348 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 17:48:43.046848 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9affd473-059f-4659-86dd-03d2d4b23fdf None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:48:43.094170 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a474484-76ea-4fb7-ab80-b3761e5bfd2b None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:48:43.188200 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:48:43.190894 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ba6d70-6b1c-473b-a896-4ee69556992c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:48:43.191983 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ba6d70-6b1c-473b-a896-4ee69556992c None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:48:43.192495 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ba6d70-6b1c-473b-a896-4ee69556992c None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:48:43.193250 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ba6d70-6b1c-473b-a896-4ee69556992c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:48:43.204758 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ba6d70-6b1c-473b-a896-4ee69556992c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:48:43.207663 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ba6d70-6b1c-473b-a896-4ee69556992c None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:48:43.219768 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9affd473-059f-4659-86dd-03d2d4b23fdf None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:48:43.225432 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application [None req-88ba6d70-6b1c-473b-a896-4ee69556992c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 17:48:43.225432 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 17:48:43.225432 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 17:48:43.225432 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 17:48:43.225432 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 17:48:43.225432 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 17:48:43.225432 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 17:48:43.225432 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 17:48:43.225432 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 17:48:43.225432 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 17:48:43.225432 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 17:48:43.225432 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 17:48:43.225432 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 15 17:48:43.225432 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 15 17:48:43.225432 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 15 17:48:43.225432 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 15 17:48:43.226743 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 17:48:43.226743 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 17:48:43.226743 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 17:48:43.226743 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 17:48:43.226743 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 17:48:43.226743 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 17:48:43.226743 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 17:48:43.226743 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application with Lock( Sep 15 17:48:43.226743 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 17:48:43.226743 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._enter() Sep 15 17:48:43.226743 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 17:48:43.226743 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 17:48:43.226743 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 17:48:43.226743 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.creator() Sep 15 17:48:43.226743 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 17:48:43.226743 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application created_value = creator( Sep 15 17:48:43.226743 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 15 17:48:43.227799 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 15 17:48:43.227799 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 17:48:43.227799 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Sep 15 17:48:43.229703 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 295/592] 10.222.0.25 () {56 vars in 1108 bytes} [Thu Sep 15 17:48:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 417 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 17:48:43.231208 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ba6d70-6b1c-473b-a896-4ee69556992c None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:48:43.260104 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c14551-b42b-4340-aa0a-731694f544f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:48:43.260834 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c14551-b42b-4340-aa0a-731694f544f5 None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:48:43.261179 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c14551-b42b-4340-aa0a-731694f544f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:48:43.261555 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c14551-b42b-4340-aa0a-731694f544f5 None admin] PATH_INFO: `/v3/users` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:48:43.262363 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c14551-b42b-4340-aa0a-731694f544f5 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81593) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 17:48:43.262758 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c14551-b42b-4340-aa0a-731694f544f5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:48:43.264411 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c14551-b42b-4340-aa0a-731694f544f5 None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:48:43.291062 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 298/593] 10.222.0.25 () {56 vars in 1137 bytes} [Thu Sep 15 17:48:43 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 17:48:43.291062 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c14551-b42b-4340-aa0a-731694f544f5 None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:48:43.383311 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ba6d70-6b1c-473b-a896-4ee69556992c None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:48:43.416059 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:48:43.426256 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b8a810-2274-4098-9d00-bee04f4e5bff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:48:43.427029 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b8a810-2274-4098-9d00-bee04f4e5bff None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:48:43.427382 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b8a810-2274-4098-9d00-bee04f4e5bff None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:48:43.427752 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b8a810-2274-4098-9d00-bee04f4e5bff None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:48:43.434972 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c14551-b42b-4340-aa0a-731694f544f5 None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:48:43.441205 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b8a810-2274-4098-9d00-bee04f4e5bff None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:48:43.443161 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b8a810-2274-4098-9d00-bee04f4e5bff None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:48:43.461178 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application [None req-f0b8a810-2274-4098-9d00-bee04f4e5bff None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 17:48:43.461178 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 17:48:43.461178 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 17:48:43.461178 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 17:48:43.461178 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 17:48:43.461178 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 17:48:43.461178 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 17:48:43.461178 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 17:48:43.461178 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 17:48:43.461178 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 17:48:43.461178 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 17:48:43.461178 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 17:48:43.461178 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 15 17:48:43.461178 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 15 17:48:43.461178 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 15 17:48:43.461178 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 15 17:48:43.462205 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 17:48:43.462205 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 17:48:43.462205 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 17:48:43.462205 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 17:48:43.462205 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 17:48:43.462205 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 17:48:43.462205 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 17:48:43.462205 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application with Lock( Sep 15 17:48:43.462205 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 17:48:43.462205 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._enter() Sep 15 17:48:43.462205 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 17:48:43.462205 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 17:48:43.462205 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 17:48:43.462205 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.creator() Sep 15 17:48:43.462205 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 17:48:43.462205 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application created_value = creator( Sep 15 17:48:43.462205 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 15 17:48:43.463089 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 15 17:48:43.463089 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 17:48:43.463089 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Sep 15 17:48:43.463089 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 296/594] 10.222.0.25 () {56 vars in 1108 bytes} [Thu Sep 15 17:48:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 17:48:43.463803 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b8a810-2274-4098-9d00-bee04f4e5bff None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:48:43.480569 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d7a83b-0d2a-49fc-829b-df8a3fa0f6a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:48:43.481480 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d7a83b-0d2a-49fc-829b-df8a3fa0f6a9 None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:48:43.481758 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d7a83b-0d2a-49fc-829b-df8a3fa0f6a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:48:43.482024 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d7a83b-0d2a-49fc-829b-df8a3fa0f6a9 None admin] PATH_INFO: `/v3/domains` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:48:43.482662 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d7a83b-0d2a-49fc-829b-df8a3fa0f6a9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81593) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 17:48:43.482958 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d7a83b-0d2a-49fc-829b-df8a3fa0f6a9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:48:43.484350 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d7a83b-0d2a-49fc-829b-df8a3fa0f6a9 None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:48:43.492102 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:48:43.497850 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 299/595] 10.222.0.25 () {56 vars in 1109 bytes} [Thu Sep 15 17:48:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 17:48:43.499084 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a571da32-d3cd-4299-aba0-bf4c834b5abc None None] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:48:43.499344 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a571da32-d3cd-4299-aba0-bf4c834b5abc None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:48:43.499851 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a571da32-d3cd-4299-aba0-bf4c834b5abc None None] PATH_INFO: `/` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:48:43.505505 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 300/596] 10.222.0.25 () {54 vars in 927 bytes} [Thu Sep 15 17:48:43 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 17:48:43.507130 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a571da32-d3cd-4299-aba0-bf4c834b5abc None None] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:48:43.596172 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b8a810-2274-4098-9d00-bee04f4e5bff None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:48:43.631564 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a571da32-d3cd-4299-aba0-bf4c834b5abc None None] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:48:43.635792 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49cfa3a-782c-4f13-9ed0-5fe22c54969f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:48:43.636433 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49cfa3a-782c-4f13-9ed0-5fe22c54969f None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:48:43.636715 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49cfa3a-782c-4f13-9ed0-5fe22c54969f None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:48:43.636982 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49cfa3a-782c-4f13-9ed0-5fe22c54969f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:48:43.649317 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b49cfa3a-782c-4f13-9ed0-5fe22c54969f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:48:43.650811 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b49cfa3a-782c-4f13-9ed0-5fe22c54969f None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:48:43.665850 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application [None req-b49cfa3a-782c-4f13-9ed0-5fe22c54969f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 17:48:43.665850 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 17:48:43.665850 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 17:48:43.665850 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 17:48:43.665850 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 17:48:43.665850 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 17:48:43.665850 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 17:48:43.665850 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 17:48:43.665850 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 17:48:43.665850 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 17:48:43.665850 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 17:48:43.665850 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 17:48:43.665850 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 15 17:48:43.665850 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 15 17:48:43.665850 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 15 17:48:43.665850 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 15 17:48:43.667038 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 17:48:43.667038 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 17:48:43.667038 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 17:48:43.667038 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 17:48:43.667038 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 17:48:43.667038 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 17:48:43.667038 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 17:48:43.667038 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application with Lock( Sep 15 17:48:43.667038 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 17:48:43.667038 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._enter() Sep 15 17:48:43.667038 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 17:48:43.667038 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 17:48:43.667038 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 17:48:43.667038 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.creator() Sep 15 17:48:43.667038 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 17:48:43.667038 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application created_value = creator( Sep 15 17:48:43.667038 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 15 17:48:43.667933 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 15 17:48:43.667933 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 17:48:43.667933 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Sep 15 17:48:43.667933 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 297/597] 10.222.0.25 () {56 vars in 1108 bytes} [Thu Sep 15 17:48:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 17:48:43.668163 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49cfa3a-782c-4f13-9ed0-5fe22c54969f None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:48:43.679561 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d315b8-e531-4b90-9c88-21be737d9134 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:48:43.680459 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d315b8-e531-4b90-9c88-21be737d9134 None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:48:43.680912 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d315b8-e531-4b90-9c88-21be737d9134 None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:48:43.681355 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d315b8-e531-4b90-9c88-21be737d9134 None admin] PATH_INFO: `/v3/domains` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:48:43.682162 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d315b8-e531-4b90-9c88-21be737d9134 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81593) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 17:48:43.682753 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d315b8-e531-4b90-9c88-21be737d9134 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:48:43.684155 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d315b8-e531-4b90-9c88-21be737d9134 None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:48:43.702064 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 301/598] 10.222.0.25 () {56 vars in 1109 bytes} [Thu Sep 15 17:48:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 17:48:43.702064 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ed4763-c026-4020-b4c4-1c11c7e59527 None None] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:48:43.702064 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ed4763-c026-4020-b4c4-1c11c7e59527 None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:48:43.702064 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ed4763-c026-4020-b4c4-1c11c7e59527 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:48:43.716306 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:48:43.720811 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.auth.core [None req-86ed4763-c026-4020-b4c4-1c11c7e59527 None None] MFA Rules not processed for user `5cfa58ef86774ab7800bf91930bf6028`. Rule list: `[]` (Enabled: `True`). {{(pid=81593) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 17:48:43.722252 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-86ed4763-c026-4020-b4c4-1c11c7e59527 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 17:48:43.786446 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:48:43.800310 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49cfa3a-782c-4f13-9ed0-5fe22c54969f None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:48:43.807222 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 302/599] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Sep 15 17:48:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 15 17:48:43.809497 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ed4763-c026-4020-b4c4-1c11c7e59527 None None] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:48:43.844694 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d4ab86-eabf-4866-9f6e-a5bb1c963073 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:48:43.846045 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d4ab86-eabf-4866-9f6e-a5bb1c963073 None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:48:43.846451 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d4ab86-eabf-4866-9f6e-a5bb1c963073 None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:48:43.846817 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d4ab86-eabf-4866-9f6e-a5bb1c963073 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:48:43.855372 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d4ab86-eabf-4866-9f6e-a5bb1c963073 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:48:43.857171 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d4ab86-eabf-4866-9f6e-a5bb1c963073 None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:48:43.871176 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application [None req-61d4ab86-eabf-4866-9f6e-a5bb1c963073 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 15 17:48:43.871176 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 17:48:43.871176 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 17:48:43.871176 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 17:48:43.871176 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 17:48:43.871176 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 17:48:43.871176 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 17:48:43.871176 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 17:48:43.871176 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 17:48:43.871176 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 17:48:43.871176 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 17:48:43.871176 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 17:48:43.871176 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 15 17:48:43.871176 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 15 17:48:43.871176 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 15 17:48:43.873017 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 15 17:48:43.873017 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 17:48:43.873017 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 17:48:43.873017 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 17:48:43.873017 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 17:48:43.873017 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 17:48:43.873017 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 17:48:43.873017 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 17:48:43.873017 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application with Lock( Sep 15 17:48:43.873017 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 17:48:43.873017 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._enter() Sep 15 17:48:43.873017 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 17:48:43.873017 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 17:48:43.873017 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 17:48:43.873017 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.creator() Sep 15 17:48:43.873017 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 17:48:43.873017 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application created_value = creator( Sep 15 17:48:43.874857 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 15 17:48:43.874857 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 15 17:48:43.874857 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 15 17:48:43.874857 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 15 17:48:43.874857 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 15 17:48:43.874857 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 15 17:48:43.874857 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 15 17:48:43.874857 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Sep 15 17:48:43.874857 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 298/600] 10.222.0.25 () {56 vars in 1111 bytes} [Thu Sep 15 17:48:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 17:48:43.875980 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d4ab86-eabf-4866-9f6e-a5bb1c963073 None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:48:43.968140 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ed4763-c026-4020-b4c4-1c11c7e59527 None None] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:48:44.009493 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50709ac-d576-446b-9d43-7ff13c4d8110 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:48:44.010414 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50709ac-d576-446b-9d43-7ff13c4d8110 None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:48:44.010898 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50709ac-d576-446b-9d43-7ff13c4d8110 None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:48:44.011345 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50709ac-d576-446b-9d43-7ff13c4d8110 None admin] PATH_INFO: `/v3/domains` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:48:44.012169 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50709ac-d576-446b-9d43-7ff13c4d8110 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81593) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 17:48:44.012647 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50709ac-d576-446b-9d43-7ff13c4d8110 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:48:44.014233 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50709ac-d576-446b-9d43-7ff13c4d8110 None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:48:44.028581 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 303/601] 10.222.0.25 () {56 vars in 1109 bytes} [Thu Sep 15 17:48:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 17:48:44.029072 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:48:44.030571 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50709ac-d576-446b-9d43-7ff13c4d8110 None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:48:44.040498 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d4ab86-eabf-4866-9f6e-a5bb1c963073 None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:48:44.079700 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e31c74b-51e6-4985-b42c-d98a1b568959 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:48:44.080341 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e31c74b-51e6-4985-b42c-d98a1b568959 None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:48:44.080769 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e31c74b-51e6-4985-b42c-d98a1b568959 None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:48:44.081464 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e31c74b-51e6-4985-b42c-d98a1b568959 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:48:44.086669 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:48:44.089742 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e31c74b-51e6-4985-b42c-d98a1b568959 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:48:44.091208 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e31c74b-51e6-4985-b42c-d98a1b568959 None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:48:44.105160 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application [None req-0e31c74b-51e6-4985-b42c-d98a1b568959 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 15 17:48:44.105160 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 17:48:44.105160 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 17:48:44.105160 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 17:48:44.105160 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 17:48:44.105160 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 17:48:44.105160 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 17:48:44.105160 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 17:48:44.105160 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 17:48:44.105160 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 17:48:44.105160 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 17:48:44.105160 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 17:48:44.105160 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 15 17:48:44.105160 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 15 17:48:44.105160 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 15 17:48:44.106427 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 15 17:48:44.106427 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 17:48:44.106427 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 17:48:44.106427 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 17:48:44.106427 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 17:48:44.106427 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 17:48:44.106427 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 17:48:44.106427 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 17:48:44.106427 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application with Lock( Sep 15 17:48:44.106427 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 17:48:44.106427 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._enter() Sep 15 17:48:44.106427 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 17:48:44.106427 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 17:48:44.106427 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 17:48:44.106427 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.creator() Sep 15 17:48:44.106427 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 17:48:44.106427 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application created_value = creator( Sep 15 17:48:44.107324 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 15 17:48:44.107324 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 15 17:48:44.107324 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 15 17:48:44.107324 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 15 17:48:44.107324 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 15 17:48:44.107324 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 15 17:48:44.107324 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 15 17:48:44.107324 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Sep 15 17:48:44.107324 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 299/602] 10.222.0.25 () {56 vars in 1111 bytes} [Thu Sep 15 17:48:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 17:48:44.108259 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e31c74b-51e6-4985-b42c-d98a1b568959 None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:48:44.150410 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50709ac-d576-446b-9d43-7ff13c4d8110 None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:48:44.191791 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e82fb72-8636-4792-9244-8e2701a59bfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:48:44.192809 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e82fb72-8636-4792-9244-8e2701a59bfd None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:48:44.193374 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e82fb72-8636-4792-9244-8e2701a59bfd None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:48:44.193756 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e82fb72-8636-4792-9244-8e2701a59bfd None admin] PATH_INFO: `/v3/projects` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:48:44.194508 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e82fb72-8636-4792-9244-8e2701a59bfd None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81593) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 17:48:44.194815 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e82fb72-8636-4792-9244-8e2701a59bfd None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:48:44.196354 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e82fb72-8636-4792-9244-8e2701a59bfd None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:48:44.211060 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 304/603] 10.222.0.25 () {56 vars in 1148 bytes} [Thu Sep 15 17:48:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 17:48:44.211954 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e82fb72-8636-4792-9244-8e2701a59bfd None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:48:44.242367 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e31c74b-51e6-4985-b42c-d98a1b568959 None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:48:44.278986 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99921b07-abf7-478a-a9a7-89b5a86770b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:48:44.279616 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99921b07-abf7-478a-a9a7-89b5a86770b9 None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:48:44.279899 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99921b07-abf7-478a-a9a7-89b5a86770b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:48:44.280179 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99921b07-abf7-478a-a9a7-89b5a86770b9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:48:44.288323 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99921b07-abf7-478a-a9a7-89b5a86770b9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:48:44.289857 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99921b07-abf7-478a-a9a7-89b5a86770b9 None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:48:44.302319 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application [None req-99921b07-abf7-478a-a9a7-89b5a86770b9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 15 17:48:44.302319 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 17:48:44.302319 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 17:48:44.302319 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 17:48:44.302319 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 17:48:44.302319 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 17:48:44.302319 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 17:48:44.302319 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 17:48:44.302319 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 17:48:44.302319 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 17:48:44.302319 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 17:48:44.302319 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 17:48:44.302319 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 15 17:48:44.302319 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 15 17:48:44.302319 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 15 17:48:44.303311 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 15 17:48:44.303311 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 17:48:44.303311 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 17:48:44.303311 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 17:48:44.303311 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 17:48:44.303311 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 17:48:44.303311 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 17:48:44.303311 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 17:48:44.303311 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application with Lock( Sep 15 17:48:44.303311 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 17:48:44.303311 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._enter() Sep 15 17:48:44.303311 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 17:48:44.303311 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 17:48:44.303311 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 17:48:44.303311 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.creator() Sep 15 17:48:44.303311 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 17:48:44.303311 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application created_value = creator( Sep 15 17:48:44.304333 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 15 17:48:44.304333 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 15 17:48:44.304333 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 15 17:48:44.304333 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 15 17:48:44.304333 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 15 17:48:44.304333 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 15 17:48:44.304333 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 15 17:48:44.304333 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Sep 15 17:48:44.304333 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 300/604] 10.222.0.25 () {56 vars in 1111 bytes} [Thu Sep 15 17:48:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 17:48:44.304832 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99921b07-abf7-478a-a9a7-89b5a86770b9 None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:48:44.326496 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:48:44.337766 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e82fb72-8636-4792-9244-8e2701a59bfd None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:48:44.348190 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:48:44.381685 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c925b4b-8ad4-4675-8c4e-8b4bc2f7f16c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:48:44.382298 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c925b4b-8ad4-4675-8c4e-8b4bc2f7f16c None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:48:44.382594 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c925b4b-8ad4-4675-8c4e-8b4bc2f7f16c None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:48:44.382839 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c925b4b-8ad4-4675-8c4e-8b4bc2f7f16c None admin] PATH_INFO: `/v3/projects` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:48:44.383544 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c925b4b-8ad4-4675-8c4e-8b4bc2f7f16c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81593) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 17:48:44.383852 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c925b4b-8ad4-4675-8c4e-8b4bc2f7f16c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:48:44.385474 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c925b4b-8ad4-4675-8c4e-8b4bc2f7f16c None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:48:44.397844 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 305/605] 10.222.0.25 () {56 vars in 1148 bytes} [Thu Sep 15 17:48:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 17:48:44.399375 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c925b4b-8ad4-4675-8c4e-8b4bc2f7f16c None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:48:44.429791 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99921b07-abf7-478a-a9a7-89b5a86770b9 None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:48:44.464665 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8ae461-4d81-44e0-92cf-851c64729902 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:48:44.465323 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8ae461-4d81-44e0-92cf-851c64729902 None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:48:44.465674 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8ae461-4d81-44e0-92cf-851c64729902 None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:48:44.465947 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8ae461-4d81-44e0-92cf-851c64729902 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:48:44.477232 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca8ae461-4d81-44e0-92cf-851c64729902 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 17:48:44.482980 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application [None req-ca8ae461-4d81-44e0-92cf-851c64729902 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 15 17:48:44.482980 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 17:48:44.482980 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 17:48:44.482980 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 17:48:44.482980 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 17:48:44.482980 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 17:48:44.482980 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 17:48:44.482980 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 17:48:44.482980 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 17:48:44.482980 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 17:48:44.482980 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 17:48:44.482980 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 17:48:44.482980 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 17:48:44.482980 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 17:48:44.482980 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 17:48:44.482980 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 17:48:44.484094 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 17:48:44.484094 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 17:48:44.484094 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 17:48:44.484094 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 17:48:44.484094 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 17:48:44.484094 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 17:48:44.484094 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 17:48:44.484094 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 17:48:44.484094 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 17:48:44.484094 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 17:48:44.484094 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 17:48:44.484094 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application with Lock( Sep 15 17:48:44.484094 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 17:48:44.484094 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._enter() Sep 15 17:48:44.484094 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 17:48:44.484094 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 17:48:44.485120 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 17:48:44.485120 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.creator() Sep 15 17:48:44.485120 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 17:48:44.485120 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application created_value = creator( Sep 15 17:48:44.485120 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 17:48:44.485120 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 17:48:44.485120 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 17:48:44.485120 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 17:48:44.485120 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 17:48:44.485120 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 17:48:44.485120 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 15 17:48:44.485120 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Sep 15 17:48:44.485120 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 301/606] 10.222.0.25 () {56 vars in 1102 bytes} [Thu Sep 15 17:48:44 2022] GET /identity/v3/roles/service => generated 85 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 17:48:44.486002 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8ae461-4d81-44e0-92cf-851c64729902 None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:48:44.516159 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c925b4b-8ad4-4675-8c4e-8b4bc2f7f16c None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:48:44.551515 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def752d8-6ce7-46a1-a5ba-9947cdce5319 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:48:44.552176 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def752d8-6ce7-46a1-a5ba-9947cdce5319 None admin] REQUEST_METHOD: `PUT` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:48:44.552454 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def752d8-6ce7-46a1-a5ba-9947cdce5319 None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:48:44.552721 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def752d8-6ce7-46a1-a5ba-9947cdce5319 None admin] PATH_INFO: `/v3/projects/1213c0d1b584404ba3998e136f166e89/users/1b232e7a841145ba93c6d8462ccb751a/roles/17e337d9acf148e99d6c50170293fa05` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:48:44.570450 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def752d8-6ce7-46a1-a5ba-9947cdce5319 None admin] RBAC: Authorizing `identity:create_grant(project_id=1213c0d1b584404ba3998e136f166e89, user_id=1b232e7a841145ba93c6d8462ccb751a, role_id=17e337d9acf148e99d6c50170293fa05)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:48:44.572023 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def752d8-6ce7-46a1-a5ba-9947cdce5319 None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:48:44.579528 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:48:44.591193 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 306/607] 10.222.0.25 () {58 vars in 1439 bytes} [Thu Sep 15 17:48:44 2022] PUT /identity/v3/projects/1213c0d1b584404ba3998e136f166e89/users/1b232e7a841145ba93c6d8462ccb751a/roles/17e337d9acf148e99d6c50170293fa05 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 17:48:44.592446 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e82895-4904-4954-967f-268a0cbddcf9 None None] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:48:44.593356 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e82895-4904-4954-967f-268a0cbddcf9 None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:48:44.593356 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e82895-4904-4954-967f-268a0cbddcf9 None None] PATH_INFO: `/` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:48:44.597431 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 307/608] 10.222.0.25 () {54 vars in 927 bytes} [Thu Sep 15 17:48:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 17:48:44.597431 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e82895-4904-4954-967f-268a0cbddcf9 None None] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:48:44.620590 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8ae461-4d81-44e0-92cf-851c64729902 None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:48:44.622339 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:48:44.672987 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f4329f-86de-430e-8545-d2f97419419a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:48:44.673731 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f4329f-86de-430e-8545-d2f97419419a None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:48:44.674009 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f4329f-86de-430e-8545-d2f97419419a None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:48:44.674289 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f4329f-86de-430e-8545-d2f97419419a None admin] PATH_INFO: `/v3/projects` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:48:44.675146 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f4329f-86de-430e-8545-d2f97419419a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81592) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 17:48:44.675448 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f4329f-86de-430e-8545-d2f97419419a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:48:44.676916 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f4329f-86de-430e-8545-d2f97419419a None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:48:44.697239 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 302/609] 10.222.0.25 () {56 vars in 1148 bytes} [Thu Sep 15 17:48:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 17:48:44.697239 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f4329f-86de-430e-8545-d2f97419419a None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:48:44.758003 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e82895-4904-4954-967f-268a0cbddcf9 None None] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:48:44.810752 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a3ca25-ebdb-4754-b15e-3092cfbf2918 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:48:44.811346 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a3ca25-ebdb-4754-b15e-3092cfbf2918 None admin] REQUEST_METHOD: `PUT` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:48:44.811615 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a3ca25-ebdb-4754-b15e-3092cfbf2918 None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:48:44.811887 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a3ca25-ebdb-4754-b15e-3092cfbf2918 None admin] PATH_INFO: `/v3/projects/1213c0d1b584404ba3998e136f166e89/users/a32274b4781b40fea9f28da8a9bde5ca/roles/17e337d9acf148e99d6c50170293fa05` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:48:44.817437 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f4329f-86de-430e-8545-d2f97419419a None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:48:44.833697 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a3ca25-ebdb-4754-b15e-3092cfbf2918 None admin] RBAC: Authorizing `identity:create_grant(project_id=1213c0d1b584404ba3998e136f166e89, user_id=a32274b4781b40fea9f28da8a9bde5ca, role_id=17e337d9acf148e99d6c50170293fa05)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:48:44.835182 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a3ca25-ebdb-4754-b15e-3092cfbf2918 None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:48:44.855019 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 308/610] 10.222.0.25 () {58 vars in 1439 bytes} [Thu Sep 15 17:48:44 2022] PUT /identity/v3/projects/1213c0d1b584404ba3998e136f166e89/users/a32274b4781b40fea9f28da8a9bde5ca/roles/17e337d9acf148e99d6c50170293fa05 => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 17:48:44.857104 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1bf573-65e3-49fa-8953-f78df81d4601 None None] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:48:44.857628 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1bf573-65e3-49fa-8953-f78df81d4601 None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:48:44.858089 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1bf573-65e3-49fa-8953-f78df81d4601 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:48:44.871248 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302868dd-e070-41a3-94fd-7268ef8adc9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:48:44.872348 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302868dd-e070-41a3-94fd-7268ef8adc9d None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:48:44.873105 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302868dd-e070-41a3-94fd-7268ef8adc9d None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:48:44.873698 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302868dd-e070-41a3-94fd-7268ef8adc9d None admin] PATH_INFO: `/v3/roles` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:48:44.874624 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-302868dd-e070-41a3-94fd-7268ef8adc9d None admin] RBAC: Adding query filter params (name=service) {{(pid=81592) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 17:48:44.875236 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-302868dd-e070-41a3-94fd-7268ef8adc9d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:48:44.876905 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-302868dd-e070-41a3-94fd-7268ef8adc9d None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:48:44.879428 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:48:44.896196 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.auth.core [None req-5a1bf573-65e3-49fa-8953-f78df81d4601 None None] MFA Rules not processed for user `5cfa58ef86774ab7800bf91930bf6028`. Rule list: `[]` (Enabled: `True`). {{(pid=81593) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 17:48:44.896196 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-5a1bf573-65e3-49fa-8953-f78df81d4601 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 17:48:44.896710 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 303/611] 10.222.0.25 () {56 vars in 1103 bytes} [Thu Sep 15 17:48:44 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 17:48:44.897970 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302868dd-e070-41a3-94fd-7268ef8adc9d None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:48:45.002238 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:48:45.011336 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 309/612] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Sep 15 17:48:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 15 17:48:45.012732 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1bf573-65e3-49fa-8953-f78df81d4601 None None] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:48:45.033092 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302868dd-e070-41a3-94fd-7268ef8adc9d None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:48:45.079177 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d11774f-2834-4d41-9281-30d283fe1fe0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:48:45.080029 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d11774f-2834-4d41-9281-30d283fe1fe0 None admin] REQUEST_METHOD: `PUT` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:48:45.080497 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d11774f-2834-4d41-9281-30d283fe1fe0 None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:48:45.081024 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d11774f-2834-4d41-9281-30d283fe1fe0 None admin] PATH_INFO: `/v3/projects/1213c0d1b584404ba3998e136f166e89/users/c194f79928aa4a4d94619c417b4e39e9/roles/17e337d9acf148e99d6c50170293fa05` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:48:45.107752 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d11774f-2834-4d41-9281-30d283fe1fe0 None admin] RBAC: Authorizing `identity:create_grant(project_id=1213c0d1b584404ba3998e136f166e89, user_id=c194f79928aa4a4d94619c417b4e39e9, role_id=17e337d9acf148e99d6c50170293fa05)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:48:45.113319 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d11774f-2834-4d41-9281-30d283fe1fe0 None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:48:45.141482 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 304/613] 10.222.0.25 () {58 vars in 1439 bytes} [Thu Sep 15 17:48:44 2022] PUT /identity/v3/projects/1213c0d1b584404ba3998e136f166e89/users/c194f79928aa4a4d94619c417b4e39e9/roles/17e337d9acf148e99d6c50170293fa05 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 17:48:45.167965 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1bf573-65e3-49fa-8953-f78df81d4601 None None] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:48:45.226319 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4f3167-db8c-4b05-8f78-b9489eb24605 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:48:45.227791 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4f3167-db8c-4b05-8f78-b9489eb24605 None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:48:45.228403 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4f3167-db8c-4b05-8f78-b9489eb24605 None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:48:45.229123 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4f3167-db8c-4b05-8f78-b9489eb24605 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:48:45.244155 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4f3167-db8c-4b05-8f78-b9489eb24605 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:48:45.246084 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4f3167-db8c-4b05-8f78-b9489eb24605 None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:48:45.265760 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application [None req-fa4f3167-db8c-4b05-8f78-b9489eb24605 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 17:48:45.265760 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 17:48:45.265760 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 17:48:45.265760 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 17:48:45.265760 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 17:48:45.265760 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 17:48:45.265760 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 17:48:45.265760 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 17:48:45.265760 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 17:48:45.265760 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 17:48:45.265760 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 17:48:45.265760 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 17:48:45.265760 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 15 17:48:45.265760 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 15 17:48:45.265760 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 15 17:48:45.265760 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 15 17:48:45.266873 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 17:48:45.266873 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 17:48:45.266873 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 17:48:45.266873 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 17:48:45.266873 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 17:48:45.266873 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 17:48:45.266873 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 17:48:45.266873 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application with Lock( Sep 15 17:48:45.266873 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 17:48:45.266873 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._enter() Sep 15 17:48:45.266873 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 17:48:45.266873 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 17:48:45.266873 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 17:48:45.266873 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.creator() Sep 15 17:48:45.266873 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 17:48:45.266873 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application created_value = creator( Sep 15 17:48:45.266873 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 15 17:48:45.267780 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 15 17:48:45.267780 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 17:48:45.267780 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Sep 15 17:48:45.273558 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 310/614] 10.222.0.25 () {56 vars in 1108 bytes} [Thu Sep 15 17:48:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 17:48:45.277459 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d11774f-2834-4d41-9281-30d283fe1fe0 None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:48:45.343979 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4f3167-db8c-4b05-8f78-b9489eb24605 None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:48:45.358191 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:48:45.426822 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:48:45.459353 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d11774f-2834-4d41-9281-30d283fe1fe0 None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:48:45.518840 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4f3167-db8c-4b05-8f78-b9489eb24605 None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:48:45.521394 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6468529d-68a2-4543-912e-a5731f4250e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:48:45.522019 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6468529d-68a2-4543-912e-a5731f4250e5 None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:48:45.522310 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6468529d-68a2-4543-912e-a5731f4250e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:48:45.522577 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6468529d-68a2-4543-912e-a5731f4250e5 None admin] PATH_INFO: `/v3/domains` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:48:45.523236 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6468529d-68a2-4543-912e-a5731f4250e5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81592) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 17:48:45.523557 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6468529d-68a2-4543-912e-a5731f4250e5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:48:45.524923 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6468529d-68a2-4543-912e-a5731f4250e5 None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:48:45.553646 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 305/615] 10.222.0.25 () {56 vars in 1109 bytes} [Thu Sep 15 17:48:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 17:48:45.559804 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6468529d-68a2-4543-912e-a5731f4250e5 None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:48:45.599813 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003c5eaa-5bef-4668-822a-8c3b68c3f095 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:48:45.600367 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003c5eaa-5bef-4668-822a-8c3b68c3f095 None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:48:45.600670 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003c5eaa-5bef-4668-822a-8c3b68c3f095 None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:48:45.601201 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003c5eaa-5bef-4668-822a-8c3b68c3f095 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:48:45.622044 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-003c5eaa-5bef-4668-822a-8c3b68c3f095 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 17:48:45.627442 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application [None req-003c5eaa-5bef-4668-822a-8c3b68c3f095 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 15 17:48:45.627442 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 17:48:45.627442 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 17:48:45.627442 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 17:48:45.627442 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 17:48:45.627442 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 17:48:45.627442 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 17:48:45.627442 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 17:48:45.627442 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 17:48:45.627442 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 17:48:45.627442 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 17:48:45.627442 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 17:48:45.627442 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 17:48:45.627442 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 17:48:45.627442 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 17:48:45.627442 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 17:48:45.629484 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 17:48:45.629484 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 17:48:45.629484 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 17:48:45.629484 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 17:48:45.629484 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 17:48:45.629484 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 17:48:45.629484 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 17:48:45.629484 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 17:48:45.629484 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 17:48:45.629484 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 17:48:45.629484 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 17:48:45.629484 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application with Lock( Sep 15 17:48:45.629484 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 17:48:45.629484 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._enter() Sep 15 17:48:45.629484 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 17:48:45.629484 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 17:48:45.631385 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 17:48:45.631385 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.creator() Sep 15 17:48:45.631385 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 17:48:45.631385 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application created_value = creator( Sep 15 17:48:45.631385 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 17:48:45.631385 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 17:48:45.631385 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 17:48:45.631385 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 17:48:45.631385 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 17:48:45.631385 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 17:48:45.631385 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 15 17:48:45.631385 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Sep 15 17:48:45.631385 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 311/616] 10.222.0.25 () {56 vars in 1102 bytes} [Thu Sep 15 17:48:45 2022] GET /identity/v3/roles/service => generated 85 bytes in 287 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 17:48:45.635596 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003c5eaa-5bef-4668-822a-8c3b68c3f095 None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:48:45.777896 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003c5eaa-5bef-4668-822a-8c3b68c3f095 None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:48:45.794144 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6468529d-68a2-4543-912e-a5731f4250e5 None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:48:45.802379 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:48:45.804728 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:48:45.840612 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f4af65-9e9c-4f02-aff5-f3c454fb7067 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:48:45.842055 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f4af65-9e9c-4f02-aff5-f3c454fb7067 None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:48:45.842445 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f4af65-9e9c-4f02-aff5-f3c454fb7067 None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:48:45.843498 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f4af65-9e9c-4f02-aff5-f3c454fb7067 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:48:45.854682 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f4af65-9e9c-4f02-aff5-f3c454fb7067 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:48:45.854879 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5edcfc2c-5efb-4f18-8bc8-21167c6636ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:48:45.855525 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edcfc2c-5efb-4f18-8bc8-21167c6636ef None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:48:45.861019 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edcfc2c-5efb-4f18-8bc8-21167c6636ef None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:48:45.861019 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edcfc2c-5efb-4f18-8bc8-21167c6636ef None admin] PATH_INFO: `/v3/roles` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:48:45.861019 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5edcfc2c-5efb-4f18-8bc8-21167c6636ef None admin] RBAC: Adding query filter params (name=service) {{(pid=81593) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 17:48:45.861019 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5edcfc2c-5efb-4f18-8bc8-21167c6636ef None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:48:45.861019 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5edcfc2c-5efb-4f18-8bc8-21167c6636ef None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:48:45.862720 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f4af65-9e9c-4f02-aff5-f3c454fb7067 None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:48:45.881321 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 312/617] 10.222.0.25 () {56 vars in 1103 bytes} [Thu Sep 15 17:48:45 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 17:48:45.881321 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5edcfc2c-5efb-4f18-8bc8-21167c6636ef None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:48:45.886386 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application [None req-74f4af65-9e9c-4f02-aff5-f3c454fb7067 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 15 17:48:45.886386 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 17:48:45.886386 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 17:48:45.886386 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 17:48:45.886386 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 17:48:45.886386 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 17:48:45.886386 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 17:48:45.886386 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 17:48:45.886386 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 17:48:45.886386 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 17:48:45.886386 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 17:48:45.886386 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 17:48:45.886386 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 15 17:48:45.886386 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 15 17:48:45.886386 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 15 17:48:45.886386 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 15 17:48:45.887518 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 17:48:45.887518 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 17:48:45.887518 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 15 17:48:45.887518 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 15 17:48:45.887518 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 15 17:48:45.887518 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 15 17:48:45.887518 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 17:48:45.887518 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 17:48:45.887518 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 17:48:45.887518 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 17:48:45.887518 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 17:48:45.887518 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application with Lock( Sep 15 17:48:45.887518 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 17:48:45.887518 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._enter() Sep 15 17:48:45.887518 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 17:48:45.887518 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 17:48:45.887518 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 17:48:45.887518 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.creator() Sep 15 17:48:45.888729 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 17:48:45.888729 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application created_value = creator( Sep 15 17:48:45.888729 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 15 17:48:45.888729 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 15 17:48:45.888729 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 15 17:48:45.888729 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 15 17:48:45.888729 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 15 17:48:45.888729 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 15 17:48:45.888729 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 15 17:48:45.888729 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Sep 15 17:48:45.893246 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 306/618] 10.222.0.25 () {56 vars in 1093 bytes} [Thu Sep 15 17:48:45 2022] GET /identity/v3/users/nova => generated 82 bytes in 334 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 15 17:48:45.903187 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f4af65-9e9c-4f02-aff5-f3c454fb7067 None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:48:46.052730 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5edcfc2c-5efb-4f18-8bc8-21167c6636ef None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:48:46.095751 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef60f64-fa4b-4082-adcd-955491dc69ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:48:46.099851 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef60f64-fa4b-4082-adcd-955491dc69ec None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:48:46.100323 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef60f64-fa4b-4082-adcd-955491dc69ec None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:48:46.100740 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef60f64-fa4b-4082-adcd-955491dc69ec None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:48:46.124482 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef60f64-fa4b-4082-adcd-955491dc69ec None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:48:46.125655 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f4af65-9e9c-4f02-aff5-f3c454fb7067 None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:48:46.126895 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef60f64-fa4b-4082-adcd-955491dc69ec None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:48:46.160187 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application [None req-aef60f64-fa4b-4082-adcd-955491dc69ec None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 17:48:46.160187 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 17:48:46.160187 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 17:48:46.160187 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 17:48:46.160187 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 17:48:46.160187 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 17:48:46.160187 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 17:48:46.160187 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 17:48:46.160187 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 17:48:46.160187 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 17:48:46.160187 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 17:48:46.160187 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 17:48:46.160187 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 15 17:48:46.160187 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 15 17:48:46.160187 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 15 17:48:46.160187 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 15 17:48:46.161220 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 17:48:46.161220 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 17:48:46.161220 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 17:48:46.161220 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 17:48:46.161220 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 17:48:46.161220 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 17:48:46.161220 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 17:48:46.161220 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application with Lock( Sep 15 17:48:46.161220 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 17:48:46.161220 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._enter() Sep 15 17:48:46.161220 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 17:48:46.161220 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 17:48:46.161220 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 17:48:46.161220 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.creator() Sep 15 17:48:46.161220 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 17:48:46.161220 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application created_value = creator( Sep 15 17:48:46.161220 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 15 17:48:46.162188 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 15 17:48:46.162188 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 17:48:46.162188 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Sep 15 17:48:46.162188 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 313/619] 10.222.0.25 () {56 vars in 1108 bytes} [Thu Sep 15 17:48:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 287 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 17:48:46.168365 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef60f64-fa4b-4082-adcd-955491dc69ec None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:48:46.169882 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013cd8b6-ca6b-4acc-8444-23eeff6e6eda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:48:46.170515 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013cd8b6-ca6b-4acc-8444-23eeff6e6eda None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:48:46.170792 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013cd8b6-ca6b-4acc-8444-23eeff6e6eda None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:48:46.171064 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013cd8b6-ca6b-4acc-8444-23eeff6e6eda None admin] PATH_INFO: `/v3/users` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:48:46.171808 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-013cd8b6-ca6b-4acc-8444-23eeff6e6eda None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81592) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 17:48:46.172111 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-013cd8b6-ca6b-4acc-8444-23eeff6e6eda None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:48:46.176115 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-013cd8b6-ca6b-4acc-8444-23eeff6e6eda None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:48:46.214683 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 307/620] 10.222.0.25 () {56 vars in 1133 bytes} [Thu Sep 15 17:48:45 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 312 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 17:48:46.220161 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013cd8b6-ca6b-4acc-8444-23eeff6e6eda None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:48:46.231173 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:48:46.249340 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:48:46.396957 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef60f64-fa4b-4082-adcd-955491dc69ec None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:48:46.420047 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013cd8b6-ca6b-4acc-8444-23eeff6e6eda None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:48:46.479709 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86dd246d-9a89-4694-90c2-4da6d31fb4f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:48:46.480332 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86dd246d-9a89-4694-90c2-4da6d31fb4f8 None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:48:46.480613 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86dd246d-9a89-4694-90c2-4da6d31fb4f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:48:46.481145 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86dd246d-9a89-4694-90c2-4da6d31fb4f8 None admin] PATH_INFO: `/v3/domains` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:48:46.484361 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86dd246d-9a89-4694-90c2-4da6d31fb4f8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81593) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 17:48:46.484756 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86dd246d-9a89-4694-90c2-4da6d31fb4f8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:48:46.487365 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86dd246d-9a89-4694-90c2-4da6d31fb4f8 None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:48:46.503405 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 314/621] 10.222.0.25 () {56 vars in 1109 bytes} [Thu Sep 15 17:48:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 335 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 17:48:46.504805 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f99f539-05f3-43d8-bd42-f89e602b27c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:48:46.505461 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f99f539-05f3-43d8-bd42-f89e602b27c3 None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:48:46.505744 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f99f539-05f3-43d8-bd42-f89e602b27c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:48:46.506020 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f99f539-05f3-43d8-bd42-f89e602b27c3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:48:46.508510 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86dd246d-9a89-4694-90c2-4da6d31fb4f8 None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:48:46.630827 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f99f539-05f3-43d8-bd42-f89e602b27c3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:48:46.632467 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f99f539-05f3-43d8-bd42-f89e602b27c3 None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:48:46.662541 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:48:46.688954 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:48:46.717891 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86dd246d-9a89-4694-90c2-4da6d31fb4f8 None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:48:46.789984 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 308/622] 10.222.0.25 () {58 vars in 1282 bytes} [Thu Sep 15 17:48:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 570 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 15 17:48:46.794734 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983c62af-2e38-47eb-8f66-14b7ca70c664 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:48:46.795409 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983c62af-2e38-47eb-8f66-14b7ca70c664 None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:48:46.795718 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983c62af-2e38-47eb-8f66-14b7ca70c664 None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:48:46.795996 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983c62af-2e38-47eb-8f66-14b7ca70c664 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:48:46.798671 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f99f539-05f3-43d8-bd42-f89e602b27c3 None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:48:46.804369 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-983c62af-2e38-47eb-8f66-14b7ca70c664 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:48:46.806675 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-983c62af-2e38-47eb-8f66-14b7ca70c664 None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:48:46.823137 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application [None req-983c62af-2e38-47eb-8f66-14b7ca70c664 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 15 17:48:46.823137 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 17:48:46.823137 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 17:48:46.823137 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 17:48:46.823137 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 17:48:46.823137 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 17:48:46.823137 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 17:48:46.823137 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 17:48:46.823137 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 17:48:46.823137 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 17:48:46.823137 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 17:48:46.823137 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 17:48:46.823137 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 15 17:48:46.823137 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 15 17:48:46.823137 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 15 17:48:46.823137 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 15 17:48:46.824134 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 17:48:46.824134 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 17:48:46.824134 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 15 17:48:46.824134 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 15 17:48:46.824134 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 15 17:48:46.824134 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 15 17:48:46.824134 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 17:48:46.824134 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 17:48:46.824134 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 17:48:46.824134 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 17:48:46.824134 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 17:48:46.824134 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application with Lock( Sep 15 17:48:46.824134 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 17:48:46.824134 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._enter() Sep 15 17:48:46.824134 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 17:48:46.824134 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 17:48:46.824134 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 17:48:46.824134 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.creator() Sep 15 17:48:46.825086 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 17:48:46.825086 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application created_value = creator( Sep 15 17:48:46.825086 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 15 17:48:46.825086 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 15 17:48:46.825086 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 15 17:48:46.825086 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 15 17:48:46.825086 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 15 17:48:46.825086 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 15 17:48:46.825086 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 15 17:48:46.825086 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Sep 15 17:48:46.825672 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 315/623] 10.222.0.25 () {56 vars in 1096 bytes} [Thu Sep 15 17:48:46 2022] GET /identity/v3/users/swift => generated 83 bytes in 317 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 15 17:48:46.832931 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983c62af-2e38-47eb-8f66-14b7ca70c664 None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:48:47.000446 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f99f539-05f3-43d8-bd42-f89e602b27c3 None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:48:47.029901 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983c62af-2e38-47eb-8f66-14b7ca70c664 None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:48:47.050966 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:48:47.078208 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc62523e-3ad3-430a-b71b-2ea8f0cdeefa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:48:47.078850 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc62523e-3ad3-430a-b71b-2ea8f0cdeefa None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:48:47.079129 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc62523e-3ad3-430a-b71b-2ea8f0cdeefa None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:48:47.079405 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc62523e-3ad3-430a-b71b-2ea8f0cdeefa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:48:47.102070 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc62523e-3ad3-430a-b71b-2ea8f0cdeefa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:48:47.104080 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc62523e-3ad3-430a-b71b-2ea8f0cdeefa None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:48:47.109318 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b19209-23ca-405e-8320-db56c3420b82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:48:47.109987 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b19209-23ca-405e-8320-db56c3420b82 None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:48:47.110268 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b19209-23ca-405e-8320-db56c3420b82 None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:48:47.110538 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b19209-23ca-405e-8320-db56c3420b82 None admin] PATH_INFO: `/v3/users` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:48:47.111276 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b19209-23ca-405e-8320-db56c3420b82 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81593) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 17:48:47.111581 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b19209-23ca-405e-8320-db56c3420b82 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:48:47.113431 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b19209-23ca-405e-8320-db56c3420b82 None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:48:47.135374 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application [None req-cc62523e-3ad3-430a-b71b-2ea8f0cdeefa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 17:48:47.135374 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 17:48:47.135374 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 17:48:47.135374 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 17:48:47.135374 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 17:48:47.135374 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 17:48:47.135374 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 17:48:47.135374 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 17:48:47.135374 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 17:48:47.135374 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 17:48:47.135374 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 17:48:47.135374 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 17:48:47.135374 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 15 17:48:47.135374 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 15 17:48:47.135374 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 15 17:48:47.135374 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 15 17:48:47.136742 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 17:48:47.136742 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 17:48:47.136742 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 17:48:47.136742 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 17:48:47.136742 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 17:48:47.136742 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 17:48:47.136742 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 17:48:47.136742 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application with Lock( Sep 15 17:48:47.136742 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 17:48:47.136742 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._enter() Sep 15 17:48:47.136742 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 17:48:47.136742 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 17:48:47.136742 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 17:48:47.136742 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.creator() Sep 15 17:48:47.136742 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 17:48:47.136742 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application created_value = creator( Sep 15 17:48:47.136742 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 15 17:48:47.137672 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 15 17:48:47.137672 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 17:48:47.137672 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Sep 15 17:48:47.137672 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 309/624] 10.222.0.25 () {56 vars in 1108 bytes} [Thu Sep 15 17:48:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 339 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 17:48:47.142168 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc62523e-3ad3-430a-b71b-2ea8f0cdeefa None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:48:47.156085 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 316/625] 10.222.0.25 () {56 vars in 1135 bytes} [Thu Sep 15 17:48:46 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 324 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 17:48:47.157024 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b19209-23ca-405e-8320-db56c3420b82 None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:48:47.165883 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:48:47.348237 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b19209-23ca-405e-8320-db56c3420b82 None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:48:47.383551 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc62523e-3ad3-430a-b71b-2ea8f0cdeefa None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:48:47.389323 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df32f832-e1a6-4fe3-96fa-c90a208e6252 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:48:47.389323 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df32f832-e1a6-4fe3-96fa-c90a208e6252 None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:48:47.389323 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df32f832-e1a6-4fe3-96fa-c90a208e6252 None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:48:47.389323 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df32f832-e1a6-4fe3-96fa-c90a208e6252 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:48:47.399527 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df32f832-e1a6-4fe3-96fa-c90a208e6252 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:48:47.400061 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df32f832-e1a6-4fe3-96fa-c90a208e6252 None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:48:47.416158 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application [None req-df32f832-e1a6-4fe3-96fa-c90a208e6252 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 17:48:47.416158 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 17:48:47.416158 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 17:48:47.416158 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 17:48:47.416158 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 17:48:47.416158 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 17:48:47.416158 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 17:48:47.416158 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 17:48:47.416158 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 17:48:47.416158 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 17:48:47.416158 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 17:48:47.416158 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 17:48:47.416158 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 15 17:48:47.416158 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 15 17:48:47.416158 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 15 17:48:47.416158 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 15 17:48:47.417182 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 17:48:47.417182 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 17:48:47.417182 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 17:48:47.417182 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 17:48:47.417182 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 17:48:47.417182 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 17:48:47.417182 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 17:48:47.417182 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application with Lock( Sep 15 17:48:47.417182 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 17:48:47.417182 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._enter() Sep 15 17:48:47.417182 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 17:48:47.417182 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 17:48:47.417182 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 17:48:47.417182 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.creator() Sep 15 17:48:47.417182 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 17:48:47.417182 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application created_value = creator( Sep 15 17:48:47.417182 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 15 17:48:47.418185 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 15 17:48:47.418185 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 17:48:47.418185 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Sep 15 17:48:47.418185 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 317/626] 10.222.0.25 () {56 vars in 1108 bytes} [Thu Sep 15 17:48:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 261 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 17:48:47.423293 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df32f832-e1a6-4fe3-96fa-c90a208e6252 None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:48:47.452847 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86da8690-6ad9-43d5-8961-4f21231c443a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:48:47.453921 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86da8690-6ad9-43d5-8961-4f21231c443a None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:48:47.454404 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86da8690-6ad9-43d5-8961-4f21231c443a None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:48:47.455011 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86da8690-6ad9-43d5-8961-4f21231c443a None admin] PATH_INFO: `/v3/domains` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:48:47.456035 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86da8690-6ad9-43d5-8961-4f21231c443a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81592) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 17:48:47.456548 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86da8690-6ad9-43d5-8961-4f21231c443a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:48:47.458254 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86da8690-6ad9-43d5-8961-4f21231c443a None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:48:47.475166 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 310/627] 10.222.0.25 () {56 vars in 1109 bytes} [Thu Sep 15 17:48:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 333 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 17:48:47.477141 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b59a93-5156-4ba4-ba5d-594df3f04805 None None] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:48:47.477707 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b59a93-5156-4ba4-ba5d-594df3f04805 None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:48:47.478216 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b59a93-5156-4ba4-ba5d-594df3f04805 None None] PATH_INFO: `/` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:48:47.479769 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 311/628] 10.222.0.25 () {54 vars in 927 bytes} [Thu Sep 15 17:48:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 17:48:47.485497 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b59a93-5156-4ba4-ba5d-594df3f04805 None None] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:48:47.488033 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:48:47.540854 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df32f832-e1a6-4fe3-96fa-c90a208e6252 None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:48:47.546462 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:48:47.583418 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fcb3764-6d88-46a9-83ee-1badccff901a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:48:47.584409 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcb3764-6d88-46a9-83ee-1badccff901a None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:48:47.584930 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcb3764-6d88-46a9-83ee-1badccff901a None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:48:47.585697 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcb3764-6d88-46a9-83ee-1badccff901a None admin] PATH_INFO: `/v3/domains` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:48:47.587088 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fcb3764-6d88-46a9-83ee-1badccff901a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81593) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 17:48:47.588015 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fcb3764-6d88-46a9-83ee-1badccff901a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:48:47.590844 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fcb3764-6d88-46a9-83ee-1badccff901a None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:48:47.611492 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 318/629] 10.222.0.25 () {56 vars in 1109 bytes} [Thu Sep 15 17:48:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 17:48:47.614016 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e903c53f-8169-452e-baef-e09b9ab436c3 None None] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:48:47.614544 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e903c53f-8169-452e-baef-e09b9ab436c3 None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:48:47.615091 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e903c53f-8169-452e-baef-e09b9ab436c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:48:47.635833 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.auth.core [None req-e903c53f-8169-452e-baef-e09b9ab436c3 None None] MFA Rules not processed for user `5cfa58ef86774ab7800bf91930bf6028`. Rule list: `[]` (Enabled: `True`). {{(pid=81593) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 17:48:47.637624 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-e903c53f-8169-452e-baef-e09b9ab436c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 17:48:47.646495 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b59a93-5156-4ba4-ba5d-594df3f04805 None None] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:48:47.688732 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35be6cd-48ed-43ac-9864-c7b860ce5c75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:48:47.689598 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35be6cd-48ed-43ac-9864-c7b860ce5c75 None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:48:47.689885 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35be6cd-48ed-43ac-9864-c7b860ce5c75 None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:48:47.690221 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35be6cd-48ed-43ac-9864-c7b860ce5c75 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:48:47.698325 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e35be6cd-48ed-43ac-9864-c7b860ce5c75 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:48:47.699890 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e35be6cd-48ed-43ac-9864-c7b860ce5c75 None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:48:47.713610 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application [None req-e35be6cd-48ed-43ac-9864-c7b860ce5c75 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 15 17:48:47.713610 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 17:48:47.713610 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 17:48:47.713610 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 17:48:47.713610 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 17:48:47.713610 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 17:48:47.713610 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 17:48:47.713610 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 17:48:47.713610 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 17:48:47.713610 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 17:48:47.713610 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 17:48:47.713610 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 17:48:47.713610 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 15 17:48:47.713610 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 15 17:48:47.713610 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 15 17:48:47.714615 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 15 17:48:47.714615 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 17:48:47.714615 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 17:48:47.714615 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 17:48:47.714615 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 17:48:47.714615 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 17:48:47.714615 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 17:48:47.714615 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 17:48:47.714615 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application with Lock( Sep 15 17:48:47.714615 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 17:48:47.714615 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._enter() Sep 15 17:48:47.714615 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 17:48:47.714615 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 17:48:47.714615 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 17:48:47.714615 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.creator() Sep 15 17:48:47.714615 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 17:48:47.714615 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application created_value = creator( Sep 15 17:48:47.715496 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 15 17:48:47.715496 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 15 17:48:47.715496 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 15 17:48:47.715496 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 15 17:48:47.715496 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 15 17:48:47.715496 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 15 17:48:47.715496 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 15 17:48:47.715496 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Sep 15 17:48:47.715496 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 312/630] 10.222.0.25 () {56 vars in 1111 bytes} [Thu Sep 15 17:48:47 2022] GET /identity/v3/projects/service => generated 88 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 17:48:47.716444 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35be6cd-48ed-43ac-9864-c7b860ce5c75 None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:48:47.720350 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 319/631] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Sep 15 17:48:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 15 17:48:47.721759 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e903c53f-8169-452e-baef-e09b9ab436c3 None None] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:48:47.789697 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:48:47.841209 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e903c53f-8169-452e-baef-e09b9ab436c3 None None] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:48:47.849524 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:48:47.855973 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35be6cd-48ed-43ac-9864-c7b860ce5c75 None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:48:47.883024 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1127192-4e51-458f-bcc0-1db4fc44e17b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:48:47.884030 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1127192-4e51-458f-bcc0-1db4fc44e17b None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:48:47.884488 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1127192-4e51-458f-bcc0-1db4fc44e17b None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:48:47.885030 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1127192-4e51-458f-bcc0-1db4fc44e17b None admin] PATH_INFO: `/v3/projects` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:48:47.885763 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1127192-4e51-458f-bcc0-1db4fc44e17b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81593) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 17:48:47.886072 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1127192-4e51-458f-bcc0-1db4fc44e17b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:48:47.887524 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1127192-4e51-458f-bcc0-1db4fc44e17b None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:48:47.901111 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 320/632] 10.222.0.25 () {56 vars in 1148 bytes} [Thu Sep 15 17:48:47 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 17:48:47.901776 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45ed327-c52d-4834-8847-c241959c3bba None None] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:48:47.902150 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45ed327-c52d-4834-8847-c241959c3bba None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:48:47.902349 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45ed327-c52d-4834-8847-c241959c3bba None None] PATH_INFO: `/` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:48:47.907606 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 321/633] 10.222.0.25 () {54 vars in 927 bytes} [Thu Sep 15 17:48:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 17:48:47.907606 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2001b096-eb1e-4990-b987-20ca88706c8f None None] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:48:47.907606 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2001b096-eb1e-4990-b987-20ca88706c8f None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:48:47.907606 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2001b096-eb1e-4990-b987-20ca88706c8f None None] PATH_INFO: `/` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:48:47.907606 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 322/634] 10.222.0.25 () {54 vars in 927 bytes} [Thu Sep 15 17:48:47 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 17:48:47.907606 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2001b096-eb1e-4990-b987-20ca88706c8f None None] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:48:47.917283 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3911256-fc22-418c-8d7b-b3819d98d0c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:48:47.918057 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3911256-fc22-418c-8d7b-b3819d98d0c5 None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:48:47.918431 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3911256-fc22-418c-8d7b-b3819d98d0c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:48:47.918772 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3911256-fc22-418c-8d7b-b3819d98d0c5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:48:47.930415 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3911256-fc22-418c-8d7b-b3819d98d0c5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:48:47.932855 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3911256-fc22-418c-8d7b-b3819d98d0c5 None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:48:47.950297 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application [None req-a3911256-fc22-418c-8d7b-b3819d98d0c5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 15 17:48:47.950297 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 17:48:47.950297 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 17:48:47.950297 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 17:48:47.950297 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 17:48:47.950297 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 17:48:47.950297 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 17:48:47.950297 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 17:48:47.950297 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 17:48:47.950297 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 17:48:47.950297 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 17:48:47.950297 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 17:48:47.950297 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 15 17:48:47.950297 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 15 17:48:47.950297 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 15 17:48:47.951274 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 15 17:48:47.951274 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 17:48:47.951274 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 17:48:47.951274 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 17:48:47.951274 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 17:48:47.951274 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 17:48:47.951274 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 17:48:47.951274 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 17:48:47.951274 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application with Lock( Sep 15 17:48:47.951274 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 17:48:47.951274 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._enter() Sep 15 17:48:47.951274 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 17:48:47.951274 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 17:48:47.951274 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 17:48:47.951274 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.creator() Sep 15 17:48:47.951274 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 17:48:47.951274 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application created_value = creator( Sep 15 17:48:47.952168 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 15 17:48:47.952168 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 15 17:48:47.952168 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 15 17:48:47.952168 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 15 17:48:47.952168 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 15 17:48:47.952168 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 15 17:48:47.952168 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 15 17:48:47.952168 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Sep 15 17:48:47.956298 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 313/635] 10.222.0.25 () {56 vars in 1111 bytes} [Thu Sep 15 17:48:47 2022] GET /identity/v3/projects/service => generated 88 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 17:48:47.957456 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dccf617-fb56-4126-a545-7a10d02c63e5 None None] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:48:47.957751 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dccf617-fb56-4126-a545-7a10d02c63e5 None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:48:47.958027 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dccf617-fb56-4126-a545-7a10d02c63e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:48:47.978127 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.auth.core [None req-1dccf617-fb56-4126-a545-7a10d02c63e5 None None] MFA Rules not processed for user `5cfa58ef86774ab7800bf91930bf6028`. Rule list: `[]` (Enabled: `True`). {{(pid=81592) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 17:48:47.979336 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-1dccf617-fb56-4126-a545-7a10d02c63e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 17:48:48.029021 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2001b096-eb1e-4990-b987-20ca88706c8f None None] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:48:48.031576 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:48:48.051386 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 314/636] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Sep 15 17:48:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 15 17:48:48.052723 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b98430-c3a1-4c32-945b-b9a579fc5de0 None None] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:48:48.053409 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b98430-c3a1-4c32-945b-b9a579fc5de0 None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:48:48.053409 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b98430-c3a1-4c32-945b-b9a579fc5de0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:48:48.070486 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2960ea81-3c61-42bf-80ed-18ab38cce99e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:48:48.071100 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2960ea81-3c61-42bf-80ed-18ab38cce99e None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:48:48.071473 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2960ea81-3c61-42bf-80ed-18ab38cce99e None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:48:48.071707 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2960ea81-3c61-42bf-80ed-18ab38cce99e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:48:48.072484 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2960ea81-3c61-42bf-80ed-18ab38cce99e None admin] RBAC: Adding query filter params (role.id=17e337d9acf148e99d6c50170293fa05, scope.project.id=1213c0d1b584404ba3998e136f166e89, user.id=fe2244818e4d4dca9c424cd078653e6a) {{(pid=81593) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 17:48:48.072651 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.auth.core [None req-28b98430-c3a1-4c32-945b-b9a579fc5de0 None None] MFA Rules not processed for user `5cfa58ef86774ab7800bf91930bf6028`. Rule list: `[]` (Enabled: `True`). {{(pid=81592) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 17:48:48.072875 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2960ea81-3c61-42bf-80ed-18ab38cce99e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:48:48.074359 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2960ea81-3c61-42bf-80ed-18ab38cce99e None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:48:48.074618 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-28b98430-c3a1-4c32-945b-b9a579fc5de0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 17:48:48.085432 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 323/637] 10.222.0.25 () {56 vars in 1374 bytes} [Thu Sep 15 17:48:47 2022] GET /identity/v3/role_assignments?user.id=fe2244818e4d4dca9c424cd078653e6a&scope.project.id=1213c0d1b584404ba3998e136f166e89&role.id=17e337d9acf148e99d6c50170293fa05 => generated 608 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 17:48:48.085432 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2960ea81-3c61-42bf-80ed-18ab38cce99e None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:48:48.177882 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 315/638] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Sep 15 17:48:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 15 17:48:48.178929 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b98430-c3a1-4c32-945b-b9a579fc5de0 None None] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:48:48.224763 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:48:48.311166 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2960ea81-3c61-42bf-80ed-18ab38cce99e None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:48:48.353650 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2a7c07-f1d8-4c1f-9018-4b20fc689e86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:48:48.354389 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2a7c07-f1d8-4c1f-9018-4b20fc689e86 None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:48:48.354743 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2a7c07-f1d8-4c1f-9018-4b20fc689e86 None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:48:48.355078 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2a7c07-f1d8-4c1f-9018-4b20fc689e86 None admin] PATH_INFO: `/v3/projects` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:48:48.356128 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2a7c07-f1d8-4c1f-9018-4b20fc689e86 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81593) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 17:48:48.356511 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2a7c07-f1d8-4c1f-9018-4b20fc689e86 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:48:48.358102 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2a7c07-f1d8-4c1f-9018-4b20fc689e86 None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:48:48.373122 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 324/639] 10.222.0.25 () {56 vars in 1148 bytes} [Thu Sep 15 17:48:48 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 17:48:48.376673 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b98430-c3a1-4c32-945b-b9a579fc5de0 None None] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:48:48.379269 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2a7c07-f1d8-4c1f-9018-4b20fc689e86 None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:48:48.419017 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:48:48.437224 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb7749d-9974-488a-8906-5f9e05bd6584 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:48:48.438126 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb7749d-9974-488a-8906-5f9e05bd6584 None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:48:48.438126 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb7749d-9974-488a-8906-5f9e05bd6584 None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:48:48.438403 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb7749d-9974-488a-8906-5f9e05bd6584 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:48:48.451983 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb7749d-9974-488a-8906-5f9e05bd6584 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 17:48:48.459346 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application [None req-8fb7749d-9974-488a-8906-5f9e05bd6584 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 15 17:48:48.459346 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 17:48:48.459346 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 17:48:48.459346 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 17:48:48.459346 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 17:48:48.459346 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 17:48:48.459346 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 17:48:48.459346 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 17:48:48.459346 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 17:48:48.459346 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 17:48:48.459346 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 17:48:48.459346 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 17:48:48.459346 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 17:48:48.459346 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 17:48:48.459346 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 17:48:48.459346 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 17:48:48.460871 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 17:48:48.460871 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 17:48:48.460871 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 17:48:48.460871 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 17:48:48.460871 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 17:48:48.460871 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 17:48:48.460871 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 17:48:48.460871 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 17:48:48.460871 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 17:48:48.460871 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 17:48:48.460871 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 17:48:48.460871 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application with Lock( Sep 15 17:48:48.460871 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 17:48:48.460871 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._enter() Sep 15 17:48:48.460871 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 17:48:48.460871 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 17:48:48.461753 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 17:48:48.461753 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.creator() Sep 15 17:48:48.461753 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 17:48:48.461753 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application created_value = creator( Sep 15 17:48:48.461753 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 17:48:48.461753 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 17:48:48.461753 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 17:48:48.461753 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 17:48:48.461753 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 17:48:48.461753 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 17:48:48.461753 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 15 17:48:48.461753 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Sep 15 17:48:48.461753 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 316/640] 10.222.0.25 () {56 vars in 1102 bytes} [Thu Sep 15 17:48:48 2022] GET /identity/v3/roles/service => generated 85 bytes in 282 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 17:48:48.461753 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb7749d-9974-488a-8906-5f9e05bd6584 None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:48:48.523592 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2a7c07-f1d8-4c1f-9018-4b20fc689e86 None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:48:48.560313 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:48:48.562427 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80fd8a9f-49f7-4625-a6d8-b62503d6977f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:48:48.563097 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fd8a9f-49f7-4625-a6d8-b62503d6977f None admin] REQUEST_METHOD: `PUT` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:48:48.563395 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fd8a9f-49f7-4625-a6d8-b62503d6977f None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:48:48.563745 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fd8a9f-49f7-4625-a6d8-b62503d6977f None admin] PATH_INFO: `/v3/projects/1213c0d1b584404ba3998e136f166e89/users/685f7ad4c6fe4c878d542dddd6d81593/roles/17e337d9acf148e99d6c50170293fa05` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:48:48.583494 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80fd8a9f-49f7-4625-a6d8-b62503d6977f None admin] RBAC: Authorizing `identity:create_grant(project_id=1213c0d1b584404ba3998e136f166e89, user_id=685f7ad4c6fe4c878d542dddd6d81593, role_id=17e337d9acf148e99d6c50170293fa05)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:48:48.583494 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80fd8a9f-49f7-4625-a6d8-b62503d6977f None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:48:48.592750 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb7749d-9974-488a-8906-5f9e05bd6584 None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:48:48.596632 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 325/641] 10.222.0.25 () {58 vars in 1439 bytes} [Thu Sep 15 17:48:48 2022] PUT /identity/v3/projects/1213c0d1b584404ba3998e136f166e89/users/685f7ad4c6fe4c878d542dddd6d81593/roles/17e337d9acf148e99d6c50170293fa05 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 17:48:48.597431 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80fd8a9f-49f7-4625-a6d8-b62503d6977f None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:48:48.657245 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385655b8-9bb1-409a-b934-c36c9a76e267 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:48:48.657945 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385655b8-9bb1-409a-b934-c36c9a76e267 None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:48:48.658232 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385655b8-9bb1-409a-b934-c36c9a76e267 None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:48:48.658497 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385655b8-9bb1-409a-b934-c36c9a76e267 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:48:48.674709 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-385655b8-9bb1-409a-b934-c36c9a76e267 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 17:48:48.679838 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application [None req-385655b8-9bb1-409a-b934-c36c9a76e267 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 15 17:48:48.679838 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 17:48:48.679838 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 17:48:48.679838 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 17:48:48.679838 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 17:48:48.679838 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 17:48:48.679838 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 17:48:48.679838 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 17:48:48.679838 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 17:48:48.679838 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 17:48:48.679838 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 17:48:48.679838 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 17:48:48.679838 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 17:48:48.679838 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 17:48:48.679838 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 17:48:48.679838 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 17:48:48.680870 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 17:48:48.680870 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 17:48:48.680870 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 17:48:48.680870 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 17:48:48.680870 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 17:48:48.680870 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 17:48:48.680870 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 17:48:48.680870 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 17:48:48.680870 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 17:48:48.680870 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 17:48:48.680870 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 17:48:48.680870 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application with Lock( Sep 15 17:48:48.680870 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 17:48:48.680870 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._enter() Sep 15 17:48:48.680870 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 17:48:48.680870 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 17:48:48.682407 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 17:48:48.682407 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.creator() Sep 15 17:48:48.682407 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 17:48:48.682407 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application created_value = creator( Sep 15 17:48:48.682407 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 17:48:48.682407 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 17:48:48.682407 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 17:48:48.682407 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 17:48:48.682407 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 17:48:48.682407 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 17:48:48.682407 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 15 17:48:48.682407 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Sep 15 17:48:48.682407 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 317/642] 10.222.0.25 () {56 vars in 1102 bytes} [Thu Sep 15 17:48:48 2022] GET /identity/v3/roles/service => generated 85 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 17:48:48.682407 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385655b8-9bb1-409a-b934-c36c9a76e267 None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:48:48.739025 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:48:48.783217 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80fd8a9f-49f7-4625-a6d8-b62503d6977f None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:48:48.814011 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385655b8-9bb1-409a-b934-c36c9a76e267 None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:48:48.832976 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b35575-5dce-4bd0-a067-43dbe80de75b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:48:48.833638 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b35575-5dce-4bd0-a067-43dbe80de75b None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:48:48.833922 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b35575-5dce-4bd0-a067-43dbe80de75b None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:48:48.834194 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b35575-5dce-4bd0-a067-43dbe80de75b None admin] PATH_INFO: `/v3/roles` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:48:48.835365 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b35575-5dce-4bd0-a067-43dbe80de75b None admin] RBAC: Adding query filter params (name=service) {{(pid=81593) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 17:48:48.835672 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b35575-5dce-4bd0-a067-43dbe80de75b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:48:48.837231 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b35575-5dce-4bd0-a067-43dbe80de75b None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:48:48.848927 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 326/643] 10.222.0.25 () {56 vars in 1103 bytes} [Thu Sep 15 17:48:48 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 17:48:48.850200 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b35575-5dce-4bd0-a067-43dbe80de75b None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:48:48.865348 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464335a5-c00f-4445-a6c8-ec35d3b877b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:48:48.866283 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464335a5-c00f-4445-a6c8-ec35d3b877b6 None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:48:48.866721 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464335a5-c00f-4445-a6c8-ec35d3b877b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:48:48.867155 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464335a5-c00f-4445-a6c8-ec35d3b877b6 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:48:48.875178 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:48:48.895589 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464335a5-c00f-4445-a6c8-ec35d3b877b6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 17:48:48.908541 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application [None req-464335a5-c00f-4445-a6c8-ec35d3b877b6 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 15 17:48:48.908541 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 17:48:48.908541 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 17:48:48.908541 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 17:48:48.908541 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 17:48:48.908541 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 17:48:48.908541 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 17:48:48.908541 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 17:48:48.908541 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 17:48:48.908541 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 17:48:48.908541 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 17:48:48.908541 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 17:48:48.908541 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 17:48:48.908541 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 17:48:48.908541 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 17:48:48.908541 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 17:48:48.909714 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 17:48:48.909714 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 17:48:48.909714 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 17:48:48.909714 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 17:48:48.909714 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 17:48:48.909714 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 17:48:48.909714 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 17:48:48.909714 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 17:48:48.909714 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 17:48:48.909714 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 17:48:48.909714 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 17:48:48.909714 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application with Lock( Sep 15 17:48:48.909714 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 17:48:48.909714 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._enter() Sep 15 17:48:48.909714 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 17:48:48.909714 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 17:48:48.910571 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 17:48:48.910571 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.creator() Sep 15 17:48:48.910571 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 17:48:48.910571 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application created_value = creator( Sep 15 17:48:48.910571 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 17:48:48.910571 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 17:48:48.910571 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 17:48:48.910571 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 17:48:48.910571 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 17:48:48.910571 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 17:48:48.910571 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 15 17:48:48.910571 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Sep 15 17:48:48.911204 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 318/644] 10.222.0.25 () {56 vars in 1102 bytes} [Thu Sep 15 17:48:48 2022] GET /identity/v3/roles/service => generated 85 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 17:48:48.913227 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464335a5-c00f-4445-a6c8-ec35d3b877b6 None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:48:48.995669 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b35575-5dce-4bd0-a067-43dbe80de75b None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:48:49.038090 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75dfc656-cae1-4d26-96a6-5d16ab361b2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:48:49.038716 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75dfc656-cae1-4d26-96a6-5d16ab361b2a None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:48:49.038995 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75dfc656-cae1-4d26-96a6-5d16ab361b2a None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:48:49.039271 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75dfc656-cae1-4d26-96a6-5d16ab361b2a None admin] PATH_INFO: `/v3/roles` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:48:49.039944 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75dfc656-cae1-4d26-96a6-5d16ab361b2a None admin] RBAC: Adding query filter params (name=service) {{(pid=81593) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 17:48:49.040250 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75dfc656-cae1-4d26-96a6-5d16ab361b2a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:48:49.041701 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75dfc656-cae1-4d26-96a6-5d16ab361b2a None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:48:49.052830 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 327/645] 10.222.0.25 () {56 vars in 1103 bytes} [Thu Sep 15 17:48:48 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 17:48:49.053848 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75dfc656-cae1-4d26-96a6-5d16ab361b2a None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:48:49.060251 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:48:49.098343 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464335a5-c00f-4445-a6c8-ec35d3b877b6 None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:48:49.142682 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7c2470-44b9-4618-97f5-afb8cd4e71c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:48:49.143938 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7c2470-44b9-4618-97f5-afb8cd4e71c9 None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:48:49.144218 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7c2470-44b9-4618-97f5-afb8cd4e71c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:48:49.144546 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7c2470-44b9-4618-97f5-afb8cd4e71c9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:48:49.157084 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7c2470-44b9-4618-97f5-afb8cd4e71c9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:48:49.158909 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7c2470-44b9-4618-97f5-afb8cd4e71c9 None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:48:49.175652 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application [None req-0f7c2470-44b9-4618-97f5-afb8cd4e71c9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 17:48:49.175652 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 17:48:49.175652 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 17:48:49.175652 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 17:48:49.175652 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 17:48:49.175652 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 17:48:49.175652 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 17:48:49.175652 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 17:48:49.175652 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 17:48:49.175652 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 17:48:49.175652 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 17:48:49.175652 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 17:48:49.175652 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 15 17:48:49.175652 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 15 17:48:49.175652 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 15 17:48:49.175652 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 15 17:48:49.176790 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 17:48:49.176790 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 17:48:49.176790 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 17:48:49.176790 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 17:48:49.176790 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 17:48:49.176790 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 17:48:49.176790 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 17:48:49.176790 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application with Lock( Sep 15 17:48:49.176790 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 17:48:49.176790 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._enter() Sep 15 17:48:49.176790 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 17:48:49.176790 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 17:48:49.176790 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 17:48:49.176790 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.creator() Sep 15 17:48:49.176790 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 17:48:49.176790 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application created_value = creator( Sep 15 17:48:49.176790 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 15 17:48:49.177869 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 15 17:48:49.177869 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 17:48:49.177869 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Sep 15 17:48:49.177869 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 319/646] 10.222.0.25 () {56 vars in 1108 bytes} [Thu Sep 15 17:48:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 265 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 17:48:49.178531 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7c2470-44b9-4618-97f5-afb8cd4e71c9 None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:48:49.192882 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75dfc656-cae1-4d26-96a6-5d16ab361b2a None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:48:49.237388 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007392ff-02ed-4ad0-ba22-a891b0a02a2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:48:49.237976 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007392ff-02ed-4ad0-ba22-a891b0a02a2f None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:48:49.238258 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007392ff-02ed-4ad0-ba22-a891b0a02a2f None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:48:49.238529 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007392ff-02ed-4ad0-ba22-a891b0a02a2f None admin] PATH_INFO: `/v3/roles` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:48:49.239256 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007392ff-02ed-4ad0-ba22-a891b0a02a2f None admin] RBAC: Adding query filter params (name=service) {{(pid=81593) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 17:48:49.239620 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007392ff-02ed-4ad0-ba22-a891b0a02a2f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:48:49.241023 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007392ff-02ed-4ad0-ba22-a891b0a02a2f None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:48:49.256421 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 328/647] 10.222.0.25 () {56 vars in 1103 bytes} [Thu Sep 15 17:48:49 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 17:48:49.257371 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007392ff-02ed-4ad0-ba22-a891b0a02a2f None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:48:49.277727 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:48:49.326529 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7c2470-44b9-4618-97f5-afb8cd4e71c9 None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:48:49.351969 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:48:49.378252 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb07234e-ac65-4e56-8175-3f9b622a232d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:48:49.379255 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb07234e-ac65-4e56-8175-3f9b622a232d None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:48:49.379967 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb07234e-ac65-4e56-8175-3f9b622a232d None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:48:49.380432 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb07234e-ac65-4e56-8175-3f9b622a232d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:48:49.397819 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb07234e-ac65-4e56-8175-3f9b622a232d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:48:49.400694 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007392ff-02ed-4ad0-ba22-a891b0a02a2f None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:48:49.401242 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb07234e-ac65-4e56-8175-3f9b622a232d None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:48:49.424488 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application [None req-cb07234e-ac65-4e56-8175-3f9b622a232d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 17:48:49.424488 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 17:48:49.424488 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 17:48:49.424488 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 17:48:49.424488 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 17:48:49.424488 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 17:48:49.424488 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 17:48:49.424488 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 17:48:49.424488 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 17:48:49.424488 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 17:48:49.424488 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 17:48:49.424488 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 17:48:49.424488 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 15 17:48:49.424488 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 15 17:48:49.424488 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 15 17:48:49.424488 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 15 17:48:49.425614 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 17:48:49.425614 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 17:48:49.425614 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 17:48:49.425614 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 17:48:49.425614 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 17:48:49.425614 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 17:48:49.425614 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 17:48:49.425614 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application with Lock( Sep 15 17:48:49.425614 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 17:48:49.425614 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._enter() Sep 15 17:48:49.425614 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 17:48:49.425614 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 17:48:49.425614 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 17:48:49.425614 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.creator() Sep 15 17:48:49.425614 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 17:48:49.425614 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application created_value = creator( Sep 15 17:48:49.425614 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 15 17:48:49.426553 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 15 17:48:49.426553 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 17:48:49.426553 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Sep 15 17:48:49.433873 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 320/648] 10.222.0.25 () {56 vars in 1108 bytes} [Thu Sep 15 17:48:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 17:48:49.435138 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb07234e-ac65-4e56-8175-3f9b622a232d None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:48:49.449945 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8cecca-8f3c-4992-9ab0-8dceab97537c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:48:49.450489 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8cecca-8f3c-4992-9ab0-8dceab97537c None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:48:49.450899 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8cecca-8f3c-4992-9ab0-8dceab97537c None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:48:49.451315 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8cecca-8f3c-4992-9ab0-8dceab97537c None admin] PATH_INFO: `/v3/domains` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:48:49.452108 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd8cecca-8f3c-4992-9ab0-8dceab97537c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81593) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 17:48:49.452488 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd8cecca-8f3c-4992-9ab0-8dceab97537c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:48:49.454126 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd8cecca-8f3c-4992-9ab0-8dceab97537c None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:48:49.473474 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 329/649] 10.222.0.25 () {56 vars in 1109 bytes} [Thu Sep 15 17:48:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 17:48:49.475217 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8cecca-8f3c-4992-9ab0-8dceab97537c None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:48:49.599418 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb07234e-ac65-4e56-8175-3f9b622a232d None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:48:49.617733 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:48:49.619919 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8cecca-8f3c-4992-9ab0-8dceab97537c None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:48:49.642793 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6444f6-7cc0-4f04-a8e9-9c933814fe69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:48:49.643526 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6444f6-7cc0-4f04-a8e9-9c933814fe69 None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:48:49.643880 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6444f6-7cc0-4f04-a8e9-9c933814fe69 None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:48:49.644246 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6444f6-7cc0-4f04-a8e9-9c933814fe69 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:48:49.656048 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:48:49.660579 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e6444f6-7cc0-4f04-a8e9-9c933814fe69 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:48:49.664766 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e6444f6-7cc0-4f04-a8e9-9c933814fe69 None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:48:49.671344 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cee7273-b0a9-4d95-8af5-dc4e35aa277c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:48:49.672474 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cee7273-b0a9-4d95-8af5-dc4e35aa277c None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:48:49.672954 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cee7273-b0a9-4d95-8af5-dc4e35aa277c None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:48:49.673491 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cee7273-b0a9-4d95-8af5-dc4e35aa277c None admin] PATH_INFO: `/v3/domains` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:48:49.674907 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cee7273-b0a9-4d95-8af5-dc4e35aa277c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81593) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 17:48:49.675384 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cee7273-b0a9-4d95-8af5-dc4e35aa277c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:48:49.677600 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cee7273-b0a9-4d95-8af5-dc4e35aa277c None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:48:49.697068 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 330/650] 10.222.0.25 () {56 vars in 1109 bytes} [Thu Sep 15 17:48:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 17:48:49.698242 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cee7273-b0a9-4d95-8af5-dc4e35aa277c None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:48:49.699080 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application [None req-0e6444f6-7cc0-4f04-a8e9-9c933814fe69 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 17:48:49.699080 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 17:48:49.699080 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 17:48:49.699080 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 17:48:49.699080 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 17:48:49.699080 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 17:48:49.699080 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 17:48:49.699080 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 17:48:49.699080 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 17:48:49.699080 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 17:48:49.699080 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 17:48:49.699080 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 17:48:49.699080 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 15 17:48:49.699080 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 15 17:48:49.699080 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 15 17:48:49.699080 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 15 17:48:49.699991 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 17:48:49.699991 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 17:48:49.699991 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 17:48:49.699991 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 17:48:49.699991 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 17:48:49.699991 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 17:48:49.699991 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 17:48:49.699991 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application with Lock( Sep 15 17:48:49.699991 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 17:48:49.699991 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._enter() Sep 15 17:48:49.699991 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 17:48:49.699991 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 17:48:49.699991 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 17:48:49.699991 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.creator() Sep 15 17:48:49.699991 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 17:48:49.699991 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application created_value = creator( Sep 15 17:48:49.699991 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 15 17:48:49.700868 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 15 17:48:49.700868 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 17:48:49.700868 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Sep 15 17:48:49.705022 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 321/651] 10.222.0.25 () {56 vars in 1108 bytes} [Thu Sep 15 17:48:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 266 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 17:48:49.706578 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6444f6-7cc0-4f04-a8e9-9c933814fe69 None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:48:49.831197 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cee7273-b0a9-4d95-8af5-dc4e35aa277c None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:48:49.839416 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6444f6-7cc0-4f04-a8e9-9c933814fe69 None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:48:49.878589 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19eafaa-32d4-4411-814f-527d519a7878 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:48:49.879230 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19eafaa-32d4-4411-814f-527d519a7878 None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:48:49.879584 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19eafaa-32d4-4411-814f-527d519a7878 None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:48:49.880006 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19eafaa-32d4-4411-814f-527d519a7878 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:48:49.888663 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e19eafaa-32d4-4411-814f-527d519a7878 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:48:49.890592 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e19eafaa-32d4-4411-814f-527d519a7878 None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:48:49.891408 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95ead17-8355-49e0-ab22-8496b9169097 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:48:49.892386 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95ead17-8355-49e0-ab22-8496b9169097 None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:48:49.893704 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95ead17-8355-49e0-ab22-8496b9169097 None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:48:49.894817 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95ead17-8355-49e0-ab22-8496b9169097 None admin] PATH_INFO: `/v3/users/glance` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:48:49.903645 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95ead17-8355-49e0-ab22-8496b9169097 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:48:49.903878 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application [None req-e19eafaa-32d4-4411-814f-527d519a7878 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 15 17:48:49.903878 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 17:48:49.903878 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 17:48:49.903878 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 17:48:49.903878 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 17:48:49.903878 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 17:48:49.903878 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 17:48:49.903878 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 17:48:49.903878 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 17:48:49.903878 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 17:48:49.903878 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 17:48:49.903878 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 17:48:49.903878 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 15 17:48:49.903878 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 15 17:48:49.903878 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 15 17:48:49.903878 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 15 17:48:49.904787 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 17:48:49.904787 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 17:48:49.904787 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 15 17:48:49.904787 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 15 17:48:49.904787 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 15 17:48:49.904787 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 15 17:48:49.904787 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 17:48:49.904787 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 17:48:49.904787 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 17:48:49.904787 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 17:48:49.904787 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 17:48:49.904787 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application with Lock( Sep 15 17:48:49.904787 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 17:48:49.904787 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._enter() Sep 15 17:48:49.904787 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 17:48:49.904787 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 17:48:49.904787 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 17:48:49.904787 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.creator() Sep 15 17:48:49.905745 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 17:48:49.905745 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application created_value = creator( Sep 15 17:48:49.905745 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 15 17:48:49.905745 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 15 17:48:49.905745 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 15 17:48:49.905745 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 15 17:48:49.905745 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 15 17:48:49.905745 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 15 17:48:49.905745 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 15 17:48:49.905745 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Sep 15 17:48:49.905745 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 331/652] 10.222.0.25 () {56 vars in 1099 bytes} [Thu Sep 15 17:48:49 2022] GET /identity/v3/users/cinder => generated 84 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 17:48:49.906415 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19eafaa-32d4-4411-814f-527d519a7878 None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:48:49.908779 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95ead17-8355-49e0-ab22-8496b9169097 None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:48:49.931189 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application [None req-f95ead17-8355-49e0-ab22-8496b9169097 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Sep 15 17:48:49.931189 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 17:48:49.931189 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 17:48:49.931189 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 17:48:49.931189 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 17:48:49.931189 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 17:48:49.931189 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 17:48:49.931189 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 17:48:49.931189 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 17:48:49.931189 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 17:48:49.931189 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 17:48:49.931189 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 17:48:49.931189 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 15 17:48:49.931189 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 15 17:48:49.931189 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 15 17:48:49.931189 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 15 17:48:49.932332 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 17:48:49.932332 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 17:48:49.932332 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 15 17:48:49.932332 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 15 17:48:49.932332 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 15 17:48:49.932332 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 15 17:48:49.932332 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 17:48:49.932332 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 17:48:49.932332 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 17:48:49.932332 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 17:48:49.932332 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 17:48:49.932332 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application with Lock( Sep 15 17:48:49.932332 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 17:48:49.932332 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._enter() Sep 15 17:48:49.932332 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 17:48:49.932332 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 17:48:49.932332 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 17:48:49.932332 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.creator() Sep 15 17:48:49.933437 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 17:48:49.933437 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application created_value = creator( Sep 15 17:48:49.933437 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 15 17:48:49.933437 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 15 17:48:49.933437 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 15 17:48:49.933437 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 15 17:48:49.933437 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 15 17:48:49.933437 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 15 17:48:49.933437 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Sep 15 17:48:49.933437 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Sep 15 17:48:49.939914 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 322/653] 10.222.0.25 () {56 vars in 1099 bytes} [Thu Sep 15 17:48:49 2022] GET /identity/v3/users/glance => generated 84 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 17:48:49.939914 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95ead17-8355-49e0-ab22-8496b9169097 None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:48:49.968466 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:48:49.978595 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:48:50.050288 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19eafaa-32d4-4411-814f-527d519a7878 None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:48:50.087104 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95ead17-8355-49e0-ab22-8496b9169097 None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:48:50.091178 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28592384-4a5f-4bbf-a388-c09071b75acc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:48:50.092056 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28592384-4a5f-4bbf-a388-c09071b75acc None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:48:50.092549 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28592384-4a5f-4bbf-a388-c09071b75acc None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:48:50.093029 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28592384-4a5f-4bbf-a388-c09071b75acc None admin] PATH_INFO: `/v3/domains` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:48:50.093908 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28592384-4a5f-4bbf-a388-c09071b75acc None admin] RBAC: Adding query filter params (name=Default) {{(pid=81593) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 17:48:50.094410 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28592384-4a5f-4bbf-a388-c09071b75acc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:48:50.096011 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28592384-4a5f-4bbf-a388-c09071b75acc None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:48:50.115632 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 332/654] 10.222.0.25 () {56 vars in 1109 bytes} [Thu Sep 15 17:48:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 17:48:50.117474 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28592384-4a5f-4bbf-a388-c09071b75acc None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:48:50.133962 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a5d50a-6804-4248-bff0-d64acb3320c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:48:50.134489 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a5d50a-6804-4248-bff0-d64acb3320c8 None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:48:50.134772 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a5d50a-6804-4248-bff0-d64acb3320c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:48:50.135047 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a5d50a-6804-4248-bff0-d64acb3320c8 None admin] PATH_INFO: `/v3/users` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:48:50.135928 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a5d50a-6804-4248-bff0-d64acb3320c8 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81592) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 17:48:50.136346 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a5d50a-6804-4248-bff0-d64acb3320c8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:48:50.137999 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a5d50a-6804-4248-bff0-d64acb3320c8 None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:48:50.161716 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 323/655] 10.222.0.25 () {56 vars in 1137 bytes} [Thu Sep 15 17:48:49 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 17:48:50.162790 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a5d50a-6804-4248-bff0-d64acb3320c8 None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:48:50.251703 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28592384-4a5f-4bbf-a388-c09071b75acc None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:48:50.257061 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:48:50.258648 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:48:50.303915 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a5d50a-6804-4248-bff0-d64acb3320c8 None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:48:50.309411 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22942c4f-ba96-4d82-a548-10cb54ea635c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:48:50.310096 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22942c4f-ba96-4d82-a548-10cb54ea635c None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:48:50.310379 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22942c4f-ba96-4d82-a548-10cb54ea635c None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:48:50.310651 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22942c4f-ba96-4d82-a548-10cb54ea635c None admin] PATH_INFO: `/v3/users` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:48:50.311393 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22942c4f-ba96-4d82-a548-10cb54ea635c None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81593) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 17:48:50.311696 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22942c4f-ba96-4d82-a548-10cb54ea635c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:48:50.313146 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22942c4f-ba96-4d82-a548-10cb54ea635c None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:48:50.343397 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 333/656] 10.222.0.25 () {56 vars in 1137 bytes} [Thu Sep 15 17:48:50 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 17:48:50.343397 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22942c4f-ba96-4d82-a548-10cb54ea635c None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:48:50.356598 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905e11dc-0b84-4ae3-98d4-ec1736e0a447 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:48:50.357757 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905e11dc-0b84-4ae3-98d4-ec1736e0a447 None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:48:50.358069 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905e11dc-0b84-4ae3-98d4-ec1736e0a447 None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:48:50.358314 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905e11dc-0b84-4ae3-98d4-ec1736e0a447 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:48:50.367756 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905e11dc-0b84-4ae3-98d4-ec1736e0a447 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:48:50.369235 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905e11dc-0b84-4ae3-98d4-ec1736e0a447 None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:48:50.390427 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application [None req-905e11dc-0b84-4ae3-98d4-ec1736e0a447 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Sep 15 17:48:50.390427 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 17:48:50.390427 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 17:48:50.390427 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 17:48:50.390427 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 17:48:50.390427 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 17:48:50.390427 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 17:48:50.390427 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 17:48:50.390427 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 17:48:50.390427 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 17:48:50.390427 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 17:48:50.390427 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 17:48:50.390427 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 15 17:48:50.390427 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 15 17:48:50.390427 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 15 17:48:50.390427 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 15 17:48:50.391828 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 17:48:50.391828 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 17:48:50.391828 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 15 17:48:50.391828 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 15 17:48:50.391828 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 15 17:48:50.391828 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 15 17:48:50.391828 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 17:48:50.391828 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 17:48:50.391828 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 17:48:50.391828 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 17:48:50.391828 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 17:48:50.391828 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application with Lock( Sep 15 17:48:50.391828 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 17:48:50.391828 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._enter() Sep 15 17:48:50.391828 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 17:48:50.391828 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 17:48:50.391828 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 17:48:50.391828 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.creator() Sep 15 17:48:50.392970 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 17:48:50.392970 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application created_value = creator( Sep 15 17:48:50.392970 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 15 17:48:50.392970 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 15 17:48:50.392970 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 15 17:48:50.392970 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 15 17:48:50.392970 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 15 17:48:50.392970 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 15 17:48:50.392970 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Sep 15 17:48:50.392970 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Sep 15 17:48:50.395841 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 324/657] 10.222.0.25 () {56 vars in 1102 bytes} [Thu Sep 15 17:48:50 2022] GET /identity/v3/users/neutron => generated 85 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 17:48:50.396834 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905e11dc-0b84-4ae3-98d4-ec1736e0a447 None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:48:50.515979 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22942c4f-ba96-4d82-a548-10cb54ea635c None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:48:50.541162 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905e11dc-0b84-4ae3-98d4-ec1736e0a447 None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:48:50.560907 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d544e3-3749-480a-90d6-2225ea8d4708 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:48:50.562068 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d544e3-3749-480a-90d6-2225ea8d4708 None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:48:50.562688 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d544e3-3749-480a-90d6-2225ea8d4708 None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:48:50.563170 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d544e3-3749-480a-90d6-2225ea8d4708 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:48:50.581468 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:48:50.590502 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ad1b2c-a094-43b0-b803-891633c62e9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:48:50.591126 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ad1b2c-a094-43b0-b803-891633c62e9c None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:48:50.591407 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ad1b2c-a094-43b0-b803-891633c62e9c None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:48:50.591682 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ad1b2c-a094-43b0-b803-891633c62e9c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:48:50.604487 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:48:50.652096 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d544e3-3749-480a-90d6-2225ea8d4708 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:48:50.653976 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d544e3-3749-480a-90d6-2225ea8d4708 None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:48:50.682110 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ad1b2c-a094-43b0-b803-891633c62e9c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:48:50.683585 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ad1b2c-a094-43b0-b803-891633c62e9c None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:48:50.773864 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 334/658] 10.222.0.25 () {58 vars in 1282 bytes} [Thu Sep 15 17:48:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 434 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 15 17:48:50.774632 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d544e3-3749-480a-90d6-2225ea8d4708 None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:48:50.796256 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 325/659] 10.222.0.25 () {58 vars in 1282 bytes} [Thu Sep 15 17:48:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 400 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 15 17:48:50.801961 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ccb86b-cf1d-4f2e-aa9d-6e9e58279896 None None] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:48:50.802254 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ccb86b-cf1d-4f2e-aa9d-6e9e58279896 None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:48:50.802529 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ccb86b-cf1d-4f2e-aa9d-6e9e58279896 None None] PATH_INFO: `/` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:48:50.804001 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 326/660] 10.222.0.25 () {54 vars in 927 bytes} [Thu Sep 15 17:48:50 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 17:48:50.805124 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ccb86b-cf1d-4f2e-aa9d-6e9e58279896 None None] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:48:50.842192 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:48:50.852797 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:48:50.896590 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d544e3-3749-480a-90d6-2225ea8d4708 None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:48:50.936090 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ccb86b-cf1d-4f2e-aa9d-6e9e58279896 None None] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:48:50.951252 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7bde9fa-202b-4608-a760-95fc1f66da4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:48:50.951881 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bde9fa-202b-4608-a760-95fc1f66da4c None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:48:50.952276 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bde9fa-202b-4608-a760-95fc1f66da4c None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:48:50.952545 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bde9fa-202b-4608-a760-95fc1f66da4c None admin] PATH_INFO: `/v3/users` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:48:50.953281 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7bde9fa-202b-4608-a760-95fc1f66da4c None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81593) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 17:48:50.953621 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7bde9fa-202b-4608-a760-95fc1f66da4c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:48:50.955067 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7bde9fa-202b-4608-a760-95fc1f66da4c None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:48:50.973503 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 335/661] 10.222.0.25 () {56 vars in 1139 bytes} [Thu Sep 15 17:48:50 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 17:48:50.974347 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7bde9fa-202b-4608-a760-95fc1f66da4c None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:48:50.981194 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30e0faf-d2b6-47a5-a187-ccfe2704cfae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:48:50.981891 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30e0faf-d2b6-47a5-a187-ccfe2704cfae None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:48:50.982169 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30e0faf-d2b6-47a5-a187-ccfe2704cfae None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:48:50.982438 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30e0faf-d2b6-47a5-a187-ccfe2704cfae None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:48:50.993110 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30e0faf-d2b6-47a5-a187-ccfe2704cfae None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:48:50.994597 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30e0faf-d2b6-47a5-a187-ccfe2704cfae None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:48:51.009771 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application [None req-c30e0faf-d2b6-47a5-a187-ccfe2704cfae None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 17:48:51.009771 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 17:48:51.009771 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 17:48:51.009771 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 17:48:51.009771 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 17:48:51.009771 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 17:48:51.009771 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 17:48:51.009771 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 17:48:51.009771 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 17:48:51.009771 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 17:48:51.009771 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 17:48:51.009771 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 17:48:51.009771 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 15 17:48:51.009771 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 15 17:48:51.009771 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 15 17:48:51.009771 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 15 17:48:51.010823 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 17:48:51.010823 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 17:48:51.010823 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 17:48:51.010823 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 17:48:51.010823 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 17:48:51.010823 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 17:48:51.010823 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 17:48:51.010823 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application with Lock( Sep 15 17:48:51.010823 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 17:48:51.010823 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._enter() Sep 15 17:48:51.010823 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 17:48:51.010823 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 17:48:51.010823 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 17:48:51.010823 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.creator() Sep 15 17:48:51.010823 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 17:48:51.010823 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application created_value = creator( Sep 15 17:48:51.010823 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 15 17:48:51.015860 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 15 17:48:51.015860 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 17:48:51.015860 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Sep 15 17:48:51.015860 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 327/662] 10.222.0.25 () {56 vars in 1108 bytes} [Thu Sep 15 17:48:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 17:48:51.015860 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4564505-eaa6-4020-b21f-f131a33a767e None None] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:48:51.015860 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4564505-eaa6-4020-b21f-f131a33a767e None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:48:51.015860 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4564505-eaa6-4020-b21f-f131a33a767e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:48:51.031336 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.auth.core [None req-d4564505-eaa6-4020-b21f-f131a33a767e None None] MFA Rules not processed for user `5cfa58ef86774ab7800bf91930bf6028`. Rule list: `[]` (Enabled: `True`). {{(pid=81592) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 17:48:51.032564 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-d4564505-eaa6-4020-b21f-f131a33a767e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 17:48:51.082273 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7bde9fa-202b-4608-a760-95fc1f66da4c None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:48:51.102072 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 328/663] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Sep 15 17:48:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 15 17:48:51.102828 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:48:51.103352 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4564505-eaa6-4020-b21f-f131a33a767e None None] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:48:51.118520 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:48:51.129866 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02052054-9462-4e8c-a072-4d352df9647d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:48:51.130660 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02052054-9462-4e8c-a072-4d352df9647d None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:48:51.130939 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02052054-9462-4e8c-a072-4d352df9647d None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:48:51.131211 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02052054-9462-4e8c-a072-4d352df9647d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:48:51.145005 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02052054-9462-4e8c-a072-4d352df9647d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:48:51.146495 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02052054-9462-4e8c-a072-4d352df9647d None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:48:51.162320 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application [None req-02052054-9462-4e8c-a072-4d352df9647d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 17:48:51.162320 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 17:48:51.162320 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 17:48:51.162320 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 17:48:51.162320 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 17:48:51.162320 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 17:48:51.162320 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 17:48:51.162320 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 17:48:51.162320 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 17:48:51.162320 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 17:48:51.162320 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 17:48:51.162320 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 17:48:51.162320 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 15 17:48:51.162320 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 15 17:48:51.162320 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 15 17:48:51.162320 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 15 17:48:51.163673 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 17:48:51.163673 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 17:48:51.163673 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 17:48:51.163673 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 17:48:51.163673 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 17:48:51.163673 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 17:48:51.163673 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 17:48:51.163673 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application with Lock( Sep 15 17:48:51.163673 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 17:48:51.163673 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._enter() Sep 15 17:48:51.163673 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 17:48:51.163673 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 17:48:51.163673 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 17:48:51.163673 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.creator() Sep 15 17:48:51.163673 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 17:48:51.163673 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application created_value = creator( Sep 15 17:48:51.163673 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 15 17:48:51.164739 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 15 17:48:51.164739 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 17:48:51.164739 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Sep 15 17:48:51.164739 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 336/664] 10.222.0.25 () {56 vars in 1108 bytes} [Thu Sep 15 17:48:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 17:48:51.164976 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ae8dfd-225e-480e-a6d9-f8ef7efc8634 None None] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:48:51.165706 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ae8dfd-225e-480e-a6d9-f8ef7efc8634 None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:48:51.165706 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ae8dfd-225e-480e-a6d9-f8ef7efc8634 None None] PATH_INFO: `/` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:48:51.168452 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 337/665] 10.222.0.25 () {54 vars in 927 bytes} [Thu Sep 15 17:48:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 17:48:51.169515 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ae8dfd-225e-480e-a6d9-f8ef7efc8634 None None] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:48:51.219910 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4564505-eaa6-4020-b21f-f131a33a767e None None] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:48:51.260982 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b502ff-b07a-4ac0-81cf-dede6d04872d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:48:51.261733 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b502ff-b07a-4ac0-81cf-dede6d04872d None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:48:51.262116 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b502ff-b07a-4ac0-81cf-dede6d04872d None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:48:51.262476 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b502ff-b07a-4ac0-81cf-dede6d04872d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:48:51.284139 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ae8dfd-225e-480e-a6d9-f8ef7efc8634 None None] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:48:51.322466 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2817b7fd-91f1-4b4e-81eb-2290ba0d1ef6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:48:51.323078 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2817b7fd-91f1-4b4e-81eb-2290ba0d1ef6 None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:48:51.323391 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2817b7fd-91f1-4b4e-81eb-2290ba0d1ef6 None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:48:51.323664 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2817b7fd-91f1-4b4e-81eb-2290ba0d1ef6 None admin] PATH_INFO: `/v3/domains` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:48:51.324311 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2817b7fd-91f1-4b4e-81eb-2290ba0d1ef6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81593) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 17:48:51.324610 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2817b7fd-91f1-4b4e-81eb-2290ba0d1ef6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:48:51.326260 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2817b7fd-91f1-4b4e-81eb-2290ba0d1ef6 None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:48:51.336620 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b502ff-b07a-4ac0-81cf-dede6d04872d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:48:51.338120 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b502ff-b07a-4ac0-81cf-dede6d04872d None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:48:51.343222 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 338/666] 10.222.0.25 () {56 vars in 1109 bytes} [Thu Sep 15 17:48:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 17:48:51.343222 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2817b7fd-91f1-4b4e-81eb-2290ba0d1ef6 None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:48:51.363360 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:48:51.376517 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:48:51.454536 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2817b7fd-91f1-4b4e-81eb-2290ba0d1ef6 None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:48:51.463771 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 329/667] 10.222.0.25 () {58 vars in 1282 bytes} [Thu Sep 15 17:48:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 361 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 15 17:48:51.465033 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7aea8a-4bcd-4e6b-9733-b4886bb1e161 None None] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:48:51.465758 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7aea8a-4bcd-4e6b-9733-b4886bb1e161 None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:48:51.465758 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7aea8a-4bcd-4e6b-9733-b4886bb1e161 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:48:51.483383 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.auth.core [None req-4b7aea8a-4bcd-4e6b-9733-b4886bb1e161 None None] MFA Rules not processed for user `5cfa58ef86774ab7800bf91930bf6028`. Rule list: `[]` (Enabled: `True`). {{(pid=81592) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 17:48:51.484502 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-4b7aea8a-4bcd-4e6b-9733-b4886bb1e161 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 17:48:51.490681 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9133e5b8-8f70-46c0-8c0b-57828c0e4ddf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:48:51.491483 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9133e5b8-8f70-46c0-8c0b-57828c0e4ddf None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:48:51.491801 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9133e5b8-8f70-46c0-8c0b-57828c0e4ddf None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:48:51.492001 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9133e5b8-8f70-46c0-8c0b-57828c0e4ddf None admin] PATH_INFO: `/v3/domains` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:48:51.492641 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9133e5b8-8f70-46c0-8c0b-57828c0e4ddf None admin] RBAC: Adding query filter params (name=Default) {{(pid=81593) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 17:48:51.492940 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9133e5b8-8f70-46c0-8c0b-57828c0e4ddf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:48:51.494344 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9133e5b8-8f70-46c0-8c0b-57828c0e4ddf None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:48:51.510154 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 339/668] 10.222.0.25 () {56 vars in 1109 bytes} [Thu Sep 15 17:48:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 17:48:51.511007 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9133e5b8-8f70-46c0-8c0b-57828c0e4ddf None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:48:51.561687 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 330/669] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Sep 15 17:48:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 15 17:48:51.562557 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7aea8a-4bcd-4e6b-9733-b4886bb1e161 None None] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:48:51.612856 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:48:51.624126 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:48:51.636514 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9133e5b8-8f70-46c0-8c0b-57828c0e4ddf None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:48:51.675215 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81f5bd4-7919-415a-b476-5d86f328169a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:48:51.675915 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7aea8a-4bcd-4e6b-9733-b4886bb1e161 None None] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:48:51.676512 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81f5bd4-7919-415a-b476-5d86f328169a None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:48:51.676986 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81f5bd4-7919-415a-b476-5d86f328169a None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:48:51.677482 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81f5bd4-7919-415a-b476-5d86f328169a None admin] PATH_INFO: `/v3/projects/service` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:48:51.685950 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81f5bd4-7919-415a-b476-5d86f328169a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:48:51.687731 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81f5bd4-7919-415a-b476-5d86f328169a None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:48:51.701260 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application [None req-e81f5bd4-7919-415a-b476-5d86f328169a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 15 17:48:51.701260 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 17:48:51.701260 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 17:48:51.701260 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 17:48:51.701260 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 17:48:51.701260 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 17:48:51.701260 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 17:48:51.701260 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 17:48:51.701260 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 17:48:51.701260 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 17:48:51.701260 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 17:48:51.701260 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 17:48:51.701260 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 15 17:48:51.701260 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 15 17:48:51.701260 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 15 17:48:51.702246 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 15 17:48:51.702246 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 17:48:51.702246 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 17:48:51.702246 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 17:48:51.702246 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 17:48:51.702246 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 17:48:51.702246 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 17:48:51.702246 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 17:48:51.702246 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application with Lock( Sep 15 17:48:51.702246 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 17:48:51.702246 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._enter() Sep 15 17:48:51.702246 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 17:48:51.702246 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 17:48:51.702246 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 17:48:51.702246 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.creator() Sep 15 17:48:51.702246 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 17:48:51.702246 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application created_value = creator( Sep 15 17:48:51.703138 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 15 17:48:51.703138 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 15 17:48:51.703138 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 15 17:48:51.703138 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 15 17:48:51.703138 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 15 17:48:51.703138 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 15 17:48:51.703138 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 15 17:48:51.703138 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Sep 15 17:48:51.706092 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 340/670] 10.222.0.25 () {56 vars in 1111 bytes} [Thu Sep 15 17:48:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 17:48:51.706968 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81f5bd4-7919-415a-b476-5d86f328169a None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:48:51.718626 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52263af4-b520-4f9c-b657-57a0415c904c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:48:51.719260 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52263af4-b520-4f9c-b657-57a0415c904c None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:48:51.719590 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52263af4-b520-4f9c-b657-57a0415c904c None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:48:51.719862 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52263af4-b520-4f9c-b657-57a0415c904c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:48:51.731930 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52263af4-b520-4f9c-b657-57a0415c904c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 17:48:51.737356 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application [None req-52263af4-b520-4f9c-b657-57a0415c904c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 15 17:48:51.737356 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 17:48:51.737356 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 17:48:51.737356 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 17:48:51.737356 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 17:48:51.737356 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 17:48:51.737356 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 17:48:51.737356 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 17:48:51.737356 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 17:48:51.737356 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 17:48:51.737356 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 17:48:51.737356 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 17:48:51.737356 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 17:48:51.737356 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 17:48:51.737356 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 17:48:51.737356 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 17:48:51.738288 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 17:48:51.738288 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 17:48:51.738288 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 17:48:51.738288 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 17:48:51.738288 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 17:48:51.738288 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 17:48:51.738288 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 17:48:51.738288 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 17:48:51.738288 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 17:48:51.738288 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 17:48:51.738288 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 17:48:51.738288 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application with Lock( Sep 15 17:48:51.738288 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 17:48:51.738288 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._enter() Sep 15 17:48:51.738288 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 17:48:51.738288 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 17:48:51.739136 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 17:48:51.739136 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.creator() Sep 15 17:48:51.739136 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 17:48:51.739136 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application created_value = creator( Sep 15 17:48:51.739136 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 17:48:51.739136 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 17:48:51.739136 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 17:48:51.739136 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 17:48:51.739136 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 17:48:51.739136 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 17:48:51.739136 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 15 17:48:51.739136 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Sep 15 17:48:51.741441 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 331/671] 10.222.0.25 () {56 vars in 1096 bytes} [Thu Sep 15 17:48:51 2022] GET /identity/v3/roles/admin => generated 83 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 17:48:51.742452 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52263af4-b520-4f9c-b657-57a0415c904c None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:48:51.854846 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81f5bd4-7919-415a-b476-5d86f328169a None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:48:51.860090 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52263af4-b520-4f9c-b657-57a0415c904c None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:48:51.861768 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:48:51.894634 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc5a904-0ed6-4a25-8319-fea958c42d7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:48:51.895801 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc5a904-0ed6-4a25-8319-fea958c42d7c None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:48:51.896283 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc5a904-0ed6-4a25-8319-fea958c42d7c None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:48:51.896764 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc5a904-0ed6-4a25-8319-fea958c42d7c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:48:51.897967 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b38b3af-3e84-4413-9e08-8888d8f691ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:48:51.898621 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b38b3af-3e84-4413-9e08-8888d8f691ca None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:48:51.898903 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b38b3af-3e84-4413-9e08-8888d8f691ca None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:48:51.899180 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b38b3af-3e84-4413-9e08-8888d8f691ca None admin] PATH_INFO: `/v3/projects/service` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:48:51.906652 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b38b3af-3e84-4413-9e08-8888d8f691ca None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:48:51.908943 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b38b3af-3e84-4413-9e08-8888d8f691ca None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:48:51.910153 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc5a904-0ed6-4a25-8319-fea958c42d7c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:48:51.911674 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc5a904-0ed6-4a25-8319-fea958c42d7c None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:48:51.923595 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application [None req-6b38b3af-3e84-4413-9e08-8888d8f691ca None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 15 17:48:51.923595 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 17:48:51.923595 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 17:48:51.923595 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 17:48:51.923595 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 17:48:51.923595 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 17:48:51.923595 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 17:48:51.923595 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 17:48:51.923595 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 17:48:51.923595 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 17:48:51.923595 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 17:48:51.923595 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 17:48:51.923595 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 15 17:48:51.923595 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 15 17:48:51.923595 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 15 17:48:51.925281 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 15 17:48:51.925281 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 17:48:51.925281 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 17:48:51.925281 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 17:48:51.925281 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 17:48:51.925281 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 17:48:51.925281 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 17:48:51.925281 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 17:48:51.925281 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application with Lock( Sep 15 17:48:51.925281 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 17:48:51.925281 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._enter() Sep 15 17:48:51.925281 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 17:48:51.925281 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 17:48:51.925281 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 17:48:51.925281 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.creator() Sep 15 17:48:51.925281 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 17:48:51.925281 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application created_value = creator( Sep 15 17:48:51.926328 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 15 17:48:51.926328 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 15 17:48:51.926328 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 15 17:48:51.926328 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 15 17:48:51.926328 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 15 17:48:51.926328 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 15 17:48:51.926328 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 15 17:48:51.926328 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Sep 15 17:48:51.926328 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 332/672] 10.222.0.25 () {56 vars in 1111 bytes} [Thu Sep 15 17:48:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 17:48:51.927324 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b38b3af-3e84-4413-9e08-8888d8f691ca None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:48:51.934258 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application [None req-8cc5a904-0ed6-4a25-8319-fea958c42d7c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 17:48:51.934258 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 17:48:51.934258 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 17:48:51.934258 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 17:48:51.934258 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 17:48:51.934258 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 17:48:51.934258 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 17:48:51.934258 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 17:48:51.934258 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 17:48:51.934258 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 17:48:51.934258 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 17:48:51.934258 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 17:48:51.934258 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 15 17:48:51.934258 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 15 17:48:51.934258 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 15 17:48:51.934258 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 15 17:48:51.935414 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 17:48:51.935414 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 17:48:51.935414 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 17:48:51.935414 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 17:48:51.935414 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 17:48:51.935414 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 17:48:51.935414 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 17:48:51.935414 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application with Lock( Sep 15 17:48:51.935414 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 17:48:51.935414 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._enter() Sep 15 17:48:51.935414 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 17:48:51.935414 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 17:48:51.935414 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 17:48:51.935414 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.creator() Sep 15 17:48:51.935414 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 17:48:51.935414 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application created_value = creator( Sep 15 17:48:51.935414 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 15 17:48:51.936328 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 15 17:48:51.936328 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 17:48:51.936328 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Sep 15 17:48:51.936328 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 341/673] 10.222.0.25 () {56 vars in 1108 bytes} [Thu Sep 15 17:48:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 17:48:51.936561 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc5a904-0ed6-4a25-8319-fea958c42d7c None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:48:51.940862 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:48:52.040044 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc5a904-0ed6-4a25-8319-fea958c42d7c None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:48:52.043076 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b38b3af-3e84-4413-9e08-8888d8f691ca None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:48:52.074322 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30ccf3a-c14d-4516-8646-429262fcdeb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:48:52.074926 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30ccf3a-c14d-4516-8646-429262fcdeb5 None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:48:52.075201 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30ccf3a-c14d-4516-8646-429262fcdeb5 None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:48:52.075472 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30ccf3a-c14d-4516-8646-429262fcdeb5 None admin] PATH_INFO: `/v3/roles` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:48:52.076127 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d30ccf3a-c14d-4516-8646-429262fcdeb5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81593) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 17:48:52.076423 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d30ccf3a-c14d-4516-8646-429262fcdeb5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:48:52.076710 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1746536d-1be8-4686-a917-5ff5ea2a4971 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:48:52.077335 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1746536d-1be8-4686-a917-5ff5ea2a4971 None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:48:52.077617 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1746536d-1be8-4686-a917-5ff5ea2a4971 None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:48:52.077845 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d30ccf3a-c14d-4516-8646-429262fcdeb5 None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:48:52.077937 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1746536d-1be8-4686-a917-5ff5ea2a4971 None admin] PATH_INFO: `/v3/projects` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:48:52.078551 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1746536d-1be8-4686-a917-5ff5ea2a4971 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81592) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 17:48:52.078851 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1746536d-1be8-4686-a917-5ff5ea2a4971 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:48:52.080248 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1746536d-1be8-4686-a917-5ff5ea2a4971 None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:48:52.086023 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 342/674] 10.222.0.25 () {56 vars in 1099 bytes} [Thu Sep 15 17:48:51 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 17:48:52.086841 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30ccf3a-c14d-4516-8646-429262fcdeb5 None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:48:52.096983 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 333/675] 10.222.0.25 () {56 vars in 1148 bytes} [Thu Sep 15 17:48:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 17:48:52.097906 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1746536d-1be8-4686-a917-5ff5ea2a4971 None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:48:52.122856 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:48:52.154797 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:48:52.191479 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30ccf3a-c14d-4516-8646-429262fcdeb5 None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:48:52.200951 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1746536d-1be8-4686-a917-5ff5ea2a4971 None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:48:52.227955 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf4bc29-a197-4bb4-8b3a-cf775230fa4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:48:52.228868 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf4bc29-a197-4bb4-8b3a-cf775230fa4a None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:48:52.229279 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf4bc29-a197-4bb4-8b3a-cf775230fa4a None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:48:52.229707 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf4bc29-a197-4bb4-8b3a-cf775230fa4a None admin] PATH_INFO: `/v3/roles/service` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:48:52.236011 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6340964f-a01b-4455-950a-34341bb3476a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:48:52.237196 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6340964f-a01b-4455-950a-34341bb3476a None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:48:52.237723 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6340964f-a01b-4455-950a-34341bb3476a None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:48:52.237841 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6340964f-a01b-4455-950a-34341bb3476a None admin] PATH_INFO: `/v3/projects` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:48:52.238496 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6340964f-a01b-4455-950a-34341bb3476a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81592) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 17:48:52.238798 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6340964f-a01b-4455-950a-34341bb3476a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:48:52.240252 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6340964f-a01b-4455-950a-34341bb3476a None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:48:52.242426 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf4bc29-a197-4bb4-8b3a-cf775230fa4a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 17:48:52.248715 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application [None req-7cf4bc29-a197-4bb4-8b3a-cf775230fa4a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 15 17:48:52.248715 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 17:48:52.248715 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 17:48:52.248715 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 17:48:52.248715 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 17:48:52.248715 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 17:48:52.248715 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 17:48:52.248715 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 17:48:52.248715 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 17:48:52.248715 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 17:48:52.248715 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 17:48:52.248715 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 17:48:52.248715 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 17:48:52.248715 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 17:48:52.248715 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 17:48:52.248715 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 17:48:52.249739 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 17:48:52.249739 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 17:48:52.249739 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 17:48:52.249739 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 17:48:52.249739 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 17:48:52.249739 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 17:48:52.249739 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 17:48:52.249739 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 17:48:52.249739 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 17:48:52.249739 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 17:48:52.249739 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 17:48:52.249739 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application with Lock( Sep 15 17:48:52.249739 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 17:48:52.249739 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._enter() Sep 15 17:48:52.249739 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 17:48:52.249739 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 17:48:52.250912 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 17:48:52.250912 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.creator() Sep 15 17:48:52.250912 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 17:48:52.250912 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application created_value = creator( Sep 15 17:48:52.250912 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 17:48:52.250912 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 17:48:52.250912 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 17:48:52.250912 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 17:48:52.250912 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 17:48:52.250912 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 17:48:52.250912 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 15 17:48:52.250912 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Sep 15 17:48:52.250912 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 343/676] 10.222.0.25 () {56 vars in 1102 bytes} [Thu Sep 15 17:48:52 2022] GET /identity/v3/roles/service => generated 85 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 17:48:52.250912 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf4bc29-a197-4bb4-8b3a-cf775230fa4a None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:48:52.262606 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 334/677] 10.222.0.25 () {56 vars in 1148 bytes} [Thu Sep 15 17:48:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 17:48:52.262606 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6340964f-a01b-4455-950a-34341bb3476a None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:48:52.349009 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:48:52.359000 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf4bc29-a197-4bb4-8b3a-cf775230fa4a None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:48:52.369071 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6340964f-a01b-4455-950a-34341bb3476a None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:48:52.387578 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:48:52.396772 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607b3e1a-9891-4cc2-9f3e-5664ab77aec5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:48:52.400313 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607b3e1a-9891-4cc2-9f3e-5664ab77aec5 None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:48:52.400313 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607b3e1a-9891-4cc2-9f3e-5664ab77aec5 None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:48:52.400313 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607b3e1a-9891-4cc2-9f3e-5664ab77aec5 None admin] PATH_INFO: `/v3/domains` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:48:52.400313 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607b3e1a-9891-4cc2-9f3e-5664ab77aec5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81593) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 17:48:52.400313 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607b3e1a-9891-4cc2-9f3e-5664ab77aec5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:48:52.400839 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607b3e1a-9891-4cc2-9f3e-5664ab77aec5 None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:48:52.407435 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef7a508-ce41-4d91-82dd-cc6705079307 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:48:52.408086 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef7a508-ce41-4d91-82dd-cc6705079307 None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:48:52.408367 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef7a508-ce41-4d91-82dd-cc6705079307 None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:48:52.409162 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef7a508-ce41-4d91-82dd-cc6705079307 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:48:52.415981 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 344/678] 10.222.0.25 () {56 vars in 1109 bytes} [Thu Sep 15 17:48:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 17:48:52.416830 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607b3e1a-9891-4cc2-9f3e-5664ab77aec5 None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:48:52.425115 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef7a508-ce41-4d91-82dd-cc6705079307 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:48:52.426638 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef7a508-ce41-4d91-82dd-cc6705079307 None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:48:52.440999 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application [None req-2ef7a508-ce41-4d91-82dd-cc6705079307 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 17:48:52.440999 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 17:48:52.440999 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 17:48:52.440999 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 17:48:52.440999 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 17:48:52.440999 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 17:48:52.440999 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 17:48:52.440999 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 17:48:52.440999 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 17:48:52.440999 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 17:48:52.440999 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 17:48:52.440999 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 17:48:52.440999 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 15 17:48:52.440999 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 15 17:48:52.440999 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 15 17:48:52.440999 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 15 17:48:52.442236 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 17:48:52.442236 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 17:48:52.442236 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 17:48:52.442236 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 17:48:52.442236 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 17:48:52.442236 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 17:48:52.442236 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 17:48:52.442236 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application with Lock( Sep 15 17:48:52.442236 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 17:48:52.442236 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._enter() Sep 15 17:48:52.442236 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 17:48:52.442236 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 17:48:52.442236 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 17:48:52.442236 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.creator() Sep 15 17:48:52.442236 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 17:48:52.442236 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application created_value = creator( Sep 15 17:48:52.442236 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 15 17:48:52.443136 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 15 17:48:52.443136 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 17:48:52.443136 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Sep 15 17:48:52.443136 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 335/679] 10.222.0.25 () {56 vars in 1108 bytes} [Thu Sep 15 17:48:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 17:48:52.443136 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef7a508-ce41-4d91-82dd-cc6705079307 None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:48:52.521240 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607b3e1a-9891-4cc2-9f3e-5664ab77aec5 None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:48:52.547069 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef7a508-ce41-4d91-82dd-cc6705079307 None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:48:52.561272 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7ce4de-1ee8-475e-8705-b458d3f0ead6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:48:52.561907 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7ce4de-1ee8-475e-8705-b458d3f0ead6 None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:48:52.562179 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7ce4de-1ee8-475e-8705-b458d3f0ead6 None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:48:52.562721 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7ce4de-1ee8-475e-8705-b458d3f0ead6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:48:52.563163 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7ce4de-1ee8-475e-8705-b458d3f0ead6 None admin] RBAC: Adding query filter params (role.id=17e337d9acf148e99d6c50170293fa05, scope.project.id=1213c0d1b584404ba3998e136f166e89, user.id=1b232e7a841145ba93c6d8462ccb751a) {{(pid=81593) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 17:48:52.563466 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7ce4de-1ee8-475e-8705-b458d3f0ead6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:48:52.564988 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7ce4de-1ee8-475e-8705-b458d3f0ead6 None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:48:52.571636 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 345/680] 10.222.0.25 () {56 vars in 1374 bytes} [Thu Sep 15 17:48:52 2022] GET /identity/v3/role_assignments?user.id=1b232e7a841145ba93c6d8462ccb751a&scope.project.id=1213c0d1b584404ba3998e136f166e89&role.id=17e337d9acf148e99d6c50170293fa05 => generated 608 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 17:48:52.572463 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7ce4de-1ee8-475e-8705-b458d3f0ead6 None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:48:52.583495 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3ec872-6369-440d-8cec-65f464f30e19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:48:52.584116 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3ec872-6369-440d-8cec-65f464f30e19 None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:48:52.584394 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3ec872-6369-440d-8cec-65f464f30e19 None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:48:52.584665 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3ec872-6369-440d-8cec-65f464f30e19 None admin] PATH_INFO: `/v3/roles` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:48:52.585698 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e3ec872-6369-440d-8cec-65f464f30e19 None admin] RBAC: Adding query filter params (name=service) {{(pid=81592) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 17:48:52.586003 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e3ec872-6369-440d-8cec-65f464f30e19 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:48:52.587415 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e3ec872-6369-440d-8cec-65f464f30e19 None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:48:52.589089 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:48:52.598947 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 336/681] 10.222.0.25 () {56 vars in 1103 bytes} [Thu Sep 15 17:48:52 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 17:48:52.600683 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3ec872-6369-440d-8cec-65f464f30e19 None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:48:52.646958 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:48:52.709579 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7ce4de-1ee8-475e-8705-b458d3f0ead6 None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:48:52.726187 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3ec872-6369-440d-8cec-65f464f30e19 None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:48:52.753621 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ff52c1-e4b6-41db-af53-c020de110e55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:48:52.754255 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ff52c1-e4b6-41db-af53-c020de110e55 None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:48:52.754699 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ff52c1-e4b6-41db-af53-c020de110e55 None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:48:52.754985 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ff52c1-e4b6-41db-af53-c020de110e55 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:48:52.755723 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ff52c1-e4b6-41db-af53-c020de110e55 None admin] RBAC: Adding query filter params (role.id=17e337d9acf148e99d6c50170293fa05, scope.project.id=1213c0d1b584404ba3998e136f166e89, user.id=c194f79928aa4a4d94619c417b4e39e9) {{(pid=81593) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 17:48:52.756041 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ff52c1-e4b6-41db-af53-c020de110e55 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:48:52.757520 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ff52c1-e4b6-41db-af53-c020de110e55 None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:48:52.764784 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 346/682] 10.222.0.25 () {56 vars in 1374 bytes} [Thu Sep 15 17:48:52 2022] GET /identity/v3/role_assignments?user.id=c194f79928aa4a4d94619c417b4e39e9&scope.project.id=1213c0d1b584404ba3998e136f166e89&role.id=17e337d9acf148e99d6c50170293fa05 => generated 608 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 17:48:52.764969 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ff52c1-e4b6-41db-af53-c020de110e55 None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:48:52.772040 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0c41f7-b4b9-4802-9e93-9b8109c580cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:48:52.772702 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0c41f7-b4b9-4802-9e93-9b8109c580cb None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:48:52.772981 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0c41f7-b4b9-4802-9e93-9b8109c580cb None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:48:52.773252 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0c41f7-b4b9-4802-9e93-9b8109c580cb None admin] PATH_INFO: `/v3/projects/service` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:48:52.781761 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a0c41f7-b4b9-4802-9e93-9b8109c580cb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:48:52.783498 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a0c41f7-b4b9-4802-9e93-9b8109c580cb None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:48:52.800134 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application [None req-5a0c41f7-b4b9-4802-9e93-9b8109c580cb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 15 17:48:52.800134 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 17:48:52.800134 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 17:48:52.800134 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 17:48:52.800134 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 17:48:52.800134 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 17:48:52.800134 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 17:48:52.800134 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 17:48:52.800134 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 17:48:52.800134 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 17:48:52.800134 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 17:48:52.800134 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 17:48:52.800134 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 15 17:48:52.800134 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 15 17:48:52.800134 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 15 17:48:52.801128 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 15 17:48:52.801128 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 17:48:52.801128 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 17:48:52.801128 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 17:48:52.801128 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 17:48:52.801128 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 17:48:52.801128 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 17:48:52.801128 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 17:48:52.801128 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application with Lock( Sep 15 17:48:52.801128 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 17:48:52.801128 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._enter() Sep 15 17:48:52.801128 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 17:48:52.801128 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 17:48:52.801128 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 17:48:52.801128 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.creator() Sep 15 17:48:52.801128 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 17:48:52.801128 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application created_value = creator( Sep 15 17:48:52.802081 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 15 17:48:52.802081 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 15 17:48:52.802081 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 15 17:48:52.802081 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 15 17:48:52.802081 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 15 17:48:52.802081 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 15 17:48:52.802081 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 15 17:48:52.802081 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Sep 15 17:48:52.802081 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 337/683] 10.222.0.25 () {56 vars in 1111 bytes} [Thu Sep 15 17:48:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 17:48:52.802081 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0c41f7-b4b9-4802-9e93-9b8109c580cb None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:48:52.886232 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:48:52.906386 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ff52c1-e4b6-41db-af53-c020de110e55 None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:48:52.925983 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:48:52.952893 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92abb128-0c52-4b93-867d-1b16b346992e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:48:52.953874 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92abb128-0c52-4b93-867d-1b16b346992e None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:48:52.954501 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92abb128-0c52-4b93-867d-1b16b346992e None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:48:52.955169 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92abb128-0c52-4b93-867d-1b16b346992e None admin] PATH_INFO: `/v3/domains` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:48:52.956546 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92abb128-0c52-4b93-867d-1b16b346992e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81593) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 17:48:52.957036 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92abb128-0c52-4b93-867d-1b16b346992e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:48:52.958403 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0c41f7-b4b9-4802-9e93-9b8109c580cb None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:48:52.958998 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92abb128-0c52-4b93-867d-1b16b346992e None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:48:52.976356 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 347/684] 10.222.0.25 () {56 vars in 1109 bytes} [Thu Sep 15 17:48:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 17:48:52.977613 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92abb128-0c52-4b93-867d-1b16b346992e None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:48:53.019666 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62f0b31-9ade-4cef-bb4d-cfdc09ace2c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:48:53.020576 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62f0b31-9ade-4cef-bb4d-cfdc09ace2c0 None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:48:53.020986 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62f0b31-9ade-4cef-bb4d-cfdc09ace2c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:48:53.021465 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62f0b31-9ade-4cef-bb4d-cfdc09ace2c0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:48:53.040068 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62f0b31-9ade-4cef-bb4d-cfdc09ace2c0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:48:53.042556 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62f0b31-9ade-4cef-bb4d-cfdc09ace2c0 None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:48:53.061265 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application [None req-f62f0b31-9ade-4cef-bb4d-cfdc09ace2c0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 17:48:53.061265 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 17:48:53.061265 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 17:48:53.061265 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 17:48:53.061265 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 17:48:53.061265 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 17:48:53.061265 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 17:48:53.061265 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 17:48:53.061265 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 17:48:53.061265 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 17:48:53.061265 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 17:48:53.061265 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 17:48:53.061265 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 15 17:48:53.061265 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 15 17:48:53.061265 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 15 17:48:53.061265 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 15 17:48:53.062320 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 17:48:53.062320 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 17:48:53.062320 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 17:48:53.062320 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 17:48:53.062320 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 17:48:53.062320 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 17:48:53.062320 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 17:48:53.062320 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application with Lock( Sep 15 17:48:53.062320 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 17:48:53.062320 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._enter() Sep 15 17:48:53.062320 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 17:48:53.062320 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 17:48:53.062320 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 17:48:53.062320 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.creator() Sep 15 17:48:53.062320 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 17:48:53.062320 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application created_value = creator( Sep 15 17:48:53.062320 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 15 17:48:53.063229 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 15 17:48:53.063229 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 17:48:53.063229 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Sep 15 17:48:53.063229 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 338/685] 10.222.0.25 () {56 vars in 1108 bytes} [Thu Sep 15 17:48:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 262 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 17:48:53.063934 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62f0b31-9ade-4cef-bb4d-cfdc09ace2c0 None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:48:53.106020 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92abb128-0c52-4b93-867d-1b16b346992e None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:48:53.153777 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8630f79c-78a2-4c4a-898e-7bbeb620bf97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:48:53.154311 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8630f79c-78a2-4c4a-898e-7bbeb620bf97 None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:48:53.154586 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8630f79c-78a2-4c4a-898e-7bbeb620bf97 None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:48:53.154950 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8630f79c-78a2-4c4a-898e-7bbeb620bf97 None admin] PATH_INFO: `/v3/projects` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:48:53.155673 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8630f79c-78a2-4c4a-898e-7bbeb620bf97 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81593) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 17:48:53.156217 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8630f79c-78a2-4c4a-898e-7bbeb620bf97 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:48:53.157689 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8630f79c-78a2-4c4a-898e-7bbeb620bf97 None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:48:53.173514 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 348/686] 10.222.0.25 () {56 vars in 1148 bytes} [Thu Sep 15 17:48:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 17:48:53.174515 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8630f79c-78a2-4c4a-898e-7bbeb620bf97 None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:48:53.187957 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62f0b31-9ade-4cef-bb4d-cfdc09ace2c0 None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:48:53.198733 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:48:53.218239 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:48:53.228545 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25558f7-7372-4858-afa3-c9f7ef9df54d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:48:53.229279 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25558f7-7372-4858-afa3-c9f7ef9df54d None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:48:53.229664 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25558f7-7372-4858-afa3-c9f7ef9df54d None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:48:53.230001 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25558f7-7372-4858-afa3-c9f7ef9df54d None admin] PATH_INFO: `/v3/users/nova` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:48:53.238963 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e25558f7-7372-4858-afa3-c9f7ef9df54d None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:48:53.240562 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e25558f7-7372-4858-afa3-c9f7ef9df54d None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:48:53.258688 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application [None req-e25558f7-7372-4858-afa3-c9f7ef9df54d None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 15 17:48:53.258688 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 17:48:53.258688 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 17:48:53.258688 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 17:48:53.258688 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 17:48:53.258688 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 17:48:53.258688 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 17:48:53.258688 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 17:48:53.258688 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 17:48:53.258688 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 17:48:53.258688 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 17:48:53.258688 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 17:48:53.258688 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 15 17:48:53.258688 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 15 17:48:53.258688 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 15 17:48:53.258688 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 15 17:48:53.259912 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 17:48:53.259912 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 17:48:53.259912 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 15 17:48:53.259912 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 15 17:48:53.259912 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 15 17:48:53.259912 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 15 17:48:53.259912 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 17:48:53.259912 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 17:48:53.259912 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 17:48:53.259912 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 17:48:53.259912 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 17:48:53.259912 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application with Lock( Sep 15 17:48:53.259912 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 17:48:53.259912 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._enter() Sep 15 17:48:53.259912 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 17:48:53.259912 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 17:48:53.259912 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 17:48:53.259912 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.creator() Sep 15 17:48:53.261103 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 17:48:53.261103 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application created_value = creator( Sep 15 17:48:53.261103 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 15 17:48:53.261103 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 15 17:48:53.261103 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 15 17:48:53.261103 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 15 17:48:53.261103 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 15 17:48:53.261103 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 15 17:48:53.261103 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 15 17:48:53.261103 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Sep 15 17:48:53.262562 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 339/687] 10.222.0.25 () {56 vars in 1093 bytes} [Thu Sep 15 17:48:53 2022] GET /identity/v3/users/nova => generated 82 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 17:48:53.267143 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25558f7-7372-4858-afa3-c9f7ef9df54d None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:48:53.310436 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8630f79c-78a2-4c4a-898e-7bbeb620bf97 None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:48:53.349573 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c515f42-51a4-4c51-a310-918b36c10f43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:48:53.350232 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c515f42-51a4-4c51-a310-918b36c10f43 None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:48:53.350511 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c515f42-51a4-4c51-a310-918b36c10f43 None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:48:53.350779 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c515f42-51a4-4c51-a310-918b36c10f43 None admin] PATH_INFO: `/v3/domains` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:48:53.351420 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c515f42-51a4-4c51-a310-918b36c10f43 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81593) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 17:48:53.351716 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c515f42-51a4-4c51-a310-918b36c10f43 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:48:53.353173 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c515f42-51a4-4c51-a310-918b36c10f43 None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:48:53.376050 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 349/688] 10.222.0.25 () {56 vars in 1109 bytes} [Thu Sep 15 17:48:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 17:48:53.377116 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c515f42-51a4-4c51-a310-918b36c10f43 None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:48:53.396679 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25558f7-7372-4858-afa3-c9f7ef9df54d None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:48:53.439135 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15eba56-7235-4e98-bd77-4972a216024e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:48:53.439709 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15eba56-7235-4e98-bd77-4972a216024e None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:48:53.439995 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15eba56-7235-4e98-bd77-4972a216024e None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:48:53.440269 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15eba56-7235-4e98-bd77-4972a216024e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:48:53.441000 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b15eba56-7235-4e98-bd77-4972a216024e None admin] RBAC: Adding query filter params (role.id=17e337d9acf148e99d6c50170293fa05, scope.project.id=1213c0d1b584404ba3998e136f166e89, user.id=a32274b4781b40fea9f28da8a9bde5ca) {{(pid=81592) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 17:48:53.441320 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b15eba56-7235-4e98-bd77-4972a216024e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:48:53.443819 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b15eba56-7235-4e98-bd77-4972a216024e None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:48:53.451950 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 340/689] 10.222.0.25 () {56 vars in 1374 bytes} [Thu Sep 15 17:48:53 2022] GET /identity/v3/role_assignments?user.id=a32274b4781b40fea9f28da8a9bde5ca&scope.project.id=1213c0d1b584404ba3998e136f166e89&role.id=17e337d9acf148e99d6c50170293fa05 => generated 608 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 17:48:53.452816 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15eba56-7235-4e98-bd77-4972a216024e None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:48:53.521494 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:48:53.539460 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:48:53.564517 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c515f42-51a4-4c51-a310-918b36c10f43 None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:48:53.613873 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15eba56-7235-4e98-bd77-4972a216024e None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:48:53.622748 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e59775-62e7-4d06-a9fc-7a255c36f3ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:48:53.623384 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e59775-62e7-4d06-a9fc-7a255c36f3ec None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:48:53.623655 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e59775-62e7-4d06-a9fc-7a255c36f3ec None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:48:53.623979 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e59775-62e7-4d06-a9fc-7a255c36f3ec None admin] PATH_INFO: `/v3/users` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:48:53.624746 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e59775-62e7-4d06-a9fc-7a255c36f3ec None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81593) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 17:48:53.625093 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e59775-62e7-4d06-a9fc-7a255c36f3ec None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:48:53.626622 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e59775-62e7-4d06-a9fc-7a255c36f3ec None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:48:53.651985 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 350/690] 10.222.0.25 () {56 vars in 1133 bytes} [Thu Sep 15 17:48:53 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 17:48:53.653600 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e59775-62e7-4d06-a9fc-7a255c36f3ec None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:48:53.682259 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd15ae64-fd71-4703-9def-65964becbb61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:48:53.683566 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd15ae64-fd71-4703-9def-65964becbb61 None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:48:53.684232 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd15ae64-fd71-4703-9def-65964becbb61 None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:48:53.684917 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd15ae64-fd71-4703-9def-65964becbb61 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:48:53.700813 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd15ae64-fd71-4703-9def-65964becbb61 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:48:53.703874 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd15ae64-fd71-4703-9def-65964becbb61 None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:48:53.726872 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application [None req-dd15ae64-fd71-4703-9def-65964becbb61 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 15 17:48:53.726872 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 17:48:53.726872 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 17:48:53.726872 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 17:48:53.726872 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 17:48:53.726872 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 17:48:53.726872 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 17:48:53.726872 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 17:48:53.726872 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 17:48:53.726872 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 17:48:53.726872 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 17:48:53.726872 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 17:48:53.726872 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 15 17:48:53.726872 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 15 17:48:53.726872 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 15 17:48:53.726872 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 15 17:48:53.728804 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 17:48:53.728804 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 17:48:53.728804 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 15 17:48:53.728804 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 15 17:48:53.728804 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 15 17:48:53.728804 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 15 17:48:53.728804 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 17:48:53.728804 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 17:48:53.728804 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 17:48:53.728804 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 17:48:53.728804 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 17:48:53.728804 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application with Lock( Sep 15 17:48:53.728804 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 17:48:53.728804 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._enter() Sep 15 17:48:53.728804 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 17:48:53.728804 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 17:48:53.728804 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 17:48:53.728804 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.creator() Sep 15 17:48:53.730555 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 17:48:53.730555 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application created_value = creator( Sep 15 17:48:53.730555 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 15 17:48:53.730555 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 15 17:48:53.730555 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 15 17:48:53.730555 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 15 17:48:53.730555 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 15 17:48:53.730555 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 15 17:48:53.730555 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 15 17:48:53.730555 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Sep 15 17:48:53.735241 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 341/691] 10.222.0.25 () {56 vars in 1096 bytes} [Thu Sep 15 17:48:53 2022] GET /identity/v3/users/swift => generated 83 bytes in 283 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 17:48:53.746804 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd15ae64-fd71-4703-9def-65964becbb61 None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:48:53.781047 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e59775-62e7-4d06-a9fc-7a255c36f3ec None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:48:53.823616 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f4d228-1b8a-44eb-b4ce-b62ead4e2175 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:48:53.824293 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f4d228-1b8a-44eb-b4ce-b62ead4e2175 None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:48:53.824574 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f4d228-1b8a-44eb-b4ce-b62ead4e2175 None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:48:53.824842 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f4d228-1b8a-44eb-b4ce-b62ead4e2175 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:48:53.873693 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:48:53.902500 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:48:53.903513 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f4d228-1b8a-44eb-b4ce-b62ead4e2175 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:48:53.907077 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f4d228-1b8a-44eb-b4ce-b62ead4e2175 None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:48:53.935618 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd15ae64-fd71-4703-9def-65964becbb61 None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:48:54.022475 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2952ea-26c3-4e0d-b103-09cdd917e4bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:48:54.023656 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2952ea-26c3-4e0d-b103-09cdd917e4bf None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:48:54.024830 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2952ea-26c3-4e0d-b103-09cdd917e4bf None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:48:54.025492 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2952ea-26c3-4e0d-b103-09cdd917e4bf None admin] PATH_INFO: `/v3/users` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:48:54.027791 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e2952ea-26c3-4e0d-b103-09cdd917e4bf None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81592) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 17:48:54.028478 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e2952ea-26c3-4e0d-b103-09cdd917e4bf None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:48:54.030810 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e2952ea-26c3-4e0d-b103-09cdd917e4bf None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:48:54.065559 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 342/692] 10.222.0.25 () {56 vars in 1135 bytes} [Thu Sep 15 17:48:53 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 321 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 17:48:54.071162 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2952ea-26c3-4e0d-b103-09cdd917e4bf None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:48:54.125201 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 351/693] 10.222.0.25 () {58 vars in 1282 bytes} [Thu Sep 15 17:48:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 467 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 15 17:48:54.127234 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f4d228-1b8a-44eb-b4ce-b62ead4e2175 None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:48:54.227321 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2952ea-26c3-4e0d-b103-09cdd917e4bf None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:48:54.239804 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:48:54.270676 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff43eb5f-7d22-4e14-a812-4513101aca5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:48:54.272047 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff43eb5f-7d22-4e14-a812-4513101aca5c None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:48:54.272750 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff43eb5f-7d22-4e14-a812-4513101aca5c None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:48:54.273216 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff43eb5f-7d22-4e14-a812-4513101aca5c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:48:54.293497 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:48:54.350505 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff43eb5f-7d22-4e14-a812-4513101aca5c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:48:54.352320 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff43eb5f-7d22-4e14-a812-4513101aca5c None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:48:54.357553 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f4d228-1b8a-44eb-b4ce-b62ead4e2175 None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:48:54.442978 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4118315-20c8-4a69-986b-eb15fa9ffb27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:48:54.443631 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4118315-20c8-4a69-986b-eb15fa9ffb27 None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:48:54.444014 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4118315-20c8-4a69-986b-eb15fa9ffb27 None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:48:54.444295 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4118315-20c8-4a69-986b-eb15fa9ffb27 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:48:54.464111 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 343/694] 10.222.0.25 () {58 vars in 1282 bytes} [Thu Sep 15 17:48:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 393 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 15 17:48:54.465745 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4118315-20c8-4a69-986b-eb15fa9ffb27 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:48:54.467434 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4118315-20c8-4a69-986b-eb15fa9ffb27 None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:48:54.469160 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff43eb5f-7d22-4e14-a812-4513101aca5c None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:48:54.497136 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application [None req-d4118315-20c8-4a69-986b-eb15fa9ffb27 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 17:48:54.497136 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 17:48:54.497136 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 17:48:54.497136 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 17:48:54.497136 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 17:48:54.497136 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 17:48:54.497136 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 17:48:54.497136 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 17:48:54.497136 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 17:48:54.497136 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 17:48:54.497136 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 17:48:54.497136 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 17:48:54.497136 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 15 17:48:54.497136 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 15 17:48:54.497136 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 15 17:48:54.497136 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 15 17:48:54.498164 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 17:48:54.498164 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 17:48:54.498164 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 17:48:54.498164 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 17:48:54.498164 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 17:48:54.498164 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 17:48:54.498164 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 17:48:54.498164 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application with Lock( Sep 15 17:48:54.498164 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 17:48:54.498164 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._enter() Sep 15 17:48:54.498164 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 17:48:54.498164 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 17:48:54.498164 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 17:48:54.498164 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.creator() Sep 15 17:48:54.498164 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 17:48:54.498164 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application created_value = creator( Sep 15 17:48:54.498164 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 15 17:48:54.499037 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 15 17:48:54.499037 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 17:48:54.499037 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Sep 15 17:48:54.506272 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 352/695] 10.222.0.25 () {56 vars in 1108 bytes} [Thu Sep 15 17:48:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 380 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 15 17:48:54.513229 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4118315-20c8-4a69-986b-eb15fa9ffb27 None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:48:54.579055 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:48:54.664019 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff43eb5f-7d22-4e14-a812-4513101aca5c None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:48:54.717629 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4118315-20c8-4a69-986b-eb15fa9ffb27 None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:48:54.726244 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b79ca39-4e01-43de-b418-93aff2ea1924 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:48:54.726885 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:48:54.727268 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b79ca39-4e01-43de-b418-93aff2ea1924 None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:48:54.727726 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b79ca39-4e01-43de-b418-93aff2ea1924 None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:48:54.728165 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b79ca39-4e01-43de-b418-93aff2ea1924 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:48:54.746813 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b79ca39-4e01-43de-b418-93aff2ea1924 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:48:54.748559 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b79ca39-4e01-43de-b418-93aff2ea1924 None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:48:54.769779 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application [None req-5b79ca39-4e01-43de-b418-93aff2ea1924 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 17:48:54.769779 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 17:48:54.769779 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 17:48:54.769779 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 17:48:54.769779 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 17:48:54.769779 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 17:48:54.769779 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 17:48:54.769779 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 17:48:54.769779 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 17:48:54.769779 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 17:48:54.769779 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 17:48:54.769779 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 17:48:54.769779 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 15 17:48:54.769779 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 15 17:48:54.769779 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 15 17:48:54.769779 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 15 17:48:54.770998 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 17:48:54.770998 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 17:48:54.770998 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 17:48:54.770998 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 17:48:54.770998 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 17:48:54.770998 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 17:48:54.770998 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 17:48:54.770998 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application with Lock( Sep 15 17:48:54.770998 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 17:48:54.770998 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._enter() Sep 15 17:48:54.770998 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 17:48:54.770998 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 17:48:54.770998 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 17:48:54.770998 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.creator() Sep 15 17:48:54.770998 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 17:48:54.770998 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application created_value = creator( Sep 15 17:48:54.770998 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 15 17:48:54.772021 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 15 17:48:54.772021 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 17:48:54.772021 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Sep 15 17:48:54.774472 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 344/696] 10.222.0.25 () {56 vars in 1108 bytes} [Thu Sep 15 17:48:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 305 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 17:48:54.780258 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b79ca39-4e01-43de-b418-93aff2ea1924 None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:48:54.785321 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64cbb7c3-ed3f-420c-9dcf-15d8494ce54f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:48:54.786013 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cbb7c3-ed3f-420c-9dcf-15d8494ce54f None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:48:54.786292 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cbb7c3-ed3f-420c-9dcf-15d8494ce54f None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:48:54.786565 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cbb7c3-ed3f-420c-9dcf-15d8494ce54f None admin] PATH_INFO: `/v3/domains` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:48:54.787224 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64cbb7c3-ed3f-420c-9dcf-15d8494ce54f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81593) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 17:48:54.787526 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64cbb7c3-ed3f-420c-9dcf-15d8494ce54f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:48:54.788990 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64cbb7c3-ed3f-420c-9dcf-15d8494ce54f None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:48:54.804397 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 353/697] 10.222.0.25 () {56 vars in 1109 bytes} [Thu Sep 15 17:48:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 17:48:54.809996 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64cbb7c3-ed3f-420c-9dcf-15d8494ce54f None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:48:54.943474 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b79ca39-4e01-43de-b418-93aff2ea1924 None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:48:54.945589 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:48:55.006232 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df6659e-7c9f-4bee-bf3e-48116f6a2ddb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:48:55.006965 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df6659e-7c9f-4bee-bf3e-48116f6a2ddb None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:48:55.007248 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df6659e-7c9f-4bee-bf3e-48116f6a2ddb None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:48:55.009150 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df6659e-7c9f-4bee-bf3e-48116f6a2ddb None admin] PATH_INFO: `/v3/domains` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:48:55.010024 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df6659e-7c9f-4bee-bf3e-48116f6a2ddb None admin] RBAC: Adding query filter params (name=Default) {{(pid=81592) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 17:48:55.010336 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df6659e-7c9f-4bee-bf3e-48116f6a2ddb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:48:55.011896 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df6659e-7c9f-4bee-bf3e-48116f6a2ddb None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:48:55.034452 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 345/698] 10.222.0.25 () {56 vars in 1109 bytes} [Thu Sep 15 17:48:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 17:48:55.038840 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df6659e-7c9f-4bee-bf3e-48116f6a2ddb None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:48:55.068804 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64cbb7c3-ed3f-420c-9dcf-15d8494ce54f None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:48:55.132295 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44c1064-ff7c-438f-a7a9-3b57ecefb9a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:48:55.133231 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44c1064-ff7c-438f-a7a9-3b57ecefb9a5 None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:48:55.133747 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44c1064-ff7c-438f-a7a9-3b57ecefb9a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:48:55.134266 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44c1064-ff7c-438f-a7a9-3b57ecefb9a5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:48:55.142159 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44c1064-ff7c-438f-a7a9-3b57ecefb9a5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:48:55.144378 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44c1064-ff7c-438f-a7a9-3b57ecefb9a5 None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:48:55.157007 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application [None req-f44c1064-ff7c-438f-a7a9-3b57ecefb9a5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 15 17:48:55.157007 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 17:48:55.157007 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 17:48:55.157007 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 17:48:55.157007 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 17:48:55.157007 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 17:48:55.157007 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 17:48:55.157007 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 17:48:55.157007 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 17:48:55.157007 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 17:48:55.157007 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 17:48:55.157007 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 17:48:55.157007 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 15 17:48:55.157007 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 15 17:48:55.157007 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 15 17:48:55.158003 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 15 17:48:55.158003 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 17:48:55.158003 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 17:48:55.158003 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 17:48:55.158003 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 17:48:55.158003 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 17:48:55.158003 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 17:48:55.158003 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 17:48:55.158003 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application with Lock( Sep 15 17:48:55.158003 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 17:48:55.158003 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._enter() Sep 15 17:48:55.158003 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 17:48:55.158003 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 17:48:55.158003 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 17:48:55.158003 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.creator() Sep 15 17:48:55.158003 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 17:48:55.158003 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application created_value = creator( Sep 15 17:48:55.158989 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 15 17:48:55.158989 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 15 17:48:55.158989 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 15 17:48:55.158989 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 15 17:48:55.158989 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 15 17:48:55.158989 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 15 17:48:55.158989 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 15 17:48:55.158989 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Sep 15 17:48:55.161335 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 354/699] 10.222.0.25 () {56 vars in 1111 bytes} [Thu Sep 15 17:48:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 352 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 17:48:55.162900 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d6d99e-908d-4375-a3ce-5f4ba9332b11 None None] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:48:55.163562 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d6d99e-908d-4375-a3ce-5f4ba9332b11 None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:48:55.164048 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d6d99e-908d-4375-a3ce-5f4ba9332b11 None None] PATH_INFO: `/` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:48:55.170050 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 355/700] 10.222.0.25 () {54 vars in 927 bytes} [Thu Sep 15 17:48:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 17:48:55.171153 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d6d99e-908d-4375-a3ce-5f4ba9332b11 None None] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:48:55.193697 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df6659e-7c9f-4bee-bf3e-48116f6a2ddb None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:48:55.200552 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:48:55.246130 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524740cb-3e08-48a6-bcc2-8ebaf267f808 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:48:55.246870 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524740cb-3e08-48a6-bcc2-8ebaf267f808 None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:48:55.247227 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524740cb-3e08-48a6-bcc2-8ebaf267f808 None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:48:55.247574 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524740cb-3e08-48a6-bcc2-8ebaf267f808 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:48:55.257808 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-524740cb-3e08-48a6-bcc2-8ebaf267f808 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:48:55.259364 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-524740cb-3e08-48a6-bcc2-8ebaf267f808 None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:48:55.274774 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application [None req-524740cb-3e08-48a6-bcc2-8ebaf267f808 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 15 17:48:55.274774 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 17:48:55.274774 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 17:48:55.274774 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 17:48:55.274774 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 17:48:55.274774 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 17:48:55.274774 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 17:48:55.274774 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 17:48:55.274774 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 17:48:55.274774 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 17:48:55.274774 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 17:48:55.274774 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 17:48:55.274774 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 15 17:48:55.274774 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 15 17:48:55.274774 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 15 17:48:55.276114 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 15 17:48:55.276114 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 17:48:55.276114 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 17:48:55.276114 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 17:48:55.276114 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 17:48:55.276114 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 17:48:55.276114 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 17:48:55.276114 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 17:48:55.276114 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application with Lock( Sep 15 17:48:55.276114 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 17:48:55.276114 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._enter() Sep 15 17:48:55.276114 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 17:48:55.276114 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 17:48:55.276114 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 17:48:55.276114 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.creator() Sep 15 17:48:55.276114 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 17:48:55.276114 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application created_value = creator( Sep 15 17:48:55.277022 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 15 17:48:55.277022 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 15 17:48:55.277022 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 15 17:48:55.277022 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 15 17:48:55.277022 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 15 17:48:55.277022 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 15 17:48:55.277022 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 15 17:48:55.277022 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Sep 15 17:48:55.279615 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 346/701] 10.222.0.25 () {56 vars in 1111 bytes} [Thu Sep 15 17:48:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 17:48:55.281085 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219d8ece-535f-4851-8748-1b146e64ba93 None None] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:48:55.281570 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219d8ece-535f-4851-8748-1b146e64ba93 None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:48:55.282055 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219d8ece-535f-4851-8748-1b146e64ba93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:48:55.300269 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d6d99e-908d-4375-a3ce-5f4ba9332b11 None None] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:48:55.302065 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.auth.core [None req-219d8ece-535f-4851-8748-1b146e64ba93 None None] MFA Rules not processed for user `5cfa58ef86774ab7800bf91930bf6028`. Rule list: `[]` (Enabled: `True`). {{(pid=81592) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 17:48:55.303506 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-219d8ece-535f-4851-8748-1b146e64ba93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 17:48:55.323807 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:48:55.349285 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bdf879a-80c2-4ebb-ab36-2c63cd4bd1cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:48:55.349951 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdf879a-80c2-4ebb-ab36-2c63cd4bd1cd None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:48:55.350234 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdf879a-80c2-4ebb-ab36-2c63cd4bd1cd None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:48:55.350509 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdf879a-80c2-4ebb-ab36-2c63cd4bd1cd None admin] PATH_INFO: `/v3/projects` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:48:55.351215 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bdf879a-80c2-4ebb-ab36-2c63cd4bd1cd None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81593) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 17:48:55.351521 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bdf879a-80c2-4ebb-ab36-2c63cd4bd1cd None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:48:55.352995 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bdf879a-80c2-4ebb-ab36-2c63cd4bd1cd None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:48:55.371917 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 356/702] 10.222.0.25 () {56 vars in 1148 bytes} [Thu Sep 15 17:48:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 17:48:55.372910 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bdf879a-80c2-4ebb-ab36-2c63cd4bd1cd None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:48:55.398870 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 347/703] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Sep 15 17:48:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 15 17:48:55.400289 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219d8ece-535f-4851-8748-1b146e64ba93 None None] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:48:55.479895 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:48:55.500779 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bdf879a-80c2-4ebb-ab36-2c63cd4bd1cd None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:48:55.538009 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9607b3cb-c4ed-4551-a80d-bf5849e57206 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:48:55.538637 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9607b3cb-c4ed-4551-a80d-bf5849e57206 None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:48:55.538919 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9607b3cb-c4ed-4551-a80d-bf5849e57206 None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:48:55.539196 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9607b3cb-c4ed-4551-a80d-bf5849e57206 None admin] PATH_INFO: `/v3/projects` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:48:55.539906 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9607b3cb-c4ed-4551-a80d-bf5849e57206 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81593) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 17:48:55.540225 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9607b3cb-c4ed-4551-a80d-bf5849e57206 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:48:55.541777 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9607b3cb-c4ed-4551-a80d-bf5849e57206 None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:48:55.555634 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 357/704] 10.222.0.25 () {56 vars in 1148 bytes} [Thu Sep 15 17:48:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 17:48:55.558933 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219d8ece-535f-4851-8748-1b146e64ba93 None None] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:48:55.562149 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1b1fd7-8439-4dac-9577-7052c7f0c86c None None] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:48:55.562430 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1b1fd7-8439-4dac-9577-7052c7f0c86c None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:48:55.562709 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1b1fd7-8439-4dac-9577-7052c7f0c86c None None] PATH_INFO: `/` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:48:55.569349 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 358/705] 10.222.0.25 () {54 vars in 927 bytes} [Thu Sep 15 17:48:55 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 17:48:55.569349 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1b1fd7-8439-4dac-9577-7052c7f0c86c None None] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:48:55.626641 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30dcdc4a-f1c8-474a-b006-d66363cee674 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:48:55.627897 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30dcdc4a-f1c8-474a-b006-d66363cee674 None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:48:55.628310 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30dcdc4a-f1c8-474a-b006-d66363cee674 None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:48:55.628579 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30dcdc4a-f1c8-474a-b006-d66363cee674 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:48:55.629521 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30dcdc4a-f1c8-474a-b006-d66363cee674 None admin] RBAC: Adding query filter params (role.id=a9e42be86923434f8af52d3fc07fb4f7, scope.project.id=1213c0d1b584404ba3998e136f166e89, user.id=fe2244818e4d4dca9c424cd078653e6a) {{(pid=81592) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 17:48:55.629880 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30dcdc4a-f1c8-474a-b006-d66363cee674 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:48:55.631621 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30dcdc4a-f1c8-474a-b006-d66363cee674 None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:48:55.645933 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 348/706] 10.222.0.25 () {56 vars in 1374 bytes} [Thu Sep 15 17:48:55 2022] GET /identity/v3/role_assignments?user.id=fe2244818e4d4dca9c424cd078653e6a&scope.project.id=1213c0d1b584404ba3998e136f166e89&role.id=a9e42be86923434f8af52d3fc07fb4f7 => generated 259 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 17:48:55.647402 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa3d177-e347-4c5c-88a5-2da1b45dbed5 None None] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:48:55.647727 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa3d177-e347-4c5c-88a5-2da1b45dbed5 None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:48:55.648018 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa3d177-e347-4c5c-88a5-2da1b45dbed5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:48:55.690081 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.auth.core [None req-7aa3d177-e347-4c5c-88a5-2da1b45dbed5 None None] MFA Rules not processed for user `5cfa58ef86774ab7800bf91930bf6028`. Rule list: `[]` (Enabled: `True`). {{(pid=81592) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 17:48:55.691341 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-7aa3d177-e347-4c5c-88a5-2da1b45dbed5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 17:48:55.695268 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1b1fd7-8439-4dac-9577-7052c7f0c86c None None] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:48:55.721874 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:48:55.768600 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b55f039-167e-4f55-af7a-d26c53e96597 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:48:55.769338 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b55f039-167e-4f55-af7a-d26c53e96597 None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:48:55.769628 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b55f039-167e-4f55-af7a-d26c53e96597 None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:48:55.769910 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b55f039-167e-4f55-af7a-d26c53e96597 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:48:55.770686 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b55f039-167e-4f55-af7a-d26c53e96597 None admin] RBAC: Adding query filter params (role.id=17e337d9acf148e99d6c50170293fa05, scope.project.id=1213c0d1b584404ba3998e136f166e89, user.id=685f7ad4c6fe4c878d542dddd6d81593) {{(pid=81593) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 17:48:55.771000 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b55f039-167e-4f55-af7a-d26c53e96597 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:48:55.774190 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b55f039-167e-4f55-af7a-d26c53e96597 None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:48:55.790232 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 359/707] 10.222.0.25 () {56 vars in 1374 bytes} [Thu Sep 15 17:48:55 2022] GET /identity/v3/role_assignments?user.id=685f7ad4c6fe4c878d542dddd6d81593&scope.project.id=1213c0d1b584404ba3998e136f166e89&role.id=17e337d9acf148e99d6c50170293fa05 => generated 608 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 17:48:55.791001 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b55f039-167e-4f55-af7a-d26c53e96597 None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:48:55.818637 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 349/708] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Sep 15 17:48:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 15 17:48:55.827105 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:48:55.956691 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b55f039-167e-4f55-af7a-d26c53e96597 None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:48:55.997930 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47bf5961-a679-4661-8b3d-7a8e2d89b4a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:48:55.998593 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bf5961-a679-4661-8b3d-7a8e2d89b4a0 None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:48:55.998872 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bf5961-a679-4661-8b3d-7a8e2d89b4a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:48:55.999144 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bf5961-a679-4661-8b3d-7a8e2d89b4a0 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:48:55.999745 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47bf5961-a679-4661-8b3d-7a8e2d89b4a0 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:48:56.001165 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47bf5961-a679-4661-8b3d-7a8e2d89b4a0 None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:48:56.014491 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application [None req-47bf5961-a679-4661-8b3d-7a8e2d89b4a0 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 15 17:48:56.014491 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 17:48:56.014491 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 15 17:48:56.014491 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 15 17:48:56.014491 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 15 17:48:56.014491 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 15 17:48:56.014491 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 15 17:48:56.014491 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 15 17:48:56.014491 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 15 17:48:56.014491 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Sep 15 17:48:56.014491 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 15 17:48:56.014491 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Sep 15 17:48:56.014491 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 17:48:56.014491 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 17:48:56.014491 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 17:48:56.014491 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 17:48:56.014491 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 17:48:56.015661 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 17:48:56.015661 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 17:48:56.015661 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 17:48:56.015661 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 17:48:56.015661 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 17:48:56.015661 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 17:48:56.015661 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 15 17:48:56.015661 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 15 17:48:56.015661 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 15 17:48:56.015661 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 15 17:48:56.015661 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 17:48:56.015661 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 17:48:56.015661 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 17:48:56.015661 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 17:48:56.015661 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 17:48:56.015661 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 17:48:56.016534 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 17:48:56.016534 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application with Lock( Sep 15 17:48:56.016534 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 17:48:56.016534 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._enter() Sep 15 17:48:56.016534 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 17:48:56.016534 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 17:48:56.016534 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 17:48:56.016534 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.creator() Sep 15 17:48:56.016534 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 17:48:56.016534 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application created_value = creator( Sep 15 17:48:56.016534 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 15 17:48:56.016534 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 15 17:48:56.016534 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 15 17:48:56.016534 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Sep 15 17:48:56.016534 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 360/709] 10.222.0.25 () {56 vars in 1129 bytes} [Thu Sep 15 17:48:55 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 17:48:56.026462 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa3d177-e347-4c5c-88a5-2da1b45dbed5 None None] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:48:56.167580 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa3d177-e347-4c5c-88a5-2da1b45dbed5 None None] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:48:56.174374 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c571be85-53ac-4b4d-afcf-b20ec09f40b4 None None] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:48:56.174663 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c571be85-53ac-4b4d-afcf-b20ec09f40b4 None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:48:56.174934 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c571be85-53ac-4b4d-afcf-b20ec09f40b4 None None] PATH_INFO: `/` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:48:56.176554 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 361/710] 10.222.0.25 () {54 vars in 927 bytes} [Thu Sep 15 17:48:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 17:48:56.182709 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8737af4f-64fd-40e2-a654-28cb23893ab8 None None] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:48:56.182991 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8737af4f-64fd-40e2-a654-28cb23893ab8 None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:48:56.183258 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8737af4f-64fd-40e2-a654-28cb23893ab8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:48:56.207921 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.auth.core [None req-8737af4f-64fd-40e2-a654-28cb23893ab8 None None] MFA Rules not processed for user `5cfa58ef86774ab7800bf91930bf6028`. Rule list: `[]` (Enabled: `True`). {{(pid=81593) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 17:48:56.209310 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-8737af4f-64fd-40e2-a654-28cb23893ab8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 17:48:56.212352 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce237844-8a96-4291-a146-1e85a5509a72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:48:56.213091 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce237844-8a96-4291-a146-1e85a5509a72 None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:48:56.213436 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce237844-8a96-4291-a146-1e85a5509a72 None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:48:56.213716 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce237844-8a96-4291-a146-1e85a5509a72 None admin] PATH_INFO: `/v3/services` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:48:56.214353 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce237844-8a96-4291-a146-1e85a5509a72 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81592) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 17:48:56.214649 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce237844-8a96-4291-a146-1e85a5509a72 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:48:56.216015 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce237844-8a96-4291-a146-1e85a5509a72 None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:48:56.222620 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 350/711] 10.222.0.25 () {56 vars in 1124 bytes} [Thu Sep 15 17:48:56 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 17:48:56.223467 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce237844-8a96-4291-a146-1e85a5509a72 None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:48:56.237647 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:48:56.293862 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 362/712] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Sep 15 17:48:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 15 17:48:56.295086 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8737af4f-64fd-40e2-a654-28cb23893ab8 None None] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:48:56.297993 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:48:56.372023 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce237844-8a96-4291-a146-1e85a5509a72 None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:48:56.413317 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd1a3a4-5e9e-4a33-bd6e-4035896d4513 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:48:56.413975 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd1a3a4-5e9e-4a33-bd6e-4035896d4513 None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:48:56.414252 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd1a3a4-5e9e-4a33-bd6e-4035896d4513 None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:48:56.414524 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd1a3a4-5e9e-4a33-bd6e-4035896d4513 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:48:56.447585 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd1a3a4-5e9e-4a33-bd6e-4035896d4513 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:48:56.450282 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd1a3a4-5e9e-4a33-bd6e-4035896d4513 None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:48:56.497645 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application [None req-fcd1a3a4-5e9e-4a33-bd6e-4035896d4513 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 17:48:56.497645 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 17:48:56.497645 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 17:48:56.497645 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 17:48:56.497645 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 17:48:56.497645 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 17:48:56.497645 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 17:48:56.497645 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 17:48:56.497645 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 17:48:56.497645 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 17:48:56.497645 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 17:48:56.497645 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 17:48:56.497645 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 15 17:48:56.497645 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 15 17:48:56.497645 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 15 17:48:56.497645 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 15 17:48:56.498768 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 17:48:56.498768 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 17:48:56.498768 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 17:48:56.498768 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 17:48:56.498768 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 17:48:56.498768 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 17:48:56.498768 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 17:48:56.498768 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application with Lock( Sep 15 17:48:56.498768 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 17:48:56.498768 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._enter() Sep 15 17:48:56.498768 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 17:48:56.498768 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 17:48:56.498768 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 17:48:56.498768 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.creator() Sep 15 17:48:56.498768 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 17:48:56.498768 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application created_value = creator( Sep 15 17:48:56.498768 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 15 17:48:56.499688 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 15 17:48:56.499688 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 17:48:56.499688 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Sep 15 17:48:56.499896 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 351/713] 10.222.0.25 () {56 vars in 1108 bytes} [Thu Sep 15 17:48:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 277 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 17:48:56.506919 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd1a3a4-5e9e-4a33-bd6e-4035896d4513 None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:48:56.528315 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8737af4f-64fd-40e2-a654-28cb23893ab8 None None] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:48:56.589393 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adaba16a-7622-4ad0-a633-c2d1001905fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:48:56.589931 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adaba16a-7622-4ad0-a633-c2d1001905fc None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:48:56.590205 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adaba16a-7622-4ad0-a633-c2d1001905fc None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:48:56.590474 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adaba16a-7622-4ad0-a633-c2d1001905fc None admin] PATH_INFO: `/v3/services` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:48:56.591286 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adaba16a-7622-4ad0-a633-c2d1001905fc None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81593) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 17:48:56.591591 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adaba16a-7622-4ad0-a633-c2d1001905fc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:48:56.592970 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adaba16a-7622-4ad0-a633-c2d1001905fc None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:48:56.609352 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 363/714] 10.222.0.25 () {56 vars in 1124 bytes} [Thu Sep 15 17:48:56 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 314 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 17:48:56.635446 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:48:56.696973 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd1a3a4-5e9e-4a33-bd6e-4035896d4513 None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:48:56.739526 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc0fd60-2146-42c0-92a3-669c203b79cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:48:56.740153 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc0fd60-2146-42c0-92a3-669c203b79cb None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:48:56.740426 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc0fd60-2146-42c0-92a3-669c203b79cb None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:48:56.740746 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc0fd60-2146-42c0-92a3-669c203b79cb None admin] PATH_INFO: `/v3/domains` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:48:56.741506 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc0fd60-2146-42c0-92a3-669c203b79cb None admin] RBAC: Adding query filter params (name=Default) {{(pid=81592) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 17:48:56.741811 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc0fd60-2146-42c0-92a3-669c203b79cb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:48:56.743213 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc0fd60-2146-42c0-92a3-669c203b79cb None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:48:56.758398 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 352/715] 10.222.0.25 () {56 vars in 1109 bytes} [Thu Sep 15 17:48:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 17:48:56.766753 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adaba16a-7622-4ad0-a633-c2d1001905fc None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:48:56.779097 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc0fd60-2146-42c0-92a3-669c203b79cb None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:48:56.910062 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:48:56.956362 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adaba16a-7622-4ad0-a633-c2d1001905fc None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:48:56.967562 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc0fd60-2146-42c0-92a3-669c203b79cb None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:48:56.994584 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:48:57.018778 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da39f33-eae6-4eb6-9c6c-8096511c3117 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:48:57.020530 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da39f33-eae6-4eb6-9c6c-8096511c3117 None admin] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:48:57.021589 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da39f33-eae6-4eb6-9c6c-8096511c3117 None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:48:57.022605 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d49c990-df3b-415e-b446-5a11a0c02d4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:48:57.023198 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da39f33-eae6-4eb6-9c6c-8096511c3117 None admin] PATH_INFO: `/v3/users` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:48:57.024114 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da39f33-eae6-4eb6-9c6c-8096511c3117 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:48:57.025026 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d49c990-df3b-415e-b446-5a11a0c02d4b None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:48:57.026816 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da39f33-eae6-4eb6-9c6c-8096511c3117 None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:48:57.027370 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d49c990-df3b-415e-b446-5a11a0c02d4b None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:48:57.027866 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d49c990-df3b-415e-b446-5a11a0c02d4b None admin] PATH_INFO: `/v3/services/network` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:48:57.028691 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d49c990-df3b-415e-b446-5a11a0c02d4b None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:48:57.030383 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d49c990-df3b-415e-b446-5a11a0c02d4b None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:48:57.053873 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application [None req-5d49c990-df3b-415e-b446-5a11a0c02d4b None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Sep 15 17:48:57.053873 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 17:48:57.053873 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 15 17:48:57.053873 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 15 17:48:57.053873 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 15 17:48:57.053873 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 15 17:48:57.053873 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 15 17:48:57.053873 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 15 17:48:57.053873 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 15 17:48:57.053873 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Sep 15 17:48:57.053873 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 15 17:48:57.053873 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Sep 15 17:48:57.053873 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 17:48:57.053873 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 17:48:57.053873 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 17:48:57.053873 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 17:48:57.053873 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 17:48:57.054940 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 17:48:57.054940 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 17:48:57.054940 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 17:48:57.054940 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 17:48:57.054940 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 17:48:57.054940 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 17:48:57.054940 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 15 17:48:57.054940 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 15 17:48:57.054940 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 15 17:48:57.054940 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 15 17:48:57.054940 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 17:48:57.054940 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 17:48:57.054940 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 17:48:57.054940 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 17:48:57.054940 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 17:48:57.054940 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 17:48:57.055768 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 17:48:57.055768 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application with Lock( Sep 15 17:48:57.055768 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 17:48:57.055768 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._enter() Sep 15 17:48:57.055768 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 17:48:57.055768 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 17:48:57.055768 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 17:48:57.055768 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.creator() Sep 15 17:48:57.055768 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 17:48:57.055768 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application created_value = creator( Sep 15 17:48:57.055768 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 15 17:48:57.055768 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 15 17:48:57.055768 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 15 17:48:57.055768 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Sep 15 17:48:57.059343 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 353/716] 10.222.0.25 () {56 vars in 1111 bytes} [Thu Sep 15 17:48:56 2022] GET /identity/v3/services/network => generated 88 bytes in 281 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 15 17:48:57.066570 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d49c990-df3b-415e-b446-5a11a0c02d4b None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:48:57.078733 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 364/717] 10.222.0.25 () {60 vars in 1132 bytes} [Thu Sep 15 17:48:56 2022] POST /identity/v3/users => generated 254 bytes in 313 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 15 17:48:57.226992 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d49c990-df3b-415e-b446-5a11a0c02d4b None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:48:57.273558 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021a8f4b-a10e-4f46-9869-681d603a5d83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:48:57.274189 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021a8f4b-a10e-4f46-9869-681d603a5d83 None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:48:57.274469 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021a8f4b-a10e-4f46-9869-681d603a5d83 None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:48:57.274737 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021a8f4b-a10e-4f46-9869-681d603a5d83 None admin] PATH_INFO: `/v3/services` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:48:57.275429 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-021a8f4b-a10e-4f46-9869-681d603a5d83 None admin] RBAC: Adding query filter params (name=network) {{(pid=81592) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 17:48:57.275697 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-021a8f4b-a10e-4f46-9869-681d603a5d83 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:48:57.277096 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-021a8f4b-a10e-4f46-9869-681d603a5d83 None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:48:57.282338 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 354/718] 10.222.0.25 () {56 vars in 1112 bytes} [Thu Sep 15 17:48:57 2022] GET /identity/v3/services?name=network => generated 124 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 17:48:57.289135 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da39f33-eae6-4eb6-9c6c-8096511c3117 None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:48:57.407393 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da39f33-eae6-4eb6-9c6c-8096511c3117 None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:48:57.433074 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:48:57.446708 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32240091-7bf5-496e-9ecd-0dffc10e7f8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:48:57.447316 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32240091-7bf5-496e-9ecd-0dffc10e7f8b None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:48:57.447593 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32240091-7bf5-496e-9ecd-0dffc10e7f8b None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:48:57.447860 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32240091-7bf5-496e-9ecd-0dffc10e7f8b None admin] PATH_INFO: `/v3/services` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:48:57.448489 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32240091-7bf5-496e-9ecd-0dffc10e7f8b None admin] RBAC: Adding query filter params (type=network) {{(pid=81593) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 17:48:57.448783 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32240091-7bf5-496e-9ecd-0dffc10e7f8b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:48:57.450188 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32240091-7bf5-496e-9ecd-0dffc10e7f8b None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:48:57.455789 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 365/719] 10.222.0.25 () {56 vars in 1112 bytes} [Thu Sep 15 17:48:57 2022] GET /identity/v3/services?type=network => generated 124 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 17:48:58.637847 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25303a76-f394-47de-b3ca-4206f48c57c8 None None] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:48:58.638404 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25303a76-f394-47de-b3ca-4206f48c57c8 None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:48:58.638404 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25303a76-f394-47de-b3ca-4206f48c57c8 None None] PATH_INFO: `/` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:48:58.640058 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 355/720] 10.222.0.25 () {54 vars in 927 bytes} [Thu Sep 15 17:48:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 17:48:58.645940 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b15ab1-9cfb-4f6f-974e-b615b665af09 None None] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:48:58.646409 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b15ab1-9cfb-4f6f-974e-b615b665af09 None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:48:58.646595 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b15ab1-9cfb-4f6f-974e-b615b665af09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:48:58.671617 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.auth.core [None req-17b15ab1-9cfb-4f6f-974e-b615b665af09 None None] MFA Rules not processed for user `5cfa58ef86774ab7800bf91930bf6028`. Rule list: `[]` (Enabled: `True`). {{(pid=81593) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 17:48:58.672984 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-17b15ab1-9cfb-4f6f-974e-b615b665af09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 17:48:58.734081 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad1c5a7-6843-45f0-a9f8-2899ffe90bae None None] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:48:58.734391 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad1c5a7-6843-45f0-a9f8-2899ffe90bae None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:48:58.734638 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad1c5a7-6843-45f0-a9f8-2899ffe90bae None None] PATH_INFO: `/` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:48:58.736257 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 356/721] 10.222.0.25 () {54 vars in 927 bytes} [Thu Sep 15 17:48:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 17:48:58.742809 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974a082c-a650-4536-8c56-c0fbf5a58802 None None] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:48:58.743446 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974a082c-a650-4536-8c56-c0fbf5a58802 None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:48:58.743938 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974a082c-a650-4536-8c56-c0fbf5a58802 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:48:58.772755 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.auth.core [None req-974a082c-a650-4536-8c56-c0fbf5a58802 None None] MFA Rules not processed for user `5cfa58ef86774ab7800bf91930bf6028`. Rule list: `[]` (Enabled: `True`). {{(pid=81592) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 17:48:58.777412 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 366/722] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Sep 15 17:48:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 15 17:48:58.778942 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-974a082c-a650-4536-8c56-c0fbf5a58802 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 17:48:58.853195 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:48:58.888502 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 357/723] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Sep 15 17:48:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 15 17:48:59.139345 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b15ab1-9cfb-4f6f-974e-b615b665af09 None None] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:48:59.213586 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974a082c-a650-4536-8c56-c0fbf5a58802 None None] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:48:59.282564 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b15ab1-9cfb-4f6f-974e-b615b665af09 None None] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:48:59.325661 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:48:59.332288 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974a082c-a650-4536-8c56-c0fbf5a58802 None None] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:48:59.355354 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0cb1ff6-1c86-4700-85e1-0d365eb44847 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:48:59.356250 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cb1ff6-1c86-4700-85e1-0d365eb44847 None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:48:59.356529 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cb1ff6-1c86-4700-85e1-0d365eb44847 None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:48:59.356798 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cb1ff6-1c86-4700-85e1-0d365eb44847 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:48:59.378558 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0cb1ff6-1c86-4700-85e1-0d365eb44847 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 17:48:59.384719 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application [None req-a0cb1ff6-1c86-4700-85e1-0d365eb44847 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 15 17:48:59.384719 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 17:48:59.384719 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 17:48:59.384719 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 17:48:59.384719 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 17:48:59.384719 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 17:48:59.384719 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 17:48:59.384719 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 17:48:59.384719 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 17:48:59.384719 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 17:48:59.384719 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 17:48:59.384719 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 17:48:59.384719 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 17:48:59.384719 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 17:48:59.384719 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 17:48:59.384719 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 17:48:59.385884 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 17:48:59.385884 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 17:48:59.385884 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 17:48:59.385884 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 17:48:59.385884 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 17:48:59.385884 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 17:48:59.385884 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 17:48:59.385884 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 17:48:59.385884 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 17:48:59.385884 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 17:48:59.385884 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 17:48:59.385884 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application with Lock( Sep 15 17:48:59.385884 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 17:48:59.385884 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._enter() Sep 15 17:48:59.385884 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 17:48:59.385884 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 17:48:59.386936 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 17:48:59.386936 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.creator() Sep 15 17:48:59.386936 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 17:48:59.386936 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application created_value = creator( Sep 15 17:48:59.386936 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 17:48:59.386936 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 17:48:59.386936 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 17:48:59.386936 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 17:48:59.386936 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 17:48:59.386936 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 17:48:59.386936 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 15 17:48:59.386936 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Sep 15 17:48:59.389742 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 367/724] 10.222.0.25 () {56 vars in 1096 bytes} [Thu Sep 15 17:48:59 2022] GET /identity/v3/roles/admin => generated 83 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 17:48:59.396173 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0cb1ff6-1c86-4700-85e1-0d365eb44847 None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:48:59.423024 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1535639-362c-4b7b-ace7-4cd6f3040906 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:48:59.423685 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1535639-362c-4b7b-ace7-4cd6f3040906 None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:48:59.424527 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1535639-362c-4b7b-ace7-4cd6f3040906 None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:48:59.424803 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1535639-362c-4b7b-ace7-4cd6f3040906 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:48:59.448033 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1535639-362c-4b7b-ace7-4cd6f3040906 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 17:48:59.457858 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application [None req-a1535639-362c-4b7b-ace7-4cd6f3040906 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 15 17:48:59.457858 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 17:48:59.457858 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 17:48:59.457858 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 17:48:59.457858 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 17:48:59.457858 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 17:48:59.457858 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 17:48:59.457858 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 17:48:59.457858 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 17:48:59.457858 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 17:48:59.457858 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 17:48:59.457858 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 17:48:59.457858 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 17:48:59.457858 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 17:48:59.457858 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 17:48:59.457858 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 17:48:59.458868 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 17:48:59.458868 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 17:48:59.458868 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 17:48:59.458868 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 17:48:59.458868 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 17:48:59.458868 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 17:48:59.458868 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 17:48:59.458868 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 17:48:59.458868 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 17:48:59.458868 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 17:48:59.458868 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 17:48:59.458868 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application with Lock( Sep 15 17:48:59.458868 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 17:48:59.458868 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._enter() Sep 15 17:48:59.458868 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 17:48:59.458868 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 17:48:59.459706 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 17:48:59.459706 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.creator() Sep 15 17:48:59.459706 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 17:48:59.459706 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application created_value = creator( Sep 15 17:48:59.459706 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 17:48:59.459706 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 17:48:59.459706 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 17:48:59.459706 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 17:48:59.459706 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 17:48:59.459706 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 17:48:59.459706 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 15 17:48:59.459706 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Sep 15 17:48:59.464742 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 358/725] 10.222.0.25 () {56 vars in 1096 bytes} [Thu Sep 15 17:48:59 2022] GET /identity/v3/roles/admin => generated 83 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 15 17:48:59.469107 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1535639-362c-4b7b-ace7-4cd6f3040906 None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:48:59.528748 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:48:59.629650 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0cb1ff6-1c86-4700-85e1-0d365eb44847 None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:48:59.647729 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1535639-362c-4b7b-ace7-4cd6f3040906 None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:48:59.682838 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a930b38d-eaab-4194-8875-aea6484844e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:48:59.683704 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a930b38d-eaab-4194-8875-aea6484844e7 None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:48:59.683997 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a930b38d-eaab-4194-8875-aea6484844e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:48:59.684250 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a930b38d-eaab-4194-8875-aea6484844e7 None admin] PATH_INFO: `/v3/roles` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:48:59.685420 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a930b38d-eaab-4194-8875-aea6484844e7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81593) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 17:48:59.685730 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a930b38d-eaab-4194-8875-aea6484844e7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:48:59.687413 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a930b38d-eaab-4194-8875-aea6484844e7 None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:48:59.696515 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f85d8f-e459-4f2e-9a17-6e58380db3a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:48:59.697536 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f85d8f-e459-4f2e-9a17-6e58380db3a5 None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:48:59.698024 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f85d8f-e459-4f2e-9a17-6e58380db3a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:48:59.698476 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 368/726] 10.222.0.25 () {56 vars in 1099 bytes} [Thu Sep 15 17:48:59 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 302 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 17:48:59.698689 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f85d8f-e459-4f2e-9a17-6e58380db3a5 None admin] PATH_INFO: `/v3/roles` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:48:59.699662 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f85d8f-e459-4f2e-9a17-6e58380db3a5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81592) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 17:48:59.699894 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4972a6-4c4b-4d34-a3db-707798c1559f None None] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:48:59.700089 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4972a6-4c4b-4d34-a3db-707798c1559f None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:48:59.700349 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f85d8f-e459-4f2e-9a17-6e58380db3a5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:48:59.700587 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4972a6-4c4b-4d34-a3db-707798c1559f None None] PATH_INFO: `/` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:48:59.702284 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 369/727] 10.222.0.25 () {54 vars in 927 bytes} [Thu Sep 15 17:48:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 17:48:59.709800 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f85d8f-e459-4f2e-9a17-6e58380db3a5 None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:48:59.710077 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4972a6-4c4b-4d34-a3db-707798c1559f None None] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:48:59.726497 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 359/728] 10.222.0.25 () {56 vars in 1099 bytes} [Thu Sep 15 17:48:59 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 17:48:59.728619 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcad054-cd08-4346-b7d5-8c29ce9284ed None None] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:48:59.729002 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcad054-cd08-4346-b7d5-8c29ce9284ed None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:48:59.729405 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcad054-cd08-4346-b7d5-8c29ce9284ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:48:59.756855 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.auth.core [None req-0dcad054-cd08-4346-b7d5-8c29ce9284ed None None] MFA Rules not processed for user `5cfa58ef86774ab7800bf91930bf6028`. Rule list: `[]` (Enabled: `True`). {{(pid=81592) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 17:48:59.759814 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-0dcad054-cd08-4346-b7d5-8c29ce9284ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 17:48:59.786902 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:48:59.853287 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 360/729] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Sep 15 17:48:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 15 17:48:59.854440 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dcad054-cd08-4346-b7d5-8c29ce9284ed None None] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:48:59.895011 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:48:59.900105 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4972a6-4c4b-4d34-a3db-707798c1559f None None] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:48:59.991129 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6d9ec0-39e1-422f-a2db-0af89a1a96f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:48:59.991780 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6d9ec0-39e1-422f-a2db-0af89a1a96f3 None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:48:59.992059 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6d9ec0-39e1-422f-a2db-0af89a1a96f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:48:59.992325 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6d9ec0-39e1-422f-a2db-0af89a1a96f3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:49:00.001529 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dcad054-cd08-4346-b7d5-8c29ce9284ed None None] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:49:00.012293 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab6d9ec0-39e1-422f-a2db-0af89a1a96f3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:49:00.013872 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab6d9ec0-39e1-422f-a2db-0af89a1a96f3 None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:49:00.029342 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application [None req-ab6d9ec0-39e1-422f-a2db-0af89a1a96f3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 17:49:00.029342 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 17:49:00.029342 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 17:49:00.029342 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 17:49:00.029342 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 17:49:00.029342 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 17:49:00.029342 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 17:49:00.029342 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 17:49:00.029342 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 17:49:00.029342 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 17:49:00.029342 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 17:49:00.029342 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 17:49:00.029342 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 15 17:49:00.029342 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 15 17:49:00.029342 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 15 17:49:00.029342 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 15 17:49:00.031538 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 17:49:00.031538 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 17:49:00.031538 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 17:49:00.031538 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 17:49:00.031538 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 17:49:00.031538 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 17:49:00.031538 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 17:49:00.031538 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application with Lock( Sep 15 17:49:00.031538 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 17:49:00.031538 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._enter() Sep 15 17:49:00.031538 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 17:49:00.031538 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 17:49:00.031538 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 17:49:00.031538 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.creator() Sep 15 17:49:00.031538 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 17:49:00.031538 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application created_value = creator( Sep 15 17:49:00.031538 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 15 17:49:00.034214 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 15 17:49:00.034214 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 17:49:00.034214 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Sep 15 17:49:00.034214 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 370/730] 10.222.0.25 () {56 vars in 1108 bytes} [Thu Sep 15 17:48:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 321 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 17:49:00.034214 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07def6e-3d07-4e94-b8d1-a56e70481b1b None None] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:49:00.034214 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07def6e-3d07-4e94-b8d1-a56e70481b1b None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:49:00.034214 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07def6e-3d07-4e94-b8d1-a56e70481b1b None None] PATH_INFO: `/` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:49:00.039429 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 371/731] 10.222.0.25 () {54 vars in 927 bytes} [Thu Sep 15 17:49:00 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 17:49:00.041251 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d35b9a-6500-497a-90c1-d2634aea4737 None None] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:49:00.041251 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d35b9a-6500-497a-90c1-d2634aea4737 None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:49:00.041251 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d35b9a-6500-497a-90c1-d2634aea4737 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:49:00.058358 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ef62b1-2c9b-4f3d-b648-d487d49c6c93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:49:00.059327 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ef62b1-2c9b-4f3d-b648-d487d49c6c93 None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:49:00.059795 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ef62b1-2c9b-4f3d-b648-d487d49c6c93 None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:49:00.060308 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ef62b1-2c9b-4f3d-b648-d487d49c6c93 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:49:00.061434 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.auth.core [None req-b2d35b9a-6500-497a-90c1-d2634aea4737 None None] MFA Rules not processed for user `5cfa58ef86774ab7800bf91930bf6028`. Rule list: `[]` (Enabled: `True`). {{(pid=81593) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 17:49:00.063244 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-b2d35b9a-6500-497a-90c1-d2634aea4737 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 17:49:00.072618 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ef62b1-2c9b-4f3d-b648-d487d49c6c93 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:49:00.074100 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ef62b1-2c9b-4f3d-b648-d487d49c6c93 None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:49:00.091868 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application [None req-02ef62b1-2c9b-4f3d-b648-d487d49c6c93 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 17:49:00.091868 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 17:49:00.091868 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 17:49:00.091868 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 17:49:00.091868 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 17:49:00.091868 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 17:49:00.091868 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 17:49:00.091868 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 17:49:00.091868 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 17:49:00.091868 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 17:49:00.091868 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 17:49:00.091868 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 17:49:00.091868 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 15 17:49:00.091868 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 15 17:49:00.091868 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 15 17:49:00.091868 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 15 17:49:00.093696 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 17:49:00.093696 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 17:49:00.093696 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 17:49:00.093696 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 17:49:00.093696 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 17:49:00.093696 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 17:49:00.093696 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 17:49:00.093696 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application with Lock( Sep 15 17:49:00.093696 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 17:49:00.093696 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._enter() Sep 15 17:49:00.093696 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 17:49:00.093696 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 17:49:00.093696 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 17:49:00.093696 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.creator() Sep 15 17:49:00.093696 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 17:49:00.093696 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application created_value = creator( Sep 15 17:49:00.093696 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 15 17:49:00.095494 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 15 17:49:00.095494 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 17:49:00.095494 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Sep 15 17:49:00.095494 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 361/732] 10.222.0.25 () {56 vars in 1108 bytes} [Thu Sep 15 17:48:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 17:49:00.095494 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ef62b1-2c9b-4f3d-b648-d487d49c6c93 None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:49:00.157765 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 372/733] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Sep 15 17:49:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 15 17:49:00.159113 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d35b9a-6500-497a-90c1-d2634aea4737 None None] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:49:00.191766 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:49:00.200202 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:49:00.212816 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ef62b1-2c9b-4f3d-b648-d487d49c6c93 None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:49:00.252966 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7826f4-fe71-4a19-880e-f4d84b5a65e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:49:00.253941 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7826f4-fe71-4a19-880e-f4d84b5a65e0 None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:49:00.254513 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7826f4-fe71-4a19-880e-f4d84b5a65e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:49:00.254786 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7826f4-fe71-4a19-880e-f4d84b5a65e0 None admin] PATH_INFO: `/v3/domains` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:49:00.255429 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc7826f4-fe71-4a19-880e-f4d84b5a65e0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81592) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 17:49:00.255728 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc7826f4-fe71-4a19-880e-f4d84b5a65e0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:49:00.257580 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc7826f4-fe71-4a19-880e-f4d84b5a65e0 None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:49:00.272972 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 362/734] 10.222.0.25 () {56 vars in 1109 bytes} [Thu Sep 15 17:49:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 17:49:00.273917 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7826f4-fe71-4a19-880e-f4d84b5a65e0 None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:49:00.301983 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d35b9a-6500-497a-90c1-d2634aea4737 None None] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:49:00.352664 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c33e28-60c6-43ae-b44c-d8f8c220c2b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:49:00.353787 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c33e28-60c6-43ae-b44c-d8f8c220c2b9 None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:49:00.354444 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c33e28-60c6-43ae-b44c-d8f8c220c2b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:49:00.354996 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c33e28-60c6-43ae-b44c-d8f8c220c2b9 None admin] PATH_INFO: `/v3/domains` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:49:00.356292 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c33e28-60c6-43ae-b44c-d8f8c220c2b9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81593) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 17:49:00.356849 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c33e28-60c6-43ae-b44c-d8f8c220c2b9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:49:00.358661 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c33e28-60c6-43ae-b44c-d8f8c220c2b9 None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:49:00.375702 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 373/735] 10.222.0.25 () {56 vars in 1109 bytes} [Thu Sep 15 17:49:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 17:49:00.377149 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c33e28-60c6-43ae-b44c-d8f8c220c2b9 None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:49:00.416256 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7826f4-fe71-4a19-880e-f4d84b5a65e0 None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:49:00.482990 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94eeb2af-1a76-4924-99cf-da8c81d17b63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:49:00.484093 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94eeb2af-1a76-4924-99cf-da8c81d17b63 None admin] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:49:00.484388 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94eeb2af-1a76-4924-99cf-da8c81d17b63 None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:49:00.484708 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94eeb2af-1a76-4924-99cf-da8c81d17b63 None admin] PATH_INFO: `/v3/services` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:49:00.485428 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94eeb2af-1a76-4924-99cf-da8c81d17b63 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:49:00.487324 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94eeb2af-1a76-4924-99cf-da8c81d17b63 None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:49:00.487654 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:49:00.506129 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 363/736] 10.222.0.25 () {60 vars in 1141 bytes} [Thu Sep 15 17:49:00 2022] POST /identity/v3/services => generated 251 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 17:49:00.507242 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94eeb2af-1a76-4924-99cf-da8c81d17b63 None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:49:00.509874 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c33e28-60c6-43ae-b44c-d8f8c220c2b9 None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:49:00.512817 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:49:00.571467 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f65dd9-29e4-4b6b-b21b-0def3e2c7c91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:49:00.572409 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f65dd9-29e4-4b6b-b21b-0def3e2c7c91 None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:49:00.572817 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f65dd9-29e4-4b6b-b21b-0def3e2c7c91 None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:49:00.573217 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f65dd9-29e4-4b6b-b21b-0def3e2c7c91 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:49:00.583243 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f65dd9-29e4-4b6b-b21b-0def3e2c7c91 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:49:00.584816 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f65dd9-29e4-4b6b-b21b-0def3e2c7c91 None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:49:00.598124 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application [None req-15f65dd9-29e4-4b6b-b21b-0def3e2c7c91 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 15 17:49:00.598124 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 17:49:00.598124 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 17:49:00.598124 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 17:49:00.598124 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 17:49:00.598124 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 17:49:00.598124 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 17:49:00.598124 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 17:49:00.598124 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 17:49:00.598124 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 17:49:00.598124 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 17:49:00.598124 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 17:49:00.598124 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 15 17:49:00.598124 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 15 17:49:00.598124 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 15 17:49:00.598124 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 15 17:49:00.599275 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 17:49:00.599275 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 17:49:00.599275 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 15 17:49:00.599275 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 15 17:49:00.599275 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 15 17:49:00.599275 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 15 17:49:00.599275 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 17:49:00.599275 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 17:49:00.599275 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 17:49:00.599275 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 17:49:00.599275 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 17:49:00.599275 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application with Lock( Sep 15 17:49:00.599275 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 17:49:00.599275 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._enter() Sep 15 17:49:00.599275 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 17:49:00.599275 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 17:49:00.599275 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 17:49:00.599275 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.creator() Sep 15 17:49:00.600655 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 17:49:00.600655 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application created_value = creator( Sep 15 17:49:00.600655 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 15 17:49:00.600655 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 15 17:49:00.600655 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 15 17:49:00.600655 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 15 17:49:00.600655 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 15 17:49:00.600655 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 15 17:49:00.600655 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 15 17:49:00.600655 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Sep 15 17:49:00.600655 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 374/737] 10.222.0.25 () {56 vars in 1096 bytes} [Thu Sep 15 17:49:00 2022] GET /identity/v3/users/swift => generated 83 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 17:49:00.600655 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f65dd9-29e4-4b6b-b21b-0def3e2c7c91 None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:49:00.653160 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94eeb2af-1a76-4924-99cf-da8c81d17b63 None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:49:00.710786 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b549ab-1708-4ee5-9b10-474d12ea60d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:49:00.712188 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b549ab-1708-4ee5-9b10-474d12ea60d2 None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:49:00.712660 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b549ab-1708-4ee5-9b10-474d12ea60d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:49:00.713132 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b549ab-1708-4ee5-9b10-474d12ea60d2 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:49:00.723028 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b549ab-1708-4ee5-9b10-474d12ea60d2 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:49:00.724521 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b549ab-1708-4ee5-9b10-474d12ea60d2 None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:49:00.738729 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application [None req-81b549ab-1708-4ee5-9b10-474d12ea60d2 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 15 17:49:00.738729 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 17:49:00.738729 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 17:49:00.738729 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 17:49:00.738729 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 17:49:00.738729 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 17:49:00.738729 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 17:49:00.738729 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 17:49:00.738729 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 17:49:00.738729 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 17:49:00.738729 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 17:49:00.738729 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 17:49:00.738729 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 15 17:49:00.738729 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 15 17:49:00.738729 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 15 17:49:00.738729 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 15 17:49:00.740655 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 17:49:00.740655 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 17:49:00.740655 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 15 17:49:00.740655 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 15 17:49:00.740655 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 15 17:49:00.740655 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 15 17:49:00.740655 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 17:49:00.740655 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 17:49:00.740655 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 17:49:00.740655 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 17:49:00.740655 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 17:49:00.740655 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application with Lock( Sep 15 17:49:00.740655 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 17:49:00.740655 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._enter() Sep 15 17:49:00.740655 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 17:49:00.740655 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 17:49:00.740655 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 17:49:00.740655 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.creator() Sep 15 17:49:00.741698 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 17:49:00.741698 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application created_value = creator( Sep 15 17:49:00.741698 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 15 17:49:00.741698 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 15 17:49:00.741698 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 15 17:49:00.741698 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 15 17:49:00.741698 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 15 17:49:00.741698 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 15 17:49:00.741698 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 15 17:49:00.741698 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Sep 15 17:49:00.741698 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 364/738] 10.222.0.25 () {56 vars in 1093 bytes} [Thu Sep 15 17:49:00 2022] GET /identity/v3/users/nova => generated 82 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 17:49:00.741698 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433b6b12-f59d-431e-8fb1-bed76de5ef05 None None] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:49:00.743974 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f65dd9-29e4-4b6b-b21b-0def3e2c7c91 None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:49:00.746221 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433b6b12-f59d-431e-8fb1-bed76de5ef05 None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:49:00.746221 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433b6b12-f59d-431e-8fb1-bed76de5ef05 None None] PATH_INFO: `/` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:49:00.747725 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 365/739] 10.222.0.25 () {54 vars in 927 bytes} [Thu Sep 15 17:49:00 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 17:49:00.748784 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433b6b12-f59d-431e-8fb1-bed76de5ef05 None None] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:49:00.787563 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65804f2-46e4-4921-a15b-51ff533c36b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:49:00.788206 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65804f2-46e4-4921-a15b-51ff533c36b0 None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:49:00.788481 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65804f2-46e4-4921-a15b-51ff533c36b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:49:00.788747 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65804f2-46e4-4921-a15b-51ff533c36b0 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:49:00.791642 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:49:00.803648 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65804f2-46e4-4921-a15b-51ff533c36b0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 17:49:00.810484 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application [None req-a65804f2-46e4-4921-a15b-51ff533c36b0 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 15 17:49:00.810484 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 17:49:00.810484 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 17:49:00.810484 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 17:49:00.810484 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 17:49:00.810484 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 17:49:00.810484 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 17:49:00.810484 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 17:49:00.810484 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 17:49:00.810484 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 17:49:00.810484 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 17:49:00.810484 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 17:49:00.810484 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 17:49:00.810484 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 17:49:00.810484 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 17:49:00.810484 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 17:49:00.811739 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 17:49:00.811739 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 17:49:00.811739 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 17:49:00.811739 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 17:49:00.811739 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 17:49:00.811739 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 17:49:00.811739 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 17:49:00.811739 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 17:49:00.811739 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 17:49:00.811739 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 17:49:00.811739 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 17:49:00.811739 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application with Lock( Sep 15 17:49:00.811739 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 17:49:00.811739 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._enter() Sep 15 17:49:00.811739 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 17:49:00.811739 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 17:49:00.812768 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 17:49:00.812768 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.creator() Sep 15 17:49:00.812768 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 17:49:00.812768 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application created_value = creator( Sep 15 17:49:00.812768 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 17:49:00.812768 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 17:49:00.812768 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 17:49:00.812768 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 17:49:00.812768 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 17:49:00.812768 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 17:49:00.812768 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 15 17:49:00.812768 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Sep 15 17:49:00.812768 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 375/740] 10.222.0.25 () {56 vars in 1102 bytes} [Thu Sep 15 17:49:00 2022] GET /identity/v3/roles/service => generated 85 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 17:49:00.813550 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65804f2-46e4-4921-a15b-51ff533c36b0 None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:49:00.835689 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:49:00.919044 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433b6b12-f59d-431e-8fb1-bed76de5ef05 None None] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:49:00.969621 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65804f2-46e4-4921-a15b-51ff533c36b0 None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:49:00.973470 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c9205d-cf52-41e5-ad54-7075c315bb31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:49:00.974085 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c9205d-cf52-41e5-ad54-7075c315bb31 None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:49:00.974358 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c9205d-cf52-41e5-ad54-7075c315bb31 None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:49:00.974627 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c9205d-cf52-41e5-ad54-7075c315bb31 None admin] PATH_INFO: `/v3/users` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:49:00.975369 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c9205d-cf52-41e5-ad54-7075c315bb31 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81592) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 17:49:00.975668 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c9205d-cf52-41e5-ad54-7075c315bb31 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:49:00.977631 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c9205d-cf52-41e5-ad54-7075c315bb31 None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:49:00.997206 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 366/741] 10.222.0.25 () {56 vars in 1135 bytes} [Thu Sep 15 17:49:00 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 17:49:00.998505 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf6e024-e323-4f26-ab2d-d57ac64f1630 None None] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:49:00.998808 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf6e024-e323-4f26-ab2d-d57ac64f1630 None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:49:00.999069 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf6e024-e323-4f26-ab2d-d57ac64f1630 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:49:01.020098 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a211e60-8bf6-41b8-a898-07c4e6d264a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:49:01.020467 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.auth.core [None req-faf6e024-e323-4f26-ab2d-d57ac64f1630 None None] MFA Rules not processed for user `5cfa58ef86774ab7800bf91930bf6028`. Rule list: `[]` (Enabled: `True`). {{(pid=81592) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 17:49:01.021239 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a211e60-8bf6-41b8-a898-07c4e6d264a3 None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:49:01.021700 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a211e60-8bf6-41b8-a898-07c4e6d264a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:49:01.022114 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-faf6e024-e323-4f26-ab2d-d57ac64f1630 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 17:49:01.022229 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a211e60-8bf6-41b8-a898-07c4e6d264a3 None admin] PATH_INFO: `/v3/users` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:49:01.023084 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a211e60-8bf6-41b8-a898-07c4e6d264a3 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81593) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 17:49:01.023528 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a211e60-8bf6-41b8-a898-07c4e6d264a3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:49:01.025121 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a211e60-8bf6-41b8-a898-07c4e6d264a3 None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:49:01.048736 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 376/742] 10.222.0.25 () {56 vars in 1133 bytes} [Thu Sep 15 17:49:00 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 17:49:01.049540 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a211e60-8bf6-41b8-a898-07c4e6d264a3 None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:49:01.110002 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 367/743] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Sep 15 17:49:00 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 15 17:49:01.111834 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf6e024-e323-4f26-ab2d-d57ac64f1630 None None] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:49:01.141552 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:49:01.195903 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:49:01.233921 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a211e60-8bf6-41b8-a898-07c4e6d264a3 None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:49:01.258937 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf6e024-e323-4f26-ab2d-d57ac64f1630 None None] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:49:01.296922 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d881af-494e-482a-8b6f-05579f9c9924 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:49:01.298589 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d881af-494e-482a-8b6f-05579f9c9924 None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:49:01.299776 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d881af-494e-482a-8b6f-05579f9c9924 None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:49:01.300477 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d881af-494e-482a-8b6f-05579f9c9924 None admin] PATH_INFO: `/v3/roles` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:49:01.302727 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d881af-494e-482a-8b6f-05579f9c9924 None admin] RBAC: Adding query filter params (name=service) {{(pid=81593) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 17:49:01.303474 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d881af-494e-482a-8b6f-05579f9c9924 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:49:01.306197 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d881af-494e-482a-8b6f-05579f9c9924 None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:49:01.310511 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7135b72b-df9d-437c-8c0d-ed7ceab93899 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:49:01.311200 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7135b72b-df9d-437c-8c0d-ed7ceab93899 None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:49:01.311556 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7135b72b-df9d-437c-8c0d-ed7ceab93899 None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:49:01.311891 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7135b72b-df9d-437c-8c0d-ed7ceab93899 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:49:01.319690 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 377/744] 10.222.0.25 () {56 vars in 1103 bytes} [Thu Sep 15 17:49:01 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 17:49:01.320921 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d881af-494e-482a-8b6f-05579f9c9924 None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:49:01.391141 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7135b72b-df9d-437c-8c0d-ed7ceab93899 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:49:01.392831 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7135b72b-df9d-437c-8c0d-ed7ceab93899 None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:49:01.458153 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d881af-494e-482a-8b6f-05579f9c9924 None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:49:01.478888 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:49:01.495067 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:49:01.518598 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33995953-a0b9-48b2-8183-8cc9011787ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:49:01.519229 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33995953-a0b9-48b2-8183-8cc9011787ae None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:49:01.519502 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33995953-a0b9-48b2-8183-8cc9011787ae None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:49:01.519770 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33995953-a0b9-48b2-8183-8cc9011787ae None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:49:01.531990 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33995953-a0b9-48b2-8183-8cc9011787ae None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:49:01.534145 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33995953-a0b9-48b2-8183-8cc9011787ae None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:49:01.544281 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 368/745] 10.222.0.25 () {58 vars in 1282 bytes} [Thu Sep 15 17:49:01 2022] GET /identity/v3/auth/tokens => generated 903 bytes in 434 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 15 17:49:01.545403 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7135b72b-df9d-437c-8c0d-ed7ceab93899 None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:49:01.549346 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application [None req-33995953-a0b9-48b2-8183-8cc9011787ae None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 17:49:01.549346 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 17:49:01.549346 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 17:49:01.549346 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 17:49:01.549346 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 17:49:01.549346 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 17:49:01.549346 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 17:49:01.549346 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 17:49:01.549346 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 17:49:01.549346 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 17:49:01.549346 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 17:49:01.549346 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 17:49:01.549346 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 15 17:49:01.549346 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 15 17:49:01.549346 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 15 17:49:01.549346 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 15 17:49:01.550273 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 17:49:01.550273 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 17:49:01.550273 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 17:49:01.550273 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 17:49:01.550273 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 17:49:01.550273 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 17:49:01.550273 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 17:49:01.550273 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application with Lock( Sep 15 17:49:01.550273 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 17:49:01.550273 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._enter() Sep 15 17:49:01.550273 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 17:49:01.550273 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 17:49:01.550273 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 17:49:01.550273 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.creator() Sep 15 17:49:01.550273 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 17:49:01.550273 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application created_value = creator( Sep 15 17:49:01.550273 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 15 17:49:01.551227 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 15 17:49:01.551227 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 17:49:01.551227 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Sep 15 17:49:01.551227 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 378/746] 10.222.0.25 () {56 vars in 1108 bytes} [Thu Sep 15 17:49:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 17:49:01.551708 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33995953-a0b9-48b2-8183-8cc9011787ae None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:49:01.688163 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7135b72b-df9d-437c-8c0d-ed7ceab93899 None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:49:01.688706 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33995953-a0b9-48b2-8183-8cc9011787ae None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:49:01.725603 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27bd1fd-6944-43da-a06e-099ac722322b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:49:01.726279 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27bd1fd-6944-43da-a06e-099ac722322b None admin] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:49:01.726505 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27bd1fd-6944-43da-a06e-099ac722322b None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:49:01.726786 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27bd1fd-6944-43da-a06e-099ac722322b None admin] PATH_INFO: `/v3/services` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:49:01.727520 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c27bd1fd-6944-43da-a06e-099ac722322b None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:49:01.728886 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c27bd1fd-6944-43da-a06e-099ac722322b None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:49:01.741992 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a65c711-6c37-4e4b-9961-6627306ea228 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:49:01.743455 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a65c711-6c37-4e4b-9961-6627306ea228 None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:49:01.744137 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a65c711-6c37-4e4b-9961-6627306ea228 None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:49:01.744852 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a65c711-6c37-4e4b-9961-6627306ea228 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:49:01.753157 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 379/747] 10.222.0.25 () {60 vars in 1141 bytes} [Thu Sep 15 17:49:01 2022] POST /identity/v3/services => generated 240 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 17:49:01.753157 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27bd1fd-6944-43da-a06e-099ac722322b None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:49:01.766336 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a65c711-6c37-4e4b-9961-6627306ea228 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:49:01.768700 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a65c711-6c37-4e4b-9961-6627306ea228 None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:49:01.781953 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:49:01.796074 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application [None req-0a65c711-6c37-4e4b-9961-6627306ea228 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 17:49:01.796074 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 17:49:01.796074 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 17:49:01.796074 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 17:49:01.796074 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 17:49:01.796074 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 17:49:01.796074 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 17:49:01.796074 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 17:49:01.796074 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 17:49:01.796074 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 17:49:01.796074 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 17:49:01.796074 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 17:49:01.796074 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 15 17:49:01.796074 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 15 17:49:01.796074 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 15 17:49:01.796074 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 15 17:49:01.797102 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 17:49:01.797102 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 17:49:01.797102 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 17:49:01.797102 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 17:49:01.797102 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 17:49:01.797102 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 17:49:01.797102 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 17:49:01.797102 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application with Lock( Sep 15 17:49:01.797102 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 17:49:01.797102 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._enter() Sep 15 17:49:01.797102 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 17:49:01.797102 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 17:49:01.797102 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 17:49:01.797102 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.creator() Sep 15 17:49:01.797102 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 17:49:01.797102 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application created_value = creator( Sep 15 17:49:01.797102 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 15 17:49:01.798076 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 15 17:49:01.798076 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 17:49:01.798076 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Sep 15 17:49:01.801874 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 369/748] 10.222.0.25 () {56 vars in 1108 bytes} [Thu Sep 15 17:49:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 17:49:01.803155 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a65c711-6c37-4e4b-9961-6627306ea228 None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:49:01.808338 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:49:01.890156 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27bd1fd-6944-43da-a06e-099ac722322b None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:49:01.946819 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e43b1e-12a6-4362-b407-ffca88fc1fa0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:49:01.946819 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e43b1e-12a6-4362-b407-ffca88fc1fa0 None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:49:01.946819 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e43b1e-12a6-4362-b407-ffca88fc1fa0 None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:49:01.946819 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e43b1e-12a6-4362-b407-ffca88fc1fa0 None admin] PATH_INFO: `/v3/domains` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:49:01.947404 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e43b1e-12a6-4362-b407-ffca88fc1fa0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81593) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 17:49:01.949659 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e43b1e-12a6-4362-b407-ffca88fc1fa0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:49:01.949775 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a65c711-6c37-4e4b-9961-6627306ea228 None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:49:01.949854 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e43b1e-12a6-4362-b407-ffca88fc1fa0 None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:49:01.967894 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 380/749] 10.222.0.25 () {56 vars in 1109 bytes} [Thu Sep 15 17:49:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 17:49:01.971561 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e43b1e-12a6-4362-b407-ffca88fc1fa0 None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:49:01.999084 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e344113-a828-4b60-929b-1b5b1fd9e5e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:49:01.999838 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e344113-a828-4b60-929b-1b5b1fd9e5e0 None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:49:02.000117 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e344113-a828-4b60-929b-1b5b1fd9e5e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:49:02.000627 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e344113-a828-4b60-929b-1b5b1fd9e5e0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:49:02.014603 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e344113-a828-4b60-929b-1b5b1fd9e5e0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:49:02.016109 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e344113-a828-4b60-929b-1b5b1fd9e5e0 None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:49:02.032560 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application [None req-9e344113-a828-4b60-929b-1b5b1fd9e5e0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 17:49:02.032560 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 17:49:02.032560 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 17:49:02.032560 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 17:49:02.032560 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 17:49:02.032560 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 17:49:02.032560 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 17:49:02.032560 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 17:49:02.032560 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 17:49:02.032560 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 17:49:02.032560 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 17:49:02.032560 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 17:49:02.032560 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 15 17:49:02.032560 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 15 17:49:02.032560 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 15 17:49:02.032560 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 15 17:49:02.034848 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 17:49:02.034848 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 17:49:02.034848 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 17:49:02.034848 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 17:49:02.034848 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 17:49:02.034848 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 17:49:02.034848 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 17:49:02.034848 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application with Lock( Sep 15 17:49:02.034848 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 17:49:02.034848 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._enter() Sep 15 17:49:02.034848 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 17:49:02.034848 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 17:49:02.034848 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 17:49:02.034848 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.creator() Sep 15 17:49:02.034848 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 17:49:02.034848 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application created_value = creator( Sep 15 17:49:02.034848 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 15 17:49:02.036610 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 15 17:49:02.036610 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 17:49:02.036610 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Sep 15 17:49:02.036610 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 370/750] 10.222.0.25 () {56 vars in 1108 bytes} [Thu Sep 15 17:49:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 17:49:02.038550 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e344113-a828-4b60-929b-1b5b1fd9e5e0 None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:49:02.103030 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:49:02.108557 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:49:02.132222 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e43b1e-12a6-4362-b407-ffca88fc1fa0 None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:49:02.164243 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e344113-a828-4b60-929b-1b5b1fd9e5e0 None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:49:02.192373 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23964f6f-c38a-449e-a8a4-a1ca96207eaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:49:02.192373 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23964f6f-c38a-449e-a8a4-a1ca96207eaa None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:49:02.192373 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23964f6f-c38a-449e-a8a4-a1ca96207eaa None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:49:02.192859 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23964f6f-c38a-449e-a8a4-a1ca96207eaa None admin] PATH_INFO: `/v3/domains` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:49:02.193160 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23964f6f-c38a-449e-a8a4-a1ca96207eaa None admin] RBAC: Adding query filter params (name=Default) {{(pid=81593) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 17:49:02.193418 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23964f6f-c38a-449e-a8a4-a1ca96207eaa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:49:02.197107 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23964f6f-c38a-449e-a8a4-a1ca96207eaa None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:49:02.214346 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 381/751] 10.222.0.25 () {56 vars in 1109 bytes} [Thu Sep 15 17:49:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 17:49:02.215265 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23964f6f-c38a-449e-a8a4-a1ca96207eaa None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:49:02.230347 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be67e6a-3067-400c-991b-9295e983bec3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:49:02.231510 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be67e6a-3067-400c-991b-9295e983bec3 None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:49:02.232223 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be67e6a-3067-400c-991b-9295e983bec3 None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:49:02.232647 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be67e6a-3067-400c-991b-9295e983bec3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:49:02.243150 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be67e6a-3067-400c-991b-9295e983bec3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:49:02.245463 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be67e6a-3067-400c-991b-9295e983bec3 None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:49:02.259856 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application [None req-2be67e6a-3067-400c-991b-9295e983bec3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 15 17:49:02.259856 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 17:49:02.259856 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 17:49:02.259856 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 17:49:02.259856 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 17:49:02.259856 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 17:49:02.259856 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 17:49:02.259856 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 17:49:02.259856 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 17:49:02.259856 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 17:49:02.259856 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 17:49:02.259856 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 17:49:02.259856 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 15 17:49:02.259856 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 15 17:49:02.259856 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 15 17:49:02.260800 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 15 17:49:02.260800 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 17:49:02.260800 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 17:49:02.260800 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 17:49:02.260800 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 17:49:02.260800 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 17:49:02.260800 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 17:49:02.260800 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 17:49:02.260800 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application with Lock( Sep 15 17:49:02.260800 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 17:49:02.260800 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._enter() Sep 15 17:49:02.260800 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 17:49:02.260800 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 17:49:02.260800 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 17:49:02.260800 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.creator() Sep 15 17:49:02.260800 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 17:49:02.260800 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application created_value = creator( Sep 15 17:49:02.261726 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 15 17:49:02.261726 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 15 17:49:02.261726 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 15 17:49:02.261726 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 15 17:49:02.261726 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 15 17:49:02.261726 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 15 17:49:02.261726 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 15 17:49:02.261726 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Sep 15 17:49:02.265520 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 371/752] 10.222.0.25 () {56 vars in 1111 bytes} [Thu Sep 15 17:49:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 17:49:02.266295 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be67e6a-3067-400c-991b-9295e983bec3 None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:49:02.363185 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23964f6f-c38a-449e-a8a4-a1ca96207eaa None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:49:02.384895 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be67e6a-3067-400c-991b-9295e983bec3 None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:49:02.402729 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:49:02.415797 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4692adc9-6015-41b5-ad53-27d198d3cb38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:49:02.416809 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4692adc9-6015-41b5-ad53-27d198d3cb38 None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:49:02.417383 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4692adc9-6015-41b5-ad53-27d198d3cb38 None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:49:02.417833 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4692adc9-6015-41b5-ad53-27d198d3cb38 None admin] PATH_INFO: `/v3/domains` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:49:02.418683 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4692adc9-6015-41b5-ad53-27d198d3cb38 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81593) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 17:49:02.419161 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4692adc9-6015-41b5-ad53-27d198d3cb38 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:49:02.420851 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4692adc9-6015-41b5-ad53-27d198d3cb38 None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:49:02.425679 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c1cf63-8474-4ec0-aa87-fa70b7ed3dff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:49:02.426307 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c1cf63-8474-4ec0-aa87-fa70b7ed3dff None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:49:02.426582 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c1cf63-8474-4ec0-aa87-fa70b7ed3dff None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:49:02.426850 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c1cf63-8474-4ec0-aa87-fa70b7ed3dff None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:49:02.435847 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c1cf63-8474-4ec0-aa87-fa70b7ed3dff None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:49:02.436811 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 382/753] 10.222.0.25 () {56 vars in 1109 bytes} [Thu Sep 15 17:49:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 17:49:02.437886 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4692adc9-6015-41b5-ad53-27d198d3cb38 None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:49:02.441853 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:49:02.444974 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c1cf63-8474-4ec0-aa87-fa70b7ed3dff None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:49:02.458947 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application [None req-d4c1cf63-8474-4ec0-aa87-fa70b7ed3dff None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 15 17:49:02.458947 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 17:49:02.458947 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 17:49:02.458947 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 17:49:02.458947 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 17:49:02.458947 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 17:49:02.458947 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 17:49:02.458947 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 17:49:02.458947 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 17:49:02.458947 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 17:49:02.458947 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 17:49:02.458947 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 17:49:02.458947 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 15 17:49:02.458947 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 15 17:49:02.458947 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 15 17:49:02.458947 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 15 17:49:02.459970 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 17:49:02.459970 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 17:49:02.459970 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 15 17:49:02.459970 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 15 17:49:02.459970 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 15 17:49:02.459970 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 15 17:49:02.459970 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 17:49:02.459970 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 17:49:02.459970 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 17:49:02.459970 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 17:49:02.459970 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 17:49:02.459970 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application with Lock( Sep 15 17:49:02.459970 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 17:49:02.459970 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._enter() Sep 15 17:49:02.459970 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 17:49:02.459970 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 17:49:02.459970 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 17:49:02.459970 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.creator() Sep 15 17:49:02.460907 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 17:49:02.460907 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application created_value = creator( Sep 15 17:49:02.460907 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 15 17:49:02.460907 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 15 17:49:02.460907 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 15 17:49:02.460907 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 15 17:49:02.460907 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 15 17:49:02.460907 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 15 17:49:02.460907 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 15 17:49:02.460907 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Sep 15 17:49:02.464818 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 372/754] 10.222.0.25 () {56 vars in 1117 bytes} [Thu Sep 15 17:49:02 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 17:49:02.465739 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c1cf63-8474-4ec0-aa87-fa70b7ed3dff None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:49:02.584049 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c1cf63-8474-4ec0-aa87-fa70b7ed3dff None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:49:02.599626 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4692adc9-6015-41b5-ad53-27d198d3cb38 None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:49:02.622275 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc27cff-51da-4f1a-8a05-982821087b27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:49:02.623190 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc27cff-51da-4f1a-8a05-982821087b27 None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:49:02.623616 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc27cff-51da-4f1a-8a05-982821087b27 None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:49:02.624022 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc27cff-51da-4f1a-8a05-982821087b27 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:49:02.635006 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc27cff-51da-4f1a-8a05-982821087b27 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:49:02.637619 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc27cff-51da-4f1a-8a05-982821087b27 None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:49:02.649435 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7877435-08f0-4062-8ea0-69794cdce2fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:49:02.650346 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7877435-08f0-4062-8ea0-69794cdce2fd None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:49:02.650801 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7877435-08f0-4062-8ea0-69794cdce2fd None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:49:02.651246 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7877435-08f0-4062-8ea0-69794cdce2fd None admin] PATH_INFO: `/v3/projects` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:49:02.651912 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application [None req-abc27cff-51da-4f1a-8a05-982821087b27 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 15 17:49:02.651912 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 17:49:02.651912 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 17:49:02.651912 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 17:49:02.651912 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 17:49:02.651912 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 17:49:02.651912 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 17:49:02.651912 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 17:49:02.651912 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 17:49:02.651912 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 17:49:02.651912 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 17:49:02.651912 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 17:49:02.651912 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 15 17:49:02.651912 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 15 17:49:02.651912 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 15 17:49:02.652794 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 15 17:49:02.652794 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 17:49:02.652794 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 17:49:02.652794 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 17:49:02.652794 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 17:49:02.652794 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 17:49:02.652794 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 17:49:02.652794 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 17:49:02.652794 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application with Lock( Sep 15 17:49:02.652794 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 17:49:02.652794 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._enter() Sep 15 17:49:02.652794 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 17:49:02.652794 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 17:49:02.652794 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 17:49:02.652794 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.creator() Sep 15 17:49:02.652794 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 17:49:02.652794 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application created_value = creator( Sep 15 17:49:02.653857 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 15 17:49:02.653857 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 15 17:49:02.653857 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 15 17:49:02.653857 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 15 17:49:02.653857 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 15 17:49:02.653857 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 15 17:49:02.653857 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 15 17:49:02.653857 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Sep 15 17:49:02.654653 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7877435-08f0-4062-8ea0-69794cdce2fd None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81593) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 17:49:02.655104 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7877435-08f0-4062-8ea0-69794cdce2fd None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:49:02.656715 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7877435-08f0-4062-8ea0-69794cdce2fd None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:49:02.657732 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 373/755] 10.222.0.25 () {56 vars in 1111 bytes} [Thu Sep 15 17:49:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 17:49:02.658580 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc27cff-51da-4f1a-8a05-982821087b27 None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:49:02.670941 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 383/756] 10.222.0.25 () {56 vars in 1148 bytes} [Thu Sep 15 17:49:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 17:49:02.672276 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7877435-08f0-4062-8ea0-69794cdce2fd None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:49:02.696897 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:49:02.745823 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:49:02.766615 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc27cff-51da-4f1a-8a05-982821087b27 None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:49:02.790072 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7877435-08f0-4062-8ea0-69794cdce2fd None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:49:02.803062 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8581cb2d-b08e-4a84-8382-6561f2268694 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:49:02.803693 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8581cb2d-b08e-4a84-8382-6561f2268694 None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:49:02.803969 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8581cb2d-b08e-4a84-8382-6561f2268694 None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:49:02.804238 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8581cb2d-b08e-4a84-8382-6561f2268694 None admin] PATH_INFO: `/v3/users` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:49:02.805214 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8581cb2d-b08e-4a84-8382-6561f2268694 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81592) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 17:49:02.805377 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8581cb2d-b08e-4a84-8382-6561f2268694 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:49:02.806781 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8581cb2d-b08e-4a84-8382-6561f2268694 None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:49:02.832110 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 374/757] 10.222.0.25 () {56 vars in 1149 bytes} [Thu Sep 15 17:49:02 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 17:49:02.833126 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8581cb2d-b08e-4a84-8382-6561f2268694 None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:49:02.835029 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa64fef-2ae7-4282-8d9f-7cfee59bc2b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:49:02.836045 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa64fef-2ae7-4282-8d9f-7cfee59bc2b4 None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:49:02.836562 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa64fef-2ae7-4282-8d9f-7cfee59bc2b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:49:02.837171 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa64fef-2ae7-4282-8d9f-7cfee59bc2b4 None admin] PATH_INFO: `/v3/projects` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:49:02.838142 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa64fef-2ae7-4282-8d9f-7cfee59bc2b4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81593) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 17:49:02.838659 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa64fef-2ae7-4282-8d9f-7cfee59bc2b4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:49:02.840378 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa64fef-2ae7-4282-8d9f-7cfee59bc2b4 None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:49:02.857205 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 384/758] 10.222.0.25 () {56 vars in 1148 bytes} [Thu Sep 15 17:49:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 17:49:02.858507 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa64fef-2ae7-4282-8d9f-7cfee59bc2b4 None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:49:02.950431 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:49:02.961632 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8581cb2d-b08e-4a84-8382-6561f2268694 None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:49:02.975900 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa64fef-2ae7-4282-8d9f-7cfee59bc2b4 None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:49:03.005198 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:49:03.016444 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b311b64-4ae5-407e-815a-9fa9cde62dc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:49:03.016691 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41c318d-8ec9-4ff0-90d7-daf8cbd2150c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:49:03.017276 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41c318d-8ec9-4ff0-90d7-daf8cbd2150c None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:49:03.017700 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41c318d-8ec9-4ff0-90d7-daf8cbd2150c None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:49:03.017929 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41c318d-8ec9-4ff0-90d7-daf8cbd2150c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:49:03.018889 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b311b64-4ae5-407e-815a-9fa9cde62dc8 None admin] REQUEST_METHOD: `PUT` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:49:03.019577 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b311b64-4ae5-407e-815a-9fa9cde62dc8 None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:49:03.020268 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b311b64-4ae5-407e-815a-9fa9cde62dc8 None admin] PATH_INFO: `/v3/projects/1213c0d1b584404ba3998e136f166e89/users/fe2244818e4d4dca9c424cd078653e6a/roles/a9e42be86923434f8af52d3fc07fb4f7` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:49:03.023821 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b311b64-4ae5-407e-815a-9fa9cde62dc8 None admin] RBAC: Authorizing `identity:create_grant(project_id=1213c0d1b584404ba3998e136f166e89, user_id=fe2244818e4d4dca9c424cd078653e6a, role_id=a9e42be86923434f8af52d3fc07fb4f7)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:49:03.026377 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b311b64-4ae5-407e-815a-9fa9cde62dc8 None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:49:03.044626 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 375/759] 10.222.0.25 () {58 vars in 1439 bytes} [Thu Sep 15 17:49:02 2022] PUT /identity/v3/projects/1213c0d1b584404ba3998e136f166e89/users/fe2244818e4d4dca9c424cd078653e6a/roles/a9e42be86923434f8af52d3fc07fb4f7 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 17:49:03.045521 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b311b64-4ae5-407e-815a-9fa9cde62dc8 None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:49:03.115901 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c41c318d-8ec9-4ff0-90d7-daf8cbd2150c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:49:03.118153 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c41c318d-8ec9-4ff0-90d7-daf8cbd2150c None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:49:03.202265 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b311b64-4ae5-407e-815a-9fa9cde62dc8 None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:49:03.250949 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 385/760] 10.222.0.25 () {58 vars in 1282 bytes} [Thu Sep 15 17:49:02 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 388 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 15 17:49:03.252474 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ae4c93-0bcd-4f37-b9c4-d27d0fd7ff77 None None] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:49:03.252655 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40888e3-a155-4df0-8e39-b5cc93c9c1ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:49:03.252774 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ae4c93-0bcd-4f37-b9c4-d27d0fd7ff77 None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:49:03.253011 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ae4c93-0bcd-4f37-b9c4-d27d0fd7ff77 None None] PATH_INFO: `/` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:49:03.253280 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40888e3-a155-4df0-8e39-b5cc93c9c1ff None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:49:03.253593 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40888e3-a155-4df0-8e39-b5cc93c9c1ff None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:49:03.253868 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40888e3-a155-4df0-8e39-b5cc93c9c1ff None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:49:03.254609 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40888e3-a155-4df0-8e39-b5cc93c9c1ff None admin] RBAC: Adding query filter params (role.id=a9e42be86923434f8af52d3fc07fb4f7, scope.project.id=1213c0d1b584404ba3998e136f166e89, user.id=685f7ad4c6fe4c878d542dddd6d81593) {{(pid=81592) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 17:49:03.254798 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 386/761] 10.222.0.25 () {54 vars in 927 bytes} [Thu Sep 15 17:49:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 17:49:03.255510 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ae4c93-0bcd-4f37-b9c4-d27d0fd7ff77 None None] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:49:03.259294 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40888e3-a155-4df0-8e39-b5cc93c9c1ff None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:49:03.261858 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40888e3-a155-4df0-8e39-b5cc93c9c1ff None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:49:03.270405 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 376/762] 10.222.0.25 () {56 vars in 1374 bytes} [Thu Sep 15 17:49:03 2022] GET /identity/v3/role_assignments?user.id=685f7ad4c6fe4c878d542dddd6d81593&scope.project.id=1213c0d1b584404ba3998e136f166e89&role.id=a9e42be86923434f8af52d3fc07fb4f7 => generated 259 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 17:49:03.271750 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f26ced-521c-4a5a-8242-d9f005d1ea16 None None] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:49:03.272040 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f26ced-521c-4a5a-8242-d9f005d1ea16 None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:49:03.272318 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f26ced-521c-4a5a-8242-d9f005d1ea16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:49:03.295956 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.auth.core [None req-96f26ced-521c-4a5a-8242-d9f005d1ea16 None None] MFA Rules not processed for user `5cfa58ef86774ab7800bf91930bf6028`. Rule list: `[]` (Enabled: `True`). {{(pid=81592) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 17:49:03.297550 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:49:03.298043 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-96f26ced-521c-4a5a-8242-d9f005d1ea16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 17:49:03.317955 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:49:03.434989 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 377/763] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Sep 15 17:49:03 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 15 17:49:03.447659 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ae4c93-0bcd-4f37-b9c4-d27d0fd7ff77 None None] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:49:03.506677 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b8b604-3e6b-4155-be89-1c37c2f6e8da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:49:03.507331 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b8b604-3e6b-4155-be89-1c37c2f6e8da None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:49:03.507623 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b8b604-3e6b-4155-be89-1c37c2f6e8da None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:49:03.507886 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b8b604-3e6b-4155-be89-1c37c2f6e8da None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:49:03.525436 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b8b604-3e6b-4155-be89-1c37c2f6e8da None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:49:03.527357 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b8b604-3e6b-4155-be89-1c37c2f6e8da None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:49:03.549860 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application [None req-f4b8b604-3e6b-4155-be89-1c37c2f6e8da None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 17:49:03.549860 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 17:49:03.549860 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 17:49:03.549860 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 17:49:03.549860 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 17:49:03.549860 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 17:49:03.549860 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 17:49:03.549860 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 17:49:03.549860 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 17:49:03.549860 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 17:49:03.549860 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 17:49:03.549860 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 17:49:03.549860 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 15 17:49:03.549860 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 15 17:49:03.549860 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 15 17:49:03.549860 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 15 17:49:03.553119 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 17:49:03.553119 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 17:49:03.553119 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 17:49:03.553119 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 17:49:03.553119 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 17:49:03.553119 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 17:49:03.553119 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 17:49:03.553119 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application with Lock( Sep 15 17:49:03.553119 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 17:49:03.553119 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._enter() Sep 15 17:49:03.553119 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 17:49:03.553119 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 17:49:03.553119 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 17:49:03.553119 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.creator() Sep 15 17:49:03.553119 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 17:49:03.553119 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application created_value = creator( Sep 15 17:49:03.553119 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 15 17:49:03.554638 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 15 17:49:03.554638 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 17:49:03.554638 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Sep 15 17:49:03.554638 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 387/764] 10.222.0.25 () {56 vars in 1108 bytes} [Thu Sep 15 17:49:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 296 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 17:49:03.561614 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f26ced-521c-4a5a-8242-d9f005d1ea16 None None] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:49:03.674836 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f26ced-521c-4a5a-8242-d9f005d1ea16 None None] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:49:03.726196 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59233242-37b3-4178-bc80-2ecab004727d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:49:03.727004 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59233242-37b3-4178-bc80-2ecab004727d None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:49:03.727169 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59233242-37b3-4178-bc80-2ecab004727d None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:49:03.727332 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59233242-37b3-4178-bc80-2ecab004727d None admin] PATH_INFO: `/v3/domains` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:49:03.728067 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59233242-37b3-4178-bc80-2ecab004727d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81592) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 17:49:03.728377 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59233242-37b3-4178-bc80-2ecab004727d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:49:03.729853 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59233242-37b3-4178-bc80-2ecab004727d None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:49:03.743479 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 378/765] 10.222.0.25 () {56 vars in 1109 bytes} [Thu Sep 15 17:49:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 17:49:03.750547 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b8b604-3e6b-4155-be89-1c37c2f6e8da None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:49:03.899643 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:49:03.965065 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59233242-37b3-4178-bc80-2ecab004727d None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:49:03.965819 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b8b604-3e6b-4155-be89-1c37c2f6e8da None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:49:03.984810 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:49:04.038685 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48561f2-947d-4fa4-9ca2-1b105e2290c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:49:04.039346 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48561f2-947d-4fa4-9ca2-1b105e2290c2 None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:49:04.039627 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48561f2-947d-4fa4-9ca2-1b105e2290c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:49:04.039906 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48561f2-947d-4fa4-9ca2-1b105e2290c2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:49:04.058621 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48561f2-947d-4fa4-9ca2-1b105e2290c2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:49:04.060163 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48561f2-947d-4fa4-9ca2-1b105e2290c2 None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:49:04.094392 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application [None req-b48561f2-947d-4fa4-9ca2-1b105e2290c2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 15 17:49:04.094392 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 17:49:04.094392 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 17:49:04.094392 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 17:49:04.094392 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 17:49:04.094392 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 17:49:04.094392 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 17:49:04.094392 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 17:49:04.094392 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 17:49:04.094392 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 17:49:04.094392 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 17:49:04.094392 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 17:49:04.094392 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 15 17:49:04.094392 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 15 17:49:04.094392 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 15 17:49:04.095367 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 15 17:49:04.095367 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 17:49:04.095367 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 17:49:04.095367 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 17:49:04.095367 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 17:49:04.095367 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 17:49:04.095367 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 17:49:04.095367 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 17:49:04.095367 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application with Lock( Sep 15 17:49:04.095367 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 17:49:04.095367 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._enter() Sep 15 17:49:04.095367 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 17:49:04.095367 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 17:49:04.095367 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 17:49:04.095367 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.creator() Sep 15 17:49:04.095367 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 17:49:04.095367 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application created_value = creator( Sep 15 17:49:04.096378 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 15 17:49:04.096378 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 15 17:49:04.096378 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 15 17:49:04.096378 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 15 17:49:04.096378 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 15 17:49:04.096378 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 15 17:49:04.096378 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 15 17:49:04.096378 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Sep 15 17:49:04.096378 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 388/766] 10.222.0.25 () {56 vars in 1111 bytes} [Thu Sep 15 17:49:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 346 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 17:49:04.102171 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48561f2-947d-4fa4-9ca2-1b105e2290c2 None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:49:04.120818 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59233242-37b3-4178-bc80-2ecab004727d None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:49:04.172012 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ed52f4-215c-457e-ab08-e9a562cd3910 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:49:04.174840 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ed52f4-215c-457e-ab08-e9a562cd3910 None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:49:04.175307 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ed52f4-215c-457e-ab08-e9a562cd3910 None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:49:04.175974 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ed52f4-215c-457e-ab08-e9a562cd3910 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:49:04.177166 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ed52f4-215c-457e-ab08-e9a562cd3910 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:49:04.180130 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ed52f4-215c-457e-ab08-e9a562cd3910 None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:49:04.203931 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application [None req-41ed52f4-215c-457e-ab08-e9a562cd3910 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 15 17:49:04.203931 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 17:49:04.203931 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 15 17:49:04.203931 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 15 17:49:04.203931 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 15 17:49:04.203931 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 15 17:49:04.203931 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 15 17:49:04.203931 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 15 17:49:04.203931 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 15 17:49:04.203931 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Sep 15 17:49:04.203931 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 15 17:49:04.203931 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Sep 15 17:49:04.203931 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 17:49:04.203931 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 17:49:04.203931 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 17:49:04.203931 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 17:49:04.203931 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 17:49:04.207530 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 17:49:04.207530 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 17:49:04.207530 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 17:49:04.207530 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 17:49:04.207530 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 17:49:04.207530 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 17:49:04.207530 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 15 17:49:04.207530 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 15 17:49:04.207530 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 15 17:49:04.207530 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 15 17:49:04.207530 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 17:49:04.207530 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 17:49:04.207530 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 17:49:04.207530 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 17:49:04.207530 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 17:49:04.207530 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 17:49:04.210289 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 17:49:04.210289 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application with Lock( Sep 15 17:49:04.210289 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 17:49:04.210289 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._enter() Sep 15 17:49:04.210289 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 17:49:04.210289 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 17:49:04.210289 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 17:49:04.210289 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.creator() Sep 15 17:49:04.210289 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 17:49:04.210289 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application created_value = creator( Sep 15 17:49:04.210289 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 15 17:49:04.210289 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 15 17:49:04.210289 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 15 17:49:04.210289 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Sep 15 17:49:04.210289 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 379/767] 10.222.0.25 () {56 vars in 1129 bytes} [Thu Sep 15 17:49:03 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 17:49:04.217486 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ed52f4-215c-457e-ab08-e9a562cd3910 None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:49:04.363053 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48561f2-947d-4fa4-9ca2-1b105e2290c2 None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:49:04.402537 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:49:04.435271 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51027bba-e505-4b26-a112-08888850f037 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:49:04.436308 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51027bba-e505-4b26-a112-08888850f037 None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:49:04.436588 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51027bba-e505-4b26-a112-08888850f037 None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:49:04.437116 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51027bba-e505-4b26-a112-08888850f037 None admin] PATH_INFO: `/v3/projects` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:49:04.437879 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51027bba-e505-4b26-a112-08888850f037 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81593) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 17:49:04.438187 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51027bba-e505-4b26-a112-08888850f037 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:49:04.440523 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51027bba-e505-4b26-a112-08888850f037 None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:49:04.444978 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ed52f4-215c-457e-ab08-e9a562cd3910 None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:49:04.453277 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:49:04.457754 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 389/768] 10.222.0.25 () {56 vars in 1148 bytes} [Thu Sep 15 17:49:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 356 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 17:49:04.460778 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbde46a-3435-4866-92fc-a117331413f0 None None] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:49:04.461361 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbde46a-3435-4866-92fc-a117331413f0 None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:49:04.462105 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbde46a-3435-4866-92fc-a117331413f0 None None] PATH_INFO: `/` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:49:04.464278 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 390/769] 10.222.0.25 () {54 vars in 927 bytes} [Thu Sep 15 17:49:04 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 17:49:04.464959 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbde46a-3435-4866-92fc-a117331413f0 None None] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:49:04.494119 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b41238b-7d45-4ad9-9a46-9b8c05da50c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:49:04.494837 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b41238b-7d45-4ad9-9a46-9b8c05da50c4 None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:49:04.495192 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b41238b-7d45-4ad9-9a46-9b8c05da50c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:49:04.495541 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b41238b-7d45-4ad9-9a46-9b8c05da50c4 None admin] PATH_INFO: `/v3/services` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:49:04.496253 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b41238b-7d45-4ad9-9a46-9b8c05da50c4 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81592) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 17:49:04.496662 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b41238b-7d45-4ad9-9a46-9b8c05da50c4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:49:04.499838 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b41238b-7d45-4ad9-9a46-9b8c05da50c4 None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:49:04.506862 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 380/770] 10.222.0.25 () {56 vars in 1124 bytes} [Thu Sep 15 17:49:04 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 17:49:04.508103 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd32acb1-786c-469a-9b55-e790ad21d46b None None] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:49:04.508392 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd32acb1-786c-469a-9b55-e790ad21d46b None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:49:04.508671 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd32acb1-786c-469a-9b55-e790ad21d46b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:49:04.531198 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.auth.core [None req-dd32acb1-786c-469a-9b55-e790ad21d46b None None] MFA Rules not processed for user `5cfa58ef86774ab7800bf91930bf6028`. Rule list: `[]` (Enabled: `True`). {{(pid=81592) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 17:49:04.532457 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-dd32acb1-786c-469a-9b55-e790ad21d46b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 17:49:04.626203 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbde46a-3435-4866-92fc-a117331413f0 None None] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:49:04.637444 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 381/771] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Sep 15 17:49:04 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 15 17:49:04.638448 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd32acb1-786c-469a-9b55-e790ad21d46b None None] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:49:04.691163 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789f8d06-1753-4a7d-a954-9844c1298b3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:49:04.691784 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789f8d06-1753-4a7d-a954-9844c1298b3b None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:49:04.692059 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789f8d06-1753-4a7d-a954-9844c1298b3b None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:49:04.692329 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789f8d06-1753-4a7d-a954-9844c1298b3b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:49:04.693068 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789f8d06-1753-4a7d-a954-9844c1298b3b None admin] RBAC: Adding query filter params (role.id=17e337d9acf148e99d6c50170293fa05, scope.project.id=1213c0d1b584404ba3998e136f166e89, user.id=d899ec4fcbeb4de382c7f0a779ca8ed5) {{(pid=81593) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 17:49:04.694304 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789f8d06-1753-4a7d-a954-9844c1298b3b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:49:04.695787 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789f8d06-1753-4a7d-a954-9844c1298b3b None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:49:04.708678 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 391/772] 10.222.0.25 () {56 vars in 1374 bytes} [Thu Sep 15 17:49:04 2022] GET /identity/v3/role_assignments?user.id=d899ec4fcbeb4de382c7f0a779ca8ed5&scope.project.id=1213c0d1b584404ba3998e136f166e89&role.id=17e337d9acf148e99d6c50170293fa05 => generated 259 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 17:49:04.757763 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:49:04.816193 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd32acb1-786c-469a-9b55-e790ad21d46b None None] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:49:04.865861 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e987225e-fec0-4cb8-a87f-7f1e7ed6b180 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:49:04.866485 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e987225e-fec0-4cb8-a87f-7f1e7ed6b180 None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:49:04.866761 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e987225e-fec0-4cb8-a87f-7f1e7ed6b180 None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:49:04.867077 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e987225e-fec0-4cb8-a87f-7f1e7ed6b180 None admin] PATH_INFO: `/v3/services` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:49:04.867721 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e987225e-fec0-4cb8-a87f-7f1e7ed6b180 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81592) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 17:49:04.868022 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e987225e-fec0-4cb8-a87f-7f1e7ed6b180 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:49:04.873071 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e987225e-fec0-4cb8-a87f-7f1e7ed6b180 None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:49:04.881276 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 382/773] 10.222.0.25 () {56 vars in 1124 bytes} [Thu Sep 15 17:49:04 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 17:49:04.889542 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789f8d06-1753-4a7d-a954-9844c1298b3b None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:49:04.983358 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:49:05.049941 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789f8d06-1753-4a7d-a954-9844c1298b3b None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:49:05.094398 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4984b785-8aef-48e4-bfdb-951bd4ebbcf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:49:05.094398 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4984b785-8aef-48e4-bfdb-951bd4ebbcf6 None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:49:05.094398 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4984b785-8aef-48e4-bfdb-951bd4ebbcf6 None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:49:05.094398 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4984b785-8aef-48e4-bfdb-951bd4ebbcf6 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:49:05.094838 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e987225e-fec0-4cb8-a87f-7f1e7ed6b180 None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:49:05.094919 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4984b785-8aef-48e4-bfdb-951bd4ebbcf6 None admin] RBAC: Adding query filter params (interface=public, service_id=e00d960533cb495ba74de184b1161338, region_id=RegionOne) {{(pid=81593) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 17:49:05.094919 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4984b785-8aef-48e4-bfdb-951bd4ebbcf6 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:49:05.096753 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4984b785-8aef-48e4-bfdb-951bd4ebbcf6 None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:49:05.109666 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 392/774] 10.222.0.25 () {56 vars in 1251 bytes} [Thu Sep 15 17:49:04 2022] GET /identity/v3/endpoints?service_id=e00d960533cb495ba74de184b1161338&interface=public®ion_id=RegionOne => generated 194 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 17:49:05.134830 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4984b785-8aef-48e4-bfdb-951bd4ebbcf6 None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:49:05.250204 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e987225e-fec0-4cb8-a87f-7f1e7ed6b180 None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:49:05.295548 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:49:05.306017 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1e912f-7a48-4258-add7-94d046a31ed2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:49:05.308181 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1e912f-7a48-4258-add7-94d046a31ed2 None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:49:05.308748 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1e912f-7a48-4258-add7-94d046a31ed2 None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:49:05.309239 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1e912f-7a48-4258-add7-94d046a31ed2 None admin] PATH_INFO: `/v3/services/network` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:49:05.310087 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e1e912f-7a48-4258-add7-94d046a31ed2 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:49:05.311662 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e1e912f-7a48-4258-add7-94d046a31ed2 None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:49:05.323057 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application [None req-9e1e912f-7a48-4258-add7-94d046a31ed2 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Sep 15 17:49:05.323057 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 17:49:05.323057 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 15 17:49:05.323057 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 15 17:49:05.323057 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 15 17:49:05.323057 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 15 17:49:05.323057 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 15 17:49:05.323057 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 15 17:49:05.323057 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 15 17:49:05.323057 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Sep 15 17:49:05.323057 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 15 17:49:05.323057 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Sep 15 17:49:05.323057 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 17:49:05.323057 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 17:49:05.323057 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 17:49:05.323057 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 17:49:05.323057 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 17:49:05.324113 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 17:49:05.324113 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 17:49:05.324113 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 17:49:05.324113 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 17:49:05.324113 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 17:49:05.324113 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 17:49:05.324113 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 15 17:49:05.324113 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 15 17:49:05.324113 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 15 17:49:05.324113 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 15 17:49:05.324113 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 17:49:05.324113 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 17:49:05.324113 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 17:49:05.324113 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 17:49:05.324113 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 17:49:05.324113 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 17:49:05.324957 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 17:49:05.324957 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application with Lock( Sep 15 17:49:05.324957 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 17:49:05.324957 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._enter() Sep 15 17:49:05.324957 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 17:49:05.324957 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 17:49:05.324957 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 17:49:05.324957 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.creator() Sep 15 17:49:05.324957 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 17:49:05.324957 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application created_value = creator( Sep 15 17:49:05.324957 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 15 17:49:05.324957 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 15 17:49:05.324957 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 15 17:49:05.324957 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Sep 15 17:49:05.328204 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 383/775] 10.222.0.25 () {56 vars in 1111 bytes} [Thu Sep 15 17:49:05 2022] GET /identity/v3/services/network => generated 88 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 17:49:05.335162 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1e912f-7a48-4258-add7-94d046a31ed2 None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:49:05.403757 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4984b785-8aef-48e4-bfdb-951bd4ebbcf6 None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:49:05.469718 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:49:05.490008 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760700e5-e37f-4b20-8235-6fe12a72a55a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:49:05.490639 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760700e5-e37f-4b20-8235-6fe12a72a55a None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:49:05.490920 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760700e5-e37f-4b20-8235-6fe12a72a55a None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:49:05.491196 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760700e5-e37f-4b20-8235-6fe12a72a55a None admin] PATH_INFO: `/v3/services` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:49:05.491815 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-760700e5-e37f-4b20-8235-6fe12a72a55a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:49:05.493184 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-760700e5-e37f-4b20-8235-6fe12a72a55a None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:49:05.500009 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1e912f-7a48-4258-add7-94d046a31ed2 None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:49:05.509635 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 393/776] 10.222.0.25 () {56 vars in 1087 bytes} [Thu Sep 15 17:49:05 2022] GET /identity/v3/services => generated 772 bytes in 375 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 17:49:05.548171 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad093e38-464e-49ca-98b2-4809829d0992 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:49:05.549439 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad093e38-464e-49ca-98b2-4809829d0992 None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:49:05.549439 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad093e38-464e-49ca-98b2-4809829d0992 None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:49:05.549439 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad093e38-464e-49ca-98b2-4809829d0992 None admin] PATH_INFO: `/v3/services` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:49:05.550009 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad093e38-464e-49ca-98b2-4809829d0992 None admin] RBAC: Adding query filter params (name=network) {{(pid=81592) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 17:49:05.550316 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad093e38-464e-49ca-98b2-4809829d0992 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:49:05.551852 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad093e38-464e-49ca-98b2-4809829d0992 None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:49:05.559686 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 384/777] 10.222.0.25 () {56 vars in 1112 bytes} [Thu Sep 15 17:49:05 2022] GET /identity/v3/services?name=network => generated 124 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 17:49:05.566819 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760700e5-e37f-4b20-8235-6fe12a72a55a None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:49:05.752665 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760700e5-e37f-4b20-8235-6fe12a72a55a None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:49:05.793944 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd3c378-1558-48a6-a7ec-1366a2397870 None None] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:49:05.794562 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd3c378-1558-48a6-a7ec-1366a2397870 None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:49:05.794562 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd3c378-1558-48a6-a7ec-1366a2397870 None None] PATH_INFO: `/` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:49:05.796072 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 385/778] 10.222.0.25 () {54 vars in 927 bytes} [Thu Sep 15 17:49:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 17:49:05.798540 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92383608-efe8-4c3d-acf5-b967b503f176 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:49:05.799412 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92383608-efe8-4c3d-acf5-b967b503f176 None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:49:05.799914 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92383608-efe8-4c3d-acf5-b967b503f176 None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:49:05.800388 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92383608-efe8-4c3d-acf5-b967b503f176 None admin] PATH_INFO: `/v3/services` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:49:05.801237 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92383608-efe8-4c3d-acf5-b967b503f176 None admin] RBAC: Adding query filter params (type=network) {{(pid=81593) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 17:49:05.801468 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c495b3-e46f-4683-aa90-894a5d8774b0 None None] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:49:05.801561 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c495b3-e46f-4683-aa90-894a5d8774b0 None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:49:05.801845 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c495b3-e46f-4683-aa90-894a5d8774b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:49:05.802260 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92383608-efe8-4c3d-acf5-b967b503f176 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:49:05.803845 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92383608-efe8-4c3d-acf5-b967b503f176 None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:49:05.811943 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 394/779] 10.222.0.25 () {56 vars in 1112 bytes} [Thu Sep 15 17:49:05 2022] GET /identity/v3/services?type=network => generated 350 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 17:49:05.818644 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92383608-efe8-4c3d-acf5-b967b503f176 None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:49:05.828431 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.auth.core [None req-c1c495b3-e46f-4683-aa90-894a5d8774b0 None None] MFA Rules not processed for user `5cfa58ef86774ab7800bf91930bf6028`. Rule list: `[]` (Enabled: `True`). {{(pid=81592) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 17:49:05.829744 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-c1c495b3-e46f-4683-aa90-894a5d8774b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 17:49:05.879423 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:49:05.945494 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:49:05.973806 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92383608-efe8-4c3d-acf5-b967b503f176 None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:49:05.975865 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 386/780] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Sep 15 17:49:05 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 15 17:49:06.038482 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c335e6-c5e0-48d6-813d-280a29584a25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:49:06.039772 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c335e6-c5e0-48d6-813d-280a29584a25 None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:49:06.040257 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c335e6-c5e0-48d6-813d-280a29584a25 None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:49:06.040733 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c335e6-c5e0-48d6-813d-280a29584a25 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:49:06.041695 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c335e6-c5e0-48d6-813d-280a29584a25 None admin] RBAC: Adding query filter params (interface=public, service_id=e102550f335846d3a57f1326158653b2, region_id=RegionOne) {{(pid=81593) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 17:49:06.042226 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c335e6-c5e0-48d6-813d-280a29584a25 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:49:06.043888 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c335e6-c5e0-48d6-813d-280a29584a25 None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:49:06.053010 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 395/781] 10.222.0.25 () {56 vars in 1251 bytes} [Thu Sep 15 17:49:05 2022] GET /identity/v3/endpoints?service_id=e102550f335846d3a57f1326158653b2&interface=public®ion_id=RegionOne => generated 194 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 17:49:06.058943 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c495b3-e46f-4683-aa90-894a5d8774b0 None None] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:49:06.163184 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c495b3-e46f-4683-aa90-894a5d8774b0 None None] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:49:06.199067 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f8dba2-4157-41d5-9a45-34ec1470756a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:49:06.200106 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f8dba2-4157-41d5-9a45-34ec1470756a None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:49:06.200590 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f8dba2-4157-41d5-9a45-34ec1470756a None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:49:06.201065 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f8dba2-4157-41d5-9a45-34ec1470756a None admin] PATH_INFO: `/v3/services` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:49:06.201945 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f8dba2-4157-41d5-9a45-34ec1470756a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:49:06.203511 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f8dba2-4157-41d5-9a45-34ec1470756a None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:49:06.209872 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 387/782] 10.222.0.25 () {56 vars in 1087 bytes} [Thu Sep 15 17:49:06 2022] GET /identity/v3/services => generated 772 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 17:49:06.363586 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c335e6-c5e0-48d6-813d-280a29584a25 None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:49:06.483246 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c335e6-c5e0-48d6-813d-280a29584a25 None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:49:06.486792 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb83e1ea-fa8c-4c24-8510-77e63b8a65df None None] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:49:06.487400 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb83e1ea-fa8c-4c24-8510-77e63b8a65df None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:49:06.487890 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb83e1ea-fa8c-4c24-8510-77e63b8a65df None None] PATH_INFO: `/` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:49:06.489976 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 388/783] 10.222.0.25 () {54 vars in 927 bytes} [Thu Sep 15 17:49:06 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 17:49:06.495765 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da2c66e-1781-4452-a98e-8640d76a19bd None None] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:49:06.496350 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da2c66e-1781-4452-a98e-8640d76a19bd None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:49:06.496843 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da2c66e-1781-4452-a98e-8640d76a19bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:49:06.507799 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:49:06.527167 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.auth.core [None req-0da2c66e-1781-4452-a98e-8640d76a19bd None None] MFA Rules not processed for user `5cfa58ef86774ab7800bf91930bf6028`. Rule list: `[]` (Enabled: `True`). {{(pid=81592) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 17:49:06.529281 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-0da2c66e-1781-4452-a98e-8640d76a19bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 17:49:06.541428 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65fd8a17-1d44-450f-ba4c-3cda686a1e6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:49:06.543953 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fd8a17-1d44-450f-ba4c-3cda686a1e6c None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:49:06.544386 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fd8a17-1d44-450f-ba4c-3cda686a1e6c None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:49:06.544806 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fd8a17-1d44-450f-ba4c-3cda686a1e6c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:49:06.566559 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65fd8a17-1d44-450f-ba4c-3cda686a1e6c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 17:49:06.573151 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application [None req-65fd8a17-1d44-450f-ba4c-3cda686a1e6c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 15 17:49:06.573151 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 17:49:06.573151 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 17:49:06.573151 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 17:49:06.573151 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 17:49:06.573151 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 17:49:06.573151 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 17:49:06.573151 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 17:49:06.573151 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 17:49:06.573151 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 17:49:06.573151 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 17:49:06.573151 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 17:49:06.573151 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 17:49:06.573151 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 17:49:06.573151 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 17:49:06.573151 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 17:49:06.574308 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 17:49:06.574308 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 17:49:06.574308 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 17:49:06.574308 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 17:49:06.574308 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 17:49:06.574308 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 17:49:06.574308 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 17:49:06.574308 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 17:49:06.574308 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 17:49:06.574308 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 17:49:06.574308 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 17:49:06.574308 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application with Lock( Sep 15 17:49:06.574308 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 17:49:06.574308 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._enter() Sep 15 17:49:06.574308 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 17:49:06.574308 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 17:49:06.575370 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 17:49:06.575370 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.creator() Sep 15 17:49:06.575370 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 17:49:06.575370 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application created_value = creator( Sep 15 17:49:06.575370 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 17:49:06.575370 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 17:49:06.575370 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 17:49:06.575370 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 17:49:06.575370 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 17:49:06.575370 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 17:49:06.575370 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 15 17:49:06.575370 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Sep 15 17:49:06.577692 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 396/784] 10.222.0.25 () {56 vars in 1096 bytes} [Thu Sep 15 17:49:06 2022] GET /identity/v3/roles/admin => generated 83 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 17:49:06.588222 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65fd8a17-1d44-450f-ba4c-3cda686a1e6c None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:49:06.610956 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:49:06.634738 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 389/785] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Sep 15 17:49:06 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 15 17:49:06.857878 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65fd8a17-1d44-450f-ba4c-3cda686a1e6c None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:49:06.906936 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ac1525-cd16-4a07-811b-fb2da6629e4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:49:06.907465 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ac1525-cd16-4a07-811b-fb2da6629e4f None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:49:06.907747 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ac1525-cd16-4a07-811b-fb2da6629e4f None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:49:06.908063 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ac1525-cd16-4a07-811b-fb2da6629e4f None admin] PATH_INFO: `/v3/roles` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:49:06.908736 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ac1525-cd16-4a07-811b-fb2da6629e4f None admin] RBAC: Adding query filter params (name=admin) {{(pid=81593) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 17:49:06.909034 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ac1525-cd16-4a07-811b-fb2da6629e4f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:49:06.910878 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ac1525-cd16-4a07-811b-fb2da6629e4f None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:49:06.926073 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 397/786] 10.222.0.25 () {56 vars in 1099 bytes} [Thu Sep 15 17:49:06 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 338 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 17:49:06.934696 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da2c66e-1781-4452-a98e-8640d76a19bd None None] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:49:07.090141 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da2c66e-1781-4452-a98e-8640d76a19bd None None] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:49:07.099860 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ac1525-cd16-4a07-811b-fb2da6629e4f None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:49:07.138380 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612f14b2-080a-4ddc-97fd-500eaeb3eeec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:49:07.139403 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612f14b2-080a-4ddc-97fd-500eaeb3eeec None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:49:07.139906 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612f14b2-080a-4ddc-97fd-500eaeb3eeec None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:49:07.140379 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612f14b2-080a-4ddc-97fd-500eaeb3eeec None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:49:07.160776 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:49:07.162300 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-612f14b2-080a-4ddc-97fd-500eaeb3eeec None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:49:07.164147 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-612f14b2-080a-4ddc-97fd-500eaeb3eeec None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:49:07.192758 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application [None req-612f14b2-080a-4ddc-97fd-500eaeb3eeec None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 17:49:07.192758 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 17:49:07.192758 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 17:49:07.192758 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 17:49:07.192758 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 17:49:07.192758 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 17:49:07.192758 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 17:49:07.192758 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 17:49:07.192758 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 17:49:07.192758 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 17:49:07.192758 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 17:49:07.192758 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 17:49:07.192758 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 15 17:49:07.192758 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 15 17:49:07.192758 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 15 17:49:07.192758 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 15 17:49:07.193885 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 17:49:07.193885 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 17:49:07.193885 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 17:49:07.193885 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 17:49:07.193885 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 17:49:07.193885 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 17:49:07.193885 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 17:49:07.193885 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application with Lock( Sep 15 17:49:07.193885 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 17:49:07.193885 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._enter() Sep 15 17:49:07.193885 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 17:49:07.193885 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 17:49:07.193885 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 17:49:07.193885 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.creator() Sep 15 17:49:07.193885 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 17:49:07.193885 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application created_value = creator( Sep 15 17:49:07.193885 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 15 17:49:07.194805 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 15 17:49:07.194805 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 17:49:07.194805 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Sep 15 17:49:07.194805 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 390/787] 10.222.0.25 () {56 vars in 1108 bytes} [Thu Sep 15 17:49:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 17:49:07.200211 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612f14b2-080a-4ddc-97fd-500eaeb3eeec None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:49:07.272974 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ac1525-cd16-4a07-811b-fb2da6629e4f None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:49:07.273680 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:49:07.351337 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b723c766-a03e-4df1-930a-6d0adfd099c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:49:07.351984 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b723c766-a03e-4df1-930a-6d0adfd099c4 None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:49:07.352310 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b723c766-a03e-4df1-930a-6d0adfd099c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:49:07.352577 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b723c766-a03e-4df1-930a-6d0adfd099c4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:49:07.375917 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b723c766-a03e-4df1-930a-6d0adfd099c4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 17:49:07.381455 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application [None req-b723c766-a03e-4df1-930a-6d0adfd099c4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 15 17:49:07.381455 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 17:49:07.381455 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 17:49:07.381455 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 17:49:07.381455 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 17:49:07.381455 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 17:49:07.381455 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 17:49:07.381455 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 17:49:07.381455 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 17:49:07.381455 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 17:49:07.381455 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 17:49:07.381455 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 17:49:07.381455 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 17:49:07.381455 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 17:49:07.381455 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 17:49:07.381455 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 17:49:07.382445 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 17:49:07.382445 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 17:49:07.382445 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 17:49:07.382445 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 17:49:07.382445 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 17:49:07.382445 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 17:49:07.382445 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 17:49:07.382445 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 17:49:07.382445 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 17:49:07.382445 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 17:49:07.382445 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 17:49:07.382445 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application with Lock( Sep 15 17:49:07.382445 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 17:49:07.382445 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._enter() Sep 15 17:49:07.382445 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 17:49:07.382445 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 17:49:07.383314 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 17:49:07.383314 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.creator() Sep 15 17:49:07.383314 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 17:49:07.383314 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application created_value = creator( Sep 15 17:49:07.383314 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 17:49:07.383314 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 17:49:07.383314 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 17:49:07.383314 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 17:49:07.383314 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 17:49:07.383314 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 17:49:07.383314 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 15 17:49:07.383314 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Sep 15 17:49:07.383314 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 398/788] 10.222.0.25 () {56 vars in 1096 bytes} [Thu Sep 15 17:49:07 2022] GET /identity/v3/roles/admin => generated 83 bytes in 283 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 15 17:49:07.393761 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b723c766-a03e-4df1-930a-6d0adfd099c4 None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:49:07.412981 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612f14b2-080a-4ddc-97fd-500eaeb3eeec None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:49:07.480896 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a84a61-e290-493c-876e-e4fe1c24490f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:49:07.481535 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a84a61-e290-493c-876e-e4fe1c24490f None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:49:07.481810 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a84a61-e290-493c-876e-e4fe1c24490f None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:49:07.482080 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a84a61-e290-493c-876e-e4fe1c24490f None admin] PATH_INFO: `/v3/domains` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:49:07.482719 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a84a61-e290-493c-876e-e4fe1c24490f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81592) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 17:49:07.483022 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a84a61-e290-493c-876e-e4fe1c24490f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:49:07.484629 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a84a61-e290-493c-876e-e4fe1c24490f None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:49:07.499476 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 391/789] 10.222.0.25 () {56 vars in 1109 bytes} [Thu Sep 15 17:49:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 300 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 17:49:07.505748 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a84a61-e290-493c-876e-e4fe1c24490f None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:49:07.548339 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:49:07.552521 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b723c766-a03e-4df1-930a-6d0adfd099c4 None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:49:07.621128 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92fdcbb-7deb-4de0-af82-afd19abc4cd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:49:07.622100 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92fdcbb-7deb-4de0-af82-afd19abc4cd2 None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:49:07.622524 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92fdcbb-7deb-4de0-af82-afd19abc4cd2 None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:49:07.622978 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92fdcbb-7deb-4de0-af82-afd19abc4cd2 None admin] PATH_INFO: `/v3/roles` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:49:07.623943 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:49:07.624345 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c92fdcbb-7deb-4de0-af82-afd19abc4cd2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81593) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 17:49:07.625487 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c92fdcbb-7deb-4de0-af82-afd19abc4cd2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:49:07.628115 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c92fdcbb-7deb-4de0-af82-afd19abc4cd2 None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:49:07.639775 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a84a61-e290-493c-876e-e4fe1c24490f None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:49:07.659870 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 399/790] 10.222.0.25 () {56 vars in 1099 bytes} [Thu Sep 15 17:49:07 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 17:49:07.661564 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955b7e4e-7222-49ac-99a3-45a28bf1d9f9 None None] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:49:07.662062 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955b7e4e-7222-49ac-99a3-45a28bf1d9f9 None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:49:07.662536 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955b7e4e-7222-49ac-99a3-45a28bf1d9f9 None None] PATH_INFO: `/` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:49:07.667976 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 400/791] 10.222.0.25 () {54 vars in 927 bytes} [Thu Sep 15 17:49:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 17:49:07.669640 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955b7e4e-7222-49ac-99a3-45a28bf1d9f9 None None] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:49:07.698637 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12dca601-1ac1-4aa1-b22b-2933aa832fa3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:49:07.699394 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12dca601-1ac1-4aa1-b22b-2933aa832fa3 None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:49:07.699676 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12dca601-1ac1-4aa1-b22b-2933aa832fa3 None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:49:07.699947 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12dca601-1ac1-4aa1-b22b-2933aa832fa3 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:49:07.708240 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12dca601-1ac1-4aa1-b22b-2933aa832fa3 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:49:07.709743 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12dca601-1ac1-4aa1-b22b-2933aa832fa3 None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:49:07.723994 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application [None req-12dca601-1ac1-4aa1-b22b-2933aa832fa3 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 15 17:49:07.723994 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 17:49:07.723994 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 17:49:07.723994 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 17:49:07.723994 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 17:49:07.723994 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 17:49:07.723994 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 17:49:07.723994 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 17:49:07.723994 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 17:49:07.723994 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 17:49:07.723994 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 17:49:07.723994 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 17:49:07.723994 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 15 17:49:07.723994 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 15 17:49:07.723994 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 15 17:49:07.723994 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 15 17:49:07.725047 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 17:49:07.725047 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 17:49:07.725047 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 15 17:49:07.725047 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 15 17:49:07.725047 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 15 17:49:07.725047 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 15 17:49:07.725047 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 17:49:07.725047 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 17:49:07.725047 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 17:49:07.725047 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 17:49:07.725047 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 17:49:07.725047 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application with Lock( Sep 15 17:49:07.725047 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 17:49:07.725047 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._enter() Sep 15 17:49:07.725047 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 17:49:07.725047 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 17:49:07.725047 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 17:49:07.725047 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.creator() Sep 15 17:49:07.726601 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 17:49:07.726601 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application created_value = creator( Sep 15 17:49:07.726601 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 15 17:49:07.726601 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 15 17:49:07.726601 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 15 17:49:07.726601 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 15 17:49:07.726601 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 15 17:49:07.726601 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 15 17:49:07.726601 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 15 17:49:07.726601 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Sep 15 17:49:07.726601 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 392/792] 10.222.0.25 () {56 vars in 1093 bytes} [Thu Sep 15 17:49:07 2022] GET /identity/v3/users/nova => generated 82 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 17:49:07.727205 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd468f7-a07f-4368-a28a-c7e3806a73c1 None None] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:49:07.727205 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd468f7-a07f-4368-a28a-c7e3806a73c1 None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:49:07.727205 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd468f7-a07f-4368-a28a-c7e3806a73c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:49:07.747168 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.auth.core [None req-bdd468f7-a07f-4368-a28a-c7e3806a73c1 None None] MFA Rules not processed for user `5cfa58ef86774ab7800bf91930bf6028`. Rule list: `[]` (Enabled: `True`). {{(pid=81592) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 17:49:07.748364 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-bdd468f7-a07f-4368-a28a-c7e3806a73c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 17:49:07.799751 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955b7e4e-7222-49ac-99a3-45a28bf1d9f9 None None] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:49:07.839657 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 393/793] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Sep 15 17:49:07 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 15 17:49:07.841439 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd468f7-a07f-4368-a28a-c7e3806a73c1 None None] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:49:07.862041 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e049866-6a5a-40b8-82bf-206aca109ba4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:49:07.862778 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e049866-6a5a-40b8-82bf-206aca109ba4 None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:49:07.863040 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e049866-6a5a-40b8-82bf-206aca109ba4 None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:49:07.863351 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e049866-6a5a-40b8-82bf-206aca109ba4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:49:07.894123 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e049866-6a5a-40b8-82bf-206aca109ba4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:49:07.895592 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e049866-6a5a-40b8-82bf-206aca109ba4 None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:49:07.931742 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application [None req-5e049866-6a5a-40b8-82bf-206aca109ba4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 17:49:07.931742 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 17:49:07.931742 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 17:49:07.931742 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 17:49:07.931742 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 17:49:07.931742 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 17:49:07.931742 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 17:49:07.931742 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 17:49:07.931742 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 17:49:07.931742 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 17:49:07.931742 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 17:49:07.931742 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 17:49:07.931742 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 15 17:49:07.931742 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 15 17:49:07.931742 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 15 17:49:07.931742 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 15 17:49:07.932752 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 17:49:07.932752 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 17:49:07.932752 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 17:49:07.932752 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 17:49:07.932752 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 17:49:07.932752 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 17:49:07.932752 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 17:49:07.932752 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application with Lock( Sep 15 17:49:07.932752 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 17:49:07.932752 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._enter() Sep 15 17:49:07.932752 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 17:49:07.932752 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 17:49:07.932752 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 17:49:07.932752 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.creator() Sep 15 17:49:07.932752 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 17:49:07.932752 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application created_value = creator( Sep 15 17:49:07.932752 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 15 17:49:07.938146 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 15 17:49:07.938146 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 17:49:07.938146 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Sep 15 17:49:07.941982 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 401/794] 10.222.0.25 () {56 vars in 1108 bytes} [Thu Sep 15 17:49:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 272 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 15 17:49:07.948146 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:49:07.955270 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e049866-6a5a-40b8-82bf-206aca109ba4 None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:49:07.969394 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd468f7-a07f-4368-a28a-c7e3806a73c1 None None] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:49:08.003025 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:49:08.032583 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f86803b-155c-4a73-855e-6e9170a5a75a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:49:08.034540 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f86803b-155c-4a73-855e-6e9170a5a75a None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:49:08.034821 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f86803b-155c-4a73-855e-6e9170a5a75a None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:49:08.035093 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f86803b-155c-4a73-855e-6e9170a5a75a None admin] PATH_INFO: `/v3/users` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:49:08.036085 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f86803b-155c-4a73-855e-6e9170a5a75a None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81592) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 17:49:08.036378 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f86803b-155c-4a73-855e-6e9170a5a75a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:49:08.042153 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f86803b-155c-4a73-855e-6e9170a5a75a None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:49:08.075773 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 394/795] 10.222.0.25 () {56 vars in 1133 bytes} [Thu Sep 15 17:49:07 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 17:49:08.080449 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f86803b-155c-4a73-855e-6e9170a5a75a None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:49:08.169378 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e049866-6a5a-40b8-82bf-206aca109ba4 None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:49:08.219817 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d050b18-3e6e-4057-b351-07bd294019a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:49:08.220870 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d050b18-3e6e-4057-b351-07bd294019a8 None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:49:08.221144 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d050b18-3e6e-4057-b351-07bd294019a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:49:08.221438 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d050b18-3e6e-4057-b351-07bd294019a8 None admin] PATH_INFO: `/v3/domains` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:49:08.222091 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d050b18-3e6e-4057-b351-07bd294019a8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81593) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 17:49:08.222391 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d050b18-3e6e-4057-b351-07bd294019a8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:49:08.223749 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d050b18-3e6e-4057-b351-07bd294019a8 None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:49:08.233312 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f86803b-155c-4a73-855e-6e9170a5a75a None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:49:08.246989 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 402/796] 10.222.0.25 () {56 vars in 1109 bytes} [Thu Sep 15 17:49:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 17:49:08.247861 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d050b18-3e6e-4057-b351-07bd294019a8 None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:49:08.279930 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5387c7af-5c57-4710-a158-89ee761e8544 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:49:08.281137 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5387c7af-5c57-4710-a158-89ee761e8544 None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:49:08.281790 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5387c7af-5c57-4710-a158-89ee761e8544 None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:49:08.282608 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5387c7af-5c57-4710-a158-89ee761e8544 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:49:08.299761 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:49:08.332695 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:49:08.366295 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d050b18-3e6e-4057-b351-07bd294019a8 None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:49:08.369348 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5387c7af-5c57-4710-a158-89ee761e8544 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:49:08.370798 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5387c7af-5c57-4710-a158-89ee761e8544 None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:49:08.410940 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5da5585-91a4-4a49-ab1f-c44f3af997fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:49:08.411581 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5da5585-91a4-4a49-ab1f-c44f3af997fb None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:49:08.411856 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5da5585-91a4-4a49-ab1f-c44f3af997fb None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:49:08.412143 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5da5585-91a4-4a49-ab1f-c44f3af997fb None admin] PATH_INFO: `/v3/roles/service` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:49:08.424033 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5da5585-91a4-4a49-ab1f-c44f3af997fb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 17:49:08.428967 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application [None req-b5da5585-91a4-4a49-ab1f-c44f3af997fb None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 15 17:49:08.428967 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 17:49:08.428967 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 17:49:08.428967 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 17:49:08.428967 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 17:49:08.428967 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 17:49:08.428967 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 17:49:08.428967 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 17:49:08.428967 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 17:49:08.428967 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 17:49:08.428967 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 17:49:08.428967 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 17:49:08.428967 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 17:49:08.428967 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 17:49:08.428967 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 17:49:08.428967 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 17:49:08.430036 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 17:49:08.430036 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 17:49:08.430036 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 17:49:08.430036 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 17:49:08.430036 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 17:49:08.430036 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 17:49:08.430036 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 17:49:08.430036 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 17:49:08.430036 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 17:49:08.430036 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 17:49:08.430036 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 17:49:08.430036 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application with Lock( Sep 15 17:49:08.430036 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 17:49:08.430036 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._enter() Sep 15 17:49:08.430036 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 17:49:08.430036 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 17:49:08.430976 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 17:49:08.430976 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.creator() Sep 15 17:49:08.430976 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 17:49:08.430976 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application created_value = creator( Sep 15 17:49:08.430976 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 17:49:08.430976 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 17:49:08.430976 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 17:49:08.430976 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 17:49:08.430976 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 17:49:08.430976 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 17:49:08.430976 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 15 17:49:08.430976 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Sep 15 17:49:08.434982 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 403/797] 10.222.0.25 () {56 vars in 1102 bytes} [Thu Sep 15 17:49:08 2022] GET /identity/v3/roles/service => generated 85 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 17:49:08.436128 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5da5585-91a4-4a49-ab1f-c44f3af997fb None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:49:08.500603 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 395/798] 10.222.0.25 () {58 vars in 1282 bytes} [Thu Sep 15 17:49:08 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 421 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 15 17:49:08.503170 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cc0fb6-c66a-4d5d-86c3-e7346c5fdaaa None None] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:49:08.503663 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cc0fb6-c66a-4d5d-86c3-e7346c5fdaaa None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:49:08.504450 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cc0fb6-c66a-4d5d-86c3-e7346c5fdaaa None None] PATH_INFO: `/` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:49:08.506262 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 396/799] 10.222.0.25 () {54 vars in 927 bytes} [Thu Sep 15 17:49:08 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 17:49:08.507230 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5cc0fb6-c66a-4d5d-86c3-e7346c5fdaaa None None] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:49:08.569003 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:49:08.584619 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5da5585-91a4-4a49-ab1f-c44f3af997fb None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:49:08.628995 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:49:08.637009 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5cc0fb6-c66a-4d5d-86c3-e7346c5fdaaa None None] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:49:08.638103 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d75026-2b64-4278-a964-08cfbc63cd30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:49:08.639068 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d75026-2b64-4278-a964-08cfbc63cd30 None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:49:08.639512 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d75026-2b64-4278-a964-08cfbc63cd30 None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:49:08.639968 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d75026-2b64-4278-a964-08cfbc63cd30 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:49:08.650399 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d75026-2b64-4278-a964-08cfbc63cd30 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:49:08.652507 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d75026-2b64-4278-a964-08cfbc63cd30 None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:49:08.666592 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application [None req-52d75026-2b64-4278-a964-08cfbc63cd30 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 15 17:49:08.666592 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 17:49:08.666592 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 17:49:08.666592 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 17:49:08.666592 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 17:49:08.666592 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 17:49:08.666592 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 17:49:08.666592 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 17:49:08.666592 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 17:49:08.666592 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 17:49:08.666592 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 17:49:08.666592 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 17:49:08.666592 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 15 17:49:08.666592 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 15 17:49:08.666592 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 15 17:49:08.666592 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 15 17:49:08.667703 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 17:49:08.667703 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 17:49:08.667703 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 15 17:49:08.667703 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 15 17:49:08.667703 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 15 17:49:08.667703 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 15 17:49:08.667703 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 17:49:08.667703 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 17:49:08.667703 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 17:49:08.667703 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 17:49:08.667703 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 17:49:08.667703 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application with Lock( Sep 15 17:49:08.667703 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 17:49:08.667703 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._enter() Sep 15 17:49:08.667703 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 17:49:08.667703 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 17:49:08.667703 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 17:49:08.667703 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.creator() Sep 15 17:49:08.668676 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 17:49:08.668676 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application created_value = creator( Sep 15 17:49:08.668676 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 15 17:49:08.668676 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 15 17:49:08.668676 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 15 17:49:08.668676 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 15 17:49:08.668676 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 15 17:49:08.668676 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 15 17:49:08.668676 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 15 17:49:08.668676 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Sep 15 17:49:08.668676 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 404/800] 10.222.0.25 () {56 vars in 1096 bytes} [Thu Sep 15 17:49:08 2022] GET /identity/v3/users/swift => generated 83 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 17:49:08.668676 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d75026-2b64-4278-a964-08cfbc63cd30 None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:49:08.680589 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e6c492-a168-47b9-8d36-e036126aaa90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:49:08.681597 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e6c492-a168-47b9-8d36-e036126aaa90 None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:49:08.682064 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e6c492-a168-47b9-8d36-e036126aaa90 None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:49:08.682622 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e6c492-a168-47b9-8d36-e036126aaa90 None admin] PATH_INFO: `/v3/roles` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:49:08.683366 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e6c492-a168-47b9-8d36-e036126aaa90 None admin] RBAC: Adding query filter params (name=service) {{(pid=81592) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 17:49:08.683675 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e6c492-a168-47b9-8d36-e036126aaa90 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:49:08.685158 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e6c492-a168-47b9-8d36-e036126aaa90 None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:49:08.696699 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 397/801] 10.222.0.25 () {56 vars in 1103 bytes} [Thu Sep 15 17:49:08 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 17:49:08.698161 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c0038b-6ec6-49b9-b832-61e4331641e0 None None] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:49:08.698515 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c0038b-6ec6-49b9-b832-61e4331641e0 None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:49:08.698794 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c0038b-6ec6-49b9-b832-61e4331641e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:49:08.720238 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.auth.core [None req-73c0038b-6ec6-49b9-b832-61e4331641e0 None None] MFA Rules not processed for user `5cfa58ef86774ab7800bf91930bf6028`. Rule list: `[]` (Enabled: `True`). {{(pid=81592) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 17:49:08.721532 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-73c0038b-6ec6-49b9-b832-61e4331641e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 17:49:08.807042 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d75026-2b64-4278-a964-08cfbc63cd30 None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:49:08.815526 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 398/802] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Sep 15 17:49:08 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 15 17:49:08.816378 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c0038b-6ec6-49b9-b832-61e4331641e0 None None] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:49:08.847226 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f88c379-7b10-484b-a3d5-c2a7ad3c7fbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:49:08.847868 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f88c379-7b10-484b-a3d5-c2a7ad3c7fbe None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:49:08.848141 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f88c379-7b10-484b-a3d5-c2a7ad3c7fbe None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:49:08.848407 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f88c379-7b10-484b-a3d5-c2a7ad3c7fbe None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:49:08.859707 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f88c379-7b10-484b-a3d5-c2a7ad3c7fbe None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:49:08.860686 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:49:08.861788 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f88c379-7b10-484b-a3d5-c2a7ad3c7fbe None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:49:08.877421 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application [None req-0f88c379-7b10-484b-a3d5-c2a7ad3c7fbe None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 17:49:08.877421 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 17:49:08.877421 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 17:49:08.877421 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 17:49:08.877421 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 17:49:08.877421 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 17:49:08.877421 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 17:49:08.877421 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 17:49:08.877421 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 17:49:08.877421 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 17:49:08.877421 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 17:49:08.877421 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 17:49:08.877421 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 15 17:49:08.877421 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 15 17:49:08.877421 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 15 17:49:08.877421 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 15 17:49:08.878490 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 17:49:08.878490 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 17:49:08.878490 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 17:49:08.878490 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 17:49:08.878490 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 17:49:08.878490 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 17:49:08.878490 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 17:49:08.878490 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application with Lock( Sep 15 17:49:08.878490 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 17:49:08.878490 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._enter() Sep 15 17:49:08.878490 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 17:49:08.878490 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 17:49:08.878490 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 17:49:08.878490 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.creator() Sep 15 17:49:08.878490 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 17:49:08.878490 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application created_value = creator( Sep 15 17:49:08.878490 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 15 17:49:08.879427 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 15 17:49:08.879427 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 17:49:08.879427 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Sep 15 17:49:08.879427 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 405/803] 10.222.0.25 () {56 vars in 1108 bytes} [Thu Sep 15 17:49:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 17:49:08.879427 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f88c379-7b10-484b-a3d5-c2a7ad3c7fbe None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:49:08.934645 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:49:08.943543 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c0038b-6ec6-49b9-b832-61e4331641e0 None None] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:49:08.985009 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6a5fe3-2a43-42a3-b4fa-f59f7f77dd5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:49:08.985717 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6a5fe3-2a43-42a3-b4fa-f59f7f77dd5f None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:49:08.986472 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6a5fe3-2a43-42a3-b4fa-f59f7f77dd5f None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:49:08.986782 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6a5fe3-2a43-42a3-b4fa-f59f7f77dd5f None admin] PATH_INFO: `/v3/users` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:49:08.988027 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb6a5fe3-2a43-42a3-b4fa-f59f7f77dd5f None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81592) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 17:49:08.988335 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb6a5fe3-2a43-42a3-b4fa-f59f7f77dd5f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:49:08.990161 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb6a5fe3-2a43-42a3-b4fa-f59f7f77dd5f None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:49:09.000050 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f88c379-7b10-484b-a3d5-c2a7ad3c7fbe None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:49:09.010298 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 399/804] 10.222.0.25 () {56 vars in 1135 bytes} [Thu Sep 15 17:49:08 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 17:49:09.011365 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459bbd78-0baa-4b11-9ed2-ae1bd3fb8b78 None None] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:49:09.011646 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459bbd78-0baa-4b11-9ed2-ae1bd3fb8b78 None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:49:09.011917 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459bbd78-0baa-4b11-9ed2-ae1bd3fb8b78 None None] PATH_INFO: `/` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:49:09.014847 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 400/805] 10.222.0.25 () {54 vars in 927 bytes} [Thu Sep 15 17:49:09 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 17:49:09.014847 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459bbd78-0baa-4b11-9ed2-ae1bd3fb8b78 None None] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:49:09.060851 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99e28ed-f9c6-4d4a-9cde-c9300f562eef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:49:09.061890 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99e28ed-f9c6-4d4a-9cde-c9300f562eef None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:49:09.062210 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99e28ed-f9c6-4d4a-9cde-c9300f562eef None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:49:09.062544 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99e28ed-f9c6-4d4a-9cde-c9300f562eef None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:49:09.076182 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a99e28ed-f9c6-4d4a-9cde-c9300f562eef None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:49:09.078325 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a99e28ed-f9c6-4d4a-9cde-c9300f562eef None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:49:09.094877 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application [None req-a99e28ed-f9c6-4d4a-9cde-c9300f562eef None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 17:49:09.094877 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 17:49:09.094877 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 17:49:09.094877 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 17:49:09.094877 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 17:49:09.094877 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 17:49:09.094877 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 17:49:09.094877 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 17:49:09.094877 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 17:49:09.094877 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 17:49:09.094877 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 17:49:09.094877 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 17:49:09.094877 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 15 17:49:09.094877 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 15 17:49:09.094877 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 15 17:49:09.094877 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 15 17:49:09.096659 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 17:49:09.096659 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 17:49:09.096659 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 17:49:09.096659 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 17:49:09.096659 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 17:49:09.096659 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 17:49:09.096659 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 17:49:09.096659 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application with Lock( Sep 15 17:49:09.096659 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 17:49:09.096659 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._enter() Sep 15 17:49:09.096659 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 17:49:09.096659 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 17:49:09.096659 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 17:49:09.096659 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.creator() Sep 15 17:49:09.096659 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 17:49:09.096659 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application created_value = creator( Sep 15 17:49:09.096659 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 15 17:49:09.098159 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 15 17:49:09.098159 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 17:49:09.098159 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Sep 15 17:49:09.098159 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 406/806] 10.222.0.25 () {56 vars in 1108 bytes} [Thu Sep 15 17:49:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 17:49:09.098159 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99e28ed-f9c6-4d4a-9cde-c9300f562eef None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:49:09.137156 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:49:09.148480 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459bbd78-0baa-4b11-9ed2-ae1bd3fb8b78 None None] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:49:09.188928 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148b1dd0-8122-403d-a365-78d80d6d16b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:49:09.189572 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148b1dd0-8122-403d-a365-78d80d6d16b2 None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:49:09.189843 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148b1dd0-8122-403d-a365-78d80d6d16b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:49:09.190113 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148b1dd0-8122-403d-a365-78d80d6d16b2 None admin] PATH_INFO: `/v3/domains` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:49:09.190752 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148b1dd0-8122-403d-a365-78d80d6d16b2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81592) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 17:49:09.191047 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148b1dd0-8122-403d-a365-78d80d6d16b2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:49:09.192434 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148b1dd0-8122-403d-a365-78d80d6d16b2 None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:49:09.210169 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:49:09.210746 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 401/807] 10.222.0.25 () {56 vars in 1109 bytes} [Thu Sep 15 17:49:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 17:49:09.212165 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae78954-4e48-45fd-a41e-d2317fc79903 None None] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:49:09.213924 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae78954-4e48-45fd-a41e-d2317fc79903 None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:49:09.213924 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae78954-4e48-45fd-a41e-d2317fc79903 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:49:09.222638 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99e28ed-f9c6-4d4a-9cde-c9300f562eef None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:49:09.232584 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.auth.core [None req-5ae78954-4e48-45fd-a41e-d2317fc79903 None None] MFA Rules not processed for user `5cfa58ef86774ab7800bf91930bf6028`. Rule list: `[]` (Enabled: `True`). {{(pid=81592) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 17:49:09.233819 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-5ae78954-4e48-45fd-a41e-d2317fc79903 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 17:49:09.258310 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7171b1-2ba9-4b0e-ab24-c887df294330 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:49:09.258953 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7171b1-2ba9-4b0e-ab24-c887df294330 None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:49:09.259228 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7171b1-2ba9-4b0e-ab24-c887df294330 None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:49:09.259498 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7171b1-2ba9-4b0e-ab24-c887df294330 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:49:09.270286 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7171b1-2ba9-4b0e-ab24-c887df294330 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:49:09.271871 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7171b1-2ba9-4b0e-ab24-c887df294330 None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:49:09.286519 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application [None req-0b7171b1-2ba9-4b0e-ab24-c887df294330 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 17:49:09.286519 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 17:49:09.286519 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 17:49:09.286519 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 17:49:09.286519 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 17:49:09.286519 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 17:49:09.286519 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 17:49:09.286519 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 17:49:09.286519 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 17:49:09.286519 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 17:49:09.286519 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 17:49:09.286519 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 17:49:09.286519 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 15 17:49:09.286519 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 15 17:49:09.286519 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 15 17:49:09.286519 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 15 17:49:09.287574 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 17:49:09.287574 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 17:49:09.287574 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 17:49:09.287574 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 17:49:09.287574 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 17:49:09.287574 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 17:49:09.287574 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 17:49:09.287574 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application with Lock( Sep 15 17:49:09.287574 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 17:49:09.287574 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._enter() Sep 15 17:49:09.287574 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 17:49:09.287574 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 17:49:09.287574 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 17:49:09.287574 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.creator() Sep 15 17:49:09.287574 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 17:49:09.287574 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application created_value = creator( Sep 15 17:49:09.287574 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 15 17:49:09.288522 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 15 17:49:09.288522 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 17:49:09.288522 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Sep 15 17:49:09.288522 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 407/808] 10.222.0.25 () {56 vars in 1108 bytes} [Thu Sep 15 17:49:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 17:49:09.288522 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7171b1-2ba9-4b0e-ab24-c887df294330 None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:49:09.307768 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 402/809] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Sep 15 17:49:09 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 15 17:49:09.308942 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae78954-4e48-45fd-a41e-d2317fc79903 None None] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:49:09.402343 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:49:09.409561 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7171b1-2ba9-4b0e-ab24-c887df294330 None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:49:09.426647 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae78954-4e48-45fd-a41e-d2317fc79903 None None] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:49:09.446667 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9a3162-40a3-4559-8fe8-c6504ee08e48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:49:09.446935 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9a3162-40a3-4559-8fe8-c6504ee08e48 None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:49:09.447137 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9a3162-40a3-4559-8fe8-c6504ee08e48 None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:49:09.447412 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9a3162-40a3-4559-8fe8-c6504ee08e48 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:49:09.447992 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b9a3162-40a3-4559-8fe8-c6504ee08e48 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:49:09.449398 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b9a3162-40a3-4559-8fe8-c6504ee08e48 None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:49:09.458813 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application [None req-7b9a3162-40a3-4559-8fe8-c6504ee08e48 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 15 17:49:09.458813 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 17:49:09.458813 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 15 17:49:09.458813 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 15 17:49:09.458813 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 15 17:49:09.458813 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 15 17:49:09.458813 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 15 17:49:09.458813 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 15 17:49:09.458813 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 15 17:49:09.458813 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Sep 15 17:49:09.458813 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 15 17:49:09.458813 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Sep 15 17:49:09.458813 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 17:49:09.458813 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 17:49:09.458813 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 17:49:09.458813 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 17:49:09.458813 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 17:49:09.460032 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 17:49:09.460032 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 17:49:09.460032 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 17:49:09.460032 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 17:49:09.460032 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 17:49:09.460032 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 17:49:09.460032 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 15 17:49:09.460032 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 15 17:49:09.460032 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 15 17:49:09.460032 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 15 17:49:09.460032 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 17:49:09.460032 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 17:49:09.460032 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 17:49:09.460032 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 17:49:09.460032 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 17:49:09.460032 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 17:49:09.460877 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 17:49:09.460877 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application with Lock( Sep 15 17:49:09.460877 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 17:49:09.460877 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._enter() Sep 15 17:49:09.460877 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 17:49:09.460877 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 17:49:09.460877 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 17:49:09.460877 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.creator() Sep 15 17:49:09.460877 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 17:49:09.460877 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application created_value = creator( Sep 15 17:49:09.460877 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 15 17:49:09.460877 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 15 17:49:09.460877 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 15 17:49:09.460877 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Sep 15 17:49:09.460877 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 408/810] 10.222.0.25 () {56 vars in 1129 bytes} [Thu Sep 15 17:49:09 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 17:49:09.461732 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9a3162-40a3-4559-8fe8-c6504ee08e48 None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:49:09.472654 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92475dd2-aded-4d38-aeea-8382c0838fa1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:49:09.473269 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92475dd2-aded-4d38-aeea-8382c0838fa1 None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:49:09.473591 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92475dd2-aded-4d38-aeea-8382c0838fa1 None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:49:09.473864 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92475dd2-aded-4d38-aeea-8382c0838fa1 None admin] PATH_INFO: `/v3/domains` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:49:09.474518 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92475dd2-aded-4d38-aeea-8382c0838fa1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81592) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 17:49:09.474929 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92475dd2-aded-4d38-aeea-8382c0838fa1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:49:09.476683 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92475dd2-aded-4d38-aeea-8382c0838fa1 None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:49:09.477358 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:49:09.489908 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 403/811] 10.222.0.25 () {56 vars in 1109 bytes} [Thu Sep 15 17:49:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 17:49:09.491193 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92475dd2-aded-4d38-aeea-8382c0838fa1 None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:49:09.577979 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9a3162-40a3-4559-8fe8-c6504ee08e48 None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:49:09.612436 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92475dd2-aded-4d38-aeea-8382c0838fa1 None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:49:09.619826 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff73d2d3-ab25-42de-b601-bc0566b90859 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:49:09.620472 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff73d2d3-ab25-42de-b601-bc0566b90859 None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:49:09.620747 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff73d2d3-ab25-42de-b601-bc0566b90859 None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:49:09.621019 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff73d2d3-ab25-42de-b601-bc0566b90859 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:49:09.628470 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff73d2d3-ab25-42de-b601-bc0566b90859 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:49:09.629987 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff73d2d3-ab25-42de-b601-bc0566b90859 None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:49:09.641822 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application [None req-ff73d2d3-ab25-42de-b601-bc0566b90859 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 15 17:49:09.641822 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 17:49:09.641822 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 17:49:09.641822 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 17:49:09.641822 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 17:49:09.641822 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 17:49:09.641822 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 17:49:09.641822 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 17:49:09.641822 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 17:49:09.641822 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 17:49:09.641822 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 17:49:09.641822 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 17:49:09.641822 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 15 17:49:09.641822 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 15 17:49:09.641822 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 15 17:49:09.643579 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 15 17:49:09.643579 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 17:49:09.643579 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 17:49:09.643579 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 17:49:09.643579 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 17:49:09.643579 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 17:49:09.643579 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 17:49:09.643579 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 17:49:09.643579 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application with Lock( Sep 15 17:49:09.643579 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 17:49:09.643579 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._enter() Sep 15 17:49:09.643579 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 17:49:09.643579 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 17:49:09.643579 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 17:49:09.643579 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.creator() Sep 15 17:49:09.643579 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 17:49:09.643579 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application created_value = creator( Sep 15 17:49:09.644684 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 15 17:49:09.644684 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 15 17:49:09.644684 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 15 17:49:09.644684 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 15 17:49:09.644684 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 15 17:49:09.644684 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 15 17:49:09.644684 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 15 17:49:09.644684 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Sep 15 17:49:09.644684 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 409/812] 10.222.0.25 () {56 vars in 1111 bytes} [Thu Sep 15 17:49:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 17:49:09.644684 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff73d2d3-ab25-42de-b601-bc0566b90859 None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:49:09.651716 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870408af-4d19-4321-b894-5a7fb77f2fbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:49:09.652327 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870408af-4d19-4321-b894-5a7fb77f2fbb None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:49:09.652652 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870408af-4d19-4321-b894-5a7fb77f2fbb None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:49:09.652869 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870408af-4d19-4321-b894-5a7fb77f2fbb None admin] PATH_INFO: `/v3/domains` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:49:09.653540 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870408af-4d19-4321-b894-5a7fb77f2fbb None admin] RBAC: Adding query filter params (name=Default) {{(pid=81592) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 17:49:09.653838 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870408af-4d19-4321-b894-5a7fb77f2fbb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:49:09.655199 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870408af-4d19-4321-b894-5a7fb77f2fbb None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:49:09.675908 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 404/813] 10.222.0.25 () {56 vars in 1109 bytes} [Thu Sep 15 17:49:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 17:49:09.676835 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870408af-4d19-4321-b894-5a7fb77f2fbb None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:49:09.680222 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:49:09.720863 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:49:09.755182 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff73d2d3-ab25-42de-b601-bc0566b90859 None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:49:09.812789 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d09e89-91bc-4792-9647-8a56faee18ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:49:09.813610 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d09e89-91bc-4792-9647-8a56faee18ed None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:49:09.814760 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d09e89-91bc-4792-9647-8a56faee18ed None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:49:09.815649 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d09e89-91bc-4792-9647-8a56faee18ed None admin] PATH_INFO: `/v3/services` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:49:09.816595 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d09e89-91bc-4792-9647-8a56faee18ed None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81593) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 17:49:09.816903 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d09e89-91bc-4792-9647-8a56faee18ed None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:49:09.818373 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d09e89-91bc-4792-9647-8a56faee18ed None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:49:09.823487 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 410/814] 10.222.0.25 () {56 vars in 1124 bytes} [Thu Sep 15 17:49:09 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 17:49:09.824303 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d09e89-91bc-4792-9647-8a56faee18ed None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:49:09.833527 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870408af-4d19-4321-b894-5a7fb77f2fbb None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:49:09.867826 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d323b532-e173-40a3-924c-3198dff12840 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:49:09.868447 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d323b532-e173-40a3-924c-3198dff12840 None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:49:09.868705 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d323b532-e173-40a3-924c-3198dff12840 None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:49:09.868978 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d323b532-e173-40a3-924c-3198dff12840 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:49:09.878632 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d323b532-e173-40a3-924c-3198dff12840 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:49:09.880485 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d323b532-e173-40a3-924c-3198dff12840 None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:49:09.900333 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application [None req-d323b532-e173-40a3-924c-3198dff12840 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 15 17:49:09.900333 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 17:49:09.900333 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 17:49:09.900333 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 17:49:09.900333 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 17:49:09.900333 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 17:49:09.900333 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 17:49:09.900333 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 17:49:09.900333 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 17:49:09.900333 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 17:49:09.900333 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 17:49:09.900333 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 17:49:09.900333 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 15 17:49:09.900333 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 15 17:49:09.900333 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 15 17:49:09.900333 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 15 17:49:09.901434 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 17:49:09.901434 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 17:49:09.901434 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 15 17:49:09.901434 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 15 17:49:09.901434 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 15 17:49:09.901434 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 15 17:49:09.901434 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 17:49:09.901434 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 17:49:09.901434 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 17:49:09.901434 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 17:49:09.901434 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 17:49:09.901434 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application with Lock( Sep 15 17:49:09.901434 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 17:49:09.901434 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._enter() Sep 15 17:49:09.901434 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 17:49:09.901434 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 17:49:09.901434 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 17:49:09.901434 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.creator() Sep 15 17:49:09.902431 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 17:49:09.902431 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application created_value = creator( Sep 15 17:49:09.902431 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 15 17:49:09.902431 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 15 17:49:09.902431 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 15 17:49:09.902431 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 15 17:49:09.902431 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 15 17:49:09.902431 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 15 17:49:09.902431 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 15 17:49:09.902431 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Sep 15 17:49:09.902431 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 405/815] 10.222.0.25 () {56 vars in 1117 bytes} [Thu Sep 15 17:49:09 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 17:49:09.903329 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d323b532-e173-40a3-924c-3198dff12840 None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:49:09.958698 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d09e89-91bc-4792-9647-8a56faee18ed None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:49:09.974123 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:49:09.996166 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd90760-dbfd-44cd-a690-95a39be9c5e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:49:09.996799 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd90760-dbfd-44cd-a690-95a39be9c5e1 None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:49:09.997071 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd90760-dbfd-44cd-a690-95a39be9c5e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:49:09.997371 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd90760-dbfd-44cd-a690-95a39be9c5e1 None admin] PATH_INFO: `/v3/services/network` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:49:09.997961 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd90760-dbfd-44cd-a690-95a39be9c5e1 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:49:09.999339 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd90760-dbfd-44cd-a690-95a39be9c5e1 None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:49:10.002630 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:49:10.010022 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application [None req-1cd90760-dbfd-44cd-a690-95a39be9c5e1 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Sep 15 17:49:10.010022 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 17:49:10.010022 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 15 17:49:10.010022 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 15 17:49:10.010022 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 15 17:49:10.010022 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 15 17:49:10.010022 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 15 17:49:10.010022 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 15 17:49:10.010022 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 15 17:49:10.010022 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Sep 15 17:49:10.010022 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 15 17:49:10.010022 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Sep 15 17:49:10.010022 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 17:49:10.010022 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 17:49:10.010022 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 17:49:10.010022 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 17:49:10.010022 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 17:49:10.011284 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 17:49:10.011284 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 17:49:10.011284 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 17:49:10.011284 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 17:49:10.011284 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 17:49:10.011284 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 17:49:10.011284 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 15 17:49:10.011284 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 15 17:49:10.011284 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 15 17:49:10.011284 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 15 17:49:10.011284 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 17:49:10.011284 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 17:49:10.011284 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 17:49:10.011284 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 17:49:10.011284 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 17:49:10.011284 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 17:49:10.012155 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 17:49:10.012155 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application with Lock( Sep 15 17:49:10.012155 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 17:49:10.012155 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._enter() Sep 15 17:49:10.012155 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 17:49:10.012155 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 17:49:10.012155 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 17:49:10.012155 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.creator() Sep 15 17:49:10.012155 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 17:49:10.012155 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application created_value = creator( Sep 15 17:49:10.012155 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 15 17:49:10.012155 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 15 17:49:10.012155 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 15 17:49:10.012155 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Sep 15 17:49:10.012155 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 411/816] 10.222.0.25 () {56 vars in 1111 bytes} [Thu Sep 15 17:49:09 2022] GET /identity/v3/services/network => generated 88 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 17:49:10.012968 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd90760-dbfd-44cd-a690-95a39be9c5e1 None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:49:10.021269 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d323b532-e173-40a3-924c-3198dff12840 None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:49:10.059150 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30623968-d556-44fa-908d-9f2325dc028b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:49:10.059766 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30623968-d556-44fa-908d-9f2325dc028b None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:49:10.060043 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30623968-d556-44fa-908d-9f2325dc028b None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:49:10.060316 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30623968-d556-44fa-908d-9f2325dc028b None admin] PATH_INFO: `/v3/projects` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:49:10.061015 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30623968-d556-44fa-908d-9f2325dc028b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81592) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 17:49:10.061351 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30623968-d556-44fa-908d-9f2325dc028b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:49:10.062787 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30623968-d556-44fa-908d-9f2325dc028b None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:49:10.081390 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 406/817] 10.222.0.25 () {56 vars in 1148 bytes} [Thu Sep 15 17:49:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 17:49:10.082235 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30623968-d556-44fa-908d-9f2325dc028b None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:49:10.114553 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd90760-dbfd-44cd-a690-95a39be9c5e1 None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:49:10.158809 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f553125f-13b2-4bfb-a57c-c38228c73827 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:49:10.159393 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f553125f-13b2-4bfb-a57c-c38228c73827 None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:49:10.159741 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f553125f-13b2-4bfb-a57c-c38228c73827 None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:49:10.160017 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f553125f-13b2-4bfb-a57c-c38228c73827 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:49:10.166870 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f553125f-13b2-4bfb-a57c-c38228c73827 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:49:10.168331 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f553125f-13b2-4bfb-a57c-c38228c73827 None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:49:10.180952 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application [None req-f553125f-13b2-4bfb-a57c-c38228c73827 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 15 17:49:10.180952 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 17:49:10.180952 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 17:49:10.180952 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 17:49:10.180952 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 17:49:10.180952 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 17:49:10.180952 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 17:49:10.180952 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 17:49:10.180952 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 17:49:10.180952 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 17:49:10.180952 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 17:49:10.180952 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 17:49:10.180952 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 15 17:49:10.180952 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 15 17:49:10.180952 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 15 17:49:10.182146 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 15 17:49:10.182146 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 17:49:10.182146 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 17:49:10.182146 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 17:49:10.182146 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 17:49:10.182146 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 17:49:10.182146 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 17:49:10.182146 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 17:49:10.182146 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application with Lock( Sep 15 17:49:10.182146 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 17:49:10.182146 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._enter() Sep 15 17:49:10.182146 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 17:49:10.182146 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 17:49:10.182146 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 17:49:10.182146 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.creator() Sep 15 17:49:10.182146 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 17:49:10.182146 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application created_value = creator( Sep 15 17:49:10.183279 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 15 17:49:10.183279 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 15 17:49:10.183279 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 15 17:49:10.183279 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 15 17:49:10.183279 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 15 17:49:10.183279 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 15 17:49:10.183279 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 15 17:49:10.183279 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Sep 15 17:49:10.183279 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 412/818] 10.222.0.25 () {56 vars in 1111 bytes} [Thu Sep 15 17:49:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 17:49:10.183279 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f553125f-13b2-4bfb-a57c-c38228c73827 None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:49:10.197002 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30623968-d556-44fa-908d-9f2325dc028b None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:49:10.221437 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:49:10.238682 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec142ac-31fa-4579-8864-24082d208ae5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:49:10.239292 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec142ac-31fa-4579-8864-24082d208ae5 None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:49:10.239570 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec142ac-31fa-4579-8864-24082d208ae5 None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:49:10.239842 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec142ac-31fa-4579-8864-24082d208ae5 None admin] PATH_INFO: `/v3/services` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:49:10.240708 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec142ac-31fa-4579-8864-24082d208ae5 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81592) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 17:49:10.240829 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec142ac-31fa-4579-8864-24082d208ae5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:49:10.242290 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec142ac-31fa-4579-8864-24082d208ae5 None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:49:10.247146 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 407/819] 10.222.0.25 () {56 vars in 1124 bytes} [Thu Sep 15 17:49:10 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 17:49:10.247901 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec142ac-31fa-4579-8864-24082d208ae5 None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:49:10.253853 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:49:10.299735 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f553125f-13b2-4bfb-a57c-c38228c73827 None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:49:10.336735 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6c5527-8ed1-4bb4-b113-8879a2d3bc8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:49:10.337457 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6c5527-8ed1-4bb4-b113-8879a2d3bc8f None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:49:10.337808 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6c5527-8ed1-4bb4-b113-8879a2d3bc8f None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:49:10.338089 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6c5527-8ed1-4bb4-b113-8879a2d3bc8f None admin] PATH_INFO: `/v3/users` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:49:10.338891 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c6c5527-8ed1-4bb4-b113-8879a2d3bc8f None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81593) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 17:49:10.339245 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c6c5527-8ed1-4bb4-b113-8879a2d3bc8f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:49:10.340871 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c6c5527-8ed1-4bb4-b113-8879a2d3bc8f None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:49:10.360442 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 413/820] 10.222.0.25 () {56 vars in 1149 bytes} [Thu Sep 15 17:49:10 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 17:49:10.362049 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6c5527-8ed1-4bb4-b113-8879a2d3bc8f None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:49:10.363715 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec142ac-31fa-4579-8864-24082d208ae5 None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:49:10.414043 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913ffd1b-433c-4efa-a4a7-d544a2a98343 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:49:10.414890 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913ffd1b-433c-4efa-a4a7-d544a2a98343 None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:49:10.415353 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913ffd1b-433c-4efa-a4a7-d544a2a98343 None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:49:10.415749 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913ffd1b-433c-4efa-a4a7-d544a2a98343 None admin] PATH_INFO: `/v3/services` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:49:10.416818 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-913ffd1b-433c-4efa-a4a7-d544a2a98343 None admin] RBAC: Adding query filter params (name=network) {{(pid=81592) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 17:49:10.417323 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-913ffd1b-433c-4efa-a4a7-d544a2a98343 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:49:10.419413 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-913ffd1b-433c-4efa-a4a7-d544a2a98343 None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:49:10.425273 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 408/821] 10.222.0.25 () {56 vars in 1112 bytes} [Thu Sep 15 17:49:10 2022] GET /identity/v3/services?name=network => generated 124 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 17:49:10.426094 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913ffd1b-433c-4efa-a4a7-d544a2a98343 None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:49:10.480034 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:49:10.481531 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6c5527-8ed1-4bb4-b113-8879a2d3bc8f None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:49:10.500654 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:49:10.518265 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1230779-3102-4240-b87e-0fe22b933de9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:49:10.518851 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1230779-3102-4240-b87e-0fe22b933de9 None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:49:10.519071 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1230779-3102-4240-b87e-0fe22b933de9 None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:49:10.519372 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1230779-3102-4240-b87e-0fe22b933de9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:49:10.520205 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1230779-3102-4240-b87e-0fe22b933de9 None admin] RBAC: Adding query filter params (role.id=a9e42be86923434f8af52d3fc07fb4f7, scope.project.id=1213c0d1b584404ba3998e136f166e89, user.id=fe2244818e4d4dca9c424cd078653e6a) {{(pid=81593) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 17:49:10.520568 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1230779-3102-4240-b87e-0fe22b933de9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:49:10.522031 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1230779-3102-4240-b87e-0fe22b933de9 None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:49:10.529969 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 414/822] 10.222.0.25 () {56 vars in 1374 bytes} [Thu Sep 15 17:49:10 2022] GET /identity/v3/role_assignments?user.id=fe2244818e4d4dca9c424cd078653e6a&scope.project.id=1213c0d1b584404ba3998e136f166e89&role.id=a9e42be86923434f8af52d3fc07fb4f7 => generated 608 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 17:49:10.530920 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1230779-3102-4240-b87e-0fe22b933de9 None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:49:10.539660 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913ffd1b-433c-4efa-a4a7-d544a2a98343 None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:49:10.581859 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586b750d-75ba-4d60-ba79-60b0505b6e5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:49:10.582480 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586b750d-75ba-4d60-ba79-60b0505b6e5c None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:49:10.582813 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586b750d-75ba-4d60-ba79-60b0505b6e5c None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:49:10.583094 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586b750d-75ba-4d60-ba79-60b0505b6e5c None admin] PATH_INFO: `/v3/projects` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:49:10.583784 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-586b750d-75ba-4d60-ba79-60b0505b6e5c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81592) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 17:49:10.584122 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-586b750d-75ba-4d60-ba79-60b0505b6e5c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:49:10.587319 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-586b750d-75ba-4d60-ba79-60b0505b6e5c None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:49:10.603633 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 409/823] 10.222.0.25 () {56 vars in 1148 bytes} [Thu Sep 15 17:49:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 17:49:10.606065 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586b750d-75ba-4d60-ba79-60b0505b6e5c None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:49:10.660222 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1230779-3102-4240-b87e-0fe22b933de9 None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:49:10.707049 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14302a5-f31b-43e0-860b-4c5943923aed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:49:10.707748 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14302a5-f31b-43e0-860b-4c5943923aed None admin] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:49:10.708115 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14302a5-f31b-43e0-860b-4c5943923aed None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:49:10.709275 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14302a5-f31b-43e0-860b-4c5943923aed None admin] PATH_INFO: `/v3/endpoints` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:49:10.709275 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14302a5-f31b-43e0-860b-4c5943923aed None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:49:10.710652 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14302a5-f31b-43e0-860b-4c5943923aed None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:49:10.741281 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 415/824] 10.222.0.25 () {60 vars in 1144 bytes} [Thu Sep 15 17:49:10 2022] POST /identity/v3/endpoints => generated 346 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 17:49:10.741597 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586b750d-75ba-4d60-ba79-60b0505b6e5c None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:49:10.742059 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14302a5-f31b-43e0-860b-4c5943923aed None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:49:10.758533 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:49:10.801668 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:49:10.814950 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afaf81e6-cae2-4b7e-8119-695677d89f60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:49:10.815597 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afaf81e6-cae2-4b7e-8119-695677d89f60 None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:49:10.815875 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afaf81e6-cae2-4b7e-8119-695677d89f60 None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:49:10.816151 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afaf81e6-cae2-4b7e-8119-695677d89f60 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:49:10.831967 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afaf81e6-cae2-4b7e-8119-695677d89f60 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:49:10.835490 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afaf81e6-cae2-4b7e-8119-695677d89f60 None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:49:10.856460 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application [None req-afaf81e6-cae2-4b7e-8119-695677d89f60 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 17:49:10.856460 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 17:49:10.856460 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 17:49:10.856460 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 17:49:10.856460 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 17:49:10.856460 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 17:49:10.856460 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 17:49:10.856460 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 17:49:10.856460 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 17:49:10.856460 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 17:49:10.856460 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 17:49:10.856460 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 17:49:10.856460 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 15 17:49:10.856460 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 15 17:49:10.856460 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 15 17:49:10.856460 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 15 17:49:10.857522 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 17:49:10.857522 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 17:49:10.857522 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 17:49:10.857522 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 17:49:10.857522 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 17:49:10.857522 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 17:49:10.857522 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 17:49:10.857522 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application with Lock( Sep 15 17:49:10.857522 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 17:49:10.857522 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._enter() Sep 15 17:49:10.857522 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 17:49:10.857522 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 17:49:10.857522 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 17:49:10.857522 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.creator() Sep 15 17:49:10.857522 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 17:49:10.857522 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application created_value = creator( Sep 15 17:49:10.857522 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 15 17:49:10.858407 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 15 17:49:10.858407 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 17:49:10.858407 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Sep 15 17:49:10.865064 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 410/825] 10.222.0.25 () {56 vars in 1108 bytes} [Thu Sep 15 17:49:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 17:49:10.865064 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afaf81e6-cae2-4b7e-8119-695677d89f60 None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:49:10.889853 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14302a5-f31b-43e0-860b-4c5943923aed None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:49:10.937720 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dafdfef1-2824-49f1-8015-792ee2a85d09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:49:10.938347 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafdfef1-2824-49f1-8015-792ee2a85d09 None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:49:10.938630 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafdfef1-2824-49f1-8015-792ee2a85d09 None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:49:10.938954 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafdfef1-2824-49f1-8015-792ee2a85d09 None admin] PATH_INFO: `/v3/services` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:49:10.939674 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dafdfef1-2824-49f1-8015-792ee2a85d09 None admin] RBAC: Adding query filter params (type=network) {{(pid=81593) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 17:49:10.939957 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dafdfef1-2824-49f1-8015-792ee2a85d09 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:49:10.941274 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dafdfef1-2824-49f1-8015-792ee2a85d09 None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:49:10.948432 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 416/826] 10.222.0.25 () {56 vars in 1112 bytes} [Thu Sep 15 17:49:10 2022] GET /identity/v3/services?type=network => generated 350 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 17:49:10.949099 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dafdfef1-2824-49f1-8015-792ee2a85d09 None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:49:10.996330 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afaf81e6-cae2-4b7e-8119-695677d89f60 None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:49:11.034533 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec40a53-0328-490e-9637-ae1caaab1f4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:49:11.036015 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec40a53-0328-490e-9637-ae1caaab1f4c None admin] REQUEST_METHOD: `PUT` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:49:11.036512 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec40a53-0328-490e-9637-ae1caaab1f4c None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:49:11.037016 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec40a53-0328-490e-9637-ae1caaab1f4c None admin] PATH_INFO: `/v3/projects/1213c0d1b584404ba3998e136f166e89/users/685f7ad4c6fe4c878d542dddd6d81593/roles/a9e42be86923434f8af52d3fc07fb4f7` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:49:11.039229 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec40a53-0328-490e-9637-ae1caaab1f4c None admin] RBAC: Authorizing `identity:create_grant(project_id=1213c0d1b584404ba3998e136f166e89, user_id=685f7ad4c6fe4c878d542dddd6d81593, role_id=a9e42be86923434f8af52d3fc07fb4f7)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:49:11.040894 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec40a53-0328-490e-9637-ae1caaab1f4c None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:49:11.056281 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 411/827] 10.222.0.25 () {58 vars in 1439 bytes} [Thu Sep 15 17:49:10 2022] PUT /identity/v3/projects/1213c0d1b584404ba3998e136f166e89/users/685f7ad4c6fe4c878d542dddd6d81593/roles/a9e42be86923434f8af52d3fc07fb4f7 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 17:49:11.057529 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec40a53-0328-490e-9637-ae1caaab1f4c None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:49:11.081225 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:49:11.110698 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dafdfef1-2824-49f1-8015-792ee2a85d09 None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:49:11.112721 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:49:11.195135 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec40a53-0328-490e-9637-ae1caaab1f4c None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:49:11.210117 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b154c1f-77d4-4299-b77d-2ee093bf7ef4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:49:11.210754 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b154c1f-77d4-4299-b77d-2ee093bf7ef4 None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:49:11.211033 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b154c1f-77d4-4299-b77d-2ee093bf7ef4 None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:49:11.211343 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b154c1f-77d4-4299-b77d-2ee093bf7ef4 None admin] PATH_INFO: `/v3/domains` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:49:11.211982 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b154c1f-77d4-4299-b77d-2ee093bf7ef4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81593) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 17:49:11.212287 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b154c1f-77d4-4299-b77d-2ee093bf7ef4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:49:11.213768 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b154c1f-77d4-4299-b77d-2ee093bf7ef4 None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:49:11.237351 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 417/828] 10.222.0.25 () {56 vars in 1109 bytes} [Thu Sep 15 17:49:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 17:49:11.242354 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b154c1f-77d4-4299-b77d-2ee093bf7ef4 None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:49:11.243890 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3515b3f-be06-442b-81d3-9fde1aa0f793 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:49:11.247206 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3515b3f-be06-442b-81d3-9fde1aa0f793 None admin] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:49:11.248501 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3515b3f-be06-442b-81d3-9fde1aa0f793 None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:49:11.248922 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3515b3f-be06-442b-81d3-9fde1aa0f793 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:49:11.249794 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3515b3f-be06-442b-81d3-9fde1aa0f793 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:49:11.255388 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3515b3f-be06-442b-81d3-9fde1aa0f793 None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:49:11.297584 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 412/829] 10.222.0.25 () {60 vars in 1144 bytes} [Thu Sep 15 17:49:11 2022] POST /identity/v3/endpoints => generated 337 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 17:49:11.397158 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b154c1f-77d4-4299-b77d-2ee093bf7ef4 None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:49:11.445194 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eae14b0-5731-49ca-a176-0e5aea5b34dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:49:11.446133 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eae14b0-5731-49ca-a176-0e5aea5b34dc None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:49:11.446571 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eae14b0-5731-49ca-a176-0e5aea5b34dc None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:49:11.447082 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eae14b0-5731-49ca-a176-0e5aea5b34dc None admin] PATH_INFO: `/v3/projects/service` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:49:11.459738 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eae14b0-5731-49ca-a176-0e5aea5b34dc None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:49:11.461472 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eae14b0-5731-49ca-a176-0e5aea5b34dc None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:49:11.478611 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application [None req-8eae14b0-5731-49ca-a176-0e5aea5b34dc None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 15 17:49:11.478611 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 17:49:11.478611 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 17:49:11.478611 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 17:49:11.478611 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 17:49:11.478611 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 17:49:11.478611 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 17:49:11.478611 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 17:49:11.478611 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 17:49:11.478611 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 17:49:11.478611 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 17:49:11.478611 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 17:49:11.478611 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 15 17:49:11.478611 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 15 17:49:11.478611 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 15 17:49:11.479780 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 15 17:49:11.479780 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 17:49:11.479780 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 17:49:11.479780 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 17:49:11.479780 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 17:49:11.479780 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 17:49:11.479780 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 17:49:11.479780 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 17:49:11.479780 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application with Lock( Sep 15 17:49:11.479780 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 17:49:11.479780 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._enter() Sep 15 17:49:11.479780 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 17:49:11.479780 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 17:49:11.479780 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 17:49:11.479780 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.creator() Sep 15 17:49:11.479780 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 17:49:11.479780 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application created_value = creator( Sep 15 17:49:11.481150 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 15 17:49:11.481150 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 15 17:49:11.481150 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 15 17:49:11.481150 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 15 17:49:11.481150 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 15 17:49:11.481150 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 15 17:49:11.481150 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 15 17:49:11.481150 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Sep 15 17:49:11.483180 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 418/830] 10.222.0.25 () {56 vars in 1111 bytes} [Thu Sep 15 17:49:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 17:49:11.488817 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3515b3f-be06-442b-81d3-9fde1aa0f793 None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:49:11.718065 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:49:11.752866 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3515b3f-be06-442b-81d3-9fde1aa0f793 None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:49:11.796142 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb47ddf-d130-4b8c-ac79-578c0fb99238 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:49:11.796766 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb47ddf-d130-4b8c-ac79-578c0fb99238 None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:49:11.797047 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb47ddf-d130-4b8c-ac79-578c0fb99238 None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:49:11.797342 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb47ddf-d130-4b8c-ac79-578c0fb99238 None admin] PATH_INFO: `/v3/projects` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:49:11.798062 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb47ddf-d130-4b8c-ac79-578c0fb99238 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81592) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 17:49:11.798405 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb47ddf-d130-4b8c-ac79-578c0fb99238 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:49:11.799871 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb47ddf-d130-4b8c-ac79-578c0fb99238 None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:49:11.819667 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 413/831] 10.222.0.25 () {56 vars in 1148 bytes} [Thu Sep 15 17:49:11 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 331 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 17:49:11.826245 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eae14b0-5731-49ca-a176-0e5aea5b34dc None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:49:11.852348 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:49:11.953424 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eae14b0-5731-49ca-a176-0e5aea5b34dc None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:49:12.004822 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198c5ff0-b445-4462-b8c3-f0f7b7521855 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:49:12.005538 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198c5ff0-b445-4462-b8c3-f0f7b7521855 None admin] REQUEST_METHOD: `PUT` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:49:12.005817 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198c5ff0-b445-4462-b8c3-f0f7b7521855 None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:49:12.006094 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198c5ff0-b445-4462-b8c3-f0f7b7521855 None admin] PATH_INFO: `/v3/projects/1213c0d1b584404ba3998e136f166e89/users/d899ec4fcbeb4de382c7f0a779ca8ed5/roles/17e337d9acf148e99d6c50170293fa05` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:49:12.025199 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198c5ff0-b445-4462-b8c3-f0f7b7521855 None admin] RBAC: Authorizing `identity:create_grant(project_id=1213c0d1b584404ba3998e136f166e89, user_id=d899ec4fcbeb4de382c7f0a779ca8ed5, role_id=17e337d9acf148e99d6c50170293fa05)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:49:12.026695 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198c5ff0-b445-4462-b8c3-f0f7b7521855 None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:49:12.043385 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 419/832] 10.222.0.25 () {58 vars in 1439 bytes} [Thu Sep 15 17:49:11 2022] PUT /identity/v3/projects/1213c0d1b584404ba3998e136f166e89/users/d899ec4fcbeb4de382c7f0a779ca8ed5/roles/17e337d9acf148e99d6c50170293fa05 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 15 17:49:13.106878 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5d2d58-1254-45f0-842a-2c396a7c3333 None None] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:49:13.107892 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5d2d58-1254-45f0-842a-2c396a7c3333 None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:49:13.108372 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5d2d58-1254-45f0-842a-2c396a7c3333 None None] PATH_INFO: `/` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:49:13.110183 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 414/833] 10.222.0.25 () {54 vars in 927 bytes} [Thu Sep 15 17:49:13 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 17:49:13.116466 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7085693-0737-4521-a9cf-4f05ec2b5a4b None None] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:49:13.117309 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7085693-0737-4521-a9cf-4f05ec2b5a4b None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:49:13.117808 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7085693-0737-4521-a9cf-4f05ec2b5a4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:49:13.138994 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.auth.core [None req-e7085693-0737-4521-a9cf-4f05ec2b5a4b None None] MFA Rules not processed for user `5cfa58ef86774ab7800bf91930bf6028`. Rule list: `[]` (Enabled: `True`). {{(pid=81593) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 17:49:13.140519 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-e7085693-0737-4521-a9cf-4f05ec2b5a4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 17:49:13.225893 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:49:13.234368 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 420/834] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Sep 15 17:49:13 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 15 17:49:13.539260 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5d2d58-1254-45f0-842a-2c396a7c3333 None None] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:49:13.555195 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c715cea8-3390-4bfb-a0fd-921b7896342f None None] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:49:13.556249 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c715cea8-3390-4bfb-a0fd-921b7896342f None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:49:13.557132 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c715cea8-3390-4bfb-a0fd-921b7896342f None None] PATH_INFO: `/` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:49:13.559999 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 421/835] 10.222.0.25 () {54 vars in 927 bytes} [Thu Sep 15 17:49:13 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 17:49:13.567679 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7dd5ce-82fc-4e0e-b28d-55b7480161c4 None None] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:49:13.568390 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7dd5ce-82fc-4e0e-b28d-55b7480161c4 None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:49:13.568881 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7dd5ce-82fc-4e0e-b28d-55b7480161c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:49:13.593585 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.auth.core [None req-af7dd5ce-82fc-4e0e-b28d-55b7480161c4 None None] MFA Rules not processed for user `5cfa58ef86774ab7800bf91930bf6028`. Rule list: `[]` (Enabled: `True`). {{(pid=81593) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 17:49:13.595797 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-af7dd5ce-82fc-4e0e-b28d-55b7480161c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 17:49:13.664741 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5d2d58-1254-45f0-842a-2c396a7c3333 None None] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:49:13.683747 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 422/836] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Sep 15 17:49:13 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 15 17:49:13.691378 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f7f75b-7975-4544-bfea-d3fdb825d726 None None] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:49:13.692107 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f7f75b-7975-4544-bfea-d3fdb825d726 None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:49:13.692577 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f7f75b-7975-4544-bfea-d3fdb825d726 None None] PATH_INFO: `/` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:49:13.699239 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 423/837] 10.222.0.25 () {54 vars in 927 bytes} [Thu Sep 15 17:49:13 2022] GET /identity => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 17:49:13.701112 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cd0c7f-1e3d-4167-a8e0-9de09d86608e None None] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:49:13.701425 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cd0c7f-1e3d-4167-a8e0-9de09d86608e None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:49:13.701696 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cd0c7f-1e3d-4167-a8e0-9de09d86608e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:49:13.711029 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14b7e3d-9b1a-42ae-86a8-f1847ae0de2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:49:13.711935 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14b7e3d-9b1a-42ae-86a8-f1847ae0de2e None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:49:13.712436 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14b7e3d-9b1a-42ae-86a8-f1847ae0de2e None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:49:13.712923 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14b7e3d-9b1a-42ae-86a8-f1847ae0de2e None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:49:13.713760 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14b7e3d-9b1a-42ae-86a8-f1847ae0de2e None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:49:13.715903 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14b7e3d-9b1a-42ae-86a8-f1847ae0de2e None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:49:13.718299 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:49:13.721563 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.auth.core [None req-d3cd0c7f-1e3d-4167-a8e0-9de09d86608e None None] MFA Rules not processed for user `5cfa58ef86774ab7800bf91930bf6028`. Rule list: `[]` (Enabled: `True`). {{(pid=81593) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 17:49:13.723020 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-d3cd0c7f-1e3d-4167-a8e0-9de09d86608e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 17:49:13.729833 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application [None req-d14b7e3d-9b1a-42ae-86a8-f1847ae0de2e None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 15 17:49:13.729833 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 17:49:13.729833 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 15 17:49:13.729833 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 15 17:49:13.729833 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 15 17:49:13.729833 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 15 17:49:13.729833 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 15 17:49:13.729833 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 15 17:49:13.729833 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 15 17:49:13.729833 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Sep 15 17:49:13.729833 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 15 17:49:13.729833 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Sep 15 17:49:13.729833 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 17:49:13.729833 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 17:49:13.729833 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 17:49:13.729833 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 17:49:13.731126 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 17:49:13.731126 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 17:49:13.731126 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 17:49:13.731126 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 17:49:13.731126 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 17:49:13.731126 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 17:49:13.731126 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 17:49:13.731126 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 15 17:49:13.731126 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 15 17:49:13.731126 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 15 17:49:13.731126 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 15 17:49:13.731126 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 17:49:13.731126 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 17:49:13.731126 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 17:49:13.731126 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 17:49:13.731126 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 17:49:13.731126 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 17:49:13.732036 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 17:49:13.732036 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application with Lock( Sep 15 17:49:13.732036 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 17:49:13.732036 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._enter() Sep 15 17:49:13.732036 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 17:49:13.732036 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 17:49:13.732036 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 17:49:13.732036 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.creator() Sep 15 17:49:13.732036 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 17:49:13.732036 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application created_value = creator( Sep 15 17:49:13.732036 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 15 17:49:13.732036 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 15 17:49:13.732036 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 15 17:49:13.732036 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Sep 15 17:49:13.735376 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 415/838] 10.222.0.25 () {56 vars in 1132 bytes} [Thu Sep 15 17:49:13 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 17:49:13.742159 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14b7e3d-9b1a-42ae-86a8-f1847ae0de2e None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:49:13.813403 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 424/839] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Sep 15 17:49:13 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 15 17:49:13.862097 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14b7e3d-9b1a-42ae-86a8-f1847ae0de2e None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:49:13.899000 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78571f06-c38c-4af2-b29a-718b54badee6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:49:13.899606 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78571f06-c38c-4af2-b29a-718b54badee6 None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:49:13.899886 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78571f06-c38c-4af2-b29a-718b54badee6 None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:49:13.900236 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78571f06-c38c-4af2-b29a-718b54badee6 None admin] PATH_INFO: `/v3/services` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:49:13.900974 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78571f06-c38c-4af2-b29a-718b54badee6 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81592) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 17:49:13.901278 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78571f06-c38c-4af2-b29a-718b54badee6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:49:13.902907 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78571f06-c38c-4af2-b29a-718b54badee6 None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:49:13.909261 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 416/840] 10.222.0.25 () {56 vars in 1126 bytes} [Thu Sep 15 17:49:13 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 17:49:13.917363 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3cd0c7f-1e3d-4167-a8e0-9de09d86608e None None] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:49:13.970821 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78571f06-c38c-4af2-b29a-718b54badee6 None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:49:13.988646 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:49:14.035107 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3cd0c7f-1e3d-4167-a8e0-9de09d86608e None None] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:49:14.046404 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:49:14.077593 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9978eaea-d098-4136-a9c8-b14a2ac7da01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:49:14.078125 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9978eaea-d098-4136-a9c8-b14a2ac7da01 None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:49:14.078404 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9978eaea-d098-4136-a9c8-b14a2ac7da01 None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:49:14.078674 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9978eaea-d098-4136-a9c8-b14a2ac7da01 None admin] PATH_INFO: `/v3/services` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:49:14.079476 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9978eaea-d098-4136-a9c8-b14a2ac7da01 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81593) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 17:49:14.079784 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9978eaea-d098-4136-a9c8-b14a2ac7da01 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:49:14.081259 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9978eaea-d098-4136-a9c8-b14a2ac7da01 None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:49:14.086958 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 425/841] 10.222.0.25 () {56 vars in 1126 bytes} [Thu Sep 15 17:49:13 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 17:49:14.105846 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78571f06-c38c-4af2-b29a-718b54badee6 None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:49:14.138046 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9978eaea-d098-4136-a9c8-b14a2ac7da01 None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:49:14.159366 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de270f47-be6f-44e4-8cb4-0fd289c71705 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:49:14.161072 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de270f47-be6f-44e4-8cb4-0fd289c71705 None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:49:14.161545 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de270f47-be6f-44e4-8cb4-0fd289c71705 None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:49:14.162518 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de270f47-be6f-44e4-8cb4-0fd289c71705 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:49:14.178189 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de270f47-be6f-44e4-8cb4-0fd289c71705 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 17:49:14.185240 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application [None req-de270f47-be6f-44e4-8cb4-0fd289c71705 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 15 17:49:14.185240 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 17:49:14.185240 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 17:49:14.185240 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 17:49:14.185240 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 17:49:14.185240 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 17:49:14.185240 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 17:49:14.185240 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 17:49:14.185240 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 17:49:14.185240 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 17:49:14.185240 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 17:49:14.185240 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 17:49:14.185240 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 17:49:14.185240 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 17:49:14.185240 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 17:49:14.185240 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 17:49:14.186474 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 17:49:14.186474 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 17:49:14.186474 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 17:49:14.186474 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 17:49:14.186474 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 17:49:14.186474 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 17:49:14.186474 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 17:49:14.186474 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 17:49:14.186474 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 17:49:14.186474 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 17:49:14.186474 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 17:49:14.186474 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application with Lock( Sep 15 17:49:14.186474 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 17:49:14.186474 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._enter() Sep 15 17:49:14.186474 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 17:49:14.186474 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 17:49:14.187520 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 17:49:14.187520 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.creator() Sep 15 17:49:14.187520 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 17:49:14.187520 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application created_value = creator( Sep 15 17:49:14.187520 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 17:49:14.187520 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 17:49:14.187520 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 17:49:14.187520 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 17:49:14.187520 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 17:49:14.187520 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 17:49:14.187520 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 15 17:49:14.187520 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Sep 15 17:49:14.190081 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 417/842] 10.222.0.25 () {56 vars in 1096 bytes} [Thu Sep 15 17:49:13 2022] GET /identity/v3/roles/admin => generated 83 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 15 17:49:14.195858 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de270f47-be6f-44e4-8cb4-0fd289c71705 None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:49:14.272378 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9978eaea-d098-4136-a9c8-b14a2ac7da01 None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:49:14.303305 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:49:14.325169 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a35f02-fe65-44a7-974e-d644f8e65455 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:49:14.326681 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a35f02-fe65-44a7-974e-d644f8e65455 None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:49:14.327170 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a35f02-fe65-44a7-974e-d644f8e65455 None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:49:14.327942 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a35f02-fe65-44a7-974e-d644f8e65455 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:49:14.328884 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a35f02-fe65-44a7-974e-d644f8e65455 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:49:14.331178 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a35f02-fe65-44a7-974e-d644f8e65455 None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:49:14.332182 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de270f47-be6f-44e4-8cb4-0fd289c71705 None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:49:14.343353 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application [None req-30a35f02-fe65-44a7-974e-d644f8e65455 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 15 17:49:14.343353 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 17:49:14.343353 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 15 17:49:14.343353 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 15 17:49:14.343353 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 15 17:49:14.343353 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 15 17:49:14.343353 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 15 17:49:14.343353 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 15 17:49:14.343353 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 15 17:49:14.343353 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Sep 15 17:49:14.343353 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 15 17:49:14.343353 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Sep 15 17:49:14.343353 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 17:49:14.343353 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 17:49:14.343353 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 17:49:14.343353 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 17:49:14.343353 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 17:49:14.344434 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 17:49:14.344434 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 17:49:14.344434 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 17:49:14.344434 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 17:49:14.344434 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 17:49:14.344434 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 17:49:14.344434 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 15 17:49:14.344434 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 15 17:49:14.344434 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 15 17:49:14.344434 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 15 17:49:14.344434 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 17:49:14.344434 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 17:49:14.344434 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 17:49:14.344434 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 17:49:14.344434 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 17:49:14.344434 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 17:49:14.346490 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 17:49:14.346490 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application with Lock( Sep 15 17:49:14.346490 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 17:49:14.346490 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._enter() Sep 15 17:49:14.346490 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 17:49:14.346490 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 17:49:14.346490 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 17:49:14.346490 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.creator() Sep 15 17:49:14.346490 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 17:49:14.346490 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application created_value = creator( Sep 15 17:49:14.346490 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 15 17:49:14.346490 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 15 17:49:14.346490 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 15 17:49:14.346490 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Sep 15 17:49:14.347242 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 426/843] 10.222.0.25 () {56 vars in 1114 bytes} [Thu Sep 15 17:49:14 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 15 17:49:14.353236 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a35f02-fe65-44a7-974e-d644f8e65455 None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:49:14.364814 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:49:14.378512 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85e062e-2a10-4166-8d56-e8632483d525 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:49:14.379269 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85e062e-2a10-4166-8d56-e8632483d525 None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:49:14.379610 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85e062e-2a10-4166-8d56-e8632483d525 None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:49:14.379992 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85e062e-2a10-4166-8d56-e8632483d525 None admin] PATH_INFO: `/v3/roles` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:49:14.380831 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f85e062e-2a10-4166-8d56-e8632483d525 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81592) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 17:49:14.381196 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f85e062e-2a10-4166-8d56-e8632483d525 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:49:14.382824 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f85e062e-2a10-4166-8d56-e8632483d525 None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:49:14.393171 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 418/844] 10.222.0.25 () {56 vars in 1099 bytes} [Thu Sep 15 17:49:14 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 17:49:14.398320 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85e062e-2a10-4166-8d56-e8632483d525 None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:49:14.473745 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a35f02-fe65-44a7-974e-d644f8e65455 None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:49:14.510425 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85e062e-2a10-4166-8d56-e8632483d525 None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:49:14.511053 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775fe2a4-15ae-44ed-926d-1e046a72c301 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:49:14.511669 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775fe2a4-15ae-44ed-926d-1e046a72c301 None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:49:14.511949 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775fe2a4-15ae-44ed-926d-1e046a72c301 None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:49:14.512346 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775fe2a4-15ae-44ed-926d-1e046a72c301 None admin] PATH_INFO: `/v3/services` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:49:14.513075 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775fe2a4-15ae-44ed-926d-1e046a72c301 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81593) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 17:49:14.513433 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775fe2a4-15ae-44ed-926d-1e046a72c301 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:49:14.514890 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775fe2a4-15ae-44ed-926d-1e046a72c301 None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:49:14.520918 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 427/845] 10.222.0.25 () {56 vars in 1114 bytes} [Thu Sep 15 17:49:14 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 17:49:14.526339 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775fe2a4-15ae-44ed-926d-1e046a72c301 None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:49:14.549740 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1add12b-a887-44c5-b2c3-373212c73596 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:49:14.550399 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1add12b-a887-44c5-b2c3-373212c73596 None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:49:14.550676 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1add12b-a887-44c5-b2c3-373212c73596 None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:49:14.550947 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1add12b-a887-44c5-b2c3-373212c73596 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:49:14.563060 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1add12b-a887-44c5-b2c3-373212c73596 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:49:14.564689 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1add12b-a887-44c5-b2c3-373212c73596 None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:49:14.582580 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:49:14.583465 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application [None req-a1add12b-a887-44c5-b2c3-373212c73596 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 17:49:14.583465 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 17:49:14.583465 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 17:49:14.583465 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 17:49:14.583465 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 17:49:14.583465 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 17:49:14.583465 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 17:49:14.583465 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 17:49:14.583465 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 17:49:14.583465 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 17:49:14.583465 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 17:49:14.583465 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 17:49:14.583465 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 15 17:49:14.583465 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 15 17:49:14.583465 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 15 17:49:14.583465 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 15 17:49:14.584672 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 17:49:14.584672 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 17:49:14.584672 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 17:49:14.584672 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 17:49:14.584672 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 17:49:14.584672 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 17:49:14.584672 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 17:49:14.584672 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application with Lock( Sep 15 17:49:14.584672 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 17:49:14.584672 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._enter() Sep 15 17:49:14.584672 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 17:49:14.584672 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 17:49:14.584672 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 17:49:14.584672 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.creator() Sep 15 17:49:14.584672 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 17:49:14.584672 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application created_value = creator( Sep 15 17:49:14.584672 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 15 17:49:14.585785 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 15 17:49:14.585785 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 17:49:14.585785 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Sep 15 17:49:14.588170 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 419/846] 10.222.0.25 () {56 vars in 1108 bytes} [Thu Sep 15 17:49:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 17:49:14.594202 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1add12b-a887-44c5-b2c3-373212c73596 None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:49:14.637870 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:49:14.652923 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775fe2a4-15ae-44ed-926d-1e046a72c301 None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:49:14.692443 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07eb8d17-fc79-46f2-a53c-2df82f2e4aec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:49:14.693532 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07eb8d17-fc79-46f2-a53c-2df82f2e4aec None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:49:14.694088 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07eb8d17-fc79-46f2-a53c-2df82f2e4aec None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:49:14.694576 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07eb8d17-fc79-46f2-a53c-2df82f2e4aec None admin] PATH_INFO: `/v3/services` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:49:14.695489 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07eb8d17-fc79-46f2-a53c-2df82f2e4aec None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81593) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 17:49:14.695993 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07eb8d17-fc79-46f2-a53c-2df82f2e4aec None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:49:14.697732 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07eb8d17-fc79-46f2-a53c-2df82f2e4aec None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:49:14.703761 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 428/847] 10.222.0.25 () {56 vars in 1114 bytes} [Thu Sep 15 17:49:14 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 17:49:14.713361 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1add12b-a887-44c5-b2c3-373212c73596 None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:49:14.716323 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc5c7fb-c6d5-4469-922c-4e09208f9f55 None None] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:49:14.716647 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc5c7fb-c6d5-4469-922c-4e09208f9f55 None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:49:14.716891 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc5c7fb-c6d5-4469-922c-4e09208f9f55 None None] PATH_INFO: `/` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:49:14.718645 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 429/848] 10.222.0.25 () {54 vars in 927 bytes} [Thu Sep 15 17:49:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 15 17:49:14.725526 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469c4095-f399-4d2a-b562-224ccfda51f1 None None] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:49:14.725984 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469c4095-f399-4d2a-b562-224ccfda51f1 None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:49:14.726376 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469c4095-f399-4d2a-b562-224ccfda51f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:49:14.753586 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.auth.core [None req-469c4095-f399-4d2a-b562-224ccfda51f1 None None] MFA Rules not processed for user `5cfa58ef86774ab7800bf91930bf6028`. Rule list: `[]` (Enabled: `True`). {{(pid=81593) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 17:49:14.755106 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-469c4095-f399-4d2a-b562-224ccfda51f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 17:49:14.756706 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c96d27-866d-43eb-8d77-124eee26f1ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:49:14.757378 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c96d27-866d-43eb-8d77-124eee26f1ed None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:49:14.757711 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c96d27-866d-43eb-8d77-124eee26f1ed None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:49:14.757989 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c96d27-866d-43eb-8d77-124eee26f1ed None admin] PATH_INFO: `/v3/domains` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:49:14.758656 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c96d27-866d-43eb-8d77-124eee26f1ed None admin] RBAC: Adding query filter params (name=Default) {{(pid=81592) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 17:49:14.758957 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c96d27-866d-43eb-8d77-124eee26f1ed None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:49:14.760438 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c96d27-866d-43eb-8d77-124eee26f1ed None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:49:14.775533 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 420/849] 10.222.0.25 () {56 vars in 1109 bytes} [Thu Sep 15 17:49:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 17:49:14.782028 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c96d27-866d-43eb-8d77-124eee26f1ed None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:49:14.859894 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 430/850] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Sep 15 17:49:14 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 15 17:49:14.904858 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:49:14.915709 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c96d27-866d-43eb-8d77-124eee26f1ed None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:49:14.954045 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0f41e2-ea84-4d2b-bc29-a9b2a564af25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:49:14.954715 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0f41e2-ea84-4d2b-bc29-a9b2a564af25 None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:49:14.955156 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0f41e2-ea84-4d2b-bc29-a9b2a564af25 None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:49:14.955564 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0f41e2-ea84-4d2b-bc29-a9b2a564af25 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:49:14.963066 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec0f41e2-ea84-4d2b-bc29-a9b2a564af25 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:49:14.964683 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec0f41e2-ea84-4d2b-bc29-a9b2a564af25 None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:49:14.977731 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application [None req-ec0f41e2-ea84-4d2b-bc29-a9b2a564af25 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 15 17:49:14.977731 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 17:49:14.977731 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 17:49:14.977731 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 17:49:14.977731 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 17:49:14.977731 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 17:49:14.977731 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 17:49:14.977731 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 17:49:14.977731 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 17:49:14.977731 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 17:49:14.977731 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 17:49:14.977731 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 17:49:14.977731 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 15 17:49:14.977731 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 15 17:49:14.977731 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 15 17:49:14.977731 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 15 17:49:14.978689 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 17:49:14.978689 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 17:49:14.978689 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 15 17:49:14.978689 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 15 17:49:14.978689 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 15 17:49:14.978689 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 15 17:49:14.978689 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 17:49:14.978689 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 17:49:14.978689 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 17:49:14.978689 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 17:49:14.978689 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 17:49:14.978689 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application with Lock( Sep 15 17:49:14.978689 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 17:49:14.978689 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._enter() Sep 15 17:49:14.978689 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 17:49:14.978689 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 17:49:14.978689 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 17:49:14.978689 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.creator() Sep 15 17:49:14.979624 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 17:49:14.979624 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application created_value = creator( Sep 15 17:49:14.979624 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 15 17:49:14.979624 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 15 17:49:14.979624 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 15 17:49:14.979624 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 15 17:49:14.979624 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 15 17:49:14.979624 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 15 17:49:14.979624 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 15 17:49:14.979624 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Sep 15 17:49:14.979624 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 421/851] 10.222.0.25 () {56 vars in 1096 bytes} [Thu Sep 15 17:49:14 2022] GET /identity/v3/users/swift => generated 83 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 15 17:49:14.985169 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469c4095-f399-4d2a-b562-224ccfda51f1 None None] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:49:15.034221 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:49:15.095325 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469c4095-f399-4d2a-b562-224ccfda51f1 None None] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:49:15.127473 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0f41e2-ea84-4d2b-bc29-a9b2a564af25 None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:49:15.131700 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298ccdde-1ff8-40e4-8b9c-e9930ea74f09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:49:15.132320 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298ccdde-1ff8-40e4-8b9c-e9930ea74f09 None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:49:15.132600 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298ccdde-1ff8-40e4-8b9c-e9930ea74f09 None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:49:15.132872 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298ccdde-1ff8-40e4-8b9c-e9930ea74f09 None admin] PATH_INFO: `/v3/users` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:49:15.133640 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298ccdde-1ff8-40e4-8b9c-e9930ea74f09 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81593) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 17:49:15.133946 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298ccdde-1ff8-40e4-8b9c-e9930ea74f09 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:49:15.135388 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298ccdde-1ff8-40e4-8b9c-e9930ea74f09 None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:49:15.155288 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 431/852] 10.222.0.25 () {56 vars in 1135 bytes} [Thu Sep 15 17:49:14 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 17:49:15.160970 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298ccdde-1ff8-40e4-8b9c-e9930ea74f09 None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:49:15.233558 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0f41e2-ea84-4d2b-bc29-a9b2a564af25 None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:49:15.263949 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298ccdde-1ff8-40e4-8b9c-e9930ea74f09 None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:49:15.265538 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:49:15.272151 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb2ba9b-c104-4266-9d5a-20ea8e5231db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:49:15.273988 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb2ba9b-c104-4266-9d5a-20ea8e5231db None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:49:15.274618 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb2ba9b-c104-4266-9d5a-20ea8e5231db None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:49:15.275380 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb2ba9b-c104-4266-9d5a-20ea8e5231db None admin] PATH_INFO: `/v3/roles/service` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:49:15.287647 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb2ba9b-c104-4266-9d5a-20ea8e5231db None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 17:49:15.293659 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application [None req-fcb2ba9b-c104-4266-9d5a-20ea8e5231db None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 15 17:49:15.293659 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 17:49:15.293659 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 17:49:15.293659 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 17:49:15.293659 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 17:49:15.293659 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 17:49:15.293659 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 17:49:15.293659 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 17:49:15.293659 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 17:49:15.293659 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 17:49:15.293659 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 17:49:15.293659 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 17:49:15.293659 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 17:49:15.293659 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 17:49:15.293659 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 17:49:15.293659 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 17:49:15.294770 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 17:49:15.294770 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 17:49:15.294770 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 17:49:15.294770 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 17:49:15.294770 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 17:49:15.294770 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 17:49:15.294770 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 17:49:15.294770 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 17:49:15.294770 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 17:49:15.294770 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 17:49:15.294770 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 17:49:15.294770 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application with Lock( Sep 15 17:49:15.294770 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 17:49:15.294770 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._enter() Sep 15 17:49:15.294770 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 17:49:15.294770 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 17:49:15.295817 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 17:49:15.295817 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.creator() Sep 15 17:49:15.295817 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 17:49:15.295817 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application created_value = creator( Sep 15 17:49:15.295817 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 17:49:15.295817 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 17:49:15.295817 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 17:49:15.295817 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 17:49:15.295817 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 17:49:15.295817 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 17:49:15.295817 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 15 17:49:15.295817 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Sep 15 17:49:15.298714 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 422/853] 10.222.0.25 () {56 vars in 1102 bytes} [Thu Sep 15 17:49:15 2022] GET /identity/v3/roles/service => generated 85 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 15 17:49:15.302987 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c164ec4b-c843-4a96-8067-86ce333c4e63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:49:15.303884 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c164ec4b-c843-4a96-8067-86ce333c4e63 None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:49:15.304187 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c164ec4b-c843-4a96-8067-86ce333c4e63 None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:49:15.304466 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c164ec4b-c843-4a96-8067-86ce333c4e63 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:49:15.305137 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb2ba9b-c104-4266-9d5a-20ea8e5231db None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:49:15.329117 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:49:15.390853 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c164ec4b-c843-4a96-8067-86ce333c4e63 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:49:15.392406 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c164ec4b-c843-4a96-8067-86ce333c4e63 None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:49:15.422066 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb2ba9b-c104-4266-9d5a-20ea8e5231db None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:49:15.459069 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc189460-81ae-41bf-a1e8-112c8df9ea65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:49:15.459927 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc189460-81ae-41bf-a1e8-112c8df9ea65 None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:49:15.460397 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc189460-81ae-41bf-a1e8-112c8df9ea65 None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:49:15.460809 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc189460-81ae-41bf-a1e8-112c8df9ea65 None admin] PATH_INFO: `/v3/roles` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:49:15.461660 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc189460-81ae-41bf-a1e8-112c8df9ea65 None admin] RBAC: Adding query filter params (name=service) {{(pid=81592) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 17:49:15.462103 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc189460-81ae-41bf-a1e8-112c8df9ea65 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:49:15.463620 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc189460-81ae-41bf-a1e8-112c8df9ea65 None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:49:15.477532 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 423/854] 10.222.0.25 () {56 vars in 1103 bytes} [Thu Sep 15 17:49:15 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 17:49:15.478670 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc189460-81ae-41bf-a1e8-112c8df9ea65 None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:49:15.505455 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 432/855] 10.222.0.25 () {58 vars in 1282 bytes} [Thu Sep 15 17:49:15 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 15 17:49:15.507462 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c164ec4b-c843-4a96-8067-86ce333c4e63 None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:49:15.509486 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:49:15.567393 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:49:15.591231 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc189460-81ae-41bf-a1e8-112c8df9ea65 None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:49:15.620860 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c164ec4b-c843-4a96-8067-86ce333c4e63 None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:49:15.628512 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0f418d-cb1d-4b4c-a886-2170f37ef4a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:49:15.629141 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0f418d-cb1d-4b4c-a886-2170f37ef4a3 None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:49:15.629447 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0f418d-cb1d-4b4c-a886-2170f37ef4a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:49:15.629718 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0f418d-cb1d-4b4c-a886-2170f37ef4a3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:49:15.641370 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec0f418d-cb1d-4b4c-a886-2170f37ef4a3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:49:15.643459 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec0f418d-cb1d-4b4c-a886-2170f37ef4a3 None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:49:15.658792 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application [None req-ec0f418d-cb1d-4b4c-a886-2170f37ef4a3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 17:49:15.658792 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 17:49:15.658792 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 17:49:15.658792 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 17:49:15.658792 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 17:49:15.658792 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 17:49:15.658792 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 17:49:15.658792 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 17:49:15.658792 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 17:49:15.658792 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 17:49:15.658792 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 17:49:15.658792 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 17:49:15.658792 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 15 17:49:15.658792 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 15 17:49:15.658792 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 15 17:49:15.658792 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 15 17:49:15.659942 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 17:49:15.659942 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 17:49:15.659942 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 17:49:15.659942 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 17:49:15.659942 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 17:49:15.659942 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 17:49:15.659942 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 17:49:15.659942 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application with Lock( Sep 15 17:49:15.659942 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 17:49:15.659942 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._enter() Sep 15 17:49:15.659942 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 17:49:15.659942 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 17:49:15.659942 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 17:49:15.659942 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.creator() Sep 15 17:49:15.659942 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 17:49:15.659942 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application created_value = creator( Sep 15 17:49:15.659942 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 15 17:49:15.660934 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 15 17:49:15.660934 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 17:49:15.660934 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Sep 15 17:49:15.664562 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 424/856] 10.222.0.25 () {56 vars in 1108 bytes} [Thu Sep 15 17:49:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 17:49:15.664765 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c53f35-c63d-4d6b-a755-d2c7f8121763 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:49:15.665511 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0f418d-cb1d-4b4c-a886-2170f37ef4a3 None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:49:15.665724 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c53f35-c63d-4d6b-a755-d2c7f8121763 None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:49:15.666268 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c53f35-c63d-4d6b-a755-d2c7f8121763 None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:49:15.666701 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c53f35-c63d-4d6b-a755-d2c7f8121763 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:49:15.678787 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c53f35-c63d-4d6b-a755-d2c7f8121763 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:49:15.680936 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c53f35-c63d-4d6b-a755-d2c7f8121763 None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:49:15.699021 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application [None req-f2c53f35-c63d-4d6b-a755-d2c7f8121763 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 17:49:15.699021 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 17:49:15.699021 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 17:49:15.699021 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 17:49:15.699021 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 17:49:15.699021 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 17:49:15.699021 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 17:49:15.699021 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 17:49:15.699021 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 17:49:15.699021 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 17:49:15.699021 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 17:49:15.699021 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 17:49:15.699021 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 15 17:49:15.699021 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 15 17:49:15.699021 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 15 17:49:15.699021 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 15 17:49:15.700225 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 17:49:15.700225 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 17:49:15.700225 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 17:49:15.700225 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 17:49:15.700225 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 17:49:15.700225 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 17:49:15.700225 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 17:49:15.700225 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application with Lock( Sep 15 17:49:15.700225 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 17:49:15.700225 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._enter() Sep 15 17:49:15.700225 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 17:49:15.700225 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 17:49:15.700225 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 17:49:15.700225 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.creator() Sep 15 17:49:15.700225 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 17:49:15.700225 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application created_value = creator( Sep 15 17:49:15.700225 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 15 17:49:15.701161 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 15 17:49:15.701161 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 17:49:15.701161 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Sep 15 17:49:15.707810 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 433/857] 10.222.0.25 () {56 vars in 1108 bytes} [Thu Sep 15 17:49:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 15 17:49:15.710925 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c53f35-c63d-4d6b-a755-d2c7f8121763 None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:49:15.775340 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0f418d-cb1d-4b4c-a886-2170f37ef4a3 None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:49:15.778749 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:49:15.808470 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:49:15.815829 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0d916d-c997-4039-ad88-0bde1a5bc3ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:49:15.816643 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0d916d-c997-4039-ad88-0bde1a5bc3ad None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:49:15.817167 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0d916d-c997-4039-ad88-0bde1a5bc3ad None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:49:15.817619 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0d916d-c997-4039-ad88-0bde1a5bc3ad None admin] PATH_INFO: `/v3/domains` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:49:15.818509 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd0d916d-c997-4039-ad88-0bde1a5bc3ad None admin] RBAC: Adding query filter params (name=Default) {{(pid=81592) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 17:49:15.818949 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd0d916d-c997-4039-ad88-0bde1a5bc3ad None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:49:15.820432 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd0d916d-c997-4039-ad88-0bde1a5bc3ad None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:49:15.837946 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c53f35-c63d-4d6b-a755-d2c7f8121763 None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:49:15.838544 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 425/858] 10.222.0.25 () {56 vars in 1109 bytes} [Thu Sep 15 17:49:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 17:49:15.839664 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0d916d-c997-4039-ad88-0bde1a5bc3ad None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:49:15.875963 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea28b2b-db90-422f-9a9b-735a9e49f160 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:49:15.877088 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea28b2b-db90-422f-9a9b-735a9e49f160 None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:49:15.877489 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea28b2b-db90-422f-9a9b-735a9e49f160 None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:49:15.877737 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea28b2b-db90-422f-9a9b-735a9e49f160 None admin] PATH_INFO: `/v3/domains` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:49:15.878380 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea28b2b-db90-422f-9a9b-735a9e49f160 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81593) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 17:49:15.878675 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea28b2b-db90-422f-9a9b-735a9e49f160 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:49:15.880200 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea28b2b-db90-422f-9a9b-735a9e49f160 None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:49:15.898885 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 434/859] 10.222.0.25 () {56 vars in 1109 bytes} [Thu Sep 15 17:49:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 17:49:15.900261 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea28b2b-db90-422f-9a9b-735a9e49f160 None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:49:15.955176 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0d916d-c997-4039-ad88-0bde1a5bc3ad None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:49:15.992836 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2d97a6-4fcf-40e4-836d-cc844275311a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:49:15.994008 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2d97a6-4fcf-40e4-836d-cc844275311a None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:49:15.994586 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2d97a6-4fcf-40e4-836d-cc844275311a None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:49:15.995133 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2d97a6-4fcf-40e4-836d-cc844275311a None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:49:16.003637 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2d97a6-4fcf-40e4-836d-cc844275311a None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:49:16.005561 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2d97a6-4fcf-40e4-836d-cc844275311a None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:49:16.018491 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application [None req-6a2d97a6-4fcf-40e4-836d-cc844275311a None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 15 17:49:16.018491 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 17:49:16.018491 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 17:49:16.018491 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 17:49:16.018491 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 17:49:16.018491 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 17:49:16.018491 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 17:49:16.018491 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 17:49:16.018491 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 17:49:16.018491 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 17:49:16.018491 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 17:49:16.018491 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 17:49:16.018491 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 15 17:49:16.018491 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 15 17:49:16.018491 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 15 17:49:16.018491 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 15 17:49:16.019521 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 17:49:16.019521 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 17:49:16.019521 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 15 17:49:16.019521 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 15 17:49:16.019521 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 15 17:49:16.019521 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 15 17:49:16.019521 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 17:49:16.019521 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 17:49:16.019521 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 17:49:16.019521 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 17:49:16.019521 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 17:49:16.019521 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application with Lock( Sep 15 17:49:16.019521 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 17:49:16.019521 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._enter() Sep 15 17:49:16.019521 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 17:49:16.019521 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 17:49:16.019521 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 17:49:16.019521 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.creator() Sep 15 17:49:16.020449 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 17:49:16.020449 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application created_value = creator( Sep 15 17:49:16.020449 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 15 17:49:16.020449 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 15 17:49:16.020449 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 15 17:49:16.020449 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 15 17:49:16.020449 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 15 17:49:16.020449 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 15 17:49:16.020449 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 15 17:49:16.020449 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Sep 15 17:49:16.028233 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea28b2b-db90-422f-9a9b-735a9e49f160 None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:49:16.028789 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 426/860] 10.222.0.25 () {56 vars in 1117 bytes} [Thu Sep 15 17:49:15 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 17:49:16.030067 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2d97a6-4fcf-40e4-836d-cc844275311a None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:49:16.042995 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:49:16.067101 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef453a9f-1c18-41c9-87a4-c443b5713e89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:49:16.067726 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef453a9f-1c18-41c9-87a4-c443b5713e89 None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:49:16.068030 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef453a9f-1c18-41c9-87a4-c443b5713e89 None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:49:16.068290 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef453a9f-1c18-41c9-87a4-c443b5713e89 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:49:16.075693 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef453a9f-1c18-41c9-87a4-c443b5713e89 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:49:16.077141 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef453a9f-1c18-41c9-87a4-c443b5713e89 None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:49:16.088422 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:49:16.092585 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application [None req-ef453a9f-1c18-41c9-87a4-c443b5713e89 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 15 17:49:16.092585 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 17:49:16.092585 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 17:49:16.092585 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 17:49:16.092585 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 17:49:16.092585 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 17:49:16.092585 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 17:49:16.092585 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 17:49:16.092585 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 17:49:16.092585 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 17:49:16.092585 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 17:49:16.092585 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 17:49:16.092585 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 15 17:49:16.092585 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 15 17:49:16.092585 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 15 17:49:16.093604 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 15 17:49:16.093604 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 17:49:16.093604 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 17:49:16.093604 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 17:49:16.093604 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 17:49:16.093604 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 17:49:16.093604 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 17:49:16.093604 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 17:49:16.093604 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application with Lock( Sep 15 17:49:16.093604 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 17:49:16.093604 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._enter() Sep 15 17:49:16.093604 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 17:49:16.093604 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 17:49:16.093604 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 17:49:16.093604 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.creator() Sep 15 17:49:16.093604 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 17:49:16.093604 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application created_value = creator( Sep 15 17:49:16.094500 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 15 17:49:16.094500 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 15 17:49:16.094500 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 15 17:49:16.094500 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 15 17:49:16.094500 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 15 17:49:16.094500 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 15 17:49:16.094500 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 15 17:49:16.094500 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Sep 15 17:49:16.099625 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 435/861] 10.222.0.25 () {56 vars in 1111 bytes} [Thu Sep 15 17:49:15 2022] GET /identity/v3/projects/service => generated 88 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 15 17:49:16.100501 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef453a9f-1c18-41c9-87a4-c443b5713e89 None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:49:16.148423 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2d97a6-4fcf-40e4-836d-cc844275311a None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:49:16.184548 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa504cf6-8e89-422c-b8d3-7862c8c0e7e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:49:16.185550 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa504cf6-8e89-422c-b8d3-7862c8c0e7e4 None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:49:16.186051 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa504cf6-8e89-422c-b8d3-7862c8c0e7e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:49:16.186532 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa504cf6-8e89-422c-b8d3-7862c8c0e7e4 None admin] PATH_INFO: `/v3/users` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:49:16.187559 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa504cf6-8e89-422c-b8d3-7862c8c0e7e4 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81592) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 17:49:16.188173 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa504cf6-8e89-422c-b8d3-7862c8c0e7e4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:49:16.189903 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa504cf6-8e89-422c-b8d3-7862c8c0e7e4 None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:49:16.207201 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef453a9f-1c18-41c9-87a4-c443b5713e89 None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:49:16.213559 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 427/862] 10.222.0.25 () {56 vars in 1149 bytes} [Thu Sep 15 17:49:16 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 17:49:16.216187 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa504cf6-8e89-422c-b8d3-7862c8c0e7e4 None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:49:16.243747 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7595fe5c-629f-4b13-a48d-4b55a92d40a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:49:16.244371 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7595fe5c-629f-4b13-a48d-4b55a92d40a9 None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:49:16.244633 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7595fe5c-629f-4b13-a48d-4b55a92d40a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:49:16.244974 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7595fe5c-629f-4b13-a48d-4b55a92d40a9 None admin] PATH_INFO: `/v3/projects` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:49:16.245662 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7595fe5c-629f-4b13-a48d-4b55a92d40a9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81593) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 17:49:16.245964 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7595fe5c-629f-4b13-a48d-4b55a92d40a9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:49:16.247516 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7595fe5c-629f-4b13-a48d-4b55a92d40a9 None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:49:16.265127 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 436/863] 10.222.0.25 () {56 vars in 1148 bytes} [Thu Sep 15 17:49:16 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 17:49:16.266246 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7595fe5c-629f-4b13-a48d-4b55a92d40a9 None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:49:16.305882 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:49:16.331188 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa504cf6-8e89-422c-b8d3-7862c8c0e7e4 None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:49:16.342083 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:49:16.369910 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbbebb87-d813-4d1c-822f-0b03a6b0f8d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:49:16.371019 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbebb87-d813-4d1c-822f-0b03a6b0f8d1 None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:49:16.371499 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbebb87-d813-4d1c-822f-0b03a6b0f8d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:49:16.371968 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbebb87-d813-4d1c-822f-0b03a6b0f8d1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:49:16.385345 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7595fe5c-629f-4b13-a48d-4b55a92d40a9 None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:49:16.424744 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd087e6-1dfa-4ff9-b1f8-8f6f526fd045 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:49:16.425428 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd087e6-1dfa-4ff9-b1f8-8f6f526fd045 None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:49:16.425708 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd087e6-1dfa-4ff9-b1f8-8f6f526fd045 None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:49:16.425980 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd087e6-1dfa-4ff9-b1f8-8f6f526fd045 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:49:16.426725 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd087e6-1dfa-4ff9-b1f8-8f6f526fd045 None admin] RBAC: Adding query filter params (role.id=a9e42be86923434f8af52d3fc07fb4f7, scope.project.id=1213c0d1b584404ba3998e136f166e89, user.id=685f7ad4c6fe4c878d542dddd6d81593) {{(pid=81593) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 17:49:16.427034 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd087e6-1dfa-4ff9-b1f8-8f6f526fd045 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:49:16.428489 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd087e6-1dfa-4ff9-b1f8-8f6f526fd045 None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:49:16.434767 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 437/864] 10.222.0.25 () {56 vars in 1374 bytes} [Thu Sep 15 17:49:16 2022] GET /identity/v3/role_assignments?user.id=685f7ad4c6fe4c878d542dddd6d81593&scope.project.id=1213c0d1b584404ba3998e136f166e89&role.id=a9e42be86923434f8af52d3fc07fb4f7 => generated 608 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 17:49:16.435992 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf22533-5619-4fff-8784-faf82f0a8134 None None] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:49:16.436440 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf22533-5619-4fff-8784-faf82f0a8134 None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:49:16.436899 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf22533-5619-4fff-8784-faf82f0a8134 None None] PATH_INFO: `/` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:49:16.441362 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 438/865] 10.222.0.25 () {54 vars in 927 bytes} [Thu Sep 15 17:49:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 17:49:16.446179 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257e4374-8447-4ccd-99c9-160c4f65171e None None] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:49:16.446455 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257e4374-8447-4ccd-99c9-160c4f65171e None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:49:16.446935 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257e4374-8447-4ccd-99c9-160c4f65171e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:49:16.470742 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.auth.core [None req-257e4374-8447-4ccd-99c9-160c4f65171e None None] MFA Rules not processed for user `5cfa58ef86774ab7800bf91930bf6028`. Rule list: `[]` (Enabled: `True`). {{(pid=81593) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 17:49:16.472111 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-257e4374-8447-4ccd-99c9-160c4f65171e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 17:49:16.475101 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbbebb87-d813-4d1c-822f-0b03a6b0f8d1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:49:16.478065 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbbebb87-d813-4d1c-822f-0b03a6b0f8d1 None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:49:16.561541 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 439/866] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Sep 15 17:49:16 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 15 17:49:16.663906 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 428/867] 10.222.0.25 () {58 vars in 1282 bytes} [Thu Sep 15 17:49:16 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 448 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 15 17:49:16.670198 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257e4374-8447-4ccd-99c9-160c4f65171e None None] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:49:16.702217 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:49:16.784482 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257e4374-8447-4ccd-99c9-160c4f65171e None None] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:49:16.820008 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c847f296-f417-4fd2-8483-bf78895f67a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:49:16.820876 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c847f296-f417-4fd2-8483-bf78895f67a0 None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:49:16.821346 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c847f296-f417-4fd2-8483-bf78895f67a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:49:16.821760 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c847f296-f417-4fd2-8483-bf78895f67a0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:49:16.832815 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c847f296-f417-4fd2-8483-bf78895f67a0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:49:16.834526 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c847f296-f417-4fd2-8483-bf78895f67a0 None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:49:16.854721 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application [None req-c847f296-f417-4fd2-8483-bf78895f67a0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 17:49:16.854721 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 17:49:16.854721 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 17:49:16.854721 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 17:49:16.854721 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 17:49:16.854721 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 17:49:16.854721 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 17:49:16.854721 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 17:49:16.854721 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 17:49:16.854721 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 17:49:16.854721 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 17:49:16.854721 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 17:49:16.854721 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 15 17:49:16.854721 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 15 17:49:16.854721 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 15 17:49:16.854721 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 15 17:49:16.856445 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 17:49:16.856445 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 17:49:16.856445 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 17:49:16.856445 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 17:49:16.856445 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 17:49:16.856445 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 17:49:16.856445 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 17:49:16.856445 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application with Lock( Sep 15 17:49:16.856445 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 17:49:16.856445 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._enter() Sep 15 17:49:16.856445 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 17:49:16.856445 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 17:49:16.856445 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 17:49:16.856445 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.creator() Sep 15 17:49:16.856445 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 17:49:16.856445 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application created_value = creator( Sep 15 17:49:16.856445 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 15 17:49:16.857605 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 15 17:49:16.857605 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 17:49:16.857605 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Sep 15 17:49:16.859365 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 440/868] 10.222.0.25 () {56 vars in 1108 bytes} [Thu Sep 15 17:49:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 17:49:16.863062 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbbebb87-d813-4d1c-822f-0b03a6b0f8d1 None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:49:16.866060 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c847f296-f417-4fd2-8483-bf78895f67a0 None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:49:16.883600 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:49:16.960879 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:49:16.982133 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c847f296-f417-4fd2-8483-bf78895f67a0 None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:49:16.998539 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbbebb87-d813-4d1c-822f-0b03a6b0f8d1 None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:49:17.019650 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977608c4-3335-447e-a545-187d1beef26f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:49:17.020260 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977608c4-3335-447e-a545-187d1beef26f None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:49:17.020509 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977608c4-3335-447e-a545-187d1beef26f None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:49:17.020784 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977608c4-3335-447e-a545-187d1beef26f None admin] PATH_INFO: `/v3/domains` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:49:17.021461 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977608c4-3335-447e-a545-187d1beef26f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81593) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 17:49:17.021821 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977608c4-3335-447e-a545-187d1beef26f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:49:17.023202 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977608c4-3335-447e-a545-187d1beef26f None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:49:17.035598 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 441/869] 10.222.0.25 () {56 vars in 1109 bytes} [Thu Sep 15 17:49:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 17:49:17.037246 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cc327d-a9a3-424a-a62b-88f838022831 None None] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:49:17.037798 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cc327d-a9a3-424a-a62b-88f838022831 None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:49:17.038277 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cc327d-a9a3-424a-a62b-88f838022831 None None] PATH_INFO: `/` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:49:17.040658 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22329cd-e6eb-4138-9e14-88ae6d891cc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:49:17.041266 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22329cd-e6eb-4138-9e14-88ae6d891cc5 None admin] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:49:17.041577 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22329cd-e6eb-4138-9e14-88ae6d891cc5 None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:49:17.041852 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22329cd-e6eb-4138-9e14-88ae6d891cc5 None admin] PATH_INFO: `/v3/services` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:49:17.042518 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d22329cd-e6eb-4138-9e14-88ae6d891cc5 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:49:17.043864 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 442/870] 10.222.0.25 () {54 vars in 927 bytes} [Thu Sep 15 17:49:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 17:49:17.043978 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d22329cd-e6eb-4138-9e14-88ae6d891cc5 None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:49:17.044634 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3cc327d-a9a3-424a-a62b-88f838022831 None None] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:49:17.061673 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 429/871] 10.222.0.25 () {60 vars in 1141 bytes} [Thu Sep 15 17:49:16 2022] POST /identity/v3/services => generated 269 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 15 17:49:17.064246 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6cbea4-7b7b-46a5-b32b-646606ad2f08 None None] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:49:17.064811 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6cbea4-7b7b-46a5-b32b-646606ad2f08 None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:49:17.065342 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6cbea4-7b7b-46a5-b32b-646606ad2f08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:49:17.091017 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.auth.core [None req-7f6cbea4-7b7b-46a5-b32b-646606ad2f08 None None] MFA Rules not processed for user `5cfa58ef86774ab7800bf91930bf6028`. Rule list: `[]` (Enabled: `True`). {{(pid=81592) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 17:49:17.092584 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-7f6cbea4-7b7b-46a5-b32b-646606ad2f08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 17:49:17.173224 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:49:17.179593 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3cc327d-a9a3-424a-a62b-88f838022831 None None] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:49:17.181714 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 430/872] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Sep 15 17:49:17 2022] POST /identity/v3/auth/tokens => generated 1271 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 15 17:49:17.232062 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65fbf6b-35cb-4efa-8e5d-9787abd07027 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:49:17.232686 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65fbf6b-35cb-4efa-8e5d-9787abd07027 None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:49:17.232890 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65fbf6b-35cb-4efa-8e5d-9787abd07027 None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:49:17.233163 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65fbf6b-35cb-4efa-8e5d-9787abd07027 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:49:17.236236 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:49:17.241764 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65fbf6b-35cb-4efa-8e5d-9787abd07027 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:49:17.243224 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65fbf6b-35cb-4efa-8e5d-9787abd07027 None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:49:17.256101 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application [None req-d65fbf6b-35cb-4efa-8e5d-9787abd07027 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 15 17:49:17.256101 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 17:49:17.256101 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 17:49:17.256101 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 17:49:17.256101 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 17:49:17.256101 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 17:49:17.256101 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 17:49:17.256101 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 17:49:17.256101 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 17:49:17.256101 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 17:49:17.256101 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 17:49:17.256101 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 17:49:17.256101 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 15 17:49:17.256101 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 15 17:49:17.256101 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 15 17:49:17.257024 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 15 17:49:17.257024 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 17:49:17.257024 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 17:49:17.257024 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 17:49:17.257024 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 17:49:17.257024 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 17:49:17.257024 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 17:49:17.257024 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 17:49:17.257024 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application with Lock( Sep 15 17:49:17.257024 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 17:49:17.257024 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._enter() Sep 15 17:49:17.257024 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 17:49:17.257024 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 17:49:17.257024 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 17:49:17.257024 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.creator() Sep 15 17:49:17.257024 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 17:49:17.257024 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application created_value = creator( Sep 15 17:49:17.257960 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 15 17:49:17.257960 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 15 17:49:17.257960 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 15 17:49:17.257960 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 15 17:49:17.257960 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 15 17:49:17.257960 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 15 17:49:17.257960 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 15 17:49:17.257960 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Sep 15 17:49:17.257960 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 443/873] 10.222.0.25 () {56 vars in 1111 bytes} [Thu Sep 15 17:49:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 17:49:17.264628 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6cbea4-7b7b-46a5-b32b-646606ad2f08 None None] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:49:17.375436 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6cbea4-7b7b-46a5-b32b-646606ad2f08 None None] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:49:17.411603 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ccd4fd-1a03-4e92-8d70-adc9ed6ab9be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:49:17.412202 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ccd4fd-1a03-4e92-8d70-adc9ed6ab9be None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:49:17.412475 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ccd4fd-1a03-4e92-8d70-adc9ed6ab9be None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:49:17.412743 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ccd4fd-1a03-4e92-8d70-adc9ed6ab9be None admin] PATH_INFO: `/v3/projects` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:49:17.413457 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ccd4fd-1a03-4e92-8d70-adc9ed6ab9be None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81592) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 17:49:17.413755 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ccd4fd-1a03-4e92-8d70-adc9ed6ab9be None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:49:17.415165 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ccd4fd-1a03-4e92-8d70-adc9ed6ab9be None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:49:17.427682 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 431/874] 10.222.0.25 () {56 vars in 1148 bytes} [Thu Sep 15 17:49:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 17:49:17.433520 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65fbf6b-35cb-4efa-8e5d-9787abd07027 None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:49:17.464149 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ccd4fd-1a03-4e92-8d70-adc9ed6ab9be None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:49:17.539227 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:49:17.565245 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65fbf6b-35cb-4efa-8e5d-9787abd07027 None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:49:17.587345 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ccd4fd-1a03-4e92-8d70-adc9ed6ab9be None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:49:17.600923 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7a9880-a81c-473d-bc91-721ee74f4f4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:49:17.601703 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7a9880-a81c-473d-bc91-721ee74f4f4c None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:49:17.602096 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7a9880-a81c-473d-bc91-721ee74f4f4c None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:49:17.602476 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7a9880-a81c-473d-bc91-721ee74f4f4c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:49:17.603597 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd7a9880-a81c-473d-bc91-721ee74f4f4c None admin] RBAC: Adding query filter params (role.id=17e337d9acf148e99d6c50170293fa05, scope.project.id=1213c0d1b584404ba3998e136f166e89, user.id=d899ec4fcbeb4de382c7f0a779ca8ed5) {{(pid=81593) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 17:49:17.603597 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd7a9880-a81c-473d-bc91-721ee74f4f4c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:49:17.605203 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd7a9880-a81c-473d-bc91-721ee74f4f4c None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:49:17.614185 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 444/875] 10.222.0.25 () {56 vars in 1374 bytes} [Thu Sep 15 17:49:17 2022] GET /identity/v3/role_assignments?user.id=d899ec4fcbeb4de382c7f0a779ca8ed5&scope.project.id=1213c0d1b584404ba3998e136f166e89&role.id=17e337d9acf148e99d6c50170293fa05 => generated 608 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 17:49:17.633975 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8dd396d-6b3f-464b-a551-437f2a498db0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:49:17.634818 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8dd396d-6b3f-464b-a551-437f2a498db0 None admin] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:49:17.635105 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8dd396d-6b3f-464b-a551-437f2a498db0 None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:49:17.635388 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8dd396d-6b3f-464b-a551-437f2a498db0 None admin] PATH_INFO: `/v3/services` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:49:17.636074 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8dd396d-6b3f-464b-a551-437f2a498db0 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:49:17.638301 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8dd396d-6b3f-464b-a551-437f2a498db0 None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:49:17.658961 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 432/876] 10.222.0.25 () {60 vars in 1141 bytes} [Thu Sep 15 17:49:17 2022] POST /identity/v3/services => generated 251 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 15 17:49:19.147468 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39aa8f0c-edb3-4010-8ec5-0d7582c72693 None None] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:49:19.148883 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39aa8f0c-edb3-4010-8ec5-0d7582c72693 None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:49:19.149651 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39aa8f0c-edb3-4010-8ec5-0d7582c72693 None None] PATH_INFO: `/` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:49:19.152616 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 445/877] 10.222.0.25 () {54 vars in 927 bytes} [Thu Sep 15 17:49:19 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 17:49:19.161971 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a1fc2a-897d-4f72-bb99-39b8499d38a6 None None] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:49:19.163246 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a1fc2a-897d-4f72-bb99-39b8499d38a6 None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:49:19.164067 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a1fc2a-897d-4f72-bb99-39b8499d38a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:49:19.194153 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.auth.core [None req-47a1fc2a-897d-4f72-bb99-39b8499d38a6 None None] MFA Rules not processed for user `5cfa58ef86774ab7800bf91930bf6028`. Rule list: `[]` (Enabled: `True`). {{(pid=81592) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 17:49:19.195961 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-47a1fc2a-897d-4f72-bb99-39b8499d38a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 17:49:19.319734 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 433/878] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Sep 15 17:49:19 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 15 17:49:19.668918 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75804d6e-9be2-4f9e-99f1-887824cfa26c None None] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:49:19.669220 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75804d6e-9be2-4f9e-99f1-887824cfa26c None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:49:19.669633 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75804d6e-9be2-4f9e-99f1-887824cfa26c None None] PATH_INFO: `/` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:49:19.670816 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 446/879] 10.222.0.25 () {54 vars in 927 bytes} [Thu Sep 15 17:49:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 17:49:19.677243 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606349d5-a694-497e-abd1-67df2d8d208d None None] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:49:19.677568 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606349d5-a694-497e-abd1-67df2d8d208d None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:49:19.677859 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606349d5-a694-497e-abd1-67df2d8d208d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:49:19.696667 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.auth.core [None req-606349d5-a694-497e-abd1-67df2d8d208d None None] MFA Rules not processed for user `5cfa58ef86774ab7800bf91930bf6028`. Rule list: `[]` (Enabled: `True`). {{(pid=81592) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 17:49:19.697886 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-606349d5-a694-497e-abd1-67df2d8d208d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 17:49:19.739489 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:49:19.782153 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 434/880] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Sep 15 17:49:19 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 15 17:49:19.799928 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75804d6e-9be2-4f9e-99f1-887824cfa26c None None] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:49:19.865935 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:49:19.921812 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75804d6e-9be2-4f9e-99f1-887824cfa26c None None] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:49:19.959654 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad13d8c0-05c9-4557-959d-046d79bd629a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:49:19.960290 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad13d8c0-05c9-4557-959d-046d79bd629a None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:49:19.960565 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad13d8c0-05c9-4557-959d-046d79bd629a None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:49:19.960831 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad13d8c0-05c9-4557-959d-046d79bd629a None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:49:19.961511 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad13d8c0-05c9-4557-959d-046d79bd629a None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:49:19.962884 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad13d8c0-05c9-4557-959d-046d79bd629a None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:49:19.971911 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application [None req-ad13d8c0-05c9-4557-959d-046d79bd629a None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 15 17:49:19.971911 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 17:49:19.971911 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 15 17:49:19.971911 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 15 17:49:19.971911 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 15 17:49:19.971911 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 15 17:49:19.971911 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 15 17:49:19.971911 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 15 17:49:19.971911 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 15 17:49:19.971911 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Sep 15 17:49:19.971911 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 15 17:49:19.971911 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Sep 15 17:49:19.971911 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 17:49:19.971911 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 17:49:19.971911 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 17:49:19.971911 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 17:49:19.971911 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 17:49:19.973026 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 17:49:19.973026 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 17:49:19.973026 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 17:49:19.973026 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 17:49:19.973026 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 17:49:19.973026 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 17:49:19.973026 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 15 17:49:19.973026 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 15 17:49:19.973026 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 15 17:49:19.973026 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 15 17:49:19.973026 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 17:49:19.973026 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 17:49:19.973026 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 17:49:19.973026 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 17:49:19.973026 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 17:49:19.973026 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 17:49:19.973906 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 17:49:19.973906 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application with Lock( Sep 15 17:49:19.973906 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 17:49:19.973906 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._enter() Sep 15 17:49:19.973906 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 17:49:19.973906 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 17:49:19.973906 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 17:49:19.973906 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.creator() Sep 15 17:49:19.973906 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 17:49:19.973906 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application created_value = creator( Sep 15 17:49:19.973906 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 15 17:49:19.973906 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 15 17:49:19.973906 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 15 17:49:19.973906 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Sep 15 17:49:19.973906 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 447/881] 10.222.0.25 () {56 vars in 1126 bytes} [Thu Sep 15 17:49:19 2022] GET /identity/v3/services/object-store => generated 93 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 17:49:19.979209 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606349d5-a694-497e-abd1-67df2d8d208d None None] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:49:20.090794 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606349d5-a694-497e-abd1-67df2d8d208d None None] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:49:20.104164 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad13d8c0-05c9-4557-959d-046d79bd629a None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:49:20.135450 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea80a0b8-974d-4746-befe-219e51949ace None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:49:20.136709 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea80a0b8-974d-4746-befe-219e51949ace None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:49:20.137202 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea80a0b8-974d-4746-befe-219e51949ace None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:49:20.137863 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea80a0b8-974d-4746-befe-219e51949ace None admin] PATH_INFO: `/v3/services` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:49:20.139046 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea80a0b8-974d-4746-befe-219e51949ace None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81592) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 17:49:20.139783 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea80a0b8-974d-4746-befe-219e51949ace None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:49:20.141640 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea80a0b8-974d-4746-befe-219e51949ace None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:49:20.149470 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 435/882] 10.222.0.25 () {56 vars in 1122 bytes} [Thu Sep 15 17:49:19 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 17:49:20.155949 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea80a0b8-974d-4746-befe-219e51949ace None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:49:20.229853 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:49:20.255505 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad13d8c0-05c9-4557-959d-046d79bd629a None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:49:20.289941 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea80a0b8-974d-4746-befe-219e51949ace None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:49:20.290326 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:49:20.306128 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a5b5ed-1a79-480b-a7d1-b25837451da6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:49:20.307133 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a5b5ed-1a79-480b-a7d1-b25837451da6 None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:49:20.307893 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a5b5ed-1a79-480b-a7d1-b25837451da6 None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:49:20.308387 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a5b5ed-1a79-480b-a7d1-b25837451da6 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:49:20.309862 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a5b5ed-1a79-480b-a7d1-b25837451da6 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:49:20.312133 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a5b5ed-1a79-480b-a7d1-b25837451da6 None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:49:20.326835 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application [None req-f6a5b5ed-1a79-480b-a7d1-b25837451da6 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 15 17:49:20.326835 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 17:49:20.326835 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 15 17:49:20.326835 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 15 17:49:20.326835 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 15 17:49:20.326835 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 15 17:49:20.326835 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 15 17:49:20.326835 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 15 17:49:20.326835 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 15 17:49:20.326835 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Sep 15 17:49:20.326835 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 15 17:49:20.326835 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Sep 15 17:49:20.326835 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 17:49:20.326835 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 17:49:20.326835 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 17:49:20.326835 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 17:49:20.327855 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 17:49:20.327855 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 17:49:20.327855 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 17:49:20.327855 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 17:49:20.327855 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 17:49:20.327855 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 17:49:20.327855 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 17:49:20.327855 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 15 17:49:20.327855 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 15 17:49:20.327855 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 15 17:49:20.327855 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 15 17:49:20.327855 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 17:49:20.327855 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 17:49:20.327855 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 17:49:20.327855 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 17:49:20.327855 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 17:49:20.327855 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 17:49:20.328766 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 17:49:20.328766 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application with Lock( Sep 15 17:49:20.328766 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 17:49:20.328766 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._enter() Sep 15 17:49:20.328766 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 17:49:20.328766 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 17:49:20.328766 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 17:49:20.328766 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.creator() Sep 15 17:49:20.328766 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 17:49:20.328766 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application created_value = creator( Sep 15 17:49:20.328766 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 15 17:49:20.328766 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 15 17:49:20.328766 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 15 17:49:20.328766 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Sep 15 17:49:20.331707 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 448/883] 10.222.0.25 () {56 vars in 1132 bytes} [Thu Sep 15 17:49:20 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 15 17:49:20.337941 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a5b5ed-1a79-480b-a7d1-b25837451da6 None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:49:20.342858 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba148d4-3327-40fd-873e-900b32de2d47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:49:20.343115 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba148d4-3327-40fd-873e-900b32de2d47 None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:49:20.343341 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba148d4-3327-40fd-873e-900b32de2d47 None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:49:20.343620 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba148d4-3327-40fd-873e-900b32de2d47 None admin] PATH_INFO: `/v3/services` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:49:20.344262 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba148d4-3327-40fd-873e-900b32de2d47 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81592) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 17:49:20.344660 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba148d4-3327-40fd-873e-900b32de2d47 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:49:20.346186 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba148d4-3327-40fd-873e-900b32de2d47 None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:49:20.357235 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 436/884] 10.222.0.25 () {56 vars in 1122 bytes} [Thu Sep 15 17:49:20 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 17:49:20.461358 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a5b5ed-1a79-480b-a7d1-b25837451da6 None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:49:20.502739 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888a133c-36ca-4819-a563-7cb44289c332 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:49:20.503815 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888a133c-36ca-4819-a563-7cb44289c332 None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:49:20.504313 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888a133c-36ca-4819-a563-7cb44289c332 None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:49:20.504807 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888a133c-36ca-4819-a563-7cb44289c332 None admin] PATH_INFO: `/v3/services` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:49:20.505731 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-888a133c-36ca-4819-a563-7cb44289c332 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81593) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 17:49:20.506255 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-888a133c-36ca-4819-a563-7cb44289c332 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:49:20.507958 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-888a133c-36ca-4819-a563-7cb44289c332 None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:49:20.519897 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 449/885] 10.222.0.25 () {56 vars in 1126 bytes} [Thu Sep 15 17:49:20 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 17:49:20.521927 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba148d4-3327-40fd-873e-900b32de2d47 None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:49:20.619056 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f53a22f-8d61-47a6-9f8c-390ea6745cd5 None None] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:49:20.619408 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f53a22f-8d61-47a6-9f8c-390ea6745cd5 None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:49:20.619598 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f53a22f-8d61-47a6-9f8c-390ea6745cd5 None None] PATH_INFO: `/` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:49:20.620929 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 450/886] 10.222.0.25 () {54 vars in 927 bytes} [Thu Sep 15 17:49:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 15 17:49:20.627950 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408d41a2-53e6-45cf-977a-8b937d6691df None None] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:49:20.628562 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408d41a2-53e6-45cf-977a-8b937d6691df None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:49:20.629030 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408d41a2-53e6-45cf-977a-8b937d6691df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:49:20.648328 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba148d4-3327-40fd-873e-900b32de2d47 None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:49:20.649914 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.auth.core [None req-408d41a2-53e6-45cf-977a-8b937d6691df None None] MFA Rules not processed for user `5cfa58ef86774ab7800bf91930bf6028`. Rule list: `[]` (Enabled: `True`). {{(pid=81593) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 17:49:20.651425 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-408d41a2-53e6-45cf-977a-8b937d6691df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 17:49:20.664091 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:49:20.698689 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91977148-da8d-4ed5-85b4-689668d20102 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:49:20.699299 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91977148-da8d-4ed5-85b4-689668d20102 None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:49:20.699575 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91977148-da8d-4ed5-85b4-689668d20102 None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:49:20.699843 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91977148-da8d-4ed5-85b4-689668d20102 None admin] PATH_INFO: `/v3/services` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:49:20.700475 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91977148-da8d-4ed5-85b4-689668d20102 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81592) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 17:49:20.700780 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91977148-da8d-4ed5-85b4-689668d20102 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:49:20.702169 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91977148-da8d-4ed5-85b4-689668d20102 None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:49:20.713404 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 437/887] 10.222.0.25 () {56 vars in 1126 bytes} [Thu Sep 15 17:49:20 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 17:49:20.716386 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:49:20.717546 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91977148-da8d-4ed5-85b4-689668d20102 None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:49:20.749477 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 451/888] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Sep 15 17:49:20 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 15 17:49:20.777564 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcc1d86-bcfb-4781-8534-c5ef20a5be59 None None] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:49:20.777751 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcc1d86-bcfb-4781-8534-c5ef20a5be59 None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:49:20.778038 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcc1d86-bcfb-4781-8534-c5ef20a5be59 None None] PATH_INFO: `/` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:49:20.779732 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 452/889] 10.222.0.25 () {54 vars in 927 bytes} [Thu Sep 15 17:49:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 17:49:20.784955 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35a059a-2262-43a5-a20d-f8b301014721 None None] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:49:20.785241 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35a059a-2262-43a5-a20d-f8b301014721 None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:49:20.785643 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35a059a-2262-43a5-a20d-f8b301014721 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:49:20.806555 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.auth.core [None req-e35a059a-2262-43a5-a20d-f8b301014721 None None] MFA Rules not processed for user `5cfa58ef86774ab7800bf91930bf6028`. Rule list: `[]` (Enabled: `True`). {{(pid=81593) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 17:49:20.807858 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-e35a059a-2262-43a5-a20d-f8b301014721 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 17:49:20.837257 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91977148-da8d-4ed5-85b4-689668d20102 None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:49:20.883268 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0267e76-1e18-4287-93e3-9ff7df9facbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:49:20.883875 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0267e76-1e18-4287-93e3-9ff7df9facbd None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:49:20.884150 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0267e76-1e18-4287-93e3-9ff7df9facbd None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:49:20.884419 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0267e76-1e18-4287-93e3-9ff7df9facbd None admin] PATH_INFO: `/v3/endpoints` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:49:20.885195 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0267e76-1e18-4287-93e3-9ff7df9facbd None admin] RBAC: Adding query filter params (interface=public, service_id=28cd67486a8e4d0b8f7909a610522dd6, region_id=RegionOne) {{(pid=81592) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 17:49:20.885551 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0267e76-1e18-4287-93e3-9ff7df9facbd None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:49:20.886907 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0267e76-1e18-4287-93e3-9ff7df9facbd None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:49:20.889658 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 453/890] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Sep 15 17:49:20 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 15 17:49:20.900006 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 438/891] 10.222.0.25 () {56 vars in 1251 bytes} [Thu Sep 15 17:49:20 2022] GET /identity/v3/endpoints?service_id=28cd67486a8e4d0b8f7909a610522dd6&interface=public®ion_id=RegionOne => generated 194 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 17:49:20.901463 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35a059a-2262-43a5-a20d-f8b301014721 None None] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:49:21.019237 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35a059a-2262-43a5-a20d-f8b301014721 None None] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:49:21.028186 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0267e76-1e18-4287-93e3-9ff7df9facbd None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:49:21.036411 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:49:21.063782 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c58ca1-1167-44a5-936c-d16520590bd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:49:21.064560 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c58ca1-1167-44a5-936c-d16520590bd8 None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:49:21.064881 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c58ca1-1167-44a5-936c-d16520590bd8 None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:49:21.065159 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c58ca1-1167-44a5-936c-d16520590bd8 None admin] PATH_INFO: `/v3/services` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:49:21.066120 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c58ca1-1167-44a5-936c-d16520590bd8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:49:21.067145 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:49:21.067775 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c58ca1-1167-44a5-936c-d16520590bd8 None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:49:21.077373 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 454/892] 10.222.0.25 () {56 vars in 1087 bytes} [Thu Sep 15 17:49:20 2022] GET /identity/v3/services => generated 1268 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 17:49:21.150225 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0267e76-1e18-4287-93e3-9ff7df9facbd None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:49:21.186793 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c58ca1-1167-44a5-936c-d16520590bd8 None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:49:21.189320 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d5e6ed-ea62-47ea-8aaf-28d0dfbb0188 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:49:21.190318 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d5e6ed-ea62-47ea-8aaf-28d0dfbb0188 None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:49:21.190880 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d5e6ed-ea62-47ea-8aaf-28d0dfbb0188 None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:49:21.191158 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d5e6ed-ea62-47ea-8aaf-28d0dfbb0188 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:49:21.204886 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d5e6ed-ea62-47ea-8aaf-28d0dfbb0188 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 17:49:21.210962 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application [None req-d6d5e6ed-ea62-47ea-8aaf-28d0dfbb0188 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 15 17:49:21.210962 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 17:49:21.210962 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 17:49:21.210962 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 17:49:21.210962 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 17:49:21.210962 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 17:49:21.210962 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 17:49:21.210962 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 17:49:21.210962 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 17:49:21.210962 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 17:49:21.210962 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 17:49:21.210962 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 17:49:21.210962 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 17:49:21.210962 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 17:49:21.210962 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 17:49:21.210962 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 17:49:21.211986 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 17:49:21.211986 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 17:49:21.211986 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 17:49:21.211986 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 17:49:21.211986 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 17:49:21.211986 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 17:49:21.211986 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 17:49:21.211986 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 17:49:21.211986 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 17:49:21.211986 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 17:49:21.211986 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 17:49:21.211986 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application with Lock( Sep 15 17:49:21.211986 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 17:49:21.211986 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._enter() Sep 15 17:49:21.211986 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 17:49:21.211986 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 17:49:21.212821 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 17:49:21.212821 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.creator() Sep 15 17:49:21.212821 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 17:49:21.212821 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application created_value = creator( Sep 15 17:49:21.212821 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 17:49:21.212821 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 17:49:21.212821 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 17:49:21.212821 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 17:49:21.212821 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 17:49:21.212821 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 17:49:21.212821 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 15 17:49:21.212821 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Sep 15 17:49:21.212821 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 439/893] 10.222.0.25 () {56 vars in 1120 bytes} [Thu Sep 15 17:49:21 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 17:49:21.219162 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d5e6ed-ea62-47ea-8aaf-28d0dfbb0188 None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:49:21.315050 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c58ca1-1167-44a5-936c-d16520590bd8 None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:49:21.341686 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:49:21.352335 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d5e6ed-ea62-47ea-8aaf-28d0dfbb0188 None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:49:21.363997 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42573a85-7142-4cfd-9549-13db8e815617 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:49:21.365056 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42573a85-7142-4cfd-9549-13db8e815617 None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:49:21.365536 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42573a85-7142-4cfd-9549-13db8e815617 None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:49:21.365952 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42573a85-7142-4cfd-9549-13db8e815617 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:49:21.366765 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42573a85-7142-4cfd-9549-13db8e815617 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:49:21.368948 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42573a85-7142-4cfd-9549-13db8e815617 None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:49:21.382181 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application [None req-42573a85-7142-4cfd-9549-13db8e815617 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 15 17:49:21.382181 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 17:49:21.382181 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 15 17:49:21.382181 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 15 17:49:21.382181 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 15 17:49:21.382181 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 15 17:49:21.382181 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 15 17:49:21.382181 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 15 17:49:21.382181 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 15 17:49:21.382181 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Sep 15 17:49:21.382181 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 15 17:49:21.382181 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Sep 15 17:49:21.382181 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 17:49:21.382181 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 17:49:21.382181 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 17:49:21.382181 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 17:49:21.382181 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 17:49:21.383189 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 17:49:21.383189 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 17:49:21.383189 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 17:49:21.383189 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 17:49:21.383189 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 17:49:21.383189 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 17:49:21.383189 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 15 17:49:21.383189 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 15 17:49:21.383189 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 15 17:49:21.383189 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 15 17:49:21.383189 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 17:49:21.383189 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 17:49:21.383189 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 17:49:21.383189 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 17:49:21.383189 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 17:49:21.383189 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 17:49:21.384021 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 17:49:21.384021 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application with Lock( Sep 15 17:49:21.384021 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 17:49:21.384021 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._enter() Sep 15 17:49:21.384021 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 17:49:21.384021 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 17:49:21.384021 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 17:49:21.384021 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.creator() Sep 15 17:49:21.384021 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 17:49:21.384021 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application created_value = creator( Sep 15 17:49:21.384021 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 15 17:49:21.384021 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 15 17:49:21.384021 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 15 17:49:21.384021 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Sep 15 17:49:21.385162 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 455/894] 10.222.0.25 () {56 vars in 1114 bytes} [Thu Sep 15 17:49:21 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 15 17:49:21.389717 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42573a85-7142-4cfd-9549-13db8e815617 None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:49:21.393944 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84cee17-900d-4d28-a648-3313f0b0e103 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:49:21.394558 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84cee17-900d-4d28-a648-3313f0b0e103 None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:49:21.394840 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84cee17-900d-4d28-a648-3313f0b0e103 None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:49:21.395128 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84cee17-900d-4d28-a648-3313f0b0e103 None admin] PATH_INFO: `/v3/roles` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:49:21.395790 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c84cee17-900d-4d28-a648-3313f0b0e103 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81592) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 17:49:21.396102 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c84cee17-900d-4d28-a648-3313f0b0e103 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:49:21.397495 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c84cee17-900d-4d28-a648-3313f0b0e103 None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:49:21.409339 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 440/895] 10.222.0.25 () {56 vars in 1115 bytes} [Thu Sep 15 17:49:21 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 17:49:21.412580 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84cee17-900d-4d28-a648-3313f0b0e103 None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:49:21.440954 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:49:21.518466 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42573a85-7142-4cfd-9549-13db8e815617 None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:49:21.529516 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84cee17-900d-4d28-a648-3313f0b0e103 None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:49:21.566117 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8866e5-ec18-420d-903b-da3845a29c07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:49:21.566308 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02fd5e83-e9d5-4040-90da-dbe2b4842db0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:49:21.566684 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fd5e83-e9d5-4040-90da-dbe2b4842db0 None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:49:21.566967 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fd5e83-e9d5-4040-90da-dbe2b4842db0 None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:49:21.567244 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fd5e83-e9d5-4040-90da-dbe2b4842db0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:49:21.567874 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8866e5-ec18-420d-903b-da3845a29c07 None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:49:21.568406 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8866e5-ec18-420d-903b-da3845a29c07 None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:49:21.568887 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8866e5-ec18-420d-903b-da3845a29c07 None admin] PATH_INFO: `/v3/services` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:49:21.570453 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b8866e5-ec18-420d-903b-da3845a29c07 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81593) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 17:49:21.570979 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b8866e5-ec18-420d-903b-da3845a29c07 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:49:21.572780 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b8866e5-ec18-420d-903b-da3845a29c07 None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:49:21.579255 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02fd5e83-e9d5-4040-90da-dbe2b4842db0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:49:21.580108 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 456/896] 10.222.0.25 () {56 vars in 1114 bytes} [Thu Sep 15 17:49:21 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 17:49:21.580707 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02fd5e83-e9d5-4040-90da-dbe2b4842db0 None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:49:21.586623 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8866e5-ec18-420d-903b-da3845a29c07 None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:49:21.602634 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application [None req-02fd5e83-e9d5-4040-90da-dbe2b4842db0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 17:49:21.602634 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 17:49:21.602634 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 17:49:21.602634 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 17:49:21.602634 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 17:49:21.602634 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 17:49:21.602634 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 17:49:21.602634 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 17:49:21.602634 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 17:49:21.602634 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 17:49:21.602634 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 17:49:21.602634 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 17:49:21.602634 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 15 17:49:21.602634 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 15 17:49:21.602634 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 15 17:49:21.602634 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 15 17:49:21.603655 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 17:49:21.603655 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 17:49:21.603655 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 17:49:21.603655 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 17:49:21.603655 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 17:49:21.603655 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 17:49:21.603655 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 17:49:21.603655 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application with Lock( Sep 15 17:49:21.603655 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 17:49:21.603655 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._enter() Sep 15 17:49:21.603655 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 17:49:21.603655 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 17:49:21.603655 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 17:49:21.603655 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.creator() Sep 15 17:49:21.603655 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 17:49:21.603655 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application created_value = creator( Sep 15 17:49:21.603655 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 15 17:49:21.604557 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 15 17:49:21.604557 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 17:49:21.604557 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Sep 15 17:49:21.611909 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 441/897] 10.222.0.25 () {56 vars in 1108 bytes} [Thu Sep 15 17:49:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 15 17:49:21.613546 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02fd5e83-e9d5-4040-90da-dbe2b4842db0 None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:49:21.618661 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:49:21.717678 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8866e5-ec18-420d-903b-da3845a29c07 None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:49:21.721991 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:49:21.740340 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02fd5e83-e9d5-4040-90da-dbe2b4842db0 None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:49:21.761960 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7688b8-9808-47d1-87f6-74da51b5c7bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:49:21.763123 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7688b8-9808-47d1-87f6-74da51b5c7bb None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:49:21.763606 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7688b8-9808-47d1-87f6-74da51b5c7bb None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:49:21.764078 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7688b8-9808-47d1-87f6-74da51b5c7bb None admin] PATH_INFO: `/v3/services` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:49:21.764922 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c7688b8-9808-47d1-87f6-74da51b5c7bb None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81593) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 17:49:21.765476 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c7688b8-9808-47d1-87f6-74da51b5c7bb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:49:21.767719 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c7688b8-9808-47d1-87f6-74da51b5c7bb None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:49:21.779297 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 457/898] 10.222.0.25 () {56 vars in 1114 bytes} [Thu Sep 15 17:49:21 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 17:49:21.780286 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7688b8-9808-47d1-87f6-74da51b5c7bb None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:49:21.788711 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-befa0b09-6e41-4eaa-8cba-8da1312ea0dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:49:21.789338 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befa0b09-6e41-4eaa-8cba-8da1312ea0dd None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:49:21.789612 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befa0b09-6e41-4eaa-8cba-8da1312ea0dd None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:49:21.789880 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befa0b09-6e41-4eaa-8cba-8da1312ea0dd None admin] PATH_INFO: `/v3/domains` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:49:21.790520 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-befa0b09-6e41-4eaa-8cba-8da1312ea0dd None admin] RBAC: Adding query filter params (name=Default) {{(pid=81592) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 17:49:21.790818 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-befa0b09-6e41-4eaa-8cba-8da1312ea0dd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:49:21.792166 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-befa0b09-6e41-4eaa-8cba-8da1312ea0dd None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:49:21.807223 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 442/899] 10.222.0.25 () {56 vars in 1109 bytes} [Thu Sep 15 17:49:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 17:49:21.812471 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-befa0b09-6e41-4eaa-8cba-8da1312ea0dd None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:49:21.886060 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:49:21.920833 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7688b8-9808-47d1-87f6-74da51b5c7bb None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:49:21.944755 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-befa0b09-6e41-4eaa-8cba-8da1312ea0dd None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:49:21.962331 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f4da0e-8504-4966-90b7-72dc3d04d574 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:49:21.962940 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f4da0e-8504-4966-90b7-72dc3d04d574 None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:49:21.963217 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f4da0e-8504-4966-90b7-72dc3d04d574 None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:49:21.963791 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f4da0e-8504-4966-90b7-72dc3d04d574 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:49:21.964179 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f4da0e-8504-4966-90b7-72dc3d04d574 None admin] RBAC: Adding query filter params (interface=public, service_id=ebd359cf1b444cbab02e3342dee8e636, region_id=RegionOne) {{(pid=81593) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 17:49:21.964485 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f4da0e-8504-4966-90b7-72dc3d04d574 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:49:21.965895 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f4da0e-8504-4966-90b7-72dc3d04d574 None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:49:21.975546 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 458/900] 10.222.0.25 () {56 vars in 1251 bytes} [Thu Sep 15 17:49:21 2022] GET /identity/v3/endpoints?service_id=ebd359cf1b444cbab02e3342dee8e636&interface=public®ion_id=RegionOne => generated 194 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 17:49:21.977833 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f4da0e-8504-4966-90b7-72dc3d04d574 None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:49:21.996165 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411c6924-cbc2-4262-be00-08c68c36ebdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:49:21.997121 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411c6924-cbc2-4262-be00-08c68c36ebdb None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:49:21.997724 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411c6924-cbc2-4262-be00-08c68c36ebdb None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:49:21.998146 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411c6924-cbc2-4262-be00-08c68c36ebdb None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:49:22.007074 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-411c6924-cbc2-4262-be00-08c68c36ebdb None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:49:22.009495 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-411c6924-cbc2-4262-be00-08c68c36ebdb None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:49:22.024597 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application [None req-411c6924-cbc2-4262-be00-08c68c36ebdb None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 15 17:49:22.024597 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 17:49:22.024597 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 17:49:22.024597 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 17:49:22.024597 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 17:49:22.024597 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 17:49:22.024597 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 17:49:22.024597 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 17:49:22.024597 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 17:49:22.024597 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 17:49:22.024597 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 17:49:22.024597 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 17:49:22.024597 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 15 17:49:22.024597 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 15 17:49:22.024597 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 15 17:49:22.024597 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 15 17:49:22.025792 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 17:49:22.025792 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 17:49:22.025792 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 15 17:49:22.025792 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 15 17:49:22.025792 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 15 17:49:22.025792 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 15 17:49:22.025792 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 17:49:22.025792 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 17:49:22.025792 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 17:49:22.025792 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 17:49:22.025792 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 17:49:22.025792 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application with Lock( Sep 15 17:49:22.025792 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 17:49:22.025792 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._enter() Sep 15 17:49:22.025792 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 17:49:22.025792 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 17:49:22.025792 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 17:49:22.025792 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.creator() Sep 15 17:49:22.026956 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 17:49:22.026956 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application created_value = creator( Sep 15 17:49:22.026956 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 15 17:49:22.026956 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 15 17:49:22.026956 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 15 17:49:22.026956 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 15 17:49:22.026956 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 15 17:49:22.026956 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 15 17:49:22.026956 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 15 17:49:22.026956 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Sep 15 17:49:22.028042 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:49:22.029659 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 443/901] 10.222.0.25 () {56 vars in 1117 bytes} [Thu Sep 15 17:49:21 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 15 17:49:22.036200 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411c6924-cbc2-4262-be00-08c68c36ebdb None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:49:22.103204 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f4da0e-8504-4966-90b7-72dc3d04d574 None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:49:22.147912 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c85f9d2-bf96-4c09-8df7-dcc5cdb00da3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:49:22.148421 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c85f9d2-bf96-4c09-8df7-dcc5cdb00da3 None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:49:22.148694 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c85f9d2-bf96-4c09-8df7-dcc5cdb00da3 None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:49:22.148969 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c85f9d2-bf96-4c09-8df7-dcc5cdb00da3 None admin] PATH_INFO: `/v3/services` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:49:22.149772 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c85f9d2-bf96-4c09-8df7-dcc5cdb00da3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:49:22.151371 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c85f9d2-bf96-4c09-8df7-dcc5cdb00da3 None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:49:22.161401 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 459/902] 10.222.0.25 () {56 vars in 1087 bytes} [Thu Sep 15 17:49:21 2022] GET /identity/v3/services => generated 1268 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 17:49:22.180010 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411c6924-cbc2-4262-be00-08c68c36ebdb None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:49:22.208540 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:49:22.222665 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd2e27a-24ae-41b6-a04a-cbc8dbde919b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:49:22.223291 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd2e27a-24ae-41b6-a04a-cbc8dbde919b None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:49:22.223572 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd2e27a-24ae-41b6-a04a-cbc8dbde919b None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:49:22.223842 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd2e27a-24ae-41b6-a04a-cbc8dbde919b None admin] PATH_INFO: `/v3/users` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:49:22.224582 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd2e27a-24ae-41b6-a04a-cbc8dbde919b None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81592) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 17:49:22.224885 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd2e27a-24ae-41b6-a04a-cbc8dbde919b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:49:22.226446 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd2e27a-24ae-41b6-a04a-cbc8dbde919b None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:49:22.252127 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 444/903] 10.222.0.25 () {56 vars in 1149 bytes} [Thu Sep 15 17:49:22 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 17:49:22.253617 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c85f9d2-bf96-4c09-8df7-dcc5cdb00da3 None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:49:22.369453 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:49:22.378587 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c85f9d2-bf96-4c09-8df7-dcc5cdb00da3 None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:49:22.419799 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6bd17b-5dfd-4343-ab27-710ba571af5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:49:22.420343 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6bd17b-5dfd-4343-ab27-710ba571af5b None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:49:22.420621 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6bd17b-5dfd-4343-ab27-710ba571af5b None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:49:22.420893 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6bd17b-5dfd-4343-ab27-710ba571af5b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:49:22.495728 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e6bd17b-5dfd-4343-ab27-710ba571af5b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:49:22.497203 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e6bd17b-5dfd-4343-ab27-710ba571af5b None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:49:22.601800 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:49:22.610188 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 460/904] 10.222.0.25 () {58 vars in 1282 bytes} [Thu Sep 15 17:49:22 2022] GET /identity/v3/auth/tokens => generated 1372 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 15 17:49:22.616868 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd2e27a-24ae-41b6-a04a-cbc8dbde919b None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:49:22.675767 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d180f3fb-84ba-49e6-aab0-5d494b834005 None None] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:49:22.675954 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d180f3fb-84ba-49e6-aab0-5d494b834005 None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:49:22.676230 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d180f3fb-84ba-49e6-aab0-5d494b834005 None None] PATH_INFO: `/` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:49:22.677870 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 461/905] 10.222.0.25 () {54 vars in 927 bytes} [Thu Sep 15 17:49:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 15 17:49:22.683145 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde9cd3c-8e91-4f2a-9a77-8d38002ea198 None None] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:49:22.683438 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde9cd3c-8e91-4f2a-9a77-8d38002ea198 None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:49:22.683720 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde9cd3c-8e91-4f2a-9a77-8d38002ea198 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:49:22.703385 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.auth.core [None req-bde9cd3c-8e91-4f2a-9a77-8d38002ea198 None None] MFA Rules not processed for user `5cfa58ef86774ab7800bf91930bf6028`. Rule list: `[]` (Enabled: `True`). {{(pid=81593) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 17:49:22.704974 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-bde9cd3c-8e91-4f2a-9a77-8d38002ea198 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 17:49:22.734437 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd2e27a-24ae-41b6-a04a-cbc8dbde919b None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:49:22.781863 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ea8d20-2427-47cd-a9d6-0d25b0209037 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:49:22.782723 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ea8d20-2427-47cd-a9d6-0d25b0209037 None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:49:22.783010 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ea8d20-2427-47cd-a9d6-0d25b0209037 None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:49:22.783291 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ea8d20-2427-47cd-a9d6-0d25b0209037 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:49:22.791155 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 462/906] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Sep 15 17:49:22 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 15 17:49:22.794959 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ea8d20-2427-47cd-a9d6-0d25b0209037 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:49:22.796487 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ea8d20-2427-47cd-a9d6-0d25b0209037 None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:49:22.812835 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application [None req-34ea8d20-2427-47cd-a9d6-0d25b0209037 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 17:49:22.812835 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 17:49:22.812835 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 17:49:22.812835 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 17:49:22.812835 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 17:49:22.812835 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 17:49:22.812835 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 17:49:22.812835 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 17:49:22.812835 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 17:49:22.812835 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 17:49:22.812835 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 17:49:22.812835 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 17:49:22.812835 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 15 17:49:22.812835 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 15 17:49:22.812835 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 15 17:49:22.812835 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 15 17:49:22.814512 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 17:49:22.814512 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 17:49:22.814512 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 17:49:22.814512 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 17:49:22.814512 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 17:49:22.814512 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 17:49:22.814512 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 17:49:22.814512 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application with Lock( Sep 15 17:49:22.814512 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 17:49:22.814512 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._enter() Sep 15 17:49:22.814512 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 17:49:22.814512 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 17:49:22.814512 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 17:49:22.814512 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.creator() Sep 15 17:49:22.814512 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 17:49:22.814512 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application created_value = creator( Sep 15 17:49:22.814512 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 15 17:49:22.815406 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 15 17:49:22.815406 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 17:49:22.815406 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Sep 15 17:49:22.815406 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 445/907] 10.222.0.25 () {56 vars in 1108 bytes} [Thu Sep 15 17:49:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 17:49:22.820561 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde9cd3c-8e91-4f2a-9a77-8d38002ea198 None None] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:49:22.944948 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde9cd3c-8e91-4f2a-9a77-8d38002ea198 None None] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:49:22.973678 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:49:22.986404 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64848747-b738-4a03-8a62-e5957ca0ee1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:49:22.987457 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64848747-b738-4a03-8a62-e5957ca0ee1a None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:49:22.987957 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64848747-b738-4a03-8a62-e5957ca0ee1a None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:49:22.988430 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64848747-b738-4a03-8a62-e5957ca0ee1a None admin] PATH_INFO: `/v3/domains` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:49:22.989286 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64848747-b738-4a03-8a62-e5957ca0ee1a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81593) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 17:49:22.989934 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64848747-b738-4a03-8a62-e5957ca0ee1a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:49:22.991573 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64848747-b738-4a03-8a62-e5957ca0ee1a None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:49:23.013444 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 463/908] 10.222.0.25 () {56 vars in 1109 bytes} [Thu Sep 15 17:49:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 17:49:23.015654 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ea8d20-2427-47cd-a9d6-0d25b0209037 None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:49:23.054991 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:49:23.128434 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ea8d20-2427-47cd-a9d6-0d25b0209037 None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:49:23.148162 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64848747-b738-4a03-8a62-e5957ca0ee1a None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:49:23.175500 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f03e6de-6f85-4710-b2cb-849e0f57180c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:49:23.176460 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f03e6de-6f85-4710-b2cb-849e0f57180c None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:49:23.176575 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f03e6de-6f85-4710-b2cb-849e0f57180c None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:49:23.176811 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f03e6de-6f85-4710-b2cb-849e0f57180c None admin] PATH_INFO: `/v3/projects/service` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:49:23.188989 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f03e6de-6f85-4710-b2cb-849e0f57180c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:49:23.192077 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f03e6de-6f85-4710-b2cb-849e0f57180c None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:49:23.208553 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application [None req-0f03e6de-6f85-4710-b2cb-849e0f57180c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 15 17:49:23.208553 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 17:49:23.208553 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 17:49:23.208553 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 17:49:23.208553 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 17:49:23.208553 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 17:49:23.208553 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 17:49:23.208553 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 17:49:23.208553 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 17:49:23.208553 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 17:49:23.208553 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 17:49:23.208553 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 17:49:23.208553 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 15 17:49:23.208553 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 15 17:49:23.208553 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 15 17:49:23.209566 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 15 17:49:23.209566 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 17:49:23.209566 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 17:49:23.209566 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 17:49:23.209566 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 17:49:23.209566 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 17:49:23.209566 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 17:49:23.209566 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 17:49:23.209566 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application with Lock( Sep 15 17:49:23.209566 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 17:49:23.209566 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._enter() Sep 15 17:49:23.209566 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 17:49:23.209566 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 17:49:23.209566 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 17:49:23.209566 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.creator() Sep 15 17:49:23.209566 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 17:49:23.209566 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application created_value = creator( Sep 15 17:49:23.210631 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 15 17:49:23.210631 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 15 17:49:23.210631 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 15 17:49:23.210631 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 15 17:49:23.210631 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 15 17:49:23.210631 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 15 17:49:23.210631 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 15 17:49:23.210631 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Sep 15 17:49:23.213384 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 446/909] 10.222.0.25 () {56 vars in 1111 bytes} [Thu Sep 15 17:49:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 17:49:23.216241 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f03e6de-6f85-4710-b2cb-849e0f57180c None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:49:23.337631 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64848747-b738-4a03-8a62-e5957ca0ee1a None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:49:23.362690 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:49:23.371893 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f03e6de-6f85-4710-b2cb-849e0f57180c None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:49:23.376144 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc72209a-8e39-4e5e-9487-981f76aac9cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:49:23.377666 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc72209a-8e39-4e5e-9487-981f76aac9cd None admin] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:49:23.378174 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc72209a-8e39-4e5e-9487-981f76aac9cd None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:49:23.378634 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc72209a-8e39-4e5e-9487-981f76aac9cd None admin] PATH_INFO: `/v3/services` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:49:23.379543 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc72209a-8e39-4e5e-9487-981f76aac9cd None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:49:23.381812 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc72209a-8e39-4e5e-9487-981f76aac9cd None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:49:23.404582 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 464/910] 10.222.0.25 () {60 vars in 1141 bytes} [Thu Sep 15 17:49:23 2022] POST /identity/v3/services => generated 241 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 15 17:49:23.404582 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773c6c34-8342-4814-8064-def34627f705 None None] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:49:23.404582 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773c6c34-8342-4814-8064-def34627f705 None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:49:23.404582 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773c6c34-8342-4814-8064-def34627f705 None None] PATH_INFO: `/` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:49:23.404582 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 465/911] 10.222.0.25 () {54 vars in 927 bytes} [Thu Sep 15 17:49:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 17:49:23.410892 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b72478a-bc29-4aa8-88c1-2b983cf1c70a None None] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:49:23.411204 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b72478a-bc29-4aa8-88c1-2b983cf1c70a None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:49:23.411438 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b72478a-bc29-4aa8-88c1-2b983cf1c70a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:49:23.420962 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48dd4cdd-3c86-4133-bfc5-f0c11109e180 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:49:23.421623 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48dd4cdd-3c86-4133-bfc5-f0c11109e180 None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:49:23.421904 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48dd4cdd-3c86-4133-bfc5-f0c11109e180 None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:49:23.422178 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48dd4cdd-3c86-4133-bfc5-f0c11109e180 None admin] PATH_INFO: `/v3/projects` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:49:23.422964 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48dd4cdd-3c86-4133-bfc5-f0c11109e180 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81592) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 17:49:23.423313 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48dd4cdd-3c86-4133-bfc5-f0c11109e180 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:49:23.424873 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48dd4cdd-3c86-4133-bfc5-f0c11109e180 None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:49:23.431809 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.auth.core [None req-2b72478a-bc29-4aa8-88c1-2b983cf1c70a None None] MFA Rules not processed for user `5cfa58ef86774ab7800bf91930bf6028`. Rule list: `[]` (Enabled: `True`). {{(pid=81593) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 17:49:23.433092 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-2b72478a-bc29-4aa8-88c1-2b983cf1c70a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 17:49:23.441203 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 447/912] 10.222.0.25 () {56 vars in 1148 bytes} [Thu Sep 15 17:49:23 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 17:49:23.449523 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48dd4cdd-3c86-4133-bfc5-f0c11109e180 None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:49:23.481854 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:49:23.525758 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 466/913] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Sep 15 17:49:23 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 15 17:49:23.588215 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48dd4cdd-3c86-4133-bfc5-f0c11109e180 None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:49:23.629150 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ea9f13-1985-4d0a-b32f-64839bdd0e12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:49:23.630590 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ea9f13-1985-4d0a-b32f-64839bdd0e12 None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:49:23.630590 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ea9f13-1985-4d0a-b32f-64839bdd0e12 None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:49:23.630590 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ea9f13-1985-4d0a-b32f-64839bdd0e12 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:49:23.631187 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ea9f13-1985-4d0a-b32f-64839bdd0e12 None admin] RBAC: Adding query filter params (role.id=99a6f32f74a84d0989c7527d9985370e, scope.project.id=1213c0d1b584404ba3998e136f166e89, user.id=d899ec4fcbeb4de382c7f0a779ca8ed5) {{(pid=81592) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 17:49:23.631515 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ea9f13-1985-4d0a-b32f-64839bdd0e12 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:49:23.632930 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ea9f13-1985-4d0a-b32f-64839bdd0e12 None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:49:23.639270 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 448/914] 10.222.0.25 () {56 vars in 1374 bytes} [Thu Sep 15 17:49:23 2022] GET /identity/v3/role_assignments?user.id=d899ec4fcbeb4de382c7f0a779ca8ed5&scope.project.id=1213c0d1b584404ba3998e136f166e89&role.id=99a6f32f74a84d0989c7527d9985370e => generated 259 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 17:49:23.791292 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b72478a-bc29-4aa8-88c1-2b983cf1c70a None None] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:49:23.901844 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b72478a-bc29-4aa8-88c1-2b983cf1c70a None None] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:49:23.957474 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8e3fc7-52d6-421b-93a3-008e179e3872 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:49:23.958187 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8e3fc7-52d6-421b-93a3-008e179e3872 None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:49:23.958477 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8e3fc7-52d6-421b-93a3-008e179e3872 None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:49:23.958823 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8e3fc7-52d6-421b-93a3-008e179e3872 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:49:23.959451 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed8e3fc7-52d6-421b-93a3-008e179e3872 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:49:23.960985 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed8e3fc7-52d6-421b-93a3-008e179e3872 None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:49:23.971262 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application [None req-ed8e3fc7-52d6-421b-93a3-008e179e3872 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 15 17:49:23.971262 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 17:49:23.971262 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 15 17:49:23.971262 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 15 17:49:23.971262 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 15 17:49:23.971262 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 15 17:49:23.971262 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 15 17:49:23.971262 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 15 17:49:23.971262 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 15 17:49:23.971262 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Sep 15 17:49:23.971262 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 15 17:49:23.971262 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Sep 15 17:49:23.971262 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 17:49:23.971262 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 17:49:23.971262 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 17:49:23.971262 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 17:49:23.972251 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 17:49:23.972251 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 17:49:23.972251 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 17:49:23.972251 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 17:49:23.972251 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 17:49:23.972251 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 17:49:23.972251 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 17:49:23.972251 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 15 17:49:23.972251 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 15 17:49:23.972251 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 15 17:49:23.972251 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 15 17:49:23.972251 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 17:49:23.972251 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 17:49:23.972251 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 17:49:23.972251 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 17:49:23.972251 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 17:49:23.972251 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 17:49:23.973779 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 17:49:23.973779 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application with Lock( Sep 15 17:49:23.973779 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 17:49:23.973779 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._enter() Sep 15 17:49:23.973779 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 17:49:23.973779 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 17:49:23.973779 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 17:49:23.973779 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.creator() Sep 15 17:49:23.973779 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 17:49:23.973779 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application created_value = creator( Sep 15 17:49:23.973779 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 15 17:49:23.973779 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 15 17:49:23.973779 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 15 17:49:23.973779 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Sep 15 17:49:23.973779 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 467/915] 10.222.0.25 () {56 vars in 1132 bytes} [Thu Sep 15 17:49:23 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 17:49:23.978374 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ea9f13-1985-4d0a-b32f-64839bdd0e12 None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:49:23.996190 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:49:24.086722 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ea9f13-1985-4d0a-b32f-64839bdd0e12 None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:49:24.124233 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f1fb14-a9f9-41dd-955f-ee3e43ce3339 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:49:24.125236 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f1fb14-a9f9-41dd-955f-ee3e43ce3339 None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:49:24.125805 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f1fb14-a9f9-41dd-955f-ee3e43ce3339 None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:49:24.126286 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f1fb14-a9f9-41dd-955f-ee3e43ce3339 None admin] PATH_INFO: `/v3/services` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:49:24.127144 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f1fb14-a9f9-41dd-955f-ee3e43ce3339 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81592) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 17:49:24.127653 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f1fb14-a9f9-41dd-955f-ee3e43ce3339 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:49:24.129219 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f1fb14-a9f9-41dd-955f-ee3e43ce3339 None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:49:24.134912 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 449/916] 10.222.0.25 () {56 vars in 1126 bytes} [Thu Sep 15 17:49:23 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 17:49:24.140154 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8e3fc7-52d6-421b-93a3-008e179e3872 None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:49:24.185594 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:49:24.254936 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8e3fc7-52d6-421b-93a3-008e179e3872 None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:49:24.291669 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3864ba51-3eb7-4265-ada6-aa8e65f7bf65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:49:24.292279 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3864ba51-3eb7-4265-ada6-aa8e65f7bf65 None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:49:24.292553 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3864ba51-3eb7-4265-ada6-aa8e65f7bf65 None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:49:24.292823 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3864ba51-3eb7-4265-ada6-aa8e65f7bf65 None admin] PATH_INFO: `/v3/services` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:49:24.293547 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3864ba51-3eb7-4265-ada6-aa8e65f7bf65 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81593) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 17:49:24.293870 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3864ba51-3eb7-4265-ada6-aa8e65f7bf65 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:49:24.295375 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3864ba51-3eb7-4265-ada6-aa8e65f7bf65 None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:49:24.302198 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 468/917] 10.222.0.25 () {56 vars in 1126 bytes} [Thu Sep 15 17:49:24 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 17:49:24.307493 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f1fb14-a9f9-41dd-955f-ee3e43ce3339 None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:49:24.394665 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:49:24.418790 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f1fb14-a9f9-41dd-955f-ee3e43ce3339 None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:49:24.455616 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537374da-25a7-4003-88f9-9e8c54bd99ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:49:24.456670 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537374da-25a7-4003-88f9-9e8c54bd99ed None admin] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:49:24.457252 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537374da-25a7-4003-88f9-9e8c54bd99ed None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:49:24.457762 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537374da-25a7-4003-88f9-9e8c54bd99ed None admin] PATH_INFO: `/v3/endpoints` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:49:24.458711 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-537374da-25a7-4003-88f9-9e8c54bd99ed None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:49:24.460435 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-537374da-25a7-4003-88f9-9e8c54bd99ed None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:49:24.489098 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 450/918] 10.222.0.25 () {60 vars in 1144 bytes} [Thu Sep 15 17:49:24 2022] POST /identity/v3/endpoints => generated 347 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 17:49:24.588065 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79dbe45b-0cab-4533-a6aa-cca7ad13232c None None] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:49:24.588618 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79dbe45b-0cab-4533-a6aa-cca7ad13232c None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:49:24.588618 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79dbe45b-0cab-4533-a6aa-cca7ad13232c None None] PATH_INFO: `/` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:49:24.590370 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 469/919] 10.222.0.25 () {54 vars in 927 bytes} [Thu Sep 15 17:49:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 17:49:24.596795 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdf0d11-2b36-48ff-be97-46910ae96ad5 None None] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:49:24.597498 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdf0d11-2b36-48ff-be97-46910ae96ad5 None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:49:24.597972 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdf0d11-2b36-48ff-be97-46910ae96ad5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:49:24.619052 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.auth.core [None req-7fdf0d11-2b36-48ff-be97-46910ae96ad5 None None] MFA Rules not processed for user `5cfa58ef86774ab7800bf91930bf6028`. Rule list: `[]` (Enabled: `True`). {{(pid=81592) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 17:49:24.620604 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-7fdf0d11-2b36-48ff-be97-46910ae96ad5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 17:49:24.714811 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 451/920] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Sep 15 17:49:24 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 15 17:49:24.988235 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79dbe45b-0cab-4533-a6aa-cca7ad13232c None None] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:49:25.100363 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79dbe45b-0cab-4533-a6aa-cca7ad13232c None None] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:49:25.102915 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:49:25.142504 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0841b7-aad0-406f-92c1-9901458da369 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:49:25.143146 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0841b7-aad0-406f-92c1-9901458da369 None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:49:25.143430 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0841b7-aad0-406f-92c1-9901458da369 None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:49:25.143704 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0841b7-aad0-406f-92c1-9901458da369 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:49:25.144289 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e0841b7-aad0-406f-92c1-9901458da369 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:49:25.145725 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e0841b7-aad0-406f-92c1-9901458da369 None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:49:25.155230 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application [None req-9e0841b7-aad0-406f-92c1-9901458da369 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 15 17:49:25.155230 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 17:49:25.155230 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 15 17:49:25.155230 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 15 17:49:25.155230 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 15 17:49:25.155230 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 15 17:49:25.155230 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 15 17:49:25.155230 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 15 17:49:25.155230 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 15 17:49:25.155230 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Sep 15 17:49:25.155230 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 15 17:49:25.155230 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Sep 15 17:49:25.155230 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 17:49:25.155230 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 17:49:25.155230 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 17:49:25.155230 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 17:49:25.155230 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 17:49:25.156278 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 17:49:25.156278 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 17:49:25.156278 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 17:49:25.156278 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 17:49:25.156278 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 17:49:25.156278 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 17:49:25.156278 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 15 17:49:25.156278 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 15 17:49:25.156278 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 15 17:49:25.156278 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 15 17:49:25.156278 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 17:49:25.156278 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 17:49:25.156278 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 17:49:25.156278 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 17:49:25.156278 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 17:49:25.156278 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 17:49:25.157770 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 17:49:25.157770 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application with Lock( Sep 15 17:49:25.157770 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 17:49:25.157770 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._enter() Sep 15 17:49:25.157770 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 17:49:25.157770 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 17:49:25.157770 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 17:49:25.157770 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.creator() Sep 15 17:49:25.157770 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 17:49:25.157770 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application created_value = creator( Sep 15 17:49:25.157770 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 15 17:49:25.157770 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 15 17:49:25.157770 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 15 17:49:25.157770 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Sep 15 17:49:25.157770 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 470/921] 10.222.0.25 () {56 vars in 1114 bytes} [Thu Sep 15 17:49:24 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 17:49:25.165449 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fdf0d11-2b36-48ff-be97-46910ae96ad5 None None] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:49:25.230021 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:49:25.274688 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fdf0d11-2b36-48ff-be97-46910ae96ad5 None None] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:49:25.310443 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ece5d1-56fb-4080-b78b-b0ce5b402af7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:49:25.311113 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ece5d1-56fb-4080-b78b-b0ce5b402af7 None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:49:25.311391 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ece5d1-56fb-4080-b78b-b0ce5b402af7 None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:49:25.311673 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ece5d1-56fb-4080-b78b-b0ce5b402af7 None admin] PATH_INFO: `/v3/services` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:49:25.312289 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ece5d1-56fb-4080-b78b-b0ce5b402af7 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81592) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 17:49:25.312644 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ece5d1-56fb-4080-b78b-b0ce5b402af7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:49:25.314599 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ece5d1-56fb-4080-b78b-b0ce5b402af7 None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:49:25.319938 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 452/922] 10.222.0.25 () {56 vars in 1114 bytes} [Thu Sep 15 17:49:25 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 17:49:25.327799 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0841b7-aad0-406f-92c1-9901458da369 None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:49:25.442003 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0841b7-aad0-406f-92c1-9901458da369 None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:49:25.482157 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd6e3bf-c27f-4741-a19f-bf381a07d27a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:49:25.482788 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd6e3bf-c27f-4741-a19f-bf381a07d27a None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:49:25.483120 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd6e3bf-c27f-4741-a19f-bf381a07d27a None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:49:25.483397 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd6e3bf-c27f-4741-a19f-bf381a07d27a None admin] PATH_INFO: `/v3/services` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:49:25.484052 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd6e3bf-c27f-4741-a19f-bf381a07d27a None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81593) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 17:49:25.484355 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd6e3bf-c27f-4741-a19f-bf381a07d27a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:49:25.485859 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd6e3bf-c27f-4741-a19f-bf381a07d27a None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:49:25.492022 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 471/923] 10.222.0.25 () {56 vars in 1114 bytes} [Thu Sep 15 17:49:25 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 17:49:25.498368 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ece5d1-56fb-4080-b78b-b0ce5b402af7 None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:49:25.638348 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ece5d1-56fb-4080-b78b-b0ce5b402af7 None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:49:25.679952 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:49:25.694222 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b57368b-58c2-4426-91ed-6cb40bac4020 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:49:25.695147 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b57368b-58c2-4426-91ed-6cb40bac4020 None admin] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:49:25.695661 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b57368b-58c2-4426-91ed-6cb40bac4020 None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:49:25.696136 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b57368b-58c2-4426-91ed-6cb40bac4020 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:49:25.697015 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b57368b-58c2-4426-91ed-6cb40bac4020 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:49:25.698632 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b57368b-58c2-4426-91ed-6cb40bac4020 None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:49:25.727591 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 453/924] 10.222.0.25 () {60 vars in 1144 bytes} [Thu Sep 15 17:49:25 2022] POST /identity/v3/endpoints => generated 346 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 17:49:25.880204 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797ba956-626d-4678-9397-fa81593fa797 None None] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:49:25.880733 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797ba956-626d-4678-9397-fa81593fa797 None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:49:25.880733 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797ba956-626d-4678-9397-fa81593fa797 None None] PATH_INFO: `/` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:49:25.882466 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 472/925] 10.222.0.25 () {54 vars in 927 bytes} [Thu Sep 15 17:49:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 17:49:25.888584 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c071442-6960-4db3-8f56-2170dcae266d None None] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:49:25.888874 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c071442-6960-4db3-8f56-2170dcae266d None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:49:25.889074 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c071442-6960-4db3-8f56-2170dcae266d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:49:25.909879 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.auth.core [None req-2c071442-6960-4db3-8f56-2170dcae266d None None] MFA Rules not processed for user `5cfa58ef86774ab7800bf91930bf6028`. Rule list: `[]` (Enabled: `True`). {{(pid=81592) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 17:49:25.911306 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-2c071442-6960-4db3-8f56-2170dcae266d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 17:49:26.000353 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 454/926] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Sep 15 17:49:25 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 15 17:49:26.062597 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e5c392-28c7-489e-b71a-3fa493734a7d None None] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:49:26.062990 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e5c392-28c7-489e-b71a-3fa493734a7d None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:49:26.063449 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e5c392-28c7-489e-b71a-3fa493734a7d None None] PATH_INFO: `/` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:49:26.065637 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 473/927] 10.222.0.25 () {54 vars in 927 bytes} [Thu Sep 15 17:49:26 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 15 17:49:26.070760 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef4dccc-572f-4a98-a30b-0adc9fab25a2 None None] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:49:26.071050 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef4dccc-572f-4a98-a30b-0adc9fab25a2 None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:49:26.071325 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef4dccc-572f-4a98-a30b-0adc9fab25a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:49:26.092034 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.auth.core [None req-aef4dccc-572f-4a98-a30b-0adc9fab25a2 None None] MFA Rules not processed for user `5cfa58ef86774ab7800bf91930bf6028`. Rule list: `[]` (Enabled: `True`). {{(pid=81592) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 17:49:26.093242 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-aef4dccc-572f-4a98-a30b-0adc9fab25a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 17:49:26.167028 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 455/928] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Sep 15 17:49:26 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 15 17:49:26.298208 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e5c392-28c7-489e-b71a-3fa493734a7d None None] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:49:26.333534 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:49:26.414671 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e5c392-28c7-489e-b71a-3fa493734a7d None None] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:49:26.452049 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef4dccc-572f-4a98-a30b-0adc9fab25a2 None None] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:49:26.454874 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7974a95c-c9f2-4962-8d9c-52d6fd12d5ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:49:26.455514 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7974a95c-c9f2-4962-8d9c-52d6fd12d5ab None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:49:26.455789 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7974a95c-c9f2-4962-8d9c-52d6fd12d5ab None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:49:26.456059 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7974a95c-c9f2-4962-8d9c-52d6fd12d5ab None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:49:26.456652 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7974a95c-c9f2-4962-8d9c-52d6fd12d5ab None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:49:26.458063 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7974a95c-c9f2-4962-8d9c-52d6fd12d5ab None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:49:26.467747 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application [None req-7974a95c-c9f2-4962-8d9c-52d6fd12d5ab None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 15 17:49:26.467747 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 17:49:26.467747 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 15 17:49:26.467747 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 15 17:49:26.467747 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 15 17:49:26.467747 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 15 17:49:26.467747 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 15 17:49:26.467747 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 15 17:49:26.467747 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 15 17:49:26.467747 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Sep 15 17:49:26.467747 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 15 17:49:26.467747 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Sep 15 17:49:26.467747 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 17:49:26.467747 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 17:49:26.467747 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 17:49:26.467747 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 17:49:26.467747 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 17:49:26.468838 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 17:49:26.468838 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 17:49:26.468838 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 17:49:26.468838 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 17:49:26.468838 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 17:49:26.468838 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 17:49:26.468838 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 15 17:49:26.468838 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 15 17:49:26.468838 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 15 17:49:26.468838 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 15 17:49:26.468838 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 17:49:26.468838 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 17:49:26.468838 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 17:49:26.468838 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 17:49:26.468838 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 17:49:26.468838 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 17:49:26.470383 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 17:49:26.470383 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application with Lock( Sep 15 17:49:26.470383 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 17:49:26.470383 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._enter() Sep 15 17:49:26.470383 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 17:49:26.470383 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 17:49:26.470383 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 17:49:26.470383 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.creator() Sep 15 17:49:26.470383 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 17:49:26.470383 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application created_value = creator( Sep 15 17:49:26.470383 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 15 17:49:26.470383 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 15 17:49:26.470383 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 15 17:49:26.470383 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Sep 15 17:49:26.470383 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 474/929] 10.222.0.25 () {56 vars in 1126 bytes} [Thu Sep 15 17:49:26 2022] GET /identity/v3/services/object-store => generated 93 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 17:49:26.475746 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7974a95c-c9f2-4962-8d9c-52d6fd12d5ab None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:49:26.508427 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:49:26.596718 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:49:26.608517 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7974a95c-c9f2-4962-8d9c-52d6fd12d5ab None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:49:26.614357 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef4dccc-572f-4a98-a30b-0adc9fab25a2 None None] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:49:26.643943 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd46d70d-cead-435c-afb8-a5c887275100 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:49:26.644576 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd46d70d-cead-435c-afb8-a5c887275100 None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:49:26.644855 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd46d70d-cead-435c-afb8-a5c887275100 None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:49:26.645128 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd46d70d-cead-435c-afb8-a5c887275100 None admin] PATH_INFO: `/v3/services` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:49:26.645806 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd46d70d-cead-435c-afb8-a5c887275100 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81593) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 17:49:26.646105 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd46d70d-cead-435c-afb8-a5c887275100 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:49:26.647495 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd46d70d-cead-435c-afb8-a5c887275100 None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:49:26.657576 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 475/930] 10.222.0.25 () {56 vars in 1122 bytes} [Thu Sep 15 17:49:26 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 17:49:26.658459 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd46d70d-cead-435c-afb8-a5c887275100 None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:49:26.664043 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b3048e-4c18-47de-a892-780a12730343 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:49:26.665092 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b3048e-4c18-47de-a892-780a12730343 None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:49:26.665597 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b3048e-4c18-47de-a892-780a12730343 None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:49:26.666066 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b3048e-4c18-47de-a892-780a12730343 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:49:26.681079 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b3048e-4c18-47de-a892-780a12730343 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 17:49:26.687732 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application [None req-38b3048e-4c18-47de-a892-780a12730343 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 15 17:49:26.687732 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 17:49:26.687732 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 17:49:26.687732 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 17:49:26.687732 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 17:49:26.687732 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 17:49:26.687732 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 17:49:26.687732 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 17:49:26.687732 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 17:49:26.687732 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 17:49:26.687732 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 17:49:26.687732 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 17:49:26.687732 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 17:49:26.687732 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 17:49:26.687732 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 17:49:26.687732 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 17:49:26.689233 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 17:49:26.689233 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 17:49:26.689233 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 17:49:26.689233 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 17:49:26.689233 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 17:49:26.689233 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 17:49:26.689233 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 17:49:26.689233 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 17:49:26.689233 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 17:49:26.689233 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 17:49:26.689233 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 17:49:26.689233 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application with Lock( Sep 15 17:49:26.689233 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 17:49:26.689233 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._enter() Sep 15 17:49:26.689233 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 17:49:26.689233 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 17:49:26.690095 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 17:49:26.690095 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.creator() Sep 15 17:49:26.690095 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 17:49:26.690095 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application created_value = creator( Sep 15 17:49:26.690095 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 17:49:26.690095 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 17:49:26.690095 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 17:49:26.690095 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 17:49:26.690095 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 17:49:26.690095 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 17:49:26.690095 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 15 17:49:26.690095 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Sep 15 17:49:26.690718 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 456/931] 10.222.0.25 () {56 vars in 1120 bytes} [Thu Sep 15 17:49:26 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 15 17:49:26.697653 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b3048e-4c18-47de-a892-780a12730343 None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:49:26.790912 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd46d70d-cead-435c-afb8-a5c887275100 None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:49:26.824881 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:49:26.827202 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13768a3c-ac6a-4d30-b5db-4c335c666674 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:49:26.827874 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13768a3c-ac6a-4d30-b5db-4c335c666674 None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:49:26.828157 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13768a3c-ac6a-4d30-b5db-4c335c666674 None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:49:26.828590 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13768a3c-ac6a-4d30-b5db-4c335c666674 None admin] PATH_INFO: `/v3/services` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:49:26.829986 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13768a3c-ac6a-4d30-b5db-4c335c666674 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81593) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 17:49:26.830398 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13768a3c-ac6a-4d30-b5db-4c335c666674 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:49:26.831789 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13768a3c-ac6a-4d30-b5db-4c335c666674 None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:49:26.835539 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b3048e-4c18-47de-a892-780a12730343 None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:49:26.841667 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 476/932] 10.222.0.25 () {56 vars in 1122 bytes} [Thu Sep 15 17:49:26 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 17:49:26.843492 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13768a3c-ac6a-4d30-b5db-4c335c666674 None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:49:26.872751 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:49:26.881095 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538ffab2-78e5-4e2f-aba4-cd5ec0c7c30e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:49:26.881744 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538ffab2-78e5-4e2f-aba4-cd5ec0c7c30e None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:49:26.882025 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538ffab2-78e5-4e2f-aba4-cd5ec0c7c30e None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:49:26.882300 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538ffab2-78e5-4e2f-aba4-cd5ec0c7c30e None admin] PATH_INFO: `/v3/roles` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:49:26.882970 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538ffab2-78e5-4e2f-aba4-cd5ec0c7c30e None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81592) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 17:49:26.883275 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538ffab2-78e5-4e2f-aba4-cd5ec0c7c30e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:49:26.884698 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538ffab2-78e5-4e2f-aba4-cd5ec0c7c30e None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:49:26.897463 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 457/933] 10.222.0.25 () {56 vars in 1115 bytes} [Thu Sep 15 17:49:26 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 17:49:26.898863 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a18856-5cd4-4905-9675-7f062ed984e1 None None] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:49:26.899148 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a18856-5cd4-4905-9675-7f062ed984e1 None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:49:26.899681 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a18856-5cd4-4905-9675-7f062ed984e1 None None] PATH_INFO: `/` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:49:26.900764 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 458/934] 10.222.0.25 () {54 vars in 927 bytes} [Thu Sep 15 17:49:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 17:49:26.901401 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a18856-5cd4-4905-9675-7f062ed984e1 None None] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:49:26.971737 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13768a3c-ac6a-4d30-b5db-4c335c666674 None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:49:27.011395 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8cf7ab2-140f-4b2d-a2ac-0631d2247735 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:49:27.012346 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cf7ab2-140f-4b2d-a2ac-0631d2247735 None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:49:27.012631 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cf7ab2-140f-4b2d-a2ac-0631d2247735 None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:49:27.012907 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cf7ab2-140f-4b2d-a2ac-0631d2247735 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:49:27.013895 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8cf7ab2-140f-4b2d-a2ac-0631d2247735 None admin] RBAC: Adding query filter params (interface=public, service_id=1b89b146122d4f9783daf5a5ee8d60a5, region_id=RegionOne) {{(pid=81593) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 17:49:27.014639 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8cf7ab2-140f-4b2d-a2ac-0631d2247735 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:49:27.017138 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8cf7ab2-140f-4b2d-a2ac-0631d2247735 None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:49:27.028439 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 477/935] 10.222.0.25 () {56 vars in 1251 bytes} [Thu Sep 15 17:49:26 2022] GET /identity/v3/endpoints?service_id=1b89b146122d4f9783daf5a5ee8d60a5&interface=public®ion_id=RegionOne => generated 194 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 17:49:27.028439 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a518dcd3-703b-4ae5-a868-c5d076d51e53 None None] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:49:27.028439 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a518dcd3-703b-4ae5-a868-c5d076d51e53 None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:49:27.028439 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a518dcd3-703b-4ae5-a868-c5d076d51e53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:49:27.033242 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a18856-5cd4-4905-9675-7f062ed984e1 None None] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:49:27.043712 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.auth.core [None req-a518dcd3-703b-4ae5-a868-c5d076d51e53 None None] MFA Rules not processed for user `5cfa58ef86774ab7800bf91930bf6028`. Rule list: `[]` (Enabled: `True`). {{(pid=81593) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 17:49:27.044846 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-a518dcd3-703b-4ae5-a868-c5d076d51e53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 17:49:27.073040 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf9c2b1-c1bd-48cd-9c32-7252bb09069e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:49:27.073759 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf9c2b1-c1bd-48cd-9c32-7252bb09069e None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:49:27.074043 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf9c2b1-c1bd-48cd-9c32-7252bb09069e None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:49:27.074487 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf9c2b1-c1bd-48cd-9c32-7252bb09069e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:49:27.086539 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf9c2b1-c1bd-48cd-9c32-7252bb09069e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:49:27.088001 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf9c2b1-c1bd-48cd-9c32-7252bb09069e None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:49:27.102828 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application [None req-4cf9c2b1-c1bd-48cd-9c32-7252bb09069e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 17:49:27.102828 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 17:49:27.102828 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 17:49:27.102828 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 17:49:27.102828 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 17:49:27.102828 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 17:49:27.102828 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 17:49:27.102828 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 17:49:27.102828 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 17:49:27.102828 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 17:49:27.102828 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 17:49:27.102828 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 17:49:27.102828 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 15 17:49:27.102828 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 15 17:49:27.102828 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 15 17:49:27.102828 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 15 17:49:27.103778 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 17:49:27.103778 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 17:49:27.103778 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 17:49:27.103778 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 17:49:27.103778 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 17:49:27.103778 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 17:49:27.103778 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 17:49:27.103778 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application with Lock( Sep 15 17:49:27.103778 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 17:49:27.103778 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._enter() Sep 15 17:49:27.103778 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 17:49:27.103778 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 17:49:27.103778 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 17:49:27.103778 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.creator() Sep 15 17:49:27.103778 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 17:49:27.103778 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application created_value = creator( Sep 15 17:49:27.103778 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 15 17:49:27.104691 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 15 17:49:27.104691 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 17:49:27.104691 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Sep 15 17:49:27.108984 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 459/936] 10.222.0.25 () {56 vars in 1108 bytes} [Thu Sep 15 17:49:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 17:49:27.109892 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf9c2b1-c1bd-48cd-9c32-7252bb09069e None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:49:27.122604 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:49:27.133320 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 478/937] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Sep 15 17:49:27 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 15 17:49:27.133320 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a518dcd3-703b-4ae5-a868-c5d076d51e53 None None] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:49:27.158565 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:49:27.226561 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf9c2b1-c1bd-48cd-9c32-7252bb09069e None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:49:27.264829 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a518dcd3-703b-4ae5-a868-c5d076d51e53 None None] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:49:27.266461 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a624528-70c4-45f6-896b-75481228c710 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:49:27.267076 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a624528-70c4-45f6-896b-75481228c710 None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:49:27.267353 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a624528-70c4-45f6-896b-75481228c710 None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:49:27.267625 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a624528-70c4-45f6-896b-75481228c710 None admin] PATH_INFO: `/v3/services` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:49:27.268234 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a624528-70c4-45f6-896b-75481228c710 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:49:27.269679 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a624528-70c4-45f6-896b-75481228c710 None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:49:27.281481 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 460/938] 10.222.0.25 () {56 vars in 1087 bytes} [Thu Sep 15 17:49:27 2022] GET /identity/v3/services => generated 1497 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 17:49:27.308242 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50caf40a-f33e-4b33-991c-ead0f4c35f87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:49:27.308786 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50caf40a-f33e-4b33-991c-ead0f4c35f87 None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:49:27.309061 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50caf40a-f33e-4b33-991c-ead0f4c35f87 None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:49:27.309356 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50caf40a-f33e-4b33-991c-ead0f4c35f87 None admin] PATH_INFO: `/v3/domains` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:49:27.310021 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50caf40a-f33e-4b33-991c-ead0f4c35f87 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81593) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 17:49:27.310317 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50caf40a-f33e-4b33-991c-ead0f4c35f87 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:49:27.311727 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50caf40a-f33e-4b33-991c-ead0f4c35f87 None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:49:27.326075 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 479/939] 10.222.0.25 () {56 vars in 1109 bytes} [Thu Sep 15 17:49:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 17:49:27.331517 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a624528-70c4-45f6-896b-75481228c710 None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:49:27.423535 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50caf40a-f33e-4b33-991c-ead0f4c35f87 None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:49:27.430469 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:49:27.461617 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a624528-70c4-45f6-896b-75481228c710 None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:49:27.513813 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b99717c-a22a-45e6-b498-c8a9461907e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:49:27.514501 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b99717c-a22a-45e6-b498-c8a9461907e5 None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:49:27.514719 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b99717c-a22a-45e6-b498-c8a9461907e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:49:27.514994 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b99717c-a22a-45e6-b498-c8a9461907e5 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:49:27.523712 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b99717c-a22a-45e6-b498-c8a9461907e5 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:49:27.525143 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b99717c-a22a-45e6-b498-c8a9461907e5 None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:49:27.543332 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application [None req-2b99717c-a22a-45e6-b498-c8a9461907e5 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 15 17:49:27.543332 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 17:49:27.543332 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 17:49:27.543332 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 17:49:27.543332 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 17:49:27.543332 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 17:49:27.543332 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 17:49:27.543332 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 17:49:27.543332 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 17:49:27.543332 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 17:49:27.543332 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 17:49:27.543332 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 17:49:27.543332 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 15 17:49:27.543332 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 15 17:49:27.543332 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 15 17:49:27.543332 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 15 17:49:27.544369 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 17:49:27.544369 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 17:49:27.544369 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 15 17:49:27.544369 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 15 17:49:27.544369 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 15 17:49:27.544369 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 15 17:49:27.544369 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 17:49:27.544369 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 17:49:27.544369 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 17:49:27.544369 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 17:49:27.544369 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 17:49:27.544369 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application with Lock( Sep 15 17:49:27.544369 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 17:49:27.544369 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._enter() Sep 15 17:49:27.544369 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 17:49:27.544369 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 17:49:27.544369 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 17:49:27.544369 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.creator() Sep 15 17:49:27.545351 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 17:49:27.545351 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application created_value = creator( Sep 15 17:49:27.545351 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 15 17:49:27.545351 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 15 17:49:27.545351 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 15 17:49:27.545351 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 15 17:49:27.545351 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 15 17:49:27.545351 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 15 17:49:27.545351 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 15 17:49:27.545351 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Sep 15 17:49:27.546534 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 461/940] 10.222.0.25 () {56 vars in 1117 bytes} [Thu Sep 15 17:49:27 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 17:49:27.546907 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:49:27.552804 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b99717c-a22a-45e6-b498-c8a9461907e5 None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:49:27.577008 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50caf40a-f33e-4b33-991c-ead0f4c35f87 None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:49:27.622121 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679b3f3e-fca1-4afe-b5c2-5725a759870c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:49:27.623368 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679b3f3e-fca1-4afe-b5c2-5725a759870c None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:49:27.624431 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679b3f3e-fca1-4afe-b5c2-5725a759870c None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:49:27.624912 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679b3f3e-fca1-4afe-b5c2-5725a759870c None admin] PATH_INFO: `/v3/services/compute` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:49:27.626573 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-679b3f3e-fca1-4afe-b5c2-5725a759870c None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:49:27.629360 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-679b3f3e-fca1-4afe-b5c2-5725a759870c None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:49:27.641591 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application [None req-679b3f3e-fca1-4afe-b5c2-5725a759870c None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Sep 15 17:49:27.641591 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 17:49:27.641591 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 15 17:49:27.641591 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 15 17:49:27.641591 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 15 17:49:27.641591 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 15 17:49:27.641591 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 15 17:49:27.641591 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 15 17:49:27.641591 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 15 17:49:27.641591 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Sep 15 17:49:27.641591 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 15 17:49:27.641591 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Sep 15 17:49:27.641591 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 17:49:27.641591 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 17:49:27.641591 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 17:49:27.641591 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 17:49:27.641591 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 17:49:27.642656 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 17:49:27.642656 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 17:49:27.642656 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 17:49:27.642656 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 17:49:27.642656 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 17:49:27.642656 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 17:49:27.642656 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 15 17:49:27.642656 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 15 17:49:27.642656 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 15 17:49:27.642656 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 15 17:49:27.642656 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 17:49:27.642656 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 17:49:27.642656 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 17:49:27.642656 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 17:49:27.642656 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 17:49:27.642656 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 17:49:27.643487 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 17:49:27.643487 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application with Lock( Sep 15 17:49:27.643487 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 17:49:27.643487 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._enter() Sep 15 17:49:27.643487 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 17:49:27.643487 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 17:49:27.643487 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 17:49:27.643487 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.creator() Sep 15 17:49:27.643487 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 17:49:27.643487 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application created_value = creator( Sep 15 17:49:27.643487 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 15 17:49:27.643487 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 15 17:49:27.643487 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 15 17:49:27.643487 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Sep 15 17:49:27.643487 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 480/941] 10.222.0.25 () {56 vars in 1111 bytes} [Thu Sep 15 17:49:27 2022] GET /identity/v3/services/compute => generated 88 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 15 17:49:27.650191 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679b3f3e-fca1-4afe-b5c2-5725a759870c None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:49:27.669821 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b99717c-a22a-45e6-b498-c8a9461907e5 None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:49:27.708398 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ddfa3a9-6126-41f3-994b-248564576dfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:49:27.709313 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddfa3a9-6126-41f3-994b-248564576dfc None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:49:27.709726 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddfa3a9-6126-41f3-994b-248564576dfc None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:49:27.710101 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddfa3a9-6126-41f3-994b-248564576dfc None admin] PATH_INFO: `/v3/users` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:49:27.711010 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ddfa3a9-6126-41f3-994b-248564576dfc None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81592) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 17:49:27.711422 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ddfa3a9-6126-41f3-994b-248564576dfc None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:49:27.712994 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ddfa3a9-6126-41f3-994b-248564576dfc None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:49:27.715162 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:49:27.741592 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 462/942] 10.222.0.25 () {56 vars in 1149 bytes} [Thu Sep 15 17:49:27 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 17:49:27.743132 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ddfa3a9-6126-41f3-994b-248564576dfc None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:49:27.790814 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679b3f3e-fca1-4afe-b5c2-5725a759870c None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:49:27.839680 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4a0e2c-9a22-4a2c-b874-db852bb2b3d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:49:27.841051 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4a0e2c-9a22-4a2c-b874-db852bb2b3d4 None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:49:27.841502 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4a0e2c-9a22-4a2c-b874-db852bb2b3d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:49:27.841919 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4a0e2c-9a22-4a2c-b874-db852bb2b3d4 None admin] PATH_INFO: `/v3/services` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:49:27.842708 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4a0e2c-9a22-4a2c-b874-db852bb2b3d4 None admin] RBAC: Adding query filter params (name=compute) {{(pid=81593) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 17:49:27.843009 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4a0e2c-9a22-4a2c-b874-db852bb2b3d4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:49:27.845212 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4a0e2c-9a22-4a2c-b874-db852bb2b3d4 None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:49:27.857446 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 481/943] 10.222.0.25 () {56 vars in 1112 bytes} [Thu Sep 15 17:49:27 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 17:49:27.860942 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4a0e2c-9a22-4a2c-b874-db852bb2b3d4 None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:49:27.871866 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:49:27.890395 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ddfa3a9-6126-41f3-994b-248564576dfc None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:49:27.941095 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94dfe99-305f-403c-bf4c-667a33a468d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:49:27.942092 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94dfe99-305f-403c-bf4c-667a33a468d8 None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:49:27.942570 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94dfe99-305f-403c-bf4c-667a33a468d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:49:27.943057 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94dfe99-305f-403c-bf4c-667a33a468d8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:49:27.955728 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94dfe99-305f-403c-bf4c-667a33a468d8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:49:27.957586 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94dfe99-305f-403c-bf4c-667a33a468d8 None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:49:27.975130 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application [None req-b94dfe99-305f-403c-bf4c-667a33a468d8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 17:49:27.975130 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 17:49:27.975130 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 17:49:27.975130 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 17:49:27.975130 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 17:49:27.975130 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 17:49:27.975130 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 17:49:27.975130 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 17:49:27.975130 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 17:49:27.975130 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 17:49:27.975130 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 17:49:27.975130 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 17:49:27.975130 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 15 17:49:27.975130 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 15 17:49:27.975130 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 15 17:49:27.975130 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 15 17:49:27.976166 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 17:49:27.976166 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 17:49:27.976166 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 17:49:27.976166 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 17:49:27.976166 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 17:49:27.976166 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 17:49:27.976166 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 17:49:27.976166 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application with Lock( Sep 15 17:49:27.976166 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 17:49:27.976166 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._enter() Sep 15 17:49:27.976166 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 17:49:27.976166 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 17:49:27.976166 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 17:49:27.976166 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.creator() Sep 15 17:49:27.976166 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 17:49:27.976166 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application created_value = creator( Sep 15 17:49:27.976166 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 15 17:49:27.977085 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 15 17:49:27.977085 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 17:49:27.977085 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Sep 15 17:49:27.984486 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 463/944] 10.222.0.25 () {56 vars in 1108 bytes} [Thu Sep 15 17:49:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 15 17:49:27.986331 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94dfe99-305f-403c-bf4c-667a33a468d8 None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:49:27.993692 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4a0e2c-9a22-4a2c-b874-db852bb2b3d4 None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:49:28.037973 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ea1fe5-9a6d-4cdb-9389-c87520b1862c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:49:28.038965 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ea1fe5-9a6d-4cdb-9389-c87520b1862c None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:49:28.039518 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ea1fe5-9a6d-4cdb-9389-c87520b1862c None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:49:28.039992 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ea1fe5-9a6d-4cdb-9389-c87520b1862c None admin] PATH_INFO: `/v3/services` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:49:28.040887 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ea1fe5-9a6d-4cdb-9389-c87520b1862c None admin] RBAC: Adding query filter params (type=compute) {{(pid=81593) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 17:49:28.041426 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ea1fe5-9a6d-4cdb-9389-c87520b1862c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:49:28.043047 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ea1fe5-9a6d-4cdb-9389-c87520b1862c None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:49:28.043462 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:49:28.050072 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 482/945] 10.222.0.25 () {56 vars in 1112 bytes} [Thu Sep 15 17:49:27 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 17:49:28.095524 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fa5532-72be-40b9-9aee-35bd5c025eea None None] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:49:28.095702 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fa5532-72be-40b9-9aee-35bd5c025eea None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:49:28.095991 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fa5532-72be-40b9-9aee-35bd5c025eea None None] PATH_INFO: `/` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:49:28.097536 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 483/946] 10.222.0.25 () {54 vars in 927 bytes} [Thu Sep 15 17:49:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 15 17:49:28.103224 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe69dab-9fa8-491b-a0b4-249d074fe14c None None] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:49:28.103521 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe69dab-9fa8-491b-a0b4-249d074fe14c None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:49:28.103776 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe69dab-9fa8-491b-a0b4-249d074fe14c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:49:28.124851 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94dfe99-305f-403c-bf4c-667a33a468d8 None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:49:28.126810 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.auth.core [None req-5fe69dab-9fa8-491b-a0b4-249d074fe14c None None] MFA Rules not processed for user `5cfa58ef86774ab7800bf91930bf6028`. Rule list: `[]` (Enabled: `True`). {{(pid=81593) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 17:49:28.129363 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-5fe69dab-9fa8-491b-a0b4-249d074fe14c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 17:49:28.169406 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca07a89f-b2fe-40d7-9930-51a25ea13a0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:49:28.170039 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca07a89f-b2fe-40d7-9930-51a25ea13a0e None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:49:28.170319 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca07a89f-b2fe-40d7-9930-51a25ea13a0e None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:49:28.170595 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca07a89f-b2fe-40d7-9930-51a25ea13a0e None admin] PATH_INFO: `/v3/domains` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:49:28.171260 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca07a89f-b2fe-40d7-9930-51a25ea13a0e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81592) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 17:49:28.171567 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca07a89f-b2fe-40d7-9930-51a25ea13a0e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:49:28.173710 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca07a89f-b2fe-40d7-9930-51a25ea13a0e None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:49:28.195686 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 464/947] 10.222.0.25 () {56 vars in 1109 bytes} [Thu Sep 15 17:49:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 17:49:28.197001 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca07a89f-b2fe-40d7-9930-51a25ea13a0e None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:49:28.210717 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:49:28.225596 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 484/948] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Sep 15 17:49:28 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 15 17:49:28.316187 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca07a89f-b2fe-40d7-9930-51a25ea13a0e None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:49:28.319190 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:49:28.352150 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c053ce-b8c0-40ae-aa5b-b62b5ee7f61e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:49:28.353130 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c053ce-b8c0-40ae-aa5b-b62b5ee7f61e None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:49:28.353667 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c053ce-b8c0-40ae-aa5b-b62b5ee7f61e None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:49:28.354139 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c053ce-b8c0-40ae-aa5b-b62b5ee7f61e None admin] PATH_INFO: `/v3/projects/service` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:49:28.362913 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c053ce-b8c0-40ae-aa5b-b62b5ee7f61e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:49:28.364630 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c053ce-b8c0-40ae-aa5b-b62b5ee7f61e None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:49:28.379893 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application [None req-55c053ce-b8c0-40ae-aa5b-b62b5ee7f61e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 15 17:49:28.379893 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 17:49:28.379893 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 17:49:28.379893 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 17:49:28.379893 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 17:49:28.379893 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 17:49:28.379893 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 17:49:28.379893 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 17:49:28.379893 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 17:49:28.379893 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 17:49:28.379893 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 17:49:28.379893 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 17:49:28.379893 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 15 17:49:28.379893 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 15 17:49:28.379893 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 15 17:49:28.380840 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 15 17:49:28.380840 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 17:49:28.380840 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 17:49:28.380840 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 17:49:28.380840 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 17:49:28.380840 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 17:49:28.380840 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 17:49:28.380840 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 17:49:28.380840 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application with Lock( Sep 15 17:49:28.380840 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 17:49:28.380840 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._enter() Sep 15 17:49:28.380840 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 17:49:28.380840 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 17:49:28.380840 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 17:49:28.380840 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.creator() Sep 15 17:49:28.380840 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 17:49:28.380840 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application created_value = creator( Sep 15 17:49:28.381772 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 15 17:49:28.381772 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 15 17:49:28.381772 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 15 17:49:28.381772 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 15 17:49:28.381772 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 15 17:49:28.381772 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 15 17:49:28.381772 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 15 17:49:28.381772 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Sep 15 17:49:28.384187 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 465/949] 10.222.0.25 () {56 vars in 1111 bytes} [Thu Sep 15 17:49:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 17:49:28.390220 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe69dab-9fa8-491b-a0b4-249d074fe14c None None] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:49:28.496614 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe69dab-9fa8-491b-a0b4-249d074fe14c None None] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:49:28.532904 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e45ae6f-9188-4d8d-bd42-412bc05e02b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:49:28.533907 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e45ae6f-9188-4d8d-bd42-412bc05e02b3 None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:49:28.534408 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e45ae6f-9188-4d8d-bd42-412bc05e02b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:49:28.534898 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e45ae6f-9188-4d8d-bd42-412bc05e02b3 None admin] PATH_INFO: `/v3/projects` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:49:28.535778 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e45ae6f-9188-4d8d-bd42-412bc05e02b3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81593) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 17:49:28.536314 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e45ae6f-9188-4d8d-bd42-412bc05e02b3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:49:28.538481 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e45ae6f-9188-4d8d-bd42-412bc05e02b3 None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:49:28.553377 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 485/950] 10.222.0.25 () {56 vars in 1148 bytes} [Thu Sep 15 17:49:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 17:49:28.558780 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c053ce-b8c0-40ae-aa5b-b62b5ee7f61e None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:49:28.566189 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e45ae6f-9188-4d8d-bd42-412bc05e02b3 None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:49:28.642297 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:49:28.693585 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e45ae6f-9188-4d8d-bd42-412bc05e02b3 None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:49:28.701745 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c053ce-b8c0-40ae-aa5b-b62b5ee7f61e None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:49:28.731240 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f4d881-bfd1-4166-aa98-9f4dff0c7ebf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:49:28.731948 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f4d881-bfd1-4166-aa98-9f4dff0c7ebf None admin] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:49:28.732229 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f4d881-bfd1-4166-aa98-9f4dff0c7ebf None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:49:28.732502 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f4d881-bfd1-4166-aa98-9f4dff0c7ebf None admin] PATH_INFO: `/v3/projects` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:49:28.733215 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f4d881-bfd1-4166-aa98-9f4dff0c7ebf None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:49:28.735577 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f4d881-bfd1-4166-aa98-9f4dff0c7ebf None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:49:28.739206 dv-cinder-835384-27-smb devstack@keystone.service[81593]: WARNING keystone.server.flask.common [None req-f2f4d881-bfd1-4166-aa98-9f4dff0c7ebf None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Sep 15 17:49:28.744305 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4466089a-7b8e-40a2-9d58-bc5d89ee8995 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:49:28.744967 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4466089a-7b8e-40a2-9d58-bc5d89ee8995 None admin] REQUEST_METHOD: `PUT` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:49:28.745242 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4466089a-7b8e-40a2-9d58-bc5d89ee8995 None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:49:28.745539 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4466089a-7b8e-40a2-9d58-bc5d89ee8995 None admin] PATH_INFO: `/v3/projects/1213c0d1b584404ba3998e136f166e89/users/d899ec4fcbeb4de382c7f0a779ca8ed5/roles/99a6f32f74a84d0989c7527d9985370e` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:49:28.748217 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4466089a-7b8e-40a2-9d58-bc5d89ee8995 None admin] RBAC: Authorizing `identity:create_grant(project_id=1213c0d1b584404ba3998e136f166e89, user_id=d899ec4fcbeb4de382c7f0a779ca8ed5, role_id=99a6f32f74a84d0989c7527d9985370e)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:49:28.749799 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4466089a-7b8e-40a2-9d58-bc5d89ee8995 None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:49:28.766627 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 466/951] 10.222.0.25 () {58 vars in 1439 bytes} [Thu Sep 15 17:49:28 2022] PUT /identity/v3/projects/1213c0d1b584404ba3998e136f166e89/users/d899ec4fcbeb4de382c7f0a779ca8ed5/roles/99a6f32f74a84d0989c7527d9985370e => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 17:49:28.770596 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.sql.core [None req-f2f4d881-bfd1-4166-aa98-9f4dff0c7ebf None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Sep 15 17:49:28.770596 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Sep 15 17:49:28.770596 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [parameters: {'id': '514a25e65d3a4ba9a174b0396be30fe7', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Sep 15 17:49:28.770596 dv-cinder-835384-27-smb devstack@keystone.service[81593]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81593) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Sep 15 17:49:28.793719 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application [None req-f2f4d881-bfd1-4166-aa98-9f4dff0c7ebf None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 514a25e65d3a4ba9a174b0396be30fe7.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 514a25e65d3a4ba9a174b0396be30fe7. Sep 15 17:49:28.793719 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 17:49:28.793719 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 15 17:49:28.793719 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 15 17:49:28.793719 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 15 17:49:28.793719 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 15 17:49:28.793719 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 15 17:49:28.793719 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application result = self._query(query) Sep 15 17:49:28.793719 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 15 17:49:28.793719 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application conn.query(q) Sep 15 17:49:28.793719 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 15 17:49:28.793719 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 15 17:49:28.793719 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 15 17:49:28.794624 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application result.read() Sep 15 17:49:28.794624 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 15 17:49:28.794624 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 15 17:49:28.794624 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 15 17:49:28.794624 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 15 17:49:28.794624 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 15 17:49:28.794624 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 15 17:49:28.794624 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 15 17:49:28.794624 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 15 17:49:28.794624 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Sep 15 17:49:28.794624 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Sep 15 17:49:28.794624 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Sep 15 17:49:28.794624 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Sep 15 17:49:28.794624 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 17:49:28.794624 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Sep 15 17:49:28.794624 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return method(*args, **kwargs) Sep 15 17:49:28.794624 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Sep 15 17:49:28.794624 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return project_ref.to_dict() Sep 15 17:49:28.795672 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 15 17:49:28.795672 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application next(self.gen) Sep 15 17:49:28.795672 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Sep 15 17:49:28.795672 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application yield resource Sep 15 17:49:28.795672 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 15 17:49:28.795672 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application next(self.gen) Sep 15 17:49:28.795672 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Sep 15 17:49:28.795672 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application self.session.rollback() Sep 15 17:49:28.795672 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 15 17:49:28.795672 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application self.force_reraise() Sep 15 17:49:28.795672 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 15 17:49:28.795672 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application raise self.value Sep 15 17:49:28.795672 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Sep 15 17:49:28.795672 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Sep 15 17:49:28.795672 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Sep 15 17:49:28.795672 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application session.commit() Sep 15 17:49:28.795672 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Sep 15 17:49:28.797260 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Sep 15 17:49:28.797260 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Sep 15 17:49:28.797260 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application self._prepare_impl() Sep 15 17:49:28.797260 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Sep 15 17:49:28.797260 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application self.session.flush() Sep 15 17:49:28.797260 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Sep 15 17:49:28.797260 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application self._flush(objects) Sep 15 17:49:28.797260 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Sep 15 17:49:28.797260 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Sep 15 17:49:28.797260 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Sep 15 17:49:28.797260 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application compat.raise_( Sep 15 17:49:28.797260 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 15 17:49:28.797260 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application raise exception Sep 15 17:49:28.797260 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Sep 15 17:49:28.797260 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application flush_context.execute() Sep 15 17:49:28.797260 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Sep 15 17:49:28.797260 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application rec.execute(self) Sep 15 17:49:28.800377 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Sep 15 17:49:28.800377 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Sep 15 17:49:28.800377 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Sep 15 17:49:28.800377 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application _emit_insert_statements( Sep 15 17:49:28.800377 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Sep 15 17:49:28.800377 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application c = connection._execute_20( Sep 15 17:49:28.800377 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Sep 15 17:49:28.800377 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Sep 15 17:49:28.800377 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Sep 15 17:49:28.800377 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Sep 15 17:49:28.800377 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Sep 15 17:49:28.800377 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application ret = self._execute_context( Sep 15 17:49:28.800377 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Sep 15 17:49:28.800377 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Sep 15 17:49:28.800377 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Sep 15 17:49:28.801444 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Sep 15 17:49:28.801444 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 15 17:49:28.801444 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application raise exception Sep 15 17:49:28.801444 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 15 17:49:28.801444 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 15 17:49:28.801444 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 15 17:49:28.801444 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 15 17:49:28.801444 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 15 17:49:28.801444 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application result = self._query(query) Sep 15 17:49:28.801444 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 15 17:49:28.801444 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application conn.query(q) Sep 15 17:49:28.801444 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 15 17:49:28.801444 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 15 17:49:28.801444 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 15 17:49:28.801444 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application result.read() Sep 15 17:49:28.801444 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 15 17:49:28.801444 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 15 17:49:28.802595 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 15 17:49:28.802595 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 15 17:49:28.802595 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 15 17:49:28.802595 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 15 17:49:28.802595 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 15 17:49:28.802595 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 15 17:49:28.802595 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Sep 15 17:49:28.802595 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Sep 15 17:49:28.802595 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application [parameters: {'id': '514a25e65d3a4ba9a174b0396be30fe7', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Sep 15 17:49:28.802595 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Sep 15 17:49:28.802595 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Sep 15 17:49:28.802595 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 15 17:49:28.802595 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Sep 15 17:49:28.802595 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 17:49:28.802595 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Sep 15 17:49:28.803530 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Sep 15 17:49:28.803530 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Sep 15 17:49:28.803530 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Sep 15 17:49:28.803530 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Sep 15 17:49:28.803530 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Sep 15 17:49:28.803530 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 15 17:49:28.803530 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Sep 15 17:49:28.803530 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 17:49:28.803530 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 17:49:28.803530 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 17:49:28.803530 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 17:49:28.803530 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 17:49:28.803530 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 17:49:28.803530 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 17:49:28.803530 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 17:49:28.803530 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 17:49:28.803530 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 17:49:28.806316 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 17:49:28.806316 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Sep 15 17:49:28.806316 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Sep 15 17:49:28.806316 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 17:49:28.806316 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 17:49:28.806316 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Sep 15 17:49:28.806316 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application raise exception.Conflict( Sep 15 17:49:28.806316 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 514a25e65d3a4ba9a174b0396be30fe7. Sep 15 17:49:28.806316 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Sep 15 17:49:28.806316 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 486/952] 10.222.0.25 () {60 vars in 1140 bytes} [Thu Sep 15 17:49:28 2022] POST /identity/v3/projects => generated 262 bytes in 230 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Sep 15 17:49:28.810544 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4466089a-7b8e-40a2-9d58-bc5d89ee8995 None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:49:28.848000 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:49:28.940428 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4466089a-7b8e-40a2-9d58-bc5d89ee8995 None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:49:28.979112 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8b43f6-1ceb-4cd3-83fb-3e7984d36359 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:49:28.979759 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8b43f6-1ceb-4cd3-83fb-3e7984d36359 None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:49:28.980035 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8b43f6-1ceb-4cd3-83fb-3e7984d36359 None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:49:28.980562 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8b43f6-1ceb-4cd3-83fb-3e7984d36359 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:49:28.988043 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8b43f6-1ceb-4cd3-83fb-3e7984d36359 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:49:28.989508 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8b43f6-1ceb-4cd3-83fb-3e7984d36359 None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:49:29.001407 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application [None req-db8b43f6-1ceb-4cd3-83fb-3e7984d36359 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 15 17:49:29.001407 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 17:49:29.001407 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 17:49:29.001407 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 17:49:29.001407 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 17:49:29.001407 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 17:49:29.001407 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 17:49:29.001407 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 17:49:29.001407 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 17:49:29.001407 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 17:49:29.001407 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 17:49:29.001407 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 17:49:29.001407 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 15 17:49:29.001407 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 15 17:49:29.001407 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 15 17:49:29.002542 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 15 17:49:29.002542 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 17:49:29.002542 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 17:49:29.002542 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 17:49:29.002542 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 17:49:29.002542 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 17:49:29.002542 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 17:49:29.002542 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 17:49:29.002542 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application with Lock( Sep 15 17:49:29.002542 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 17:49:29.002542 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._enter() Sep 15 17:49:29.002542 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 17:49:29.002542 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 17:49:29.002542 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 17:49:29.002542 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.creator() Sep 15 17:49:29.002542 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 17:49:29.002542 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application created_value = creator( Sep 15 17:49:29.003510 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 15 17:49:29.003510 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 15 17:49:29.003510 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 15 17:49:29.003510 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 15 17:49:29.003510 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 15 17:49:29.003510 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 15 17:49:29.003510 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 15 17:49:29.003510 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Sep 15 17:49:29.003510 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 467/953] 10.222.0.25 () {56 vars in 1111 bytes} [Thu Sep 15 17:49:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 17:49:29.012963 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f4d881-bfd1-4166-aa98-9f4dff0c7ebf None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:49:29.140139 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f4d881-bfd1-4166-aa98-9f4dff0c7ebf None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:49:29.159468 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:49:29.181482 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b27b39-7908-4b7e-bcf0-aec2f8195cf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:49:29.182018 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b27b39-7908-4b7e-bcf0-aec2f8195cf4 None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:49:29.182293 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b27b39-7908-4b7e-bcf0-aec2f8195cf4 None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:49:29.182561 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b27b39-7908-4b7e-bcf0-aec2f8195cf4 None admin] PATH_INFO: `/v3/projects` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:49:29.183220 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b27b39-7908-4b7e-bcf0-aec2f8195cf4 None admin] RBAC: Adding query filter params (name=service) {{(pid=81593) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 17:49:29.183519 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b27b39-7908-4b7e-bcf0-aec2f8195cf4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:49:29.185165 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b27b39-7908-4b7e-bcf0-aec2f8195cf4 None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:49:29.213455 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 487/954] 10.222.0.25 () {56 vars in 1112 bytes} [Thu Sep 15 17:49:29 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 17:49:29.677271 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de099592-be35-4242-8e88-7161dcfe9e94 None None] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:49:29.678003 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de099592-be35-4242-8e88-7161dcfe9e94 None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:49:29.678508 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de099592-be35-4242-8e88-7161dcfe9e94 None None] PATH_INFO: `/` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:49:29.680305 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 468/955] 10.222.0.25 () {54 vars in 927 bytes} [Thu Sep 15 17:49:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 17:49:29.685888 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed83c85-ee37-4cbe-8720-3491c557d617 None None] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:49:29.686426 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed83c85-ee37-4cbe-8720-3491c557d617 None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:49:29.686915 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed83c85-ee37-4cbe-8720-3491c557d617 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:49:29.707278 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.auth.core [None req-2ed83c85-ee37-4cbe-8720-3491c557d617 None None] MFA Rules not processed for user `5cfa58ef86774ab7800bf91930bf6028`. Rule list: `[]` (Enabled: `True`). {{(pid=81593) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 17:49:29.709172 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-2ed83c85-ee37-4cbe-8720-3491c557d617 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 17:49:29.789970 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 488/956] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Sep 15 17:49:29 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 15 17:49:30.085168 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de099592-be35-4242-8e88-7161dcfe9e94 None None] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:49:30.174315 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:49:30.191846 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de099592-be35-4242-8e88-7161dcfe9e94 None None] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:49:30.231838 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b367dd-c8f1-472b-b3bd-bceec5a98996 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:49:30.232474 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b367dd-c8f1-472b-b3bd-bceec5a98996 None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:49:30.232752 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b367dd-c8f1-472b-b3bd-bceec5a98996 None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:49:30.233026 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b367dd-c8f1-472b-b3bd-bceec5a98996 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:49:30.233643 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b367dd-c8f1-472b-b3bd-bceec5a98996 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:49:30.235049 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b367dd-c8f1-472b-b3bd-bceec5a98996 None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:49:30.244643 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application [None req-72b367dd-c8f1-472b-b3bd-bceec5a98996 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 15 17:49:30.244643 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 17:49:30.244643 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 15 17:49:30.244643 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 15 17:49:30.244643 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 15 17:49:30.244643 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 15 17:49:30.244643 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 15 17:49:30.244643 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 15 17:49:30.244643 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 15 17:49:30.244643 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Sep 15 17:49:30.244643 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 15 17:49:30.244643 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Sep 15 17:49:30.244643 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 17:49:30.244643 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 17:49:30.244643 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 17:49:30.244643 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 17:49:30.244643 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 17:49:30.245902 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 17:49:30.245902 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 17:49:30.245902 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 17:49:30.245902 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 17:49:30.245902 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 17:49:30.245902 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 17:49:30.245902 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 15 17:49:30.245902 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 15 17:49:30.245902 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 15 17:49:30.245902 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 15 17:49:30.245902 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 17:49:30.245902 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 17:49:30.245902 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 17:49:30.245902 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 17:49:30.245902 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 17:49:30.245902 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 17:49:30.247329 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 17:49:30.247329 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application with Lock( Sep 15 17:49:30.247329 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 17:49:30.247329 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._enter() Sep 15 17:49:30.247329 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 17:49:30.247329 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 17:49:30.247329 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 17:49:30.247329 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.creator() Sep 15 17:49:30.247329 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 17:49:30.247329 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application created_value = creator( Sep 15 17:49:30.247329 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 15 17:49:30.247329 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 15 17:49:30.247329 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 15 17:49:30.247329 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Sep 15 17:49:30.247329 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 469/957] 10.222.0.25 () {56 vars in 1126 bytes} [Thu Sep 15 17:49:30 2022] GET /identity/v3/services/object-store => generated 93 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 17:49:30.251984 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed83c85-ee37-4cbe-8720-3491c557d617 None None] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:49:30.363108 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed83c85-ee37-4cbe-8720-3491c557d617 None None] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:49:30.370636 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:49:30.400065 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4148a339-4051-460e-a36d-8fa988eeff47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:49:30.400685 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4148a339-4051-460e-a36d-8fa988eeff47 None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:49:30.400967 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4148a339-4051-460e-a36d-8fa988eeff47 None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:49:30.401243 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4148a339-4051-460e-a36d-8fa988eeff47 None admin] PATH_INFO: `/v3/services` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:49:30.401909 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4148a339-4051-460e-a36d-8fa988eeff47 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81593) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 17:49:30.402218 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4148a339-4051-460e-a36d-8fa988eeff47 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:49:30.403601 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4148a339-4051-460e-a36d-8fa988eeff47 None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:49:30.409550 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 489/958] 10.222.0.25 () {56 vars in 1122 bytes} [Thu Sep 15 17:49:30 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 17:49:30.415498 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b367dd-c8f1-472b-b3bd-bceec5a98996 None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:49:30.432086 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eaf532d-cf41-4829-9f69-4e4dcb602697 None None] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:49:30.432389 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eaf532d-cf41-4829-9f69-4e4dcb602697 None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:49:30.432642 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eaf532d-cf41-4829-9f69-4e4dcb602697 None None] PATH_INFO: `/` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:49:30.434272 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 490/959] 10.222.0.25 () {54 vars in 927 bytes} [Thu Sep 15 17:49:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 15 17:49:30.440985 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cad7760-aca1-4c50-9eab-f1013996bf63 None None] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:49:30.441478 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cad7760-aca1-4c50-9eab-f1013996bf63 None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:49:30.441899 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cad7760-aca1-4c50-9eab-f1013996bf63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:49:30.461522 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.auth.core [None req-4cad7760-aca1-4c50-9eab-f1013996bf63 None None] MFA Rules not processed for user `5cfa58ef86774ab7800bf91930bf6028`. Rule list: `[]` (Enabled: `True`). {{(pid=81593) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 17:49:30.463037 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-4cad7760-aca1-4c50-9eab-f1013996bf63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 17:49:30.537198 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b367dd-c8f1-472b-b3bd-bceec5a98996 None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:49:30.553864 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 491/960] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Sep 15 17:49:30 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 15 17:49:30.581335 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041c2ff9-2337-45b1-8d15-21cd911239c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:49:30.581986 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041c2ff9-2337-45b1-8d15-21cd911239c7 None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:49:30.582262 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041c2ff9-2337-45b1-8d15-21cd911239c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:49:30.582533 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041c2ff9-2337-45b1-8d15-21cd911239c7 None admin] PATH_INFO: `/v3/services` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:49:30.583370 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041c2ff9-2337-45b1-8d15-21cd911239c7 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81592) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 17:49:30.583863 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041c2ff9-2337-45b1-8d15-21cd911239c7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:49:30.585282 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041c2ff9-2337-45b1-8d15-21cd911239c7 None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:49:30.591102 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 470/961] 10.222.0.25 () {56 vars in 1122 bytes} [Thu Sep 15 17:49:30 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 17:49:30.596949 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cad7760-aca1-4c50-9eab-f1013996bf63 None None] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:49:30.708483 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:49:30.710849 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cad7760-aca1-4c50-9eab-f1013996bf63 None None] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:49:30.751375 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f28da90-7211-4611-83e5-7282c2f973d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:49:30.751988 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f28da90-7211-4611-83e5-7282c2f973d9 None admin] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:49:30.752264 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f28da90-7211-4611-83e5-7282c2f973d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:49:30.752534 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f28da90-7211-4611-83e5-7282c2f973d9 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:49:30.753209 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f28da90-7211-4611-83e5-7282c2f973d9 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:49:30.754602 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f28da90-7211-4611-83e5-7282c2f973d9 None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:49:30.776893 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 492/962] 10.222.0.25 () {60 vars in 1144 bytes} [Thu Sep 15 17:49:30 2022] POST /identity/v3/endpoints => generated 349 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 17:49:30.877694 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041c2ff9-2337-45b1-8d15-21cd911239c7 None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:49:30.894441 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:49:31.003522 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041c2ff9-2337-45b1-8d15-21cd911239c7 None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:49:31.046126 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b418f5f-c712-4998-bdbb-8081cfa6045d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:49:31.046795 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b418f5f-c712-4998-bdbb-8081cfa6045d None admin] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:49:31.047075 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b418f5f-c712-4998-bdbb-8081cfa6045d None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:49:31.047925 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b418f5f-c712-4998-bdbb-8081cfa6045d None admin] PATH_INFO: `/v3/services` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:49:31.048595 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b418f5f-c712-4998-bdbb-8081cfa6045d None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:49:31.049993 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b418f5f-c712-4998-bdbb-8081cfa6045d None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:49:31.067045 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4618352c-0daf-4459-9210-0939faa20c09 None None] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:49:31.067264 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 471/963] 10.222.0.25 () {60 vars in 1141 bytes} [Thu Sep 15 17:49:30 2022] POST /identity/v3/services => generated 242 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 17:49:31.067348 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4618352c-0daf-4459-9210-0939faa20c09 None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:49:31.067598 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4618352c-0daf-4459-9210-0939faa20c09 None None] PATH_INFO: `/` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:49:31.069191 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 493/964] 10.222.0.25 () {54 vars in 927 bytes} [Thu Sep 15 17:49:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 15 17:49:31.075252 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916f7f48-0163-4e85-ac91-7c258e8103eb None None] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:49:31.075642 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916f7f48-0163-4e85-ac91-7c258e8103eb None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:49:31.075921 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916f7f48-0163-4e85-ac91-7c258e8103eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:49:31.098156 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.auth.core [None req-916f7f48-0163-4e85-ac91-7c258e8103eb None None] MFA Rules not processed for user `5cfa58ef86774ab7800bf91930bf6028`. Rule list: `[]` (Enabled: `True`). {{(pid=81592) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 17:49:31.099413 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-916f7f48-0163-4e85-ac91-7c258e8103eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 17:49:31.178057 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:49:31.191792 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 472/965] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Sep 15 17:49:31 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 15 17:49:31.470691 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4618352c-0daf-4459-9210-0939faa20c09 None None] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:49:31.587216 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4618352c-0daf-4459-9210-0939faa20c09 None None] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:49:31.607738 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc2117d-9d03-4c1c-b093-8ac268b8190c None None] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:49:31.608355 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc2117d-9d03-4c1c-b093-8ac268b8190c None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:49:31.608638 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc2117d-9d03-4c1c-b093-8ac268b8190c None None] PATH_INFO: `/` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:49:31.610344 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 473/966] 10.222.0.25 () {54 vars in 927 bytes} [Thu Sep 15 17:49:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 17:49:31.615681 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f959d871-0040-48ab-91b9-94a00aec1d59 None None] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:49:31.615956 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f959d871-0040-48ab-91b9-94a00aec1d59 None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:49:31.616239 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f959d871-0040-48ab-91b9-94a00aec1d59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:49:31.629139 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e84694-ace0-4035-a3bc-465af183105a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:49:31.629811 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e84694-ace0-4035-a3bc-465af183105a None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:49:31.630095 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e84694-ace0-4035-a3bc-465af183105a None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:49:31.630369 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e84694-ace0-4035-a3bc-465af183105a None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:49:31.635909 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.auth.core [None req-f959d871-0040-48ab-91b9-94a00aec1d59 None None] MFA Rules not processed for user `5cfa58ef86774ab7800bf91930bf6028`. Rule list: `[]` (Enabled: `True`). {{(pid=81592) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 17:49:31.637400 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-f959d871-0040-48ab-91b9-94a00aec1d59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 17:49:31.650289 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e84694-ace0-4035-a3bc-465af183105a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 17:49:31.651310 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application [None req-71e84694-ace0-4035-a3bc-465af183105a None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 15 17:49:31.651310 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 17:49:31.651310 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 17:49:31.651310 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 17:49:31.651310 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 17:49:31.651310 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 17:49:31.651310 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 17:49:31.651310 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 17:49:31.651310 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 17:49:31.651310 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 17:49:31.651310 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 17:49:31.651310 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 17:49:31.651310 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 17:49:31.651310 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 17:49:31.651310 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 17:49:31.651310 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 17:49:31.652226 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 17:49:31.652226 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 17:49:31.652226 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 17:49:31.652226 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 17:49:31.652226 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 17:49:31.652226 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 17:49:31.652226 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 17:49:31.652226 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 17:49:31.652226 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 17:49:31.652226 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 17:49:31.652226 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 17:49:31.652226 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application with Lock( Sep 15 17:49:31.652226 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 17:49:31.652226 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._enter() Sep 15 17:49:31.652226 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 17:49:31.652226 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 17:49:31.653070 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 17:49:31.653070 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.creator() Sep 15 17:49:31.653070 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 17:49:31.653070 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application created_value = creator( Sep 15 17:49:31.653070 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 17:49:31.653070 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 17:49:31.653070 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 17:49:31.653070 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 17:49:31.653070 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 17:49:31.653070 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 17:49:31.653070 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 15 17:49:31.653070 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Sep 15 17:49:31.653070 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 494/967] 10.222.0.25 () {56 vars in 1120 bytes} [Thu Sep 15 17:49:31 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 17:49:31.658419 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e84694-ace0-4035-a3bc-465af183105a None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:49:31.677849 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:49:31.738972 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 474/968] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Sep 15 17:49:31 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 15 17:49:31.775054 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e84694-ace0-4035-a3bc-465af183105a None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:49:31.811390 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c0c6ad-004c-4349-84fd-ba320bc65f46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:49:31.812234 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c0c6ad-004c-4349-84fd-ba320bc65f46 None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:49:31.812678 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c0c6ad-004c-4349-84fd-ba320bc65f46 None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:49:31.813179 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c0c6ad-004c-4349-84fd-ba320bc65f46 None admin] PATH_INFO: `/v3/roles` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:49:31.813992 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c0c6ad-004c-4349-84fd-ba320bc65f46 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81593) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 17:49:31.814446 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c0c6ad-004c-4349-84fd-ba320bc65f46 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:49:31.815968 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c0c6ad-004c-4349-84fd-ba320bc65f46 None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:49:31.825012 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 495/969] 10.222.0.25 () {56 vars in 1115 bytes} [Thu Sep 15 17:49:31 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 17:49:31.831506 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f959d871-0040-48ab-91b9-94a00aec1d59 None None] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:49:31.938950 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f959d871-0040-48ab-91b9-94a00aec1d59 None None] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:49:31.963741 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:49:31.975716 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79527861-64c2-472b-a725-bf0c26c8d00e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:49:31.976346 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79527861-64c2-472b-a725-bf0c26c8d00e None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:49:31.976624 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79527861-64c2-472b-a725-bf0c26c8d00e None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:49:31.976891 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79527861-64c2-472b-a725-bf0c26c8d00e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:49:31.988602 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79527861-64c2-472b-a725-bf0c26c8d00e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:49:31.990410 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79527861-64c2-472b-a725-bf0c26c8d00e None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:49:32.005256 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application [None req-79527861-64c2-472b-a725-bf0c26c8d00e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 17:49:32.005256 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 17:49:32.005256 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 17:49:32.005256 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 17:49:32.005256 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 17:49:32.005256 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 17:49:32.005256 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 17:49:32.005256 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 17:49:32.005256 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 17:49:32.005256 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 17:49:32.005256 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 17:49:32.005256 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 17:49:32.005256 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 15 17:49:32.005256 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 15 17:49:32.005256 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 15 17:49:32.005256 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 15 17:49:32.006244 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 17:49:32.006244 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 17:49:32.006244 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 17:49:32.006244 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 17:49:32.006244 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 17:49:32.006244 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 17:49:32.006244 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 17:49:32.006244 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application with Lock( Sep 15 17:49:32.006244 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 17:49:32.006244 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._enter() Sep 15 17:49:32.006244 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 17:49:32.006244 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 17:49:32.006244 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 17:49:32.006244 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.creator() Sep 15 17:49:32.006244 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 17:49:32.006244 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application created_value = creator( Sep 15 17:49:32.006244 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 15 17:49:32.007156 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 15 17:49:32.007156 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 17:49:32.007156 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Sep 15 17:49:32.007156 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 475/970] 10.222.0.25 () {56 vars in 1108 bytes} [Thu Sep 15 17:49:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 17:49:32.012350 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c0c6ad-004c-4349-84fd-ba320bc65f46 None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:49:32.032976 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79527861-64c2-472b-a725-bf0c26c8d00e None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:49:32.106184 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:49:32.132808 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c0c6ad-004c-4349-84fd-ba320bc65f46 None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:49:32.153890 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79527861-64c2-472b-a725-bf0c26c8d00e None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:49:32.169506 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22495761-ec03-4b5b-ba99-b7c899b47f97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:49:32.170114 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22495761-ec03-4b5b-ba99-b7c899b47f97 None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:49:32.170389 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22495761-ec03-4b5b-ba99-b7c899b47f97 None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:49:32.170657 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22495761-ec03-4b5b-ba99-b7c899b47f97 None admin] PATH_INFO: `/v3/domains` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:49:32.171410 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22495761-ec03-4b5b-ba99-b7c899b47f97 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81593) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 17:49:32.171710 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22495761-ec03-4b5b-ba99-b7c899b47f97 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:49:32.173798 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22495761-ec03-4b5b-ba99-b7c899b47f97 None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:49:32.191962 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 496/971] 10.222.0.25 () {56 vars in 1109 bytes} [Thu Sep 15 17:49:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 17:49:32.192660 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d23f54-4c96-410c-a23b-01f77a11dfb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:49:32.192915 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22495761-ec03-4b5b-ba99-b7c899b47f97 None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:49:32.193279 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d23f54-4c96-410c-a23b-01f77a11dfb3 None admin] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:49:32.193593 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d23f54-4c96-410c-a23b-01f77a11dfb3 None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:49:32.193869 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d23f54-4c96-410c-a23b-01f77a11dfb3 None admin] PATH_INFO: `/v3/users` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:49:32.194536 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d23f54-4c96-410c-a23b-01f77a11dfb3 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:49:32.196095 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d23f54-4c96-410c-a23b-01f77a11dfb3 None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:49:32.198944 dv-cinder-835384-27-smb devstack@keystone.service[81592]: WARNING keystone.server.flask.common [None req-97d23f54-4c96-410c-a23b-01f77a11dfb3 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Sep 15 17:49:32.213998 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.sql.core [None req-97d23f54-4c96-410c-a23b-01f77a11dfb3 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Sep 15 17:49:32.213998 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Sep 15 17:49:32.213998 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [parameters: {'user_id': '40c0ebec023648559698710901e6ead8', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Sep 15 17:49:32.213998 dv-cinder-835384-27-smb devstack@keystone.service[81592]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81592) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Sep 15 17:49:32.223546 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application [None req-97d23f54-4c96-410c-a23b-01f77a11dfb3 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Sep 15 17:49:32.223546 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 17:49:32.223546 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 15 17:49:32.223546 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 15 17:49:32.223546 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 15 17:49:32.223546 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 15 17:49:32.223546 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 15 17:49:32.223546 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application result = self._query(query) Sep 15 17:49:32.223546 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 15 17:49:32.223546 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application conn.query(q) Sep 15 17:49:32.223546 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 15 17:49:32.223546 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 15 17:49:32.223546 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 15 17:49:32.223546 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application result.read() Sep 15 17:49:32.223546 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 15 17:49:32.225433 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 15 17:49:32.225433 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 15 17:49:32.225433 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 15 17:49:32.225433 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 15 17:49:32.225433 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 15 17:49:32.225433 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 15 17:49:32.225433 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 15 17:49:32.225433 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Sep 15 17:49:32.225433 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Sep 15 17:49:32.225433 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Sep 15 17:49:32.225433 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Sep 15 17:49:32.225433 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 17:49:32.225433 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Sep 15 17:49:32.225433 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return method(*args, **kwargs) Sep 15 17:49:32.225433 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Sep 15 17:49:32.225433 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Sep 15 17:49:32.225433 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 15 17:49:32.225433 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application next(self.gen) Sep 15 17:49:32.226906 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Sep 15 17:49:32.226906 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application yield resource Sep 15 17:49:32.226906 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 15 17:49:32.226906 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application next(self.gen) Sep 15 17:49:32.226906 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Sep 15 17:49:32.226906 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application self.session.rollback() Sep 15 17:49:32.226906 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 15 17:49:32.226906 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application self.force_reraise() Sep 15 17:49:32.226906 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 15 17:49:32.226906 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application raise self.value Sep 15 17:49:32.226906 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Sep 15 17:49:32.226906 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Sep 15 17:49:32.226906 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Sep 15 17:49:32.226906 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application session.commit() Sep 15 17:49:32.226906 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Sep 15 17:49:32.226906 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Sep 15 17:49:32.226906 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Sep 15 17:49:32.228037 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application self._prepare_impl() Sep 15 17:49:32.228037 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Sep 15 17:49:32.228037 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application self.session.flush() Sep 15 17:49:32.228037 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Sep 15 17:49:32.228037 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application self._flush(objects) Sep 15 17:49:32.228037 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Sep 15 17:49:32.228037 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Sep 15 17:49:32.228037 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Sep 15 17:49:32.228037 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application compat.raise_( Sep 15 17:49:32.228037 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 15 17:49:32.228037 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application raise exception Sep 15 17:49:32.228037 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Sep 15 17:49:32.228037 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application flush_context.execute() Sep 15 17:49:32.228037 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Sep 15 17:49:32.228037 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application rec.execute(self) Sep 15 17:49:32.228037 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Sep 15 17:49:32.228037 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Sep 15 17:49:32.229163 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Sep 15 17:49:32.229163 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application _emit_insert_statements( Sep 15 17:49:32.229163 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Sep 15 17:49:32.229163 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application result = connection._execute_20( Sep 15 17:49:32.229163 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Sep 15 17:49:32.229163 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Sep 15 17:49:32.229163 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Sep 15 17:49:32.229163 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Sep 15 17:49:32.229163 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Sep 15 17:49:32.229163 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application ret = self._execute_context( Sep 15 17:49:32.229163 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Sep 15 17:49:32.229163 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Sep 15 17:49:32.229163 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Sep 15 17:49:32.229163 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Sep 15 17:49:32.229163 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 15 17:49:32.229163 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application raise exception Sep 15 17:49:32.230468 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 15 17:49:32.230468 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 15 17:49:32.230468 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 15 17:49:32.230468 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 15 17:49:32.230468 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 15 17:49:32.230468 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application result = self._query(query) Sep 15 17:49:32.230468 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 15 17:49:32.230468 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application conn.query(q) Sep 15 17:49:32.230468 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 15 17:49:32.230468 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 15 17:49:32.230468 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 15 17:49:32.230468 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application result.read() Sep 15 17:49:32.230468 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 15 17:49:32.230468 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 15 17:49:32.230468 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 15 17:49:32.230468 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 15 17:49:32.231504 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 15 17:49:32.231504 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 15 17:49:32.231504 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 15 17:49:32.231504 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 15 17:49:32.231504 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Sep 15 17:49:32.231504 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Sep 15 17:49:32.231504 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application [parameters: {'user_id': '40c0ebec023648559698710901e6ead8', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Sep 15 17:49:32.231504 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Sep 15 17:49:32.231504 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Sep 15 17:49:32.231504 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 15 17:49:32.231504 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Sep 15 17:49:32.231504 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 17:49:32.231504 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 17:49:32.231504 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 17:49:32.231504 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 17:49:32.241655 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 17:49:32.241655 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 17:49:32.241655 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 17:49:32.241655 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 17:49:32.241655 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 17:49:32.241655 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 17:49:32.241655 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 17:49:32.241655 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Sep 15 17:49:32.241655 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Sep 15 17:49:32.241655 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 17:49:32.241655 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 17:49:32.241655 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 15 17:49:32.241655 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 15 17:49:32.241655 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 15 17:49:32.241655 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 15 17:49:32.241655 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Sep 15 17:49:32.241655 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Sep 15 17:49:32.243539 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Sep 15 17:49:32.243539 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Sep 15 17:49:32.243539 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Sep 15 17:49:32.243539 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Sep 15 17:49:32.243539 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Sep 15 17:49:32.243539 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Sep 15 17:49:32.243539 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 476/972] 10.222.0.25 () {60 vars in 1131 bytes} [Thu Sep 15 17:49:32 2022] POST /identity/v3/users => generated 160 bytes in 193 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Sep 15 17:49:32.243539 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d23f54-4c96-410c-a23b-01f77a11dfb3 None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:49:32.280148 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:49:32.317817 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22495761-ec03-4b5b-ba99-b7c899b47f97 None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:49:32.357087 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b66006-f0e2-4496-b8c9-e6babffc7619 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:49:32.358081 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b66006-f0e2-4496-b8c9-e6babffc7619 None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:49:32.358381 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d23f54-4c96-410c-a23b-01f77a11dfb3 None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:49:32.358800 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b66006-f0e2-4496-b8c9-e6babffc7619 None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:49:32.359335 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b66006-f0e2-4496-b8c9-e6babffc7619 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:49:32.369810 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b66006-f0e2-4496-b8c9-e6babffc7619 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:49:32.372094 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b66006-f0e2-4496-b8c9-e6babffc7619 None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:49:32.374707 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:49:32.389970 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application [None req-44b66006-f0e2-4496-b8c9-e6babffc7619 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 15 17:49:32.389970 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 17:49:32.389970 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 17:49:32.389970 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 17:49:32.389970 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 17:49:32.389970 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 17:49:32.389970 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 17:49:32.389970 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 17:49:32.389970 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 17:49:32.389970 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 17:49:32.389970 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 17:49:32.389970 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 17:49:32.389970 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 15 17:49:32.389970 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 15 17:49:32.389970 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 15 17:49:32.389970 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 15 17:49:32.391573 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 17:49:32.391573 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 17:49:32.391573 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 15 17:49:32.391573 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 15 17:49:32.391573 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 15 17:49:32.391573 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 15 17:49:32.391573 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 17:49:32.391573 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 17:49:32.391573 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 17:49:32.391573 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 17:49:32.391573 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 17:49:32.391573 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application with Lock( Sep 15 17:49:32.391573 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 17:49:32.391573 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._enter() Sep 15 17:49:32.391573 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 17:49:32.391573 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 17:49:32.391573 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 17:49:32.391573 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.creator() Sep 15 17:49:32.392506 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 17:49:32.392506 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application created_value = creator( Sep 15 17:49:32.392506 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 15 17:49:32.392506 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 15 17:49:32.392506 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 15 17:49:32.392506 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 15 17:49:32.392506 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 15 17:49:32.392506 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 15 17:49:32.392506 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 15 17:49:32.392506 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Sep 15 17:49:32.399739 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 497/973] 10.222.0.25 () {56 vars in 1117 bytes} [Thu Sep 15 17:49:32 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 17:49:32.401212 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b66006-f0e2-4496-b8c9-e6babffc7619 None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:49:32.408456 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611f09b7-bd1c-4a1c-b6d6-655b7e93935a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:49:32.409243 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611f09b7-bd1c-4a1c-b6d6-655b7e93935a None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:49:32.409661 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611f09b7-bd1c-4a1c-b6d6-655b7e93935a None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:49:32.409944 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611f09b7-bd1c-4a1c-b6d6-655b7e93935a None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:49:32.425879 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-611f09b7-bd1c-4a1c-b6d6-655b7e93935a None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:49:32.428809 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-611f09b7-bd1c-4a1c-b6d6-655b7e93935a None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:49:32.442136 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application [None req-611f09b7-bd1c-4a1c-b6d6-655b7e93935a None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 15 17:49:32.442136 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 17:49:32.442136 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 17:49:32.442136 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 17:49:32.442136 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 17:49:32.442136 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 17:49:32.442136 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 17:49:32.442136 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 17:49:32.442136 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 17:49:32.442136 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 17:49:32.442136 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 17:49:32.442136 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 17:49:32.442136 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 15 17:49:32.442136 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 15 17:49:32.442136 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 15 17:49:32.442136 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 15 17:49:32.443262 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 17:49:32.443262 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 17:49:32.443262 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 15 17:49:32.443262 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 15 17:49:32.443262 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 15 17:49:32.443262 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 15 17:49:32.443262 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 17:49:32.443262 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 17:49:32.443262 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 17:49:32.443262 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 17:49:32.443262 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 17:49:32.443262 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application with Lock( Sep 15 17:49:32.443262 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 17:49:32.443262 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._enter() Sep 15 17:49:32.443262 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 17:49:32.443262 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 17:49:32.443262 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 17:49:32.443262 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.creator() Sep 15 17:49:32.444215 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 17:49:32.444215 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application created_value = creator( Sep 15 17:49:32.444215 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 15 17:49:32.444215 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 15 17:49:32.444215 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 15 17:49:32.444215 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 15 17:49:32.444215 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 15 17:49:32.444215 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 15 17:49:32.444215 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 15 17:49:32.444215 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Sep 15 17:49:32.447305 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 477/974] 10.222.0.25 () {56 vars in 1099 bytes} [Thu Sep 15 17:49:32 2022] GET /identity/v3/users/cinder => generated 84 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 17:49:32.452522 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611f09b7-bd1c-4a1c-b6d6-655b7e93935a None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:49:32.524883 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b66006-f0e2-4496-b8c9-e6babffc7619 None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:49:32.561466 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5178af7b-aeba-439a-ac76-cca4cb0f254b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:49:32.562287 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5178af7b-aeba-439a-ac76-cca4cb0f254b None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:49:32.562730 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5178af7b-aeba-439a-ac76-cca4cb0f254b None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:49:32.563001 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5178af7b-aeba-439a-ac76-cca4cb0f254b None admin] PATH_INFO: `/v3/users` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:49:32.563734 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5178af7b-aeba-439a-ac76-cca4cb0f254b None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81593) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 17:49:32.564034 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5178af7b-aeba-439a-ac76-cca4cb0f254b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:49:32.565494 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5178af7b-aeba-439a-ac76-cca4cb0f254b None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:49:32.577672 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:49:32.584006 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611f09b7-bd1c-4a1c-b6d6-655b7e93935a None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:49:32.591094 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 498/975] 10.222.0.25 () {56 vars in 1149 bytes} [Thu Sep 15 17:49:32 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 17:49:32.592007 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5178af7b-aeba-439a-ac76-cca4cb0f254b None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:49:32.623845 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d749eede-3013-44c0-9d51-7a76de031a5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:49:32.625078 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d749eede-3013-44c0-9d51-7a76de031a5a None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:49:32.626161 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d749eede-3013-44c0-9d51-7a76de031a5a None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:49:32.627052 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d749eede-3013-44c0-9d51-7a76de031a5a None admin] PATH_INFO: `/v3/users` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:49:32.628239 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d749eede-3013-44c0-9d51-7a76de031a5a None admin] RBAC: Adding query filter params (name=cinder) {{(pid=81592) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 17:49:32.628763 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d749eede-3013-44c0-9d51-7a76de031a5a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:49:32.630648 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d749eede-3013-44c0-9d51-7a76de031a5a None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:49:32.654822 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:49:32.685815 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 478/976] 10.222.0.25 () {56 vars in 1101 bytes} [Thu Sep 15 17:49:32 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 17:49:32.711879 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5178af7b-aeba-439a-ac76-cca4cb0f254b None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:49:32.753708 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b1d11f-70f5-4dbf-b101-f3866cabc64c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:49:32.754336 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b1d11f-70f5-4dbf-b101-f3866cabc64c None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:49:32.754750 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b1d11f-70f5-4dbf-b101-f3866cabc64c None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:49:32.755186 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b1d11f-70f5-4dbf-b101-f3866cabc64c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:49:32.842894 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b1d11f-70f5-4dbf-b101-f3866cabc64c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:49:32.845392 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b1d11f-70f5-4dbf-b101-f3866cabc64c None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:49:32.913602 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:49:32.964406 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 499/977] 10.222.0.25 () {58 vars in 1282 bytes} [Thu Sep 15 17:49:32 2022] GET /identity/v3/auth/tokens => generated 1570 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 15 17:49:32.970896 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d749eede-3013-44c0-9d51-7a76de031a5a None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:49:33.092172 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d749eede-3013-44c0-9d51-7a76de031a5a None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:49:33.094583 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e0e588-ab6c-4811-8deb-5044fd360b3e None None] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:49:33.094810 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e0e588-ab6c-4811-8deb-5044fd360b3e None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:49:33.095080 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e0e588-ab6c-4811-8deb-5044fd360b3e None None] PATH_INFO: `/` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:49:33.096599 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 500/978] 10.222.0.25 () {54 vars in 927 bytes} [Thu Sep 15 17:49:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 17:49:33.101742 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b94c954-9afc-493c-9427-3cd3210054cd None None] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:49:33.102122 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b94c954-9afc-493c-9427-3cd3210054cd None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:49:33.102297 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b94c954-9afc-493c-9427-3cd3210054cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:49:33.125667 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.auth.core [None req-5b94c954-9afc-493c-9427-3cd3210054cd None None] MFA Rules not processed for user `5cfa58ef86774ab7800bf91930bf6028`. Rule list: `[]` (Enabled: `True`). {{(pid=81593) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 17:49:33.126940 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-5b94c954-9afc-493c-9427-3cd3210054cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 17:49:33.139748 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1641b32f-3a92-402f-8324-42b97135b78e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:49:33.140397 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1641b32f-3a92-402f-8324-42b97135b78e None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:49:33.140702 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1641b32f-3a92-402f-8324-42b97135b78e None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:49:33.141675 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1641b32f-3a92-402f-8324-42b97135b78e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:49:33.152415 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1641b32f-3a92-402f-8324-42b97135b78e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:49:33.153925 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1641b32f-3a92-402f-8324-42b97135b78e None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:49:33.169667 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application [None req-1641b32f-3a92-402f-8324-42b97135b78e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 17:49:33.169667 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 17:49:33.169667 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 17:49:33.169667 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 17:49:33.169667 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 17:49:33.169667 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 17:49:33.169667 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 17:49:33.169667 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 17:49:33.169667 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 17:49:33.169667 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 17:49:33.169667 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 17:49:33.169667 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 17:49:33.169667 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 15 17:49:33.169667 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 15 17:49:33.169667 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 15 17:49:33.169667 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 15 17:49:33.170685 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 17:49:33.170685 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 17:49:33.170685 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 17:49:33.170685 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 17:49:33.170685 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 17:49:33.170685 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 17:49:33.170685 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 17:49:33.170685 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application with Lock( Sep 15 17:49:33.170685 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 17:49:33.170685 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._enter() Sep 15 17:49:33.170685 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 17:49:33.170685 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 17:49:33.170685 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 17:49:33.170685 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.creator() Sep 15 17:49:33.170685 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 17:49:33.170685 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application created_value = creator( Sep 15 17:49:33.170685 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 15 17:49:33.176995 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 15 17:49:33.176995 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 17:49:33.176995 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Sep 15 17:49:33.176995 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 479/979] 10.222.0.25 () {56 vars in 1108 bytes} [Thu Sep 15 17:49:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 17:49:33.176995 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1641b32f-3a92-402f-8324-42b97135b78e None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:49:33.188927 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:49:33.204930 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 501/980] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Sep 15 17:49:33 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 15 17:49:33.292866 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1641b32f-3a92-402f-8324-42b97135b78e None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:49:33.327657 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f76c0c-a430-4a32-84a6-54e2b2fcafe0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:49:33.327997 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f76c0c-a430-4a32-84a6-54e2b2fcafe0 None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:49:33.328169 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f76c0c-a430-4a32-84a6-54e2b2fcafe0 None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:49:33.328953 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f76c0c-a430-4a32-84a6-54e2b2fcafe0 None admin] PATH_INFO: `/v3/domains` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:49:33.329629 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f76c0c-a430-4a32-84a6-54e2b2fcafe0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81592) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 17:49:33.329929 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f76c0c-a430-4a32-84a6-54e2b2fcafe0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:49:33.331279 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f76c0c-a430-4a32-84a6-54e2b2fcafe0 None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:49:33.343399 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 480/981] 10.222.0.25 () {56 vars in 1109 bytes} [Thu Sep 15 17:49:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 17:49:33.349741 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b94c954-9afc-493c-9427-3cd3210054cd None None] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:49:33.372276 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ef5144-b6c8-46d6-b2a4-752d050396d6 None None] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:49:33.372567 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ef5144-b6c8-46d6-b2a4-752d050396d6 None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:49:33.372850 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ef5144-b6c8-46d6-b2a4-752d050396d6 None None] PATH_INFO: `/` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:49:33.374267 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 481/982] 10.222.0.25 () {54 vars in 927 bytes} [Thu Sep 15 17:49:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 15 17:49:33.379272 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9352ca86-eba9-47ed-be4e-8a6d028dde16 None None] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:49:33.379614 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9352ca86-eba9-47ed-be4e-8a6d028dde16 None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:49:33.379919 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9352ca86-eba9-47ed-be4e-8a6d028dde16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:49:33.399130 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.auth.core [None req-9352ca86-eba9-47ed-be4e-8a6d028dde16 None None] MFA Rules not processed for user `5cfa58ef86774ab7800bf91930bf6028`. Rule list: `[]` (Enabled: `True`). {{(pid=81592) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 17:49:33.400634 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-9352ca86-eba9-47ed-be4e-8a6d028dde16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 17:49:33.446725 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:49:33.464878 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b94c954-9afc-493c-9427-3cd3210054cd None None] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:49:33.474101 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:49:33.485566 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 482/983] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Sep 15 17:49:33 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 15 17:49:33.487072 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9352ca86-eba9-47ed-be4e-8a6d028dde16 None None] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:49:33.502401 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a7e60b-d609-490f-9594-0667ed1d1d78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:49:33.503034 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a7e60b-d609-490f-9594-0667ed1d1d78 None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:49:33.503312 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a7e60b-d609-490f-9594-0667ed1d1d78 None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:49:33.503585 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a7e60b-d609-490f-9594-0667ed1d1d78 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:49:33.510324 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a7e60b-d609-490f-9594-0667ed1d1d78 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:49:33.511901 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a7e60b-d609-490f-9594-0667ed1d1d78 None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:49:33.525277 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application [None req-e0a7e60b-d609-490f-9594-0667ed1d1d78 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 15 17:49:33.525277 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 17:49:33.525277 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 17:49:33.525277 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 17:49:33.525277 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 17:49:33.525277 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 17:49:33.525277 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 17:49:33.525277 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 17:49:33.525277 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 17:49:33.525277 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 17:49:33.525277 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 17:49:33.525277 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 17:49:33.525277 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 15 17:49:33.525277 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 15 17:49:33.525277 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 15 17:49:33.526782 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 15 17:49:33.526782 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 17:49:33.526782 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 17:49:33.526782 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 17:49:33.526782 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 17:49:33.526782 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 17:49:33.526782 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 17:49:33.526782 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 17:49:33.526782 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application with Lock( Sep 15 17:49:33.526782 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 17:49:33.526782 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._enter() Sep 15 17:49:33.526782 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 17:49:33.526782 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 17:49:33.526782 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 17:49:33.526782 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.creator() Sep 15 17:49:33.526782 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 17:49:33.526782 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application created_value = creator( Sep 15 17:49:33.527668 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 15 17:49:33.527668 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 15 17:49:33.527668 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 15 17:49:33.527668 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 15 17:49:33.527668 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 15 17:49:33.527668 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 15 17:49:33.527668 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 15 17:49:33.527668 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Sep 15 17:49:33.527668 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 502/984] 10.222.0.25 () {56 vars in 1111 bytes} [Thu Sep 15 17:49:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 17:49:33.532578 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a7e60b-d609-490f-9594-0667ed1d1d78 None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:49:33.605677 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9352ca86-eba9-47ed-be4e-8a6d028dde16 None None] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:49:33.639703 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a7e60b-d609-490f-9594-0667ed1d1d78 None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:49:33.646873 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6ac63d-957e-4dce-b1c1-521180f76541 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:49:33.647840 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6ac63d-957e-4dce-b1c1-521180f76541 None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:49:33.648371 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6ac63d-957e-4dce-b1c1-521180f76541 None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:49:33.648851 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6ac63d-957e-4dce-b1c1-521180f76541 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:49:33.649839 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6ac63d-957e-4dce-b1c1-521180f76541 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:49:33.651515 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6ac63d-957e-4dce-b1c1-521180f76541 None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:49:33.662508 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application [None req-9f6ac63d-957e-4dce-b1c1-521180f76541 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 15 17:49:33.662508 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 17:49:33.662508 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 15 17:49:33.662508 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 15 17:49:33.662508 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 15 17:49:33.662508 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 15 17:49:33.662508 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 15 17:49:33.662508 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 15 17:49:33.662508 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 15 17:49:33.662508 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Sep 15 17:49:33.662508 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 15 17:49:33.662508 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Sep 15 17:49:33.662508 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 17:49:33.662508 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 17:49:33.662508 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 17:49:33.662508 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 17:49:33.662508 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 17:49:33.663515 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 17:49:33.663515 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 17:49:33.663515 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 17:49:33.663515 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 17:49:33.663515 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 17:49:33.663515 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 17:49:33.663515 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 15 17:49:33.663515 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 15 17:49:33.663515 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 15 17:49:33.663515 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 15 17:49:33.663515 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 17:49:33.663515 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 17:49:33.663515 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 17:49:33.663515 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 17:49:33.663515 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 17:49:33.663515 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 17:49:33.666351 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 17:49:33.666351 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application with Lock( Sep 15 17:49:33.666351 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 17:49:33.666351 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._enter() Sep 15 17:49:33.666351 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 17:49:33.666351 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 17:49:33.666351 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 17:49:33.666351 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.creator() Sep 15 17:49:33.666351 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 17:49:33.666351 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application created_value = creator( Sep 15 17:49:33.666351 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 15 17:49:33.666351 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 15 17:49:33.666351 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 15 17:49:33.666351 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Sep 15 17:49:33.666351 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 483/985] 10.222.0.25 () {56 vars in 1126 bytes} [Thu Sep 15 17:49:33 2022] GET /identity/v3/services/object-store => generated 93 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 15 17:49:33.669775 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6ac63d-957e-4dce-b1c1-521180f76541 None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:49:33.678368 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1874c570-7918-4393-a64d-bac70c014ffe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:49:33.679055 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1874c570-7918-4393-a64d-bac70c014ffe None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:49:33.679399 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1874c570-7918-4393-a64d-bac70c014ffe None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:49:33.679744 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1874c570-7918-4393-a64d-bac70c014ffe None admin] PATH_INFO: `/v3/projects` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:49:33.680501 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1874c570-7918-4393-a64d-bac70c014ffe None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81593) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 17:49:33.680885 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1874c570-7918-4393-a64d-bac70c014ffe None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:49:33.682424 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1874c570-7918-4393-a64d-bac70c014ffe None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:49:33.694304 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 503/986] 10.222.0.25 () {56 vars in 1148 bytes} [Thu Sep 15 17:49:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 17:49:33.700512 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1874c570-7918-4393-a64d-bac70c014ffe None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:49:33.710289 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:49:33.744180 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:49:33.806367 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6ac63d-957e-4dce-b1c1-521180f76541 None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:49:33.829483 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1874c570-7918-4393-a64d-bac70c014ffe None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:49:33.842348 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2dd219-8729-46a3-a2c1-6947bf2f9ea6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:49:33.842953 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2dd219-8729-46a3-a2c1-6947bf2f9ea6 None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:49:33.843232 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2dd219-8729-46a3-a2c1-6947bf2f9ea6 None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:49:33.843505 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2dd219-8729-46a3-a2c1-6947bf2f9ea6 None admin] PATH_INFO: `/v3/services` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:49:33.844729 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c2dd219-8729-46a3-a2c1-6947bf2f9ea6 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81592) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 17:49:33.845026 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c2dd219-8729-46a3-a2c1-6947bf2f9ea6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:49:33.846408 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c2dd219-8729-46a3-a2c1-6947bf2f9ea6 None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:49:33.851397 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 484/987] 10.222.0.25 () {56 vars in 1122 bytes} [Thu Sep 15 17:49:33 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 17:49:33.851397 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2dd219-8729-46a3-a2c1-6947bf2f9ea6 None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:49:33.867877 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a0564e-cd8a-4a46-8293-1afe8926b472 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:49:33.868410 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a0564e-cd8a-4a46-8293-1afe8926b472 None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:49:33.868687 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a0564e-cd8a-4a46-8293-1afe8926b472 None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:49:33.868957 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a0564e-cd8a-4a46-8293-1afe8926b472 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:49:33.869714 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a0564e-cd8a-4a46-8293-1afe8926b472 None admin] RBAC: Adding query filter params (role.id=99a6f32f74a84d0989c7527d9985370e, scope.project.id=1213c0d1b584404ba3998e136f166e89, user.id=d899ec4fcbeb4de382c7f0a779ca8ed5) {{(pid=81593) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 17:49:33.870023 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a0564e-cd8a-4a46-8293-1afe8926b472 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:49:33.871460 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a0564e-cd8a-4a46-8293-1afe8926b472 None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:49:33.877335 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 504/988] 10.222.0.25 () {56 vars in 1374 bytes} [Thu Sep 15 17:49:33 2022] GET /identity/v3/role_assignments?user.id=d899ec4fcbeb4de382c7f0a779ca8ed5&scope.project.id=1213c0d1b584404ba3998e136f166e89&role.id=99a6f32f74a84d0989c7527d9985370e => generated 608 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 17:49:33.879173 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a0564e-cd8a-4a46-8293-1afe8926b472 None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:49:33.970114 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2dd219-8729-46a3-a2c1-6947bf2f9ea6 None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:49:33.976187 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:49:33.999439 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:49:34.011305 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6e9d94-66ec-45fd-b890-b01f03ceee74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:49:34.011962 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6e9d94-66ec-45fd-b890-b01f03ceee74 None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:49:34.012242 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6e9d94-66ec-45fd-b890-b01f03ceee74 None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:49:34.012523 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6e9d94-66ec-45fd-b890-b01f03ceee74 None admin] PATH_INFO: `/v3/services/compute` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:49:34.013078 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a0564e-cd8a-4a46-8293-1afe8926b472 None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:49:34.013191 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c6e9d94-66ec-45fd-b890-b01f03ceee74 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:49:34.014521 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c6e9d94-66ec-45fd-b890-b01f03ceee74 None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:49:34.024464 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application [None req-8c6e9d94-66ec-45fd-b890-b01f03ceee74 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Sep 15 17:49:34.024464 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 17:49:34.024464 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 15 17:49:34.024464 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 15 17:49:34.024464 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 15 17:49:34.024464 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 15 17:49:34.024464 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 15 17:49:34.024464 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 15 17:49:34.024464 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 15 17:49:34.024464 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Sep 15 17:49:34.024464 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 15 17:49:34.024464 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Sep 15 17:49:34.024464 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 17:49:34.024464 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 17:49:34.024464 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 17:49:34.024464 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 17:49:34.024464 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 17:49:34.025592 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 17:49:34.025592 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 17:49:34.025592 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 17:49:34.025592 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 17:49:34.025592 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 17:49:34.025592 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 17:49:34.025592 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 15 17:49:34.025592 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 15 17:49:34.025592 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 15 17:49:34.025592 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 15 17:49:34.025592 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 17:49:34.025592 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 17:49:34.025592 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 17:49:34.025592 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 17:49:34.025592 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 17:49:34.025592 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 17:49:34.027070 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 17:49:34.027070 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application with Lock( Sep 15 17:49:34.027070 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 17:49:34.027070 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._enter() Sep 15 17:49:34.027070 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 17:49:34.027070 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 17:49:34.027070 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 17:49:34.027070 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.creator() Sep 15 17:49:34.027070 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 17:49:34.027070 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application created_value = creator( Sep 15 17:49:34.027070 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 15 17:49:34.027070 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 15 17:49:34.027070 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 15 17:49:34.027070 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Sep 15 17:49:34.027070 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 485/989] 10.222.0.25 () {56 vars in 1111 bytes} [Thu Sep 15 17:49:33 2022] GET /identity/v3/services/compute => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 17:49:34.032448 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6e9d94-66ec-45fd-b890-b01f03ceee74 None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:49:34.057099 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79aa6991-ed31-4302-b4b9-1b4a38b511b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:49:34.057099 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79aa6991-ed31-4302-b4b9-1b4a38b511b0 None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:49:34.057099 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79aa6991-ed31-4302-b4b9-1b4a38b511b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:49:34.058399 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79aa6991-ed31-4302-b4b9-1b4a38b511b0 None admin] PATH_INFO: `/v3/services` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:49:34.059395 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79aa6991-ed31-4302-b4b9-1b4a38b511b0 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81593) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 17:49:34.059711 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79aa6991-ed31-4302-b4b9-1b4a38b511b0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:49:34.061153 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79aa6991-ed31-4302-b4b9-1b4a38b511b0 None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:49:34.069158 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 505/990] 10.222.0.25 () {56 vars in 1122 bytes} [Thu Sep 15 17:49:33 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 17:49:34.077942 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79aa6991-ed31-4302-b4b9-1b4a38b511b0 None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:49:34.175167 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6e9d94-66ec-45fd-b890-b01f03ceee74 None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:49:34.199710 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79aa6991-ed31-4302-b4b9-1b4a38b511b0 None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:49:34.213438 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a42e7e-8e11-4da1-9b12-ebda65b60bb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:49:34.214065 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a42e7e-8e11-4da1-9b12-ebda65b60bb5 None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:49:34.214362 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a42e7e-8e11-4da1-9b12-ebda65b60bb5 None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:49:34.214631 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a42e7e-8e11-4da1-9b12-ebda65b60bb5 None admin] PATH_INFO: `/v3/services` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:49:34.215274 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a42e7e-8e11-4da1-9b12-ebda65b60bb5 None admin] RBAC: Adding query filter params (name=compute) {{(pid=81592) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 17:49:34.215578 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a42e7e-8e11-4da1-9b12-ebda65b60bb5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:49:34.216976 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a42e7e-8e11-4da1-9b12-ebda65b60bb5 None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:49:34.228060 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 486/991] 10.222.0.25 () {56 vars in 1112 bytes} [Thu Sep 15 17:49:34 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 17:49:34.229166 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a42e7e-8e11-4da1-9b12-ebda65b60bb5 None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:49:34.240398 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14271fc7-b7ce-4ddc-958a-3a5f427d2856 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:49:34.241011 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14271fc7-b7ce-4ddc-958a-3a5f427d2856 None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:49:34.241289 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14271fc7-b7ce-4ddc-958a-3a5f427d2856 None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:49:34.241582 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14271fc7-b7ce-4ddc-958a-3a5f427d2856 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:49:34.242287 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14271fc7-b7ce-4ddc-958a-3a5f427d2856 None admin] RBAC: Adding query filter params (interface=admin, service_id=1b89b146122d4f9783daf5a5ee8d60a5, region_id=RegionOne) {{(pid=81593) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 17:49:34.242593 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14271fc7-b7ce-4ddc-958a-3a5f427d2856 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:49:34.243956 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14271fc7-b7ce-4ddc-958a-3a5f427d2856 None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:49:34.245541 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:49:34.255316 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 506/992] 10.222.0.25 () {56 vars in 1249 bytes} [Thu Sep 15 17:49:34 2022] GET /identity/v3/endpoints?service_id=1b89b146122d4f9783daf5a5ee8d60a5&interface=admin®ion_id=RegionOne => generated 193 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 17:49:34.256220 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14271fc7-b7ce-4ddc-958a-3a5f427d2856 None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:49:34.294581 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:49:34.348631 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a42e7e-8e11-4da1-9b12-ebda65b60bb5 None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:49:34.367446 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14271fc7-b7ce-4ddc-958a-3a5f427d2856 None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:49:34.385448 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d460bd4-485e-43c4-82c2-66714b88445d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:49:34.386055 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d460bd4-485e-43c4-82c2-66714b88445d None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:49:34.386331 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d460bd4-485e-43c4-82c2-66714b88445d None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:49:34.386599 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d460bd4-485e-43c4-82c2-66714b88445d None admin] PATH_INFO: `/v3/services` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:49:34.387221 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d460bd4-485e-43c4-82c2-66714b88445d None admin] RBAC: Adding query filter params (type=compute) {{(pid=81592) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 17:49:34.387516 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d460bd4-485e-43c4-82c2-66714b88445d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:49:34.388871 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d460bd4-485e-43c4-82c2-66714b88445d None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:49:34.394409 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 487/993] 10.222.0.25 () {56 vars in 1112 bytes} [Thu Sep 15 17:49:34 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 17:49:34.400246 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d460bd4-485e-43c4-82c2-66714b88445d None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:49:34.408518 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d905857-5ab9-4828-8f03-29b65f288045 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:49:34.409134 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d905857-5ab9-4828-8f03-29b65f288045 None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:49:34.409448 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d905857-5ab9-4828-8f03-29b65f288045 None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:49:34.409780 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d905857-5ab9-4828-8f03-29b65f288045 None admin] PATH_INFO: `/v3/services` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:49:34.410426 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d905857-5ab9-4828-8f03-29b65f288045 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:49:34.412037 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d905857-5ab9-4828-8f03-29b65f288045 None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:49:34.419410 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 507/994] 10.222.0.25 () {56 vars in 1087 bytes} [Thu Sep 15 17:49:34 2022] GET /identity/v3/services => generated 1727 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 17:49:34.531105 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d460bd4-485e-43c4-82c2-66714b88445d None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:49:34.551815 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:49:34.576765 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a44351b-8ba4-4487-87d1-309318bac2d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:49:34.577489 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a44351b-8ba4-4487-87d1-309318bac2d9 None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:49:34.577775 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a44351b-8ba4-4487-87d1-309318bac2d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:49:34.578049 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a44351b-8ba4-4487-87d1-309318bac2d9 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:49:34.579331 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a44351b-8ba4-4487-87d1-309318bac2d9 None admin] RBAC: Adding query filter params (interface=public, service_id=7428be770bd142a58dc2b9209dd397d8, region_id=RegionOne) {{(pid=81592) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 17:49:34.579666 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a44351b-8ba4-4487-87d1-309318bac2d9 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:49:34.581123 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a44351b-8ba4-4487-87d1-309318bac2d9 None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:49:34.594301 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 488/995] 10.222.0.25 () {56 vars in 1251 bytes} [Thu Sep 15 17:49:34 2022] GET /identity/v3/endpoints?service_id=7428be770bd142a58dc2b9209dd397d8&interface=public®ion_id=RegionOne => generated 194 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 17:49:34.594507 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d905857-5ab9-4828-8f03-29b65f288045 None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:49:34.667389 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:49:34.710765 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d905857-5ab9-4828-8f03-29b65f288045 None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:49:34.748451 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150b4293-065e-484b-8f09-d1d3179e608d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:49:34.749064 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150b4293-065e-484b-8f09-d1d3179e608d None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:49:34.749369 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150b4293-065e-484b-8f09-d1d3179e608d None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:49:34.749642 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150b4293-065e-484b-8f09-d1d3179e608d None admin] PATH_INFO: `/v3/services` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:49:34.750399 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150b4293-065e-484b-8f09-d1d3179e608d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:49:34.751766 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150b4293-065e-484b-8f09-d1d3179e608d None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:49:34.758407 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 508/996] 10.222.0.25 () {56 vars in 1087 bytes} [Thu Sep 15 17:49:34 2022] GET /identity/v3/services => generated 1727 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 17:49:36.111922 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3e949e-f9c6-464b-bc3c-d78ceba86c2d None None] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:49:36.112468 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3e949e-f9c6-464b-bc3c-d78ceba86c2d None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:49:36.112468 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3e949e-f9c6-464b-bc3c-d78ceba86c2d None None] PATH_INFO: `/` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:49:36.113853 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 489/997] 10.222.0.25 () {54 vars in 927 bytes} [Thu Sep 15 17:49:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 17:49:36.119331 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d26b608-9660-4c26-9c29-46b6ff8cbe77 None None] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:49:36.119780 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d26b608-9660-4c26-9c29-46b6ff8cbe77 None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:49:36.120067 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d26b608-9660-4c26-9c29-46b6ff8cbe77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:49:36.138706 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.auth.core [None req-0d26b608-9660-4c26-9c29-46b6ff8cbe77 None None] MFA Rules not processed for user `5cfa58ef86774ab7800bf91930bf6028`. Rule list: `[]` (Enabled: `True`). {{(pid=81593) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 17:49:36.139885 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-0d26b608-9660-4c26-9c29-46b6ff8cbe77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 17:49:36.210194 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 509/998] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Sep 15 17:49:36 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 15 17:49:36.487844 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3e949e-f9c6-464b-bc3c-d78ceba86c2d None None] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:49:36.605309 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3e949e-f9c6-464b-bc3c-d78ceba86c2d None None] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:49:36.636745 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af3b0d1-f674-46e4-acb7-d6643bdb9697 None None] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:49:36.637033 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af3b0d1-f674-46e4-acb7-d6643bdb9697 None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:49:36.637321 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af3b0d1-f674-46e4-acb7-d6643bdb9697 None None] PATH_INFO: `/` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:49:36.638806 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 510/999] 10.222.0.25 () {54 vars in 927 bytes} [Thu Sep 15 17:49:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 15 17:49:36.641498 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c327607d-f295-4e2c-bf25-d28b135b26b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:49:36.642265 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c327607d-f295-4e2c-bf25-d28b135b26b9 None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:49:36.642478 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c327607d-f295-4e2c-bf25-d28b135b26b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:49:36.642750 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c327607d-f295-4e2c-bf25-d28b135b26b9 None admin] PATH_INFO: `/v3/services/image` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:49:36.643337 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c327607d-f295-4e2c-bf25-d28b135b26b9 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:49:36.643878 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419ef4bf-8c06-4d20-97de-d9442d7904cc None None] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:49:36.644222 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419ef4bf-8c06-4d20-97de-d9442d7904cc None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:49:36.644574 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419ef4bf-8c06-4d20-97de-d9442d7904cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:49:36.644706 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c327607d-f295-4e2c-bf25-d28b135b26b9 None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:49:36.653701 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application [None req-c327607d-f295-4e2c-bf25-d28b135b26b9 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Sep 15 17:49:36.653701 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 17:49:36.653701 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 15 17:49:36.653701 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 15 17:49:36.653701 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 15 17:49:36.653701 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 15 17:49:36.653701 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 15 17:49:36.653701 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 15 17:49:36.653701 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 15 17:49:36.653701 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Sep 15 17:49:36.653701 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 15 17:49:36.653701 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Sep 15 17:49:36.653701 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 17:49:36.653701 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 17:49:36.653701 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 17:49:36.653701 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 17:49:36.653701 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 17:49:36.654784 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 17:49:36.654784 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 17:49:36.654784 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 17:49:36.654784 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 17:49:36.654784 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 17:49:36.654784 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 17:49:36.654784 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 15 17:49:36.654784 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 15 17:49:36.654784 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 15 17:49:36.654784 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 15 17:49:36.654784 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 17:49:36.654784 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 17:49:36.654784 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 17:49:36.654784 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 17:49:36.654784 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 17:49:36.654784 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 17:49:36.658399 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 17:49:36.658399 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application with Lock( Sep 15 17:49:36.658399 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 17:49:36.658399 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._enter() Sep 15 17:49:36.658399 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 17:49:36.658399 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 17:49:36.658399 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 17:49:36.658399 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.creator() Sep 15 17:49:36.658399 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 17:49:36.658399 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application created_value = creator( Sep 15 17:49:36.658399 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 15 17:49:36.658399 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 15 17:49:36.658399 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 15 17:49:36.658399 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Sep 15 17:49:36.658399 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 490/1000] 10.222.0.25 () {56 vars in 1105 bytes} [Thu Sep 15 17:49:36 2022] GET /identity/v3/services/image => generated 86 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 17:49:36.661080 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c327607d-f295-4e2c-bf25-d28b135b26b9 None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:49:36.664187 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.auth.core [None req-419ef4bf-8c06-4d20-97de-d9442d7904cc None None] MFA Rules not processed for user `5cfa58ef86774ab7800bf91930bf6028`. Rule list: `[]` (Enabled: `True`). {{(pid=81593) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 17:49:36.665393 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-419ef4bf-8c06-4d20-97de-d9442d7904cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 17:49:36.711342 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:49:36.722526 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:49:36.740726 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 511/1001] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Sep 15 17:49:36 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 15 17:49:36.773320 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c327607d-f295-4e2c-bf25-d28b135b26b9 None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:49:36.808820 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796dd335-7c09-47e1-8b0c-30525f0cd006 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:49:36.809453 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796dd335-7c09-47e1-8b0c-30525f0cd006 None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:49:36.809730 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796dd335-7c09-47e1-8b0c-30525f0cd006 None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:49:36.809998 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796dd335-7c09-47e1-8b0c-30525f0cd006 None admin] PATH_INFO: `/v3/services` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:49:36.810623 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796dd335-7c09-47e1-8b0c-30525f0cd006 None admin] RBAC: Adding query filter params (name=image) {{(pid=81592) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 17:49:36.810920 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796dd335-7c09-47e1-8b0c-30525f0cd006 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:49:36.812265 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796dd335-7c09-47e1-8b0c-30525f0cd006 None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:49:36.822085 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 491/1002] 10.222.0.25 () {56 vars in 1108 bytes} [Thu Sep 15 17:49:36 2022] GET /identity/v3/services?name=image => generated 122 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 17:49:36.823290 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419ef4bf-8c06-4d20-97de-d9442d7904cc None None] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:49:36.952461 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419ef4bf-8c06-4d20-97de-d9442d7904cc None None] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:49:36.977455 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a20678-005e-4f30-a32b-40366bf8e59d None None] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:49:36.977744 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a20678-005e-4f30-a32b-40366bf8e59d None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:49:36.978058 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a20678-005e-4f30-a32b-40366bf8e59d None None] PATH_INFO: `/` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:49:36.979568 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 492/1003] 10.222.0.25 () {54 vars in 927 bytes} [Thu Sep 15 17:49:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 15 17:49:36.984422 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa0fc5e-d1a5-4726-b23d-4ec455da86b5 None None] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:49:36.984706 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa0fc5e-d1a5-4726-b23d-4ec455da86b5 None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:49:36.984985 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa0fc5e-d1a5-4726-b23d-4ec455da86b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:49:36.988810 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee4d976-6bb7-4983-be1e-5a79ac20af7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:49:36.989455 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee4d976-6bb7-4983-be1e-5a79ac20af7f None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:49:36.989733 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee4d976-6bb7-4983-be1e-5a79ac20af7f None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:49:36.990003 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee4d976-6bb7-4983-be1e-5a79ac20af7f None admin] PATH_INFO: `/v3/services` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:49:36.990632 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee4d976-6bb7-4983-be1e-5a79ac20af7f None admin] RBAC: Adding query filter params (type=image) {{(pid=81593) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 17:49:36.990985 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee4d976-6bb7-4983-be1e-5a79ac20af7f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:49:36.992295 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee4d976-6bb7-4983-be1e-5a79ac20af7f None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:49:36.996999 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 512/1004] 10.222.0.25 () {56 vars in 1108 bytes} [Thu Sep 15 17:49:36 2022] GET /identity/v3/services?type=image => generated 122 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 17:49:37.003543 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.auth.core [None req-daa0fc5e-d1a5-4726-b23d-4ec455da86b5 None None] MFA Rules not processed for user `5cfa58ef86774ab7800bf91930bf6028`. Rule list: `[]` (Enabled: `True`). {{(pid=81592) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 17:49:37.004944 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-daa0fc5e-d1a5-4726-b23d-4ec455da86b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 17:49:37.033906 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee4d976-6bb7-4983-be1e-5a79ac20af7f None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:49:37.086750 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 493/1005] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Sep 15 17:49:36 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 15 17:49:37.100331 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:49:37.158421 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee4d976-6bb7-4983-be1e-5a79ac20af7f None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:49:37.196018 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6ac938-739a-4055-9e86-2c71b1677b49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:49:37.196655 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6ac938-739a-4055-9e86-2c71b1677b49 None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:49:37.196930 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6ac938-739a-4055-9e86-2c71b1677b49 None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:49:37.197199 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6ac938-739a-4055-9e86-2c71b1677b49 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:49:37.197806 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6ac938-739a-4055-9e86-2c71b1677b49 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:49:37.199170 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6ac938-739a-4055-9e86-2c71b1677b49 None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:49:37.208748 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application [None req-6a6ac938-739a-4055-9e86-2c71b1677b49 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 15 17:49:37.208748 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 17:49:37.208748 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 15 17:49:37.208748 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 15 17:49:37.208748 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 15 17:49:37.208748 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 15 17:49:37.208748 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 15 17:49:37.208748 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 15 17:49:37.208748 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 15 17:49:37.208748 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Sep 15 17:49:37.208748 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 15 17:49:37.208748 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Sep 15 17:49:37.208748 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 17:49:37.208748 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 17:49:37.208748 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 17:49:37.208748 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 17:49:37.208748 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 17:49:37.209854 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 17:49:37.209854 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 17:49:37.209854 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 17:49:37.209854 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 17:49:37.209854 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 17:49:37.209854 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 17:49:37.209854 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 15 17:49:37.209854 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 15 17:49:37.209854 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 15 17:49:37.209854 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 15 17:49:37.209854 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 17:49:37.209854 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 17:49:37.209854 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 17:49:37.209854 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 17:49:37.209854 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 17:49:37.209854 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 17:49:37.210702 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 17:49:37.210702 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application with Lock( Sep 15 17:49:37.210702 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 17:49:37.210702 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._enter() Sep 15 17:49:37.210702 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 17:49:37.210702 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 17:49:37.210702 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 17:49:37.210702 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.creator() Sep 15 17:49:37.210702 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 17:49:37.210702 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application created_value = creator( Sep 15 17:49:37.210702 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 15 17:49:37.210702 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 15 17:49:37.210702 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 15 17:49:37.210702 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Sep 15 17:49:37.210702 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 513/1006] 10.222.0.25 () {56 vars in 1126 bytes} [Thu Sep 15 17:49:37 2022] GET /identity/v3/services/object-store => generated 93 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 15 17:49:37.217947 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa0fc5e-d1a5-4726-b23d-4ec455da86b5 None None] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:49:37.266904 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:49:37.327959 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa0fc5e-d1a5-4726-b23d-4ec455da86b5 None None] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:49:37.360071 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6ac938-739a-4055-9e86-2c71b1677b49 None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:49:37.364339 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928478d7-f404-4502-83bb-f12a01500910 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:49:37.364956 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928478d7-f404-4502-83bb-f12a01500910 None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:49:37.365305 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928478d7-f404-4502-83bb-f12a01500910 None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:49:37.365593 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928478d7-f404-4502-83bb-f12a01500910 None admin] PATH_INFO: `/v3/services` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:49:37.366286 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-928478d7-f404-4502-83bb-f12a01500910 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81592) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 17:49:37.366591 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-928478d7-f404-4502-83bb-f12a01500910 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:49:37.368081 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-928478d7-f404-4502-83bb-f12a01500910 None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:49:37.373632 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 494/1007] 10.222.0.25 () {56 vars in 1122 bytes} [Thu Sep 15 17:49:37 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 17:49:37.379786 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928478d7-f404-4502-83bb-f12a01500910 None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:49:37.471899 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6ac938-739a-4055-9e86-2c71b1677b49 None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:49:37.487368 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928478d7-f404-4502-83bb-f12a01500910 None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:49:37.488094 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:49:37.503328 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:49:37.529113 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74812de-b516-4fdd-a9de-434ea43dbe2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:49:37.530071 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74812de-b516-4fdd-a9de-434ea43dbe2e None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:49:37.530543 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74812de-b516-4fdd-a9de-434ea43dbe2e None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:49:37.530743 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9411f7f3-5639-4302-80c3-ab8dbce2fb64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:49:37.531172 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74812de-b516-4fdd-a9de-434ea43dbe2e None admin] PATH_INFO: `/v3/services/compute` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:49:37.531387 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9411f7f3-5639-4302-80c3-ab8dbce2fb64 None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:49:37.531673 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9411f7f3-5639-4302-80c3-ab8dbce2fb64 None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:49:37.531949 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9411f7f3-5639-4302-80c3-ab8dbce2fb64 None admin] PATH_INFO: `/v3/services` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:49:37.532498 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74812de-b516-4fdd-a9de-434ea43dbe2e None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:49:37.532600 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9411f7f3-5639-4302-80c3-ab8dbce2fb64 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81592) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 17:49:37.532913 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9411f7f3-5639-4302-80c3-ab8dbce2fb64 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:49:37.534371 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74812de-b516-4fdd-a9de-434ea43dbe2e None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:49:37.534498 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9411f7f3-5639-4302-80c3-ab8dbce2fb64 None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:49:37.539944 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 495/1008] 10.222.0.25 () {56 vars in 1122 bytes} [Thu Sep 15 17:49:37 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 17:49:37.545175 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9411f7f3-5639-4302-80c3-ab8dbce2fb64 None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:49:37.550870 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application [None req-d74812de-b516-4fdd-a9de-434ea43dbe2e None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Sep 15 17:49:37.550870 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 17:49:37.550870 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 15 17:49:37.550870 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 15 17:49:37.550870 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 15 17:49:37.550870 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 15 17:49:37.550870 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 15 17:49:37.550870 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 15 17:49:37.550870 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 15 17:49:37.550870 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Sep 15 17:49:37.550870 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 15 17:49:37.550870 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Sep 15 17:49:37.550870 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 17:49:37.550870 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 17:49:37.550870 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 17:49:37.550870 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 17:49:37.550870 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 17:49:37.551878 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 17:49:37.551878 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 17:49:37.551878 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 17:49:37.551878 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 17:49:37.551878 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 17:49:37.551878 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 17:49:37.551878 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 15 17:49:37.551878 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 15 17:49:37.551878 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 15 17:49:37.551878 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 15 17:49:37.551878 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 17:49:37.551878 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 17:49:37.551878 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 17:49:37.551878 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 17:49:37.551878 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 17:49:37.551878 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 17:49:37.552716 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 17:49:37.552716 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application with Lock( Sep 15 17:49:37.552716 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 17:49:37.552716 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._enter() Sep 15 17:49:37.552716 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 17:49:37.552716 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 17:49:37.552716 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 17:49:37.552716 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.creator() Sep 15 17:49:37.552716 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 17:49:37.552716 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application created_value = creator( Sep 15 17:49:37.552716 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 15 17:49:37.552716 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 15 17:49:37.552716 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 15 17:49:37.552716 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Sep 15 17:49:37.552716 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 514/1009] 10.222.0.25 () {56 vars in 1111 bytes} [Thu Sep 15 17:49:37 2022] GET /identity/v3/services/compute => generated 88 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 17:49:37.557709 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74812de-b516-4fdd-a9de-434ea43dbe2e None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:49:37.670194 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9411f7f3-5639-4302-80c3-ab8dbce2fb64 None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:49:37.678364 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74812de-b516-4fdd-a9de-434ea43dbe2e None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:49:37.709620 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc67051-32b6-4574-a077-0eb6e1ef82a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:49:37.710248 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc67051-32b6-4574-a077-0eb6e1ef82a0 None admin] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:49:37.710532 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc67051-32b6-4574-a077-0eb6e1ef82a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:49:37.710807 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc67051-32b6-4574-a077-0eb6e1ef82a0 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:49:37.711480 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc67051-32b6-4574-a077-0eb6e1ef82a0 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:49:37.712881 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc67051-32b6-4574-a077-0eb6e1ef82a0 None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:49:37.721468 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3446cdf0-8332-48a4-8655-8036ee501058 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:49:37.722221 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3446cdf0-8332-48a4-8655-8036ee501058 None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:49:37.722532 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3446cdf0-8332-48a4-8655-8036ee501058 None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:49:37.722830 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3446cdf0-8332-48a4-8655-8036ee501058 None admin] PATH_INFO: `/v3/services` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:49:37.724284 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3446cdf0-8332-48a4-8655-8036ee501058 None admin] RBAC: Adding query filter params (name=compute) {{(pid=81593) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 17:49:37.724284 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3446cdf0-8332-48a4-8655-8036ee501058 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:49:37.725561 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3446cdf0-8332-48a4-8655-8036ee501058 None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:49:37.731411 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 515/1010] 10.222.0.25 () {56 vars in 1112 bytes} [Thu Sep 15 17:49:37 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 17:49:37.733342 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 496/1011] 10.222.0.25 () {60 vars in 1144 bytes} [Thu Sep 15 17:49:37 2022] POST /identity/v3/endpoints => generated 325 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 15 17:49:37.738537 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3446cdf0-8332-48a4-8655-8036ee501058 None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:49:37.791938 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:49:37.863880 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3446cdf0-8332-48a4-8655-8036ee501058 None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:49:37.913830 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6956d731-23cc-4e41-9579-843a2bd15ac8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:49:37.914710 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6956d731-23cc-4e41-9579-843a2bd15ac8 None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:49:37.915162 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6956d731-23cc-4e41-9579-843a2bd15ac8 None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:49:37.915582 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6956d731-23cc-4e41-9579-843a2bd15ac8 None admin] PATH_INFO: `/v3/services` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:49:37.916456 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6956d731-23cc-4e41-9579-843a2bd15ac8 None admin] RBAC: Adding query filter params (type=compute) {{(pid=81593) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 17:49:37.916913 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6956d731-23cc-4e41-9579-843a2bd15ac8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:49:37.918380 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6956d731-23cc-4e41-9579-843a2bd15ac8 None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:49:37.929147 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 516/1012] 10.222.0.25 () {56 vars in 1112 bytes} [Thu Sep 15 17:49:37 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 17:49:37.935174 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc67051-32b6-4574-a077-0eb6e1ef82a0 None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:49:37.970965 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:49:38.059847 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc67051-32b6-4574-a077-0eb6e1ef82a0 None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:49:38.097492 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2abaeec9-4344-44e3-beb7-21d7edcaa385 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:49:38.098118 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abaeec9-4344-44e3-beb7-21d7edcaa385 None admin] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:49:38.098398 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abaeec9-4344-44e3-beb7-21d7edcaa385 None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:49:38.098669 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abaeec9-4344-44e3-beb7-21d7edcaa385 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:49:38.099350 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2abaeec9-4344-44e3-beb7-21d7edcaa385 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:49:38.100733 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2abaeec9-4344-44e3-beb7-21d7edcaa385 None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:49:38.124639 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 497/1013] 10.222.0.25 () {60 vars in 1144 bytes} [Thu Sep 15 17:49:37 2022] POST /identity/v3/endpoints => generated 334 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 17:49:39.493038 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1852d7c6-ee58-4f4a-947b-edd0f8c26299 None None] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:49:39.493701 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1852d7c6-ee58-4f4a-947b-edd0f8c26299 None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:49:39.494104 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1852d7c6-ee58-4f4a-947b-edd0f8c26299 None None] PATH_INFO: `/` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:49:39.497117 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 517/1014] 10.222.0.25 () {54 vars in 927 bytes} [Thu Sep 15 17:49:39 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 17:49:39.506992 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d84921b-1a20-4a4f-b2d8-ba7e12ff8b03 None None] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:49:39.507594 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d84921b-1a20-4a4f-b2d8-ba7e12ff8b03 None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:49:39.507972 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d84921b-1a20-4a4f-b2d8-ba7e12ff8b03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:49:39.541035 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.auth.core [None req-5d84921b-1a20-4a4f-b2d8-ba7e12ff8b03 None None] MFA Rules not processed for user `5cfa58ef86774ab7800bf91930bf6028`. Rule list: `[]` (Enabled: `True`). {{(pid=81592) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 17:49:39.543093 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-5d84921b-1a20-4a4f-b2d8-ba7e12ff8b03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 17:49:39.690707 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 498/1015] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Sep 15 17:49:39 2022] POST /identity/v3/auth/tokens => generated 1873 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 15 17:49:39.997281 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1852d7c6-ee58-4f4a-947b-edd0f8c26299 None None] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:49:40.166065 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1852d7c6-ee58-4f4a-947b-edd0f8c26299 None None] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:49:40.168603 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:49:40.212678 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede804ac-42d6-484a-b8b1-e551aeb4240d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:49:40.212678 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede804ac-42d6-484a-b8b1-e551aeb4240d None admin] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:49:40.212978 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede804ac-42d6-484a-b8b1-e551aeb4240d None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:49:40.213062 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede804ac-42d6-484a-b8b1-e551aeb4240d None admin] PATH_INFO: `/v3/services` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:49:40.213815 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede804ac-42d6-484a-b8b1-e551aeb4240d None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:49:40.215196 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede804ac-42d6-484a-b8b1-e551aeb4240d None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:49:40.233443 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 518/1016] 10.222.0.25 () {60 vars in 1141 bytes} [Thu Sep 15 17:49:39 2022] POST /identity/v3/services => generated 242 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 17:49:40.376806 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60407456-51b3-4f61-bd99-f53f01a1b7a7 None None] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:49:40.377307 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60407456-51b3-4f61-bd99-f53f01a1b7a7 None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:49:40.377851 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60407456-51b3-4f61-bd99-f53f01a1b7a7 None None] PATH_INFO: `/` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:49:40.380166 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 499/1017] 10.222.0.25 () {54 vars in 927 bytes} [Thu Sep 15 17:49:40 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 17:49:40.386403 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8357dcb8-2908-4984-8ace-c47810b49002 None None] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:49:40.386813 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8357dcb8-2908-4984-8ace-c47810b49002 None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:49:40.386998 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8357dcb8-2908-4984-8ace-c47810b49002 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:49:40.412027 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.auth.core [None req-8357dcb8-2908-4984-8ace-c47810b49002 None None] MFA Rules not processed for user `5cfa58ef86774ab7800bf91930bf6028`. Rule list: `[]` (Enabled: `True`). {{(pid=81593) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 17:49:40.413332 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-8357dcb8-2908-4984-8ace-c47810b49002 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 17:49:40.518336 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 519/1018] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Sep 15 17:49:40 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 15 17:49:40.742162 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8875fff-53b4-4543-87ef-6ee3f14e2f14 None None] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:49:40.742771 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8875fff-53b4-4543-87ef-6ee3f14e2f14 None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:49:40.743174 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8875fff-53b4-4543-87ef-6ee3f14e2f14 None None] PATH_INFO: `/` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:49:40.745568 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 500/1019] 10.222.0.25 () {54 vars in 927 bytes} [Thu Sep 15 17:49:40 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 17:49:40.754037 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25740053-47b4-4706-9135-416aae5bc6ce None None] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:49:40.754531 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25740053-47b4-4706-9135-416aae5bc6ce None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:49:40.754999 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25740053-47b4-4706-9135-416aae5bc6ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:49:40.784756 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.auth.core [None req-25740053-47b4-4706-9135-416aae5bc6ce None None] MFA Rules not processed for user `5cfa58ef86774ab7800bf91930bf6028`. Rule list: `[]` (Enabled: `True`). {{(pid=81593) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 17:49:40.786693 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-25740053-47b4-4706-9135-416aae5bc6ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 17:49:40.857632 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8875fff-53b4-4543-87ef-6ee3f14e2f14 None None] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:49:40.872944 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:49:40.908270 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 520/1020] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Sep 15 17:49:40 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 15 17:49:41.003312 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8875fff-53b4-4543-87ef-6ee3f14e2f14 None None] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:49:41.047869 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf81670-08c9-4595-9f2e-222a0e7fa93a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:49:41.048410 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf81670-08c9-4595-9f2e-222a0e7fa93a None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:49:41.048691 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf81670-08c9-4595-9f2e-222a0e7fa93a None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:49:41.048961 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf81670-08c9-4595-9f2e-222a0e7fa93a None admin] PATH_INFO: `/v3/domains/default` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:49:41.050218 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf81670-08c9-4595-9f2e-222a0e7fa93a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:49:41.051654 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf81670-08c9-4595-9f2e-222a0e7fa93a None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:49:41.057337 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 501/1021] 10.222.0.25 () {56 vars in 1108 bytes} [Thu Sep 15 17:49:40 2022] GET /identity/v3/domains/default => generated 199 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 17:49:41.061017 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25740053-47b4-4706-9135-416aae5bc6ce None None] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:49:41.086350 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:49:41.206078 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25740053-47b4-4706-9135-416aae5bc6ce None None] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:49:41.206790 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf81670-08c9-4595-9f2e-222a0e7fa93a None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:49:41.251251 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f260a370-fbce-4005-99ea-8d737590d6a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:49:41.251879 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f260a370-fbce-4005-99ea-8d737590d6a9 None admin] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:49:41.252165 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f260a370-fbce-4005-99ea-8d737590d6a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:49:41.252539 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f260a370-fbce-4005-99ea-8d737590d6a9 None admin] PATH_INFO: `/v3/projects` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:49:41.253565 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f260a370-fbce-4005-99ea-8d737590d6a9 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:49:41.256182 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f260a370-fbce-4005-99ea-8d737590d6a9 None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:49:41.305480 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 521/1022] 10.222.0.25 () {60 vars in 1141 bytes} [Thu Sep 15 17:49:41 2022] POST /identity/v3/projects => generated 311 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 17:49:41.322686 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:49:41.360861 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf81670-08c9-4595-9f2e-222a0e7fa93a None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:49:41.409696 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8696845e-a75d-4d10-ad3d-8fd2e40482b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:49:41.410357 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8696845e-a75d-4d10-ad3d-8fd2e40482b7 None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:49:41.410625 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8696845e-a75d-4d10-ad3d-8fd2e40482b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:49:41.410900 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8696845e-a75d-4d10-ad3d-8fd2e40482b7 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:49:41.424592 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8696845e-a75d-4d10-ad3d-8fd2e40482b7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 17:49:41.430203 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application [None req-8696845e-a75d-4d10-ad3d-8fd2e40482b7 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 15 17:49:41.430203 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 17:49:41.430203 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 17:49:41.430203 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 17:49:41.430203 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 17:49:41.430203 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 17:49:41.430203 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 17:49:41.430203 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 17:49:41.430203 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 17:49:41.430203 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 17:49:41.430203 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 17:49:41.430203 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 17:49:41.430203 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 17:49:41.430203 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 17:49:41.430203 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 17:49:41.430203 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 17:49:41.433925 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 17:49:41.433925 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 17:49:41.433925 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 17:49:41.433925 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 17:49:41.433925 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 17:49:41.433925 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 17:49:41.433925 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 17:49:41.433925 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 17:49:41.433925 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 17:49:41.433925 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 17:49:41.433925 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 17:49:41.433925 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application with Lock( Sep 15 17:49:41.433925 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 17:49:41.433925 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._enter() Sep 15 17:49:41.433925 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 17:49:41.433925 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 17:49:41.434899 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 17:49:41.434899 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.creator() Sep 15 17:49:41.434899 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 17:49:41.434899 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application created_value = creator( Sep 15 17:49:41.434899 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 17:49:41.434899 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 17:49:41.434899 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 17:49:41.434899 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 17:49:41.434899 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 17:49:41.434899 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 17:49:41.434899 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 15 17:49:41.434899 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Sep 15 17:49:41.434899 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 502/1023] 10.222.0.25 () {56 vars in 1120 bytes} [Thu Sep 15 17:49:41 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 15 17:49:41.442114 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f260a370-fbce-4005-99ea-8d737590d6a9 None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:49:41.576104 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:49:41.632983 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f260a370-fbce-4005-99ea-8d737590d6a9 None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:49:41.686591 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32634df0-9376-431f-9fab-87f79ee405ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:49:41.687556 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32634df0-9376-431f-9fab-87f79ee405ea None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:49:41.687945 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32634df0-9376-431f-9fab-87f79ee405ea None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:49:41.688317 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32634df0-9376-431f-9fab-87f79ee405ea None admin] PATH_INFO: `/v3/roles` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:49:41.689354 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32634df0-9376-431f-9fab-87f79ee405ea None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81593) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 17:49:41.689712 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32634df0-9376-431f-9fab-87f79ee405ea None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:49:41.691811 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32634df0-9376-431f-9fab-87f79ee405ea None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:49:41.705658 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 522/1024] 10.222.0.25 () {56 vars in 1115 bytes} [Thu Sep 15 17:49:41 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 17:49:41.714318 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8696845e-a75d-4d10-ad3d-8fd2e40482b7 None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:49:41.864503 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8696845e-a75d-4d10-ad3d-8fd2e40482b7 None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:49:41.907968 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec06354-487b-4418-bee1-44ce1ded8e7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:49:41.908601 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec06354-487b-4418-bee1-44ce1ded8e7d None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:49:41.908985 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec06354-487b-4418-bee1-44ce1ded8e7d None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:49:41.909321 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec06354-487b-4418-bee1-44ce1ded8e7d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:49:41.933232 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:49:41.934997 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec06354-487b-4418-bee1-44ce1ded8e7d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:49:41.939109 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec06354-487b-4418-bee1-44ce1ded8e7d None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:49:41.974883 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application [None req-cec06354-487b-4418-bee1-44ce1ded8e7d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 17:49:41.974883 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 17:49:41.974883 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 17:49:41.974883 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 17:49:41.974883 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 17:49:41.974883 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 17:49:41.974883 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 17:49:41.974883 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 17:49:41.974883 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 17:49:41.974883 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 17:49:41.974883 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 17:49:41.974883 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 17:49:41.974883 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 15 17:49:41.974883 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 15 17:49:41.974883 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 15 17:49:41.974883 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 15 17:49:41.976005 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 17:49:41.976005 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 17:49:41.976005 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 17:49:41.976005 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 17:49:41.976005 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 17:49:41.976005 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 17:49:41.976005 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 17:49:41.976005 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application with Lock( Sep 15 17:49:41.976005 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 17:49:41.976005 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._enter() Sep 15 17:49:41.976005 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 17:49:41.976005 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 17:49:41.976005 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 17:49:41.976005 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.creator() Sep 15 17:49:41.976005 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 17:49:41.976005 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application created_value = creator( Sep 15 17:49:41.976005 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 15 17:49:41.977196 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 15 17:49:41.977196 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 17:49:41.977196 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Sep 15 17:49:41.977594 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 503/1025] 10.222.0.25 () {56 vars in 1108 bytes} [Thu Sep 15 17:49:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 264 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 17:49:41.983755 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32634df0-9376-431f-9fab-87f79ee405ea None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:49:42.150974 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32634df0-9376-431f-9fab-87f79ee405ea None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:49:42.185935 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:49:42.197517 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fabc5dda-fd6f-4fdc-ac4d-63e83630e37f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:49:42.198552 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabc5dda-fd6f-4fdc-ac4d-63e83630e37f None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:49:42.199087 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabc5dda-fd6f-4fdc-ac4d-63e83630e37f None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:49:42.199539 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabc5dda-fd6f-4fdc-ac4d-63e83630e37f None admin] PATH_INFO: `/v3/domains` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:49:42.200793 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fabc5dda-fd6f-4fdc-ac4d-63e83630e37f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81593) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 17:49:42.201339 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fabc5dda-fd6f-4fdc-ac4d-63e83630e37f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:49:42.203835 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fabc5dda-fd6f-4fdc-ac4d-63e83630e37f None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:49:42.225684 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 523/1026] 10.222.0.25 () {56 vars in 1109 bytes} [Thu Sep 15 17:49:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 17:49:42.227276 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec06354-487b-4418-bee1-44ce1ded8e7d None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:49:42.344654 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec06354-487b-4418-bee1-44ce1ded8e7d None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:49:42.384867 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c243411-2dea-49bd-a84c-a57c6960ed74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:49:42.385729 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c243411-2dea-49bd-a84c-a57c6960ed74 None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:49:42.386139 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c243411-2dea-49bd-a84c-a57c6960ed74 None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:49:42.386598 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c243411-2dea-49bd-a84c-a57c6960ed74 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:49:42.402825 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c243411-2dea-49bd-a84c-a57c6960ed74 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:49:42.405545 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c243411-2dea-49bd-a84c-a57c6960ed74 None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:49:42.426663 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application [None req-7c243411-2dea-49bd-a84c-a57c6960ed74 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 15 17:49:42.426663 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 17:49:42.426663 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 17:49:42.426663 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 17:49:42.426663 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 17:49:42.426663 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 17:49:42.426663 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 17:49:42.426663 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 17:49:42.426663 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 17:49:42.426663 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 17:49:42.426663 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 17:49:42.426663 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 17:49:42.426663 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 15 17:49:42.426663 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 15 17:49:42.426663 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 15 17:49:42.426663 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 15 17:49:42.427804 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 17:49:42.427804 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 17:49:42.427804 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 15 17:49:42.427804 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 15 17:49:42.427804 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 15 17:49:42.427804 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 15 17:49:42.427804 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 17:49:42.427804 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 17:49:42.427804 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 17:49:42.427804 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 17:49:42.427804 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 17:49:42.427804 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application with Lock( Sep 15 17:49:42.427804 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 17:49:42.427804 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._enter() Sep 15 17:49:42.427804 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 17:49:42.427804 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 17:49:42.427804 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 17:49:42.427804 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.creator() Sep 15 17:49:42.428836 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 17:49:42.428836 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application created_value = creator( Sep 15 17:49:42.428836 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 15 17:49:42.428836 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 15 17:49:42.428836 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 15 17:49:42.428836 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 15 17:49:42.428836 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 15 17:49:42.428836 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 15 17:49:42.428836 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 15 17:49:42.428836 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Sep 15 17:49:42.428836 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 504/1027] 10.222.0.25 () {56 vars in 1093 bytes} [Thu Sep 15 17:49:42 2022] GET /identity/v3/users/nova => generated 82 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 17:49:42.436539 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fabc5dda-fd6f-4fdc-ac4d-63e83630e37f None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:49:42.555789 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fabc5dda-fd6f-4fdc-ac4d-63e83630e37f None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:49:42.607325 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f5b61d-d85b-48f8-bab5-c954ceab18fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:49:42.608253 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f5b61d-d85b-48f8-bab5-c954ceab18fe None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:49:42.608704 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f5b61d-d85b-48f8-bab5-c954ceab18fe None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:49:42.609168 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f5b61d-d85b-48f8-bab5-c954ceab18fe None admin] PATH_INFO: `/v3/users` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:49:42.610613 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f5b61d-d85b-48f8-bab5-c954ceab18fe None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81593) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 17:49:42.611062 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f5b61d-d85b-48f8-bab5-c954ceab18fe None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:49:42.614251 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f5b61d-d85b-48f8-bab5-c954ceab18fe None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:49:42.646988 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 524/1028] 10.222.0.25 () {56 vars in 1133 bytes} [Thu Sep 15 17:49:42 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 17:49:42.649442 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c243411-2dea-49bd-a84c-a57c6960ed74 None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:49:42.714502 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:49:42.786406 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c243411-2dea-49bd-a84c-a57c6960ed74 None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:49:42.834291 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dfec3d3-4311-4aeb-8dea-63bfc424053d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:49:42.834993 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfec3d3-4311-4aeb-8dea-63bfc424053d None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:49:42.835275 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfec3d3-4311-4aeb-8dea-63bfc424053d None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:49:42.835550 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfec3d3-4311-4aeb-8dea-63bfc424053d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:49:42.934611 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dfec3d3-4311-4aeb-8dea-63bfc424053d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:49:42.937672 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dfec3d3-4311-4aeb-8dea-63bfc424053d None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:49:43.010477 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:49:43.048093 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7533c3-3fa9-4605-bf48-2dc474d9489f None None] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:49:43.048652 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7533c3-3fa9-4605-bf48-2dc474d9489f None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:49:43.049172 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7533c3-3fa9-4605-bf48-2dc474d9489f None None] PATH_INFO: `/` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:49:43.051323 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 525/1029] 10.222.0.25 () {54 vars in 927 bytes} [Thu Sep 15 17:49:43 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 17:49:43.057960 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54865966-d205-4772-9ca5-610a4e1a1b68 None None] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:49:43.058229 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54865966-d205-4772-9ca5-610a4e1a1b68 None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:49:43.058544 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54865966-d205-4772-9ca5-610a4e1a1b68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:49:43.079667 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.auth.core [None req-54865966-d205-4772-9ca5-610a4e1a1b68 None None] MFA Rules not processed for user `5cfa58ef86774ab7800bf91930bf6028`. Rule list: `[]` (Enabled: `True`). {{(pid=81593) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 17:49:43.080734 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 505/1030] 10.222.0.25 () {58 vars in 1282 bytes} [Thu Sep 15 17:49:42 2022] GET /identity/v3/auth/tokens => generated 1969 bytes in 432 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 15 17:49:43.080959 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-54865966-d205-4772-9ca5-610a4e1a1b68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 17:49:43.086361 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dfec3d3-4311-4aeb-8dea-63bfc424053d None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:49:43.144554 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:49:43.176345 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 526/1031] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Sep 15 17:49:43 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 15 17:49:43.239867 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dfec3d3-4311-4aeb-8dea-63bfc424053d None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:49:43.289405 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd77e19-d505-4aa9-8cb5-c723e2ab7572 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:49:43.289405 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd77e19-d505-4aa9-8cb5-c723e2ab7572 None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:49:43.289405 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd77e19-d505-4aa9-8cb5-c723e2ab7572 None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:49:43.289405 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd77e19-d505-4aa9-8cb5-c723e2ab7572 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:49:43.303429 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd77e19-d505-4aa9-8cb5-c723e2ab7572 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:49:43.303429 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd77e19-d505-4aa9-8cb5-c723e2ab7572 None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:49:43.321029 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application [None req-ddd77e19-d505-4aa9-8cb5-c723e2ab7572 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 17:49:43.321029 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 17:49:43.321029 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 17:49:43.321029 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 17:49:43.321029 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 17:49:43.321029 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 17:49:43.321029 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 17:49:43.321029 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 17:49:43.321029 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 17:49:43.321029 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 17:49:43.321029 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 17:49:43.321029 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 17:49:43.321029 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 15 17:49:43.321029 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 15 17:49:43.321029 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 15 17:49:43.321029 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 15 17:49:43.322791 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 17:49:43.322791 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 17:49:43.322791 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 17:49:43.322791 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 17:49:43.322791 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 17:49:43.322791 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 17:49:43.322791 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 17:49:43.322791 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application with Lock( Sep 15 17:49:43.322791 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 17:49:43.322791 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._enter() Sep 15 17:49:43.322791 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 17:49:43.322791 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 17:49:43.322791 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 17:49:43.322791 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.creator() Sep 15 17:49:43.322791 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 17:49:43.322791 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application created_value = creator( Sep 15 17:49:43.322791 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 15 17:49:43.324300 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 15 17:49:43.324300 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 17:49:43.324300 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Sep 15 17:49:43.327354 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 506/1032] 10.222.0.25 () {56 vars in 1108 bytes} [Thu Sep 15 17:49:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 15 17:49:43.333599 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54865966-d205-4772-9ca5-610a4e1a1b68 None None] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:49:43.446720 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54865966-d205-4772-9ca5-610a4e1a1b68 None None] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:49:43.486142 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fde2c00-733a-475c-a707-068152c794da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:49:43.487125 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fde2c00-733a-475c-a707-068152c794da None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:49:43.487654 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fde2c00-733a-475c-a707-068152c794da None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:49:43.488130 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fde2c00-733a-475c-a707-068152c794da None admin] PATH_INFO: `/v3/domains` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:49:43.488978 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fde2c00-733a-475c-a707-068152c794da None admin] RBAC: Adding query filter params (name=Default) {{(pid=81593) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 17:49:43.489522 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fde2c00-733a-475c-a707-068152c794da None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:49:43.491120 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fde2c00-733a-475c-a707-068152c794da None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:49:43.504206 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 527/1033] 10.222.0.25 () {56 vars in 1109 bytes} [Thu Sep 15 17:49:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 17:49:43.504517 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd77e19-d505-4aa9-8cb5-c723e2ab7572 None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:49:43.507671 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:49:43.510777 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fde2c00-733a-475c-a707-068152c794da None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:49:43.575809 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:49:43.662807 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd77e19-d505-4aa9-8cb5-c723e2ab7572 None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:49:43.669180 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fde2c00-733a-475c-a707-068152c794da None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:49:43.703837 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb37868-1bc0-4b2f-a7e0-336cf598852e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:49:43.704480 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb37868-1bc0-4b2f-a7e0-336cf598852e None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:49:43.704753 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb37868-1bc0-4b2f-a7e0-336cf598852e None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:49:43.705018 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb37868-1bc0-4b2f-a7e0-336cf598852e None admin] PATH_INFO: `/v3/services/image` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:49:43.705634 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb37868-1bc0-4b2f-a7e0-336cf598852e None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:49:43.707006 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb37868-1bc0-4b2f-a7e0-336cf598852e None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:49:43.716561 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa882270-4bdd-4b28-9be3-956812c65601 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:49:43.717420 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa882270-4bdd-4b28-9be3-956812c65601 None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:49:43.717828 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa882270-4bdd-4b28-9be3-956812c65601 None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:49:43.718261 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa882270-4bdd-4b28-9be3-956812c65601 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:49:43.719605 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application [None req-ecb37868-1bc0-4b2f-a7e0-336cf598852e None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Sep 15 17:49:43.719605 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 17:49:43.719605 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 15 17:49:43.719605 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 15 17:49:43.719605 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 15 17:49:43.719605 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 15 17:49:43.719605 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 15 17:49:43.719605 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 15 17:49:43.719605 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 15 17:49:43.719605 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Sep 15 17:49:43.719605 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 15 17:49:43.719605 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Sep 15 17:49:43.719605 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 17:49:43.719605 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 17:49:43.719605 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 17:49:43.719605 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 17:49:43.719605 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 17:49:43.720720 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 17:49:43.720720 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 17:49:43.720720 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 17:49:43.720720 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 17:49:43.720720 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 17:49:43.720720 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 17:49:43.720720 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 15 17:49:43.720720 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 15 17:49:43.720720 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 15 17:49:43.720720 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 15 17:49:43.720720 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 17:49:43.720720 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 17:49:43.720720 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 17:49:43.720720 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 17:49:43.720720 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 17:49:43.720720 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 17:49:43.723086 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 17:49:43.723086 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application with Lock( Sep 15 17:49:43.723086 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 17:49:43.723086 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._enter() Sep 15 17:49:43.723086 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 17:49:43.723086 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 17:49:43.723086 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 17:49:43.723086 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.creator() Sep 15 17:49:43.723086 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 17:49:43.723086 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application created_value = creator( Sep 15 17:49:43.723086 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 15 17:49:43.723086 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 15 17:49:43.723086 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 15 17:49:43.723086 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Sep 15 17:49:43.723086 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 507/1034] 10.222.0.25 () {56 vars in 1105 bytes} [Thu Sep 15 17:49:43 2022] GET /identity/v3/services/image => generated 86 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 15 17:49:43.728478 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb37868-1bc0-4b2f-a7e0-336cf598852e None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:49:43.735273 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa882270-4bdd-4b28-9be3-956812c65601 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:49:43.736739 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa882270-4bdd-4b28-9be3-956812c65601 None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:49:43.748619 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application [None req-fa882270-4bdd-4b28-9be3-956812c65601 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 15 17:49:43.748619 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 17:49:43.748619 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 17:49:43.748619 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 17:49:43.748619 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 17:49:43.748619 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 17:49:43.748619 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 17:49:43.748619 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 17:49:43.748619 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 17:49:43.748619 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 17:49:43.748619 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 17:49:43.748619 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 17:49:43.748619 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 15 17:49:43.748619 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 15 17:49:43.748619 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 15 17:49:43.749807 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 15 17:49:43.749807 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 17:49:43.749807 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 17:49:43.749807 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 17:49:43.749807 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 17:49:43.749807 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 17:49:43.749807 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 17:49:43.749807 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 17:49:43.749807 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application with Lock( Sep 15 17:49:43.749807 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 17:49:43.749807 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._enter() Sep 15 17:49:43.749807 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 17:49:43.749807 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 17:49:43.749807 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 17:49:43.749807 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.creator() Sep 15 17:49:43.749807 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 17:49:43.749807 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application created_value = creator( Sep 15 17:49:43.755804 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 15 17:49:43.755804 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 15 17:49:43.755804 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 15 17:49:43.755804 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 15 17:49:43.755804 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 15 17:49:43.755804 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 15 17:49:43.755804 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 15 17:49:43.755804 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Sep 15 17:49:43.755804 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 528/1035] 10.222.0.25 () {56 vars in 1111 bytes} [Thu Sep 15 17:49:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 15 17:49:43.755804 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa882270-4bdd-4b28-9be3-956812c65601 None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:49:43.808999 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:49:43.847817 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb37868-1bc0-4b2f-a7e0-336cf598852e None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:49:43.862514 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:49:43.866201 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa882270-4bdd-4b28-9be3-956812c65601 None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:49:43.884813 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2559a188-9501-4a89-91ac-6cac43a71a5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:49:43.885431 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2559a188-9501-4a89-91ac-6cac43a71a5b None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:49:43.885710 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2559a188-9501-4a89-91ac-6cac43a71a5b None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:49:43.885983 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2559a188-9501-4a89-91ac-6cac43a71a5b None admin] PATH_INFO: `/v3/services` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:49:43.886986 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2559a188-9501-4a89-91ac-6cac43a71a5b None admin] RBAC: Adding query filter params (name=image) {{(pid=81592) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 17:49:43.886986 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2559a188-9501-4a89-91ac-6cac43a71a5b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:49:43.888274 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2559a188-9501-4a89-91ac-6cac43a71a5b None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:49:43.893851 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 508/1036] 10.222.0.25 () {56 vars in 1108 bytes} [Thu Sep 15 17:49:43 2022] GET /identity/v3/services?name=image => generated 122 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 17:49:43.895037 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d47c2b-d712-4b87-b863-6fb67db72263 None None] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:49:43.895327 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d47c2b-d712-4b87-b863-6fb67db72263 None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:49:43.895598 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d47c2b-d712-4b87-b863-6fb67db72263 None None] PATH_INFO: `/` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:49:43.896816 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 509/1037] 10.222.0.25 () {54 vars in 927 bytes} [Thu Sep 15 17:49:43 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 17:49:43.900616 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d47c2b-d712-4b87-b863-6fb67db72263 None None] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:49:43.906988 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328dda28-db36-40c2-9625-2ed7f239a58d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:49:43.907669 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328dda28-db36-40c2-9625-2ed7f239a58d None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:49:43.907942 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328dda28-db36-40c2-9625-2ed7f239a58d None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:49:43.908208 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328dda28-db36-40c2-9625-2ed7f239a58d None admin] PATH_INFO: `/v3/projects` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:49:43.908908 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328dda28-db36-40c2-9625-2ed7f239a58d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81593) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 17:49:43.909207 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328dda28-db36-40c2-9625-2ed7f239a58d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:49:43.910688 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328dda28-db36-40c2-9625-2ed7f239a58d None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:49:43.926225 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 529/1038] 10.222.0.25 () {56 vars in 1148 bytes} [Thu Sep 15 17:49:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 17:49:43.927632 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e5372e-4137-46d6-bdc8-9c1e55eddccb None None] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:49:43.927924 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e5372e-4137-46d6-bdc8-9c1e55eddccb None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:49:43.928188 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e5372e-4137-46d6-bdc8-9c1e55eddccb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:49:43.946575 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.auth.core [None req-f9e5372e-4137-46d6-bdc8-9c1e55eddccb None None] MFA Rules not processed for user `5cfa58ef86774ab7800bf91930bf6028`. Rule list: `[]` (Enabled: `True`). {{(pid=81593) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 17:49:43.947954 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-f9e5372e-4137-46d6-bdc8-9c1e55eddccb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 17:49:44.026628 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 530/1039] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Sep 15 17:49:43 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 15 17:49:44.029730 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e5372e-4137-46d6-bdc8-9c1e55eddccb None None] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:49:44.034274 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d47c2b-d712-4b87-b863-6fb67db72263 None None] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:49:44.080529 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:49:44.090973 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0412bb-a6e0-4b78-85cc-1780d5314b12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:49:44.092013 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0412bb-a6e0-4b78-85cc-1780d5314b12 None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:49:44.092438 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0412bb-a6e0-4b78-85cc-1780d5314b12 None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:49:44.092751 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0412bb-a6e0-4b78-85cc-1780d5314b12 None admin] PATH_INFO: `/v3/services` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:49:44.093743 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd0412bb-a6e0-4b78-85cc-1780d5314b12 None admin] RBAC: Adding query filter params (type=image) {{(pid=81592) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 17:49:44.094285 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd0412bb-a6e0-4b78-85cc-1780d5314b12 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:49:44.096594 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd0412bb-a6e0-4b78-85cc-1780d5314b12 None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:49:44.114367 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 510/1040] 10.222.0.25 () {56 vars in 1108 bytes} [Thu Sep 15 17:49:43 2022] GET /identity/v3/services?type=image => generated 350 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 17:49:44.115758 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0412bb-a6e0-4b78-85cc-1780d5314b12 None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:49:44.179506 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:49:44.194909 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e5372e-4137-46d6-bdc8-9c1e55eddccb None None] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:49:44.249378 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff57f2bb-6702-4859-a29f-b8d82c1a4b85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:49:44.250039 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff57f2bb-6702-4859-a29f-b8d82c1a4b85 None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:49:44.250313 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff57f2bb-6702-4859-a29f-b8d82c1a4b85 None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:49:44.250582 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff57f2bb-6702-4859-a29f-b8d82c1a4b85 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:49:44.251309 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff57f2bb-6702-4859-a29f-b8d82c1a4b85 None admin] RBAC: Adding query filter params (role.id=99a6f32f74a84d0989c7527d9985370e, scope.project.id=1213c0d1b584404ba3998e136f166e89, user.id=fe2244818e4d4dca9c424cd078653e6a) {{(pid=81593) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 17:49:44.251731 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff57f2bb-6702-4859-a29f-b8d82c1a4b85 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:49:44.253237 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff57f2bb-6702-4859-a29f-b8d82c1a4b85 None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:49:44.260846 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 531/1041] 10.222.0.25 () {56 vars in 1374 bytes} [Thu Sep 15 17:49:44 2022] GET /identity/v3/role_assignments?user.id=fe2244818e4d4dca9c424cd078653e6a&scope.project.id=1213c0d1b584404ba3998e136f166e89&role.id=99a6f32f74a84d0989c7527d9985370e => generated 259 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 17:49:44.265388 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0412bb-a6e0-4b78-85cc-1780d5314b12 None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:49:44.307920 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff57f2bb-6702-4859-a29f-b8d82c1a4b85 None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:49:44.311834 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7e5b2f-b595-49e4-bc48-a8cf16d7ab7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:49:44.313155 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7e5b2f-b595-49e4-bc48-a8cf16d7ab7e None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:49:44.313470 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7e5b2f-b595-49e4-bc48-a8cf16d7ab7e None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:49:44.313741 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7e5b2f-b595-49e4-bc48-a8cf16d7ab7e None admin] PATH_INFO: `/v3/endpoints` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:49:44.314497 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f7e5b2f-b595-49e4-bc48-a8cf16d7ab7e None admin] RBAC: Adding query filter params (interface=public, service_id=d30efba0b0c047efb158600c9b3a2d22, region_id=RegionOne) {{(pid=81592) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 17:49:44.314809 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f7e5b2f-b595-49e4-bc48-a8cf16d7ab7e None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:49:44.316257 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f7e5b2f-b595-49e4-bc48-a8cf16d7ab7e None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:49:44.325971 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 511/1042] 10.222.0.25 () {56 vars in 1251 bytes} [Thu Sep 15 17:49:44 2022] GET /identity/v3/endpoints?service_id=d30efba0b0c047efb158600c9b3a2d22&interface=public®ion_id=RegionOne => generated 194 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 17:49:44.332656 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7e5b2f-b595-49e4-bc48-a8cf16d7ab7e None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:49:44.423605 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:49:44.487278 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff57f2bb-6702-4859-a29f-b8d82c1a4b85 None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:49:44.502884 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7e5b2f-b595-49e4-bc48-a8cf16d7ab7e None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:49:44.551132 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89b8bd2-57fc-49ff-a945-022d26a76e7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:49:44.551737 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89b8bd2-57fc-49ff-a945-022d26a76e7f None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:49:44.552014 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89b8bd2-57fc-49ff-a945-022d26a76e7f None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:49:44.552283 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89b8bd2-57fc-49ff-a945-022d26a76e7f None admin] PATH_INFO: `/v3/services` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:49:44.552889 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e89b8bd2-57fc-49ff-a945-022d26a76e7f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:49:44.552999 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570f6421-17f6-4b53-8a77-4b3c7a77b927 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:49:44.554046 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570f6421-17f6-4b53-8a77-4b3c7a77b927 None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:49:44.554291 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e89b8bd2-57fc-49ff-a945-022d26a76e7f None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:49:44.554527 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570f6421-17f6-4b53-8a77-4b3c7a77b927 None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:49:44.555010 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570f6421-17f6-4b53-8a77-4b3c7a77b927 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:49:44.556883 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-570f6421-17f6-4b53-8a77-4b3c7a77b927 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:49:44.560033 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-570f6421-17f6-4b53-8a77-4b3c7a77b927 None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:49:44.572465 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 512/1043] 10.222.0.25 () {56 vars in 1087 bytes} [Thu Sep 15 17:49:44 2022] GET /identity/v3/services => generated 1957 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 15 17:49:44.572727 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 532/1044] 10.222.0.25 () {56 vars in 1108 bytes} [Thu Sep 15 17:49:44 2022] GET /identity/v3/domains/default => generated 199 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 17:49:44.572900 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89b8bd2-57fc-49ff-a945-022d26a76e7f None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:49:44.707348 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89b8bd2-57fc-49ff-a945-022d26a76e7f None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:49:44.740599 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:49:44.759146 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868e4090-93f7-4fbf-93c8-8053ddc59d4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:49:44.759779 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868e4090-93f7-4fbf-93c8-8053ddc59d4b None admin] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:49:44.760053 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868e4090-93f7-4fbf-93c8-8053ddc59d4b None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:49:44.760323 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868e4090-93f7-4fbf-93c8-8053ddc59d4b None admin] PATH_INFO: `/v3/users` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:49:44.760991 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-868e4090-93f7-4fbf-93c8-8053ddc59d4b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:49:44.762526 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-868e4090-93f7-4fbf-93c8-8053ddc59d4b None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:49:44.791522 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 513/1045] 10.222.0.25 () {60 vars in 1132 bytes} [Thu Sep 15 17:49:44 2022] POST /identity/v3/users => generated 285 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 17:49:46.782949 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b5828f-abb7-41a4-980d-a8bf10f0e932 None None] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:49:46.783544 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b5828f-abb7-41a4-980d-a8bf10f0e932 None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:49:46.783775 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b5828f-abb7-41a4-980d-a8bf10f0e932 None None] PATH_INFO: `/` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:49:46.785866 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 533/1046] 10.222.0.25 () {54 vars in 927 bytes} [Thu Sep 15 17:49:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 17:49:46.794763 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9e0a62-4502-4833-b756-da056f43ff70 None None] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:49:46.795270 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9e0a62-4502-4833-b756-da056f43ff70 None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:49:46.795356 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9e0a62-4502-4833-b756-da056f43ff70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:49:46.816226 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.auth.core [None req-aa9e0a62-4502-4833-b756-da056f43ff70 None None] MFA Rules not processed for user `5cfa58ef86774ab7800bf91930bf6028`. Rule list: `[]` (Enabled: `True`). {{(pid=81592) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 17:49:46.817504 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-aa9e0a62-4502-4833-b756-da056f43ff70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 17:49:46.865998 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf29901-181f-425a-a2ae-3fc09053c5a5 None None] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:49:46.866301 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf29901-181f-425a-a2ae-3fc09053c5a5 None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:49:46.866611 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf29901-181f-425a-a2ae-3fc09053c5a5 None None] PATH_INFO: `/` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:49:46.868343 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 534/1047] 10.222.0.25 () {54 vars in 927 bytes} [Thu Sep 15 17:49:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 17:49:46.877282 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aaf38c4-b2d8-4e12-9421-53760421a44a None None] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:49:46.877929 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aaf38c4-b2d8-4e12-9421-53760421a44a None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:49:46.878417 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aaf38c4-b2d8-4e12-9421-53760421a44a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:49:46.904508 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.auth.core [None req-0aaf38c4-b2d8-4e12-9421-53760421a44a None None] MFA Rules not processed for user `5cfa58ef86774ab7800bf91930bf6028`. Rule list: `[]` (Enabled: `True`). {{(pid=81593) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 17:49:46.906484 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-0aaf38c4-b2d8-4e12-9421-53760421a44a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 17:49:46.917351 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 514/1048] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Sep 15 17:49:46 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 15 17:49:46.942807 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:49:47.017354 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 535/1049] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Sep 15 17:49:46 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 15 17:49:47.194401 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9e0a62-4502-4833-b756-da056f43ff70 None None] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:49:47.321022 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9e0a62-4502-4833-b756-da056f43ff70 None None] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:49:47.322547 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aaf38c4-b2d8-4e12-9421-53760421a44a None None] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:49:47.332919 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:49:47.369856 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780ac57f-6f9d-4613-87dd-22186ba22639 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:49:47.370836 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780ac57f-6f9d-4613-87dd-22186ba22639 None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:49:47.371540 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780ac57f-6f9d-4613-87dd-22186ba22639 None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:49:47.371722 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780ac57f-6f9d-4613-87dd-22186ba22639 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:49:47.383851 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-780ac57f-6f9d-4613-87dd-22186ba22639 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 17:49:47.388624 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application [None req-780ac57f-6f9d-4613-87dd-22186ba22639 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 15 17:49:47.388624 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 17:49:47.388624 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 17:49:47.388624 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 17:49:47.388624 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 17:49:47.388624 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 17:49:47.388624 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 17:49:47.388624 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 17:49:47.388624 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 17:49:47.388624 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 17:49:47.388624 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 17:49:47.388624 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 17:49:47.388624 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 17:49:47.388624 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 17:49:47.388624 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 17:49:47.388624 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 17:49:47.391299 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 17:49:47.391299 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 17:49:47.391299 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 17:49:47.391299 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 17:49:47.391299 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 17:49:47.391299 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 17:49:47.391299 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 17:49:47.391299 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 17:49:47.391299 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 17:49:47.391299 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 17:49:47.391299 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 17:49:47.391299 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application with Lock( Sep 15 17:49:47.391299 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 17:49:47.391299 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._enter() Sep 15 17:49:47.391299 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 17:49:47.391299 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 17:49:47.392360 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 17:49:47.392360 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.creator() Sep 15 17:49:47.392360 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 17:49:47.392360 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application created_value = creator( Sep 15 17:49:47.392360 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 17:49:47.392360 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 17:49:47.392360 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 17:49:47.392360 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 17:49:47.392360 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 17:49:47.392360 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 17:49:47.392360 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 15 17:49:47.392360 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Sep 15 17:49:47.392360 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 515/1050] 10.222.0.25 () {56 vars in 1120 bytes} [Thu Sep 15 17:49:47 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 15 17:49:47.392360 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc8b941-4faa-4a53-ab04-2734bb9c2a36 None None] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:49:47.393712 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc8b941-4faa-4a53-ab04-2734bb9c2a36 None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:49:47.393712 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc8b941-4faa-4a53-ab04-2734bb9c2a36 None None] PATH_INFO: `/` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:49:47.393712 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 516/1051] 10.222.0.25 () {54 vars in 927 bytes} [Thu Sep 15 17:49:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 17:49:47.396146 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc8b941-4faa-4a53-ab04-2734bb9c2a36 None None] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:49:47.444918 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aaf38c4-b2d8-4e12-9421-53760421a44a None None] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:49:47.491498 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60bd92fc-0531-4539-a25a-853ad7d2c7a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:49:47.492141 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bd92fc-0531-4539-a25a-853ad7d2c7a9 None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:49:47.492618 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bd92fc-0531-4539-a25a-853ad7d2c7a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:49:47.493068 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bd92fc-0531-4539-a25a-853ad7d2c7a9 None admin] PATH_INFO: `/v3/services/image` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:49:47.494160 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60bd92fc-0531-4539-a25a-853ad7d2c7a9 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:49:47.495885 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60bd92fc-0531-4539-a25a-853ad7d2c7a9 None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:49:47.506743 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application [None req-60bd92fc-0531-4539-a25a-853ad7d2c7a9 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Sep 15 17:49:47.506743 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 17:49:47.506743 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 15 17:49:47.506743 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 15 17:49:47.506743 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 15 17:49:47.506743 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 15 17:49:47.506743 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 15 17:49:47.506743 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 15 17:49:47.506743 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 15 17:49:47.506743 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Sep 15 17:49:47.506743 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 15 17:49:47.506743 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Sep 15 17:49:47.506743 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 17:49:47.506743 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 17:49:47.506743 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 17:49:47.506743 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 17:49:47.506743 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 17:49:47.508272 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 17:49:47.508272 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 17:49:47.508272 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 17:49:47.508272 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 17:49:47.508272 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 17:49:47.508272 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 17:49:47.508272 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 15 17:49:47.508272 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 15 17:49:47.508272 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 15 17:49:47.508272 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 15 17:49:47.508272 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 17:49:47.508272 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 17:49:47.508272 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 17:49:47.508272 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 17:49:47.508272 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 17:49:47.508272 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 17:49:47.509135 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 17:49:47.509135 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application with Lock( Sep 15 17:49:47.509135 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 17:49:47.509135 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._enter() Sep 15 17:49:47.509135 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 17:49:47.509135 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 17:49:47.509135 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 17:49:47.509135 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.creator() Sep 15 17:49:47.509135 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 17:49:47.509135 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application created_value = creator( Sep 15 17:49:47.509135 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 15 17:49:47.509135 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 15 17:49:47.509135 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 15 17:49:47.509135 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Sep 15 17:49:47.509135 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 536/1052] 10.222.0.25 () {56 vars in 1105 bytes} [Thu Sep 15 17:49:47 2022] GET /identity/v3/services/image => generated 86 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 17:49:47.509971 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb539e1-1285-48ee-94e8-e230b9ef8064 None None] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:49:47.509971 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb539e1-1285-48ee-94e8-e230b9ef8064 None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:49:47.509971 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb539e1-1285-48ee-94e8-e230b9ef8064 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:49:47.523871 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc8b941-4faa-4a53-ab04-2734bb9c2a36 None None] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:49:47.531658 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.auth.core [None req-dcb539e1-1285-48ee-94e8-e230b9ef8064 None None] MFA Rules not processed for user `5cfa58ef86774ab7800bf91930bf6028`. Rule list: `[]` (Enabled: `True`). {{(pid=81593) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 17:49:47.532867 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-dcb539e1-1285-48ee-94e8-e230b9ef8064 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 17:49:47.544921 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:49:47.568073 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7a26d1-32a8-48a3-be8f-1a296760870e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:49:47.568757 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7a26d1-32a8-48a3-be8f-1a296760870e None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:49:47.569048 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7a26d1-32a8-48a3-be8f-1a296760870e None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:49:47.569346 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7a26d1-32a8-48a3-be8f-1a296760870e None admin] PATH_INFO: `/v3/roles` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:49:47.570116 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f7a26d1-32a8-48a3-be8f-1a296760870e None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81592) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 17:49:47.570492 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f7a26d1-32a8-48a3-be8f-1a296760870e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:49:47.571922 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f7a26d1-32a8-48a3-be8f-1a296760870e None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:49:47.583966 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 517/1053] 10.222.0.25 () {56 vars in 1115 bytes} [Thu Sep 15 17:49:47 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 17:49:47.585027 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7a26d1-32a8-48a3-be8f-1a296760870e None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:49:47.619305 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:49:47.629061 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 537/1054] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Sep 15 17:49:47 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 15 17:49:47.629938 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb539e1-1285-48ee-94e8-e230b9ef8064 None None] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:49:47.727673 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7a26d1-32a8-48a3-be8f-1a296760870e None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:49:47.775096 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8787253-27eb-4580-86fa-9f87ecf7147b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:49:47.776080 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8787253-27eb-4580-86fa-9f87ecf7147b None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:49:47.776364 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8787253-27eb-4580-86fa-9f87ecf7147b None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:49:47.776635 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8787253-27eb-4580-86fa-9f87ecf7147b None admin] PATH_INFO: `/v3/services` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:49:47.777261 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8787253-27eb-4580-86fa-9f87ecf7147b None admin] RBAC: Adding query filter params (name=image) {{(pid=81592) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 17:49:47.777621 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8787253-27eb-4580-86fa-9f87ecf7147b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:49:47.779133 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8787253-27eb-4580-86fa-9f87ecf7147b None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:49:47.784648 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 518/1055] 10.222.0.25 () {56 vars in 1108 bytes} [Thu Sep 15 17:49:47 2022] GET /identity/v3/services?name=image => generated 122 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 17:49:47.788544 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb539e1-1285-48ee-94e8-e230b9ef8064 None None] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:49:47.790605 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8787253-27eb-4580-86fa-9f87ecf7147b None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:49:47.840103 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c179d6-312a-499a-963a-c9937d714597 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:49:47.840736 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c179d6-312a-499a-963a-c9937d714597 None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:49:47.841014 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c179d6-312a-499a-963a-c9937d714597 None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:49:47.841282 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c179d6-312a-499a-963a-c9937d714597 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:49:47.857184 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c179d6-312a-499a-963a-c9937d714597 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:49:47.858997 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c179d6-312a-499a-963a-c9937d714597 None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:49:47.869565 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:49:47.882938 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application [None req-63c179d6-312a-499a-963a-c9937d714597 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 17:49:47.882938 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 17:49:47.882938 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 17:49:47.882938 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 17:49:47.882938 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 17:49:47.882938 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 17:49:47.882938 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 17:49:47.882938 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 17:49:47.882938 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 17:49:47.882938 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 17:49:47.882938 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 17:49:47.882938 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 17:49:47.882938 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 15 17:49:47.882938 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 15 17:49:47.882938 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 15 17:49:47.882938 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 15 17:49:47.884773 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 17:49:47.884773 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 17:49:47.884773 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 17:49:47.884773 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 17:49:47.884773 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 17:49:47.884773 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 17:49:47.884773 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 17:49:47.884773 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application with Lock( Sep 15 17:49:47.884773 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 17:49:47.884773 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._enter() Sep 15 17:49:47.884773 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 17:49:47.884773 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 17:49:47.884773 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 17:49:47.884773 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.creator() Sep 15 17:49:47.884773 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 17:49:47.884773 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application created_value = creator( Sep 15 17:49:47.884773 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 15 17:49:47.887079 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 15 17:49:47.887079 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 17:49:47.887079 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Sep 15 17:49:47.887079 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 538/1056] 10.222.0.25 () {56 vars in 1108 bytes} [Thu Sep 15 17:49:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 17:49:47.891948 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c179d6-312a-499a-963a-c9937d714597 None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:49:47.943000 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:49:47.958711 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8787253-27eb-4580-86fa-9f87ecf7147b None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:49:48.003923 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5050d4a8-b11f-4d7d-a9e6-c17dfadd4a3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:49:48.004535 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5050d4a8-b11f-4d7d-a9e6-c17dfadd4a3e None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:49:48.004812 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5050d4a8-b11f-4d7d-a9e6-c17dfadd4a3e None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:49:48.005081 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5050d4a8-b11f-4d7d-a9e6-c17dfadd4a3e None admin] PATH_INFO: `/v3/services` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:49:48.005865 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5050d4a8-b11f-4d7d-a9e6-c17dfadd4a3e None admin] RBAC: Adding query filter params (type=image) {{(pid=81592) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 17:49:48.006206 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5050d4a8-b11f-4d7d-a9e6-c17dfadd4a3e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:49:48.007592 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5050d4a8-b11f-4d7d-a9e6-c17dfadd4a3e None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:49:48.024660 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 519/1057] 10.222.0.25 () {56 vars in 1108 bytes} [Thu Sep 15 17:49:47 2022] GET /identity/v3/services?type=image => generated 350 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 17:49:48.024660 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5050d4a8-b11f-4d7d-a9e6-c17dfadd4a3e None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:49:48.043590 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c179d6-312a-499a-963a-c9937d714597 None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:49:48.082576 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a339ad19-ea36-45b7-83fc-1f8b7dbf570a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:49:48.083402 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a339ad19-ea36-45b7-83fc-1f8b7dbf570a None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:49:48.083857 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a339ad19-ea36-45b7-83fc-1f8b7dbf570a None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:49:48.084197 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a339ad19-ea36-45b7-83fc-1f8b7dbf570a None admin] PATH_INFO: `/v3/domains` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:49:48.084895 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a339ad19-ea36-45b7-83fc-1f8b7dbf570a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81593) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 17:49:48.085405 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a339ad19-ea36-45b7-83fc-1f8b7dbf570a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:49:48.087092 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a339ad19-ea36-45b7-83fc-1f8b7dbf570a None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:49:48.101217 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 539/1058] 10.222.0.25 () {56 vars in 1109 bytes} [Thu Sep 15 17:49:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 17:49:48.101217 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a339ad19-ea36-45b7-83fc-1f8b7dbf570a None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:49:48.157831 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5050d4a8-b11f-4d7d-a9e6-c17dfadd4a3e None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:49:48.188186 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:49:48.205797 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b0e9dc-f3af-4718-a507-11166b409de3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:49:48.206878 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b0e9dc-f3af-4718-a507-11166b409de3 None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:49:48.207365 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b0e9dc-f3af-4718-a507-11166b409de3 None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:49:48.207851 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b0e9dc-f3af-4718-a507-11166b409de3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:49:48.221667 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b0e9dc-f3af-4718-a507-11166b409de3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 17:49:48.226581 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application [None req-30b0e9dc-f3af-4718-a507-11166b409de3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 15 17:49:48.226581 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 17:49:48.226581 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 17:49:48.226581 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 17:49:48.226581 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 17:49:48.226581 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 17:49:48.226581 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 17:49:48.226581 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 17:49:48.226581 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 17:49:48.226581 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 17:49:48.226581 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 17:49:48.226581 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 17:49:48.226581 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 17:49:48.226581 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 17:49:48.226581 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 17:49:48.226581 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 17:49:48.227560 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 17:49:48.227560 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 17:49:48.227560 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 17:49:48.227560 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 17:49:48.227560 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 17:49:48.227560 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 17:49:48.227560 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 17:49:48.227560 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 17:49:48.227560 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 17:49:48.227560 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 17:49:48.227560 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 17:49:48.227560 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application with Lock( Sep 15 17:49:48.227560 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 17:49:48.227560 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._enter() Sep 15 17:49:48.227560 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 17:49:48.227560 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 17:49:48.228840 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 17:49:48.228840 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.creator() Sep 15 17:49:48.228840 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 17:49:48.228840 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application created_value = creator( Sep 15 17:49:48.228840 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 17:49:48.228840 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 17:49:48.228840 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 17:49:48.228840 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 17:49:48.228840 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 17:49:48.228840 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 17:49:48.228840 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 15 17:49:48.228840 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Sep 15 17:49:48.228840 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 520/1059] 10.222.0.25 () {56 vars in 1096 bytes} [Thu Sep 15 17:49:48 2022] GET /identity/v3/roles/admin => generated 83 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 17:49:48.228840 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b0e9dc-f3af-4718-a507-11166b409de3 None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:49:48.238007 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a339ad19-ea36-45b7-83fc-1f8b7dbf570a None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:49:48.250024 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:49:48.279231 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488dfdb7-4ebe-4048-9338-1924fec0b207 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:49:48.279759 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488dfdb7-4ebe-4048-9338-1924fec0b207 None admin] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:49:48.280030 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488dfdb7-4ebe-4048-9338-1924fec0b207 None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:49:48.280293 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488dfdb7-4ebe-4048-9338-1924fec0b207 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:49:48.281722 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-488dfdb7-4ebe-4048-9338-1924fec0b207 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:49:48.283359 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-488dfdb7-4ebe-4048-9338-1924fec0b207 None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:49:48.306192 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 540/1060] 10.222.0.25 () {60 vars in 1144 bytes} [Thu Sep 15 17:49:48 2022] POST /identity/v3/endpoints => generated 327 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 17:49:48.310376 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488dfdb7-4ebe-4048-9338-1924fec0b207 None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:49:48.370232 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b0e9dc-f3af-4718-a507-11166b409de3 None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:49:48.429207 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1dd6cd3-9dad-4470-a5a7-0cdb51c0115e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:49:48.430033 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1dd6cd3-9dad-4470-a5a7-0cdb51c0115e None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:49:48.430318 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1dd6cd3-9dad-4470-a5a7-0cdb51c0115e None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:49:48.430590 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1dd6cd3-9dad-4470-a5a7-0cdb51c0115e None admin] PATH_INFO: `/v3/users/nova` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:49:48.442364 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1dd6cd3-9dad-4470-a5a7-0cdb51c0115e None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:49:48.443841 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488dfdb7-4ebe-4048-9338-1924fec0b207 None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:49:48.444119 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1dd6cd3-9dad-4470-a5a7-0cdb51c0115e None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:49:48.460063 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application [None req-f1dd6cd3-9dad-4470-a5a7-0cdb51c0115e None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 15 17:49:48.460063 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 17:49:48.460063 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 17:49:48.460063 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 17:49:48.460063 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 17:49:48.460063 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 17:49:48.460063 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 17:49:48.460063 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 17:49:48.460063 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 17:49:48.460063 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 17:49:48.460063 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 17:49:48.460063 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 17:49:48.460063 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 15 17:49:48.460063 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 15 17:49:48.460063 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 15 17:49:48.460063 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 15 17:49:48.461145 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 17:49:48.461145 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 17:49:48.461145 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 15 17:49:48.461145 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 15 17:49:48.461145 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 15 17:49:48.461145 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 15 17:49:48.461145 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 17:49:48.461145 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 17:49:48.461145 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 17:49:48.461145 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 17:49:48.461145 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 17:49:48.461145 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application with Lock( Sep 15 17:49:48.461145 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 17:49:48.461145 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._enter() Sep 15 17:49:48.461145 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 17:49:48.461145 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 17:49:48.461145 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 17:49:48.461145 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.creator() Sep 15 17:49:48.462159 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 17:49:48.462159 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application created_value = creator( Sep 15 17:49:48.462159 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 15 17:49:48.462159 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 15 17:49:48.462159 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 15 17:49:48.462159 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 15 17:49:48.462159 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 15 17:49:48.462159 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 15 17:49:48.462159 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 15 17:49:48.462159 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Sep 15 17:49:48.462159 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 521/1061] 10.222.0.25 () {56 vars in 1093 bytes} [Thu Sep 15 17:49:48 2022] GET /identity/v3/users/nova => generated 82 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 17:49:48.464314 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:49:48.470230 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1dd6cd3-9dad-4470-a5a7-0cdb51c0115e None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:49:48.499860 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66dd27a7-d290-40ee-87cb-bbc3ff1a646e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:49:48.500634 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66dd27a7-d290-40ee-87cb-bbc3ff1a646e None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:49:48.500927 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66dd27a7-d290-40ee-87cb-bbc3ff1a646e None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:49:48.501193 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66dd27a7-d290-40ee-87cb-bbc3ff1a646e None admin] PATH_INFO: `/v3/roles` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:49:48.501926 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66dd27a7-d290-40ee-87cb-bbc3ff1a646e None admin] RBAC: Adding query filter params (name=admin) {{(pid=81593) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 17:49:48.502227 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66dd27a7-d290-40ee-87cb-bbc3ff1a646e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:49:48.503687 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66dd27a7-d290-40ee-87cb-bbc3ff1a646e None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:49:48.514669 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 541/1062] 10.222.0.25 () {56 vars in 1099 bytes} [Thu Sep 15 17:49:48 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 17:49:48.521486 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66dd27a7-d290-40ee-87cb-bbc3ff1a646e None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:49:48.589849 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:49:48.620919 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1dd6cd3-9dad-4470-a5a7-0cdb51c0115e None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:49:48.637691 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66dd27a7-d290-40ee-87cb-bbc3ff1a646e None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:49:48.663985 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c16447-72e5-4621-ba68-dbec72d5f1d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:49:48.664598 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c16447-72e5-4621-ba68-dbec72d5f1d8 None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:49:48.664871 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c16447-72e5-4621-ba68-dbec72d5f1d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:49:48.665135 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c16447-72e5-4621-ba68-dbec72d5f1d8 None admin] PATH_INFO: `/v3/users` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:49:48.665998 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c16447-72e5-4621-ba68-dbec72d5f1d8 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81592) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 17:49:48.666193 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c16447-72e5-4621-ba68-dbec72d5f1d8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:49:48.667742 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c16447-72e5-4621-ba68-dbec72d5f1d8 None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:49:48.682687 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f754a4-0f7f-4bcf-b030-61eb38ff7052 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:49:48.683731 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f754a4-0f7f-4bcf-b030-61eb38ff7052 None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:49:48.683883 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f754a4-0f7f-4bcf-b030-61eb38ff7052 None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:49:48.684071 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f754a4-0f7f-4bcf-b030-61eb38ff7052 None admin] PATH_INFO: `/v3/users/e8ccf4c7485d4d3e8fd7acbdf3d6a6ff` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:49:48.688927 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 522/1063] 10.222.0.25 () {56 vars in 1133 bytes} [Thu Sep 15 17:49:48 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 17:49:48.694902 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c16447-72e5-4621-ba68-dbec72d5f1d8 None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:49:48.703620 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f754a4-0f7f-4bcf-b030-61eb38ff7052 None admin] RBAC: Authorizing `identity:get_user(user_id=e8ccf4c7485d4d3e8fd7acbdf3d6a6ff)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:49:48.705336 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f754a4-0f7f-4bcf-b030-61eb38ff7052 None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:49:48.708498 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 542/1064] 10.222.0.25 () {56 vars in 1177 bytes} [Thu Sep 15 17:49:48 2022] GET /identity/v3/users/e8ccf4c7485d4d3e8fd7acbdf3d6a6ff => generated 285 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 17:49:48.715069 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f754a4-0f7f-4bcf-b030-61eb38ff7052 None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:49:48.757261 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:49:48.810091 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c16447-72e5-4621-ba68-dbec72d5f1d8 None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:49:48.836825 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f754a4-0f7f-4bcf-b030-61eb38ff7052 None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:49:48.846929 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:49:48.856026 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9abbb6-ea6f-4ffd-95b1-f798c995f953 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:49:48.857222 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9abbb6-ea6f-4ffd-95b1-f798c995f953 None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:49:48.857690 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9abbb6-ea6f-4ffd-95b1-f798c995f953 None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:49:48.857971 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9abbb6-ea6f-4ffd-95b1-f798c995f953 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:49:48.870243 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9abbb6-ea6f-4ffd-95b1-f798c995f953 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:49:48.871710 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9abbb6-ea6f-4ffd-95b1-f798c995f953 None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:49:48.881029 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7272a23-3631-403a-864c-ebe91a8c60b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:49:48.882005 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7272a23-3631-403a-864c-ebe91a8c60b3 None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:49:48.882005 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7272a23-3631-403a-864c-ebe91a8c60b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:49:48.882289 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7272a23-3631-403a-864c-ebe91a8c60b3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:49:48.888359 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application [None req-9c9abbb6-ea6f-4ffd-95b1-f798c995f953 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 17:49:48.888359 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 17:49:48.888359 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 17:49:48.888359 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 17:49:48.888359 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 17:49:48.888359 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 17:49:48.888359 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 17:49:48.888359 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 17:49:48.888359 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 17:49:48.888359 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 17:49:48.888359 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 17:49:48.888359 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 17:49:48.888359 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 15 17:49:48.888359 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 15 17:49:48.888359 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 15 17:49:48.888359 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 15 17:49:48.889493 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 17:49:48.889493 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 17:49:48.889493 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 17:49:48.889493 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 17:49:48.889493 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 17:49:48.889493 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 17:49:48.889493 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 17:49:48.889493 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application with Lock( Sep 15 17:49:48.889493 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 17:49:48.889493 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._enter() Sep 15 17:49:48.889493 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 17:49:48.889493 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 17:49:48.889493 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 17:49:48.889493 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.creator() Sep 15 17:49:48.889493 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 17:49:48.889493 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application created_value = creator( Sep 15 17:49:48.889493 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 15 17:49:48.895632 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 15 17:49:48.895632 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 17:49:48.895632 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Sep 15 17:49:48.895632 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 523/1065] 10.222.0.25 () {56 vars in 1108 bytes} [Thu Sep 15 17:49:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 15 17:49:48.895887 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9abbb6-ea6f-4ffd-95b1-f798c995f953 None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:49:48.974404 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7272a23-3631-403a-864c-ebe91a8c60b3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:49:48.976445 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7272a23-3631-403a-864c-ebe91a8c60b3 None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:49:49.012325 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:49:49.025489 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9abbb6-ea6f-4ffd-95b1-f798c995f953 None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:49:49.073994 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954b49c0-4e72-4ed1-9b8d-682a5462e2af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:49:49.074751 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954b49c0-4e72-4ed1-9b8d-682a5462e2af None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:49:49.075173 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954b49c0-4e72-4ed1-9b8d-682a5462e2af None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:49:49.075354 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954b49c0-4e72-4ed1-9b8d-682a5462e2af None admin] PATH_INFO: `/v3/domains` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:49:49.076093 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954b49c0-4e72-4ed1-9b8d-682a5462e2af None admin] RBAC: Adding query filter params (name=Default) {{(pid=81592) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 17:49:49.076451 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954b49c0-4e72-4ed1-9b8d-682a5462e2af None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:49:49.078624 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954b49c0-4e72-4ed1-9b8d-682a5462e2af None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:49:49.097877 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 543/1066] 10.222.0.25 () {58 vars in 1282 bytes} [Thu Sep 15 17:49:48 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 383 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 15 17:49:49.103967 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7272a23-3631-403a-864c-ebe91a8c60b3 None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:49:49.104160 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 524/1067] 10.222.0.25 () {56 vars in 1109 bytes} [Thu Sep 15 17:49:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 17:49:49.111522 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954b49c0-4e72-4ed1-9b8d-682a5462e2af None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:49:49.176044 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:49:49.242257 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7272a23-3631-403a-864c-ebe91a8c60b3 None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:49:49.244854 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954b49c0-4e72-4ed1-9b8d-682a5462e2af None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:49:49.300130 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236d2702-9fc5-467f-be9d-c41e64581f67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:49:49.301054 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236d2702-9fc5-467f-be9d-c41e64581f67 None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:49:49.301636 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236d2702-9fc5-467f-be9d-c41e64581f67 None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:49:49.301907 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236d2702-9fc5-467f-be9d-c41e64581f67 None admin] PATH_INFO: `/v3/projects/2e01052d505748a3b5b2f06f06cf7819` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:49:49.303286 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-236d2702-9fc5-467f-be9d-c41e64581f67 None admin] RBAC: Authorizing `identity:get_project(project_id=2e01052d505748a3b5b2f06f06cf7819)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:49:49.304764 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-236d2702-9fc5-467f-be9d-c41e64581f67 None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:49:49.304924 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270b8938-0c3e-4607-b1f5-1fd3907b20b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:49:49.305835 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270b8938-0c3e-4607-b1f5-1fd3907b20b8 None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:49:49.306314 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270b8938-0c3e-4607-b1f5-1fd3907b20b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:49:49.306789 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270b8938-0c3e-4607-b1f5-1fd3907b20b8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:49:49.311604 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 544/1068] 10.222.0.25 () {56 vars in 1186 bytes} [Thu Sep 15 17:49:49 2022] GET /identity/v3/projects/2e01052d505748a3b5b2f06f06cf7819 => generated 311 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 17:49:49.312566 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236d2702-9fc5-467f-be9d-c41e64581f67 None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:49:49.315102 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-270b8938-0c3e-4607-b1f5-1fd3907b20b8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:49:49.316634 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-270b8938-0c3e-4607-b1f5-1fd3907b20b8 None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:49:49.317646 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:49:49.329287 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application [None req-270b8938-0c3e-4607-b1f5-1fd3907b20b8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 15 17:49:49.329287 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 17:49:49.329287 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 17:49:49.329287 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 17:49:49.329287 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 17:49:49.329287 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 17:49:49.329287 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 17:49:49.329287 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 17:49:49.329287 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 17:49:49.329287 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 17:49:49.329287 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 17:49:49.329287 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 17:49:49.329287 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 15 17:49:49.329287 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 15 17:49:49.329287 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 15 17:49:49.330402 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 15 17:49:49.330402 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 17:49:49.330402 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 17:49:49.330402 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 17:49:49.330402 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 17:49:49.330402 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 17:49:49.330402 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 17:49:49.330402 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 17:49:49.330402 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application with Lock( Sep 15 17:49:49.330402 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 17:49:49.330402 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._enter() Sep 15 17:49:49.330402 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 17:49:49.330402 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 17:49:49.330402 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 17:49:49.330402 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.creator() Sep 15 17:49:49.330402 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 17:49:49.330402 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application created_value = creator( Sep 15 17:49:49.331387 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 15 17:49:49.331387 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 15 17:49:49.331387 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 15 17:49:49.331387 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 15 17:49:49.331387 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 15 17:49:49.331387 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 15 17:49:49.331387 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 15 17:49:49.331387 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Sep 15 17:49:49.331387 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 525/1069] 10.222.0.25 () {56 vars in 1111 bytes} [Thu Sep 15 17:49:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 15 17:49:49.336618 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270b8938-0c3e-4607-b1f5-1fd3907b20b8 None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:49:49.445543 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236d2702-9fc5-467f-be9d-c41e64581f67 None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:49:49.458199 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270b8938-0c3e-4607-b1f5-1fd3907b20b8 None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:49:49.463268 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:49:49.491932 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d6502e-27e2-469d-8b87-bfd733227803 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:49:49.492829 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d6502e-27e2-469d-8b87-bfd733227803 None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:49:49.493219 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d6502e-27e2-469d-8b87-bfd733227803 None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:49:49.493978 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d6502e-27e2-469d-8b87-bfd733227803 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:49:49.494852 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d6502e-27e2-469d-8b87-bfd733227803 None admin] RBAC: Adding query filter params (role.id=a9e42be86923434f8af52d3fc07fb4f7, scope.project.id=2e01052d505748a3b5b2f06f06cf7819, user.id=e8ccf4c7485d4d3e8fd7acbdf3d6a6ff) {{(pid=81593) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 17:49:49.495431 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d6502e-27e2-469d-8b87-bfd733227803 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:49:49.497799 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d6502e-27e2-469d-8b87-bfd733227803 None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:49:49.503595 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bcf2987-482e-4b64-9c9a-0c5628dcff52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:49:49.504618 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcf2987-482e-4b64-9c9a-0c5628dcff52 None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:49:49.513373 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcf2987-482e-4b64-9c9a-0c5628dcff52 None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:49:49.513373 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcf2987-482e-4b64-9c9a-0c5628dcff52 None admin] PATH_INFO: `/v3/projects` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:49:49.513787 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 545/1070] 10.222.0.25 () {56 vars in 1374 bytes} [Thu Sep 15 17:49:49 2022] GET /identity/v3/role_assignments?user.id=e8ccf4c7485d4d3e8fd7acbdf3d6a6ff&scope.project.id=2e01052d505748a3b5b2f06f06cf7819&role.id=a9e42be86923434f8af52d3fc07fb4f7 => generated 259 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 17:49:49.513892 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bcf2987-482e-4b64-9c9a-0c5628dcff52 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81592) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 17:49:49.513892 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bcf2987-482e-4b64-9c9a-0c5628dcff52 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:49:49.513892 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bcf2987-482e-4b64-9c9a-0c5628dcff52 None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:49:49.525327 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 526/1071] 10.222.0.25 () {56 vars in 1148 bytes} [Thu Sep 15 17:49:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 17:49:49.531752 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d6502e-27e2-469d-8b87-bfd733227803 None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:49:49.621370 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:49:49.669897 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d6502e-27e2-469d-8b87-bfd733227803 None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:49:49.710339 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efddb9fe-5a4a-4a99-831c-fde00d61212a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:49:49.711226 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efddb9fe-5a4a-4a99-831c-fde00d61212a None admin] REQUEST_METHOD: `PUT` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:49:49.711661 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efddb9fe-5a4a-4a99-831c-fde00d61212a None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:49:49.712074 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efddb9fe-5a4a-4a99-831c-fde00d61212a None admin] PATH_INFO: `/v3/projects/1213c0d1b584404ba3998e136f166e89/users/fe2244818e4d4dca9c424cd078653e6a/roles/99a6f32f74a84d0989c7527d9985370e` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:49:49.714438 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efddb9fe-5a4a-4a99-831c-fde00d61212a None admin] RBAC: Authorizing `identity:create_grant(project_id=1213c0d1b584404ba3998e136f166e89, user_id=fe2244818e4d4dca9c424cd078653e6a, role_id=99a6f32f74a84d0989c7527d9985370e)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:49:49.716013 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efddb9fe-5a4a-4a99-831c-fde00d61212a None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:49:49.731264 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 546/1072] 10.222.0.25 () {58 vars in 1439 bytes} [Thu Sep 15 17:49:49 2022] PUT /identity/v3/projects/1213c0d1b584404ba3998e136f166e89/users/fe2244818e4d4dca9c424cd078653e6a/roles/99a6f32f74a84d0989c7527d9985370e => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 17:49:50.636749 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaee1cb6-e2b5-4958-aa1d-20135756fd40 None None] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:49:50.637555 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaee1cb6-e2b5-4958-aa1d-20135756fd40 None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:49:50.637555 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaee1cb6-e2b5-4958-aa1d-20135756fd40 None None] PATH_INFO: `/` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:49:50.638911 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 527/1073] 10.222.0.25 () {54 vars in 927 bytes} [Thu Sep 15 17:49:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 17:49:50.644389 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de23b2e-f64f-4e00-99d9-3e2eec670215 None None] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:49:50.644974 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de23b2e-f64f-4e00-99d9-3e2eec670215 None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:49:50.644974 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de23b2e-f64f-4e00-99d9-3e2eec670215 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:49:50.664961 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.auth.core [None req-8de23b2e-f64f-4e00-99d9-3e2eec670215 None None] MFA Rules not processed for user `5cfa58ef86774ab7800bf91930bf6028`. Rule list: `[]` (Enabled: `True`). {{(pid=81593) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 17:49:50.666153 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-8de23b2e-f64f-4e00-99d9-3e2eec670215 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 17:49:50.777016 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 547/1074] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Sep 15 17:49:50 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 15 17:49:51.061283 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaee1cb6-e2b5-4958-aa1d-20135756fd40 None None] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:49:51.185065 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaee1cb6-e2b5-4958-aa1d-20135756fd40 None None] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:49:51.230113 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7689d5-da22-4f55-a68e-f8a42af2a182 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:49:51.230686 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7689d5-da22-4f55-a68e-f8a42af2a182 None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:49:51.230969 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7689d5-da22-4f55-a68e-f8a42af2a182 None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:49:51.231344 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7689d5-da22-4f55-a68e-f8a42af2a182 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:49:51.274015 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:49:51.323222 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b7689d5-da22-4f55-a68e-f8a42af2a182 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:49:51.324674 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b7689d5-da22-4f55-a68e-f8a42af2a182 None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:49:51.449669 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 528/1075] 10.222.0.25 () {58 vars in 1282 bytes} [Thu Sep 15 17:49:51 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 386 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 15 17:49:51.452985 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de23b2e-f64f-4e00-99d9-3e2eec670215 None None] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:49:51.523328 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:49:51.593003 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de23b2e-f64f-4e00-99d9-3e2eec670215 None None] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:49:51.633289 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7021c06c-0e46-408d-9d37-57303f81beb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:49:51.633957 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7021c06c-0e46-408d-9d37-57303f81beb5 None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:49:51.634238 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7021c06c-0e46-408d-9d37-57303f81beb5 None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:49:51.634511 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7021c06c-0e46-408d-9d37-57303f81beb5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:49:51.651731 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7021c06c-0e46-408d-9d37-57303f81beb5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:49:51.653632 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7021c06c-0e46-408d-9d37-57303f81beb5 None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:49:51.676697 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application [None req-7021c06c-0e46-408d-9d37-57303f81beb5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 17:49:51.676697 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 17:49:51.676697 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 17:49:51.676697 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 17:49:51.676697 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 17:49:51.676697 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 17:49:51.676697 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 17:49:51.676697 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 17:49:51.676697 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 17:49:51.676697 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 17:49:51.676697 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 17:49:51.676697 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 17:49:51.676697 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 15 17:49:51.676697 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 15 17:49:51.676697 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 15 17:49:51.676697 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 15 17:49:51.677780 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 17:49:51.677780 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 17:49:51.677780 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 17:49:51.677780 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 17:49:51.677780 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 17:49:51.677780 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 17:49:51.677780 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 17:49:51.677780 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application with Lock( Sep 15 17:49:51.677780 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 17:49:51.677780 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._enter() Sep 15 17:49:51.677780 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 17:49:51.677780 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 17:49:51.677780 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 17:49:51.677780 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.creator() Sep 15 17:49:51.677780 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 17:49:51.677780 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application created_value = creator( Sep 15 17:49:51.677780 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 15 17:49:51.678682 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 15 17:49:51.678682 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 17:49:51.678682 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Sep 15 17:49:51.679482 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 548/1076] 10.222.0.25 () {56 vars in 1108 bytes} [Thu Sep 15 17:49:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 17:49:51.685742 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7689d5-da22-4f55-a68e-f8a42af2a182 None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:49:51.781181 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:49:51.783970 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0268df45-8306-4281-b893-6c9ec0a7f86f None None] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:49:51.784318 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0268df45-8306-4281-b893-6c9ec0a7f86f None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:49:51.784600 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0268df45-8306-4281-b893-6c9ec0a7f86f None None] PATH_INFO: `/` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:49:51.786359 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 549/1077] 10.222.0.25 () {54 vars in 927 bytes} [Thu Sep 15 17:49:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 17:49:51.794395 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c2b4df-0cec-4b63-be02-f5002803f9b0 None None] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:49:51.794693 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c2b4df-0cec-4b63-be02-f5002803f9b0 None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:49:51.794969 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c2b4df-0cec-4b63-be02-f5002803f9b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:49:51.815748 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.auth.core [None req-81c2b4df-0cec-4b63-be02-f5002803f9b0 None None] MFA Rules not processed for user `5cfa58ef86774ab7800bf91930bf6028`. Rule list: `[]` (Enabled: `True`). {{(pid=81593) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 17:49:51.817027 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-81c2b4df-0cec-4b63-be02-f5002803f9b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 17:49:51.835770 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7689d5-da22-4f55-a68e-f8a42af2a182 None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:49:51.880660 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e01c57-746e-41dd-b933-cdb34e41fdca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:49:51.881276 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e01c57-746e-41dd-b933-cdb34e41fdca None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:49:51.881583 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e01c57-746e-41dd-b933-cdb34e41fdca None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:49:51.881854 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e01c57-746e-41dd-b933-cdb34e41fdca None admin] PATH_INFO: `/v3/domains` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:49:51.882504 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e01c57-746e-41dd-b933-cdb34e41fdca None admin] RBAC: Adding query filter params (name=Default) {{(pid=81592) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 17:49:51.882806 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e01c57-746e-41dd-b933-cdb34e41fdca None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:49:51.884175 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e01c57-746e-41dd-b933-cdb34e41fdca None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:49:51.900804 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 550/1078] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Sep 15 17:49:51 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 15 17:49:51.913363 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 529/1079] 10.222.0.25 () {56 vars in 1109 bytes} [Thu Sep 15 17:49:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 17:49:52.043323 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839db38e-5ec5-494c-a640-876008228f4b None None] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:49:52.043627 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839db38e-5ec5-494c-a640-876008228f4b None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:49:52.043774 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839db38e-5ec5-494c-a640-876008228f4b None None] PATH_INFO: `/` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:49:52.045497 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 551/1080] 10.222.0.25 () {54 vars in 927 bytes} [Thu Sep 15 17:49:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 17:49:52.051537 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457f6ac3-c409-4847-b3ed-85fae2a91979 None None] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:49:52.051857 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457f6ac3-c409-4847-b3ed-85fae2a91979 None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:49:52.052093 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457f6ac3-c409-4847-b3ed-85fae2a91979 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:49:52.072328 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.auth.core [None req-457f6ac3-c409-4847-b3ed-85fae2a91979 None None] MFA Rules not processed for user `5cfa58ef86774ab7800bf91930bf6028`. Rule list: `[]` (Enabled: `True`). {{(pid=81592) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 17:49:52.073684 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-457f6ac3-c409-4847-b3ed-85fae2a91979 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 17:49:52.160839 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 530/1081] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Sep 15 17:49:52 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 15 17:49:52.190314 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839db38e-5ec5-494c-a640-876008228f4b None None] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:49:52.241538 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:49:52.308803 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839db38e-5ec5-494c-a640-876008228f4b None None] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:49:52.350111 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbed1dd1-723e-4bc6-8c3e-e0bc3001fc24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:49:52.350781 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbed1dd1-723e-4bc6-8c3e-e0bc3001fc24 None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:49:52.351033 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbed1dd1-723e-4bc6-8c3e-e0bc3001fc24 None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:49:52.351304 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbed1dd1-723e-4bc6-8c3e-e0bc3001fc24 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:49:52.362111 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbed1dd1-723e-4bc6-8c3e-e0bc3001fc24 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 17:49:52.366904 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application [None req-dbed1dd1-723e-4bc6-8c3e-e0bc3001fc24 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 15 17:49:52.366904 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 17:49:52.366904 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 17:49:52.366904 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 17:49:52.366904 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 17:49:52.366904 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 17:49:52.366904 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 17:49:52.366904 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 17:49:52.366904 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 17:49:52.366904 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 17:49:52.366904 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 17:49:52.366904 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 17:49:52.366904 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 17:49:52.366904 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 17:49:52.366904 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 17:49:52.366904 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 17:49:52.368021 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 17:49:52.368021 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 17:49:52.368021 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 17:49:52.368021 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 17:49:52.368021 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 17:49:52.368021 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 17:49:52.368021 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 17:49:52.368021 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 17:49:52.368021 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 17:49:52.368021 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 17:49:52.368021 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 17:49:52.368021 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application with Lock( Sep 15 17:49:52.368021 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 17:49:52.368021 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._enter() Sep 15 17:49:52.368021 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 17:49:52.368021 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 17:49:52.368873 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 17:49:52.368873 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.creator() Sep 15 17:49:52.368873 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 17:49:52.368873 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application created_value = creator( Sep 15 17:49:52.368873 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 17:49:52.368873 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 17:49:52.368873 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 17:49:52.368873 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 17:49:52.368873 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 17:49:52.368873 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 17:49:52.368873 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 15 17:49:52.368873 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Sep 15 17:49:52.368873 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 552/1082] 10.222.0.25 () {56 vars in 1096 bytes} [Thu Sep 15 17:49:52 2022] GET /identity/v3/roles/admin => generated 83 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 17:49:52.375092 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457f6ac3-c409-4847-b3ed-85fae2a91979 None None] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:49:52.441006 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:49:52.441741 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbed1dd1-723e-4bc6-8c3e-e0bc3001fc24 None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:49:52.496655 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457f6ac3-c409-4847-b3ed-85fae2a91979 None None] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:49:52.537308 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720fdec9-435a-4ea3-b100-fdae3877eda1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:49:52.538036 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720fdec9-435a-4ea3-b100-fdae3877eda1 None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:49:52.538319 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720fdec9-435a-4ea3-b100-fdae3877eda1 None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:49:52.538594 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720fdec9-435a-4ea3-b100-fdae3877eda1 None admin] PATH_INFO: `/v3/roles` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:49:52.539259 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720fdec9-435a-4ea3-b100-fdae3877eda1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81592) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 17:49:52.539564 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720fdec9-435a-4ea3-b100-fdae3877eda1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:49:52.540926 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720fdec9-435a-4ea3-b100-fdae3877eda1 None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:49:52.550267 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 531/1083] 10.222.0.25 () {56 vars in 1099 bytes} [Thu Sep 15 17:49:52 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 17:49:52.551529 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:49:52.555888 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbed1dd1-723e-4bc6-8c3e-e0bc3001fc24 None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:49:52.556378 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720fdec9-435a-4ea3-b100-fdae3877eda1 None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:49:52.595094 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45346f6-b3c2-4489-954c-80886417a41b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:49:52.595642 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45346f6-b3c2-4489-954c-80886417a41b None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:49:52.595918 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45346f6-b3c2-4489-954c-80886417a41b None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:49:52.596192 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45346f6-b3c2-4489-954c-80886417a41b None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:49:52.609939 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d45346f6-b3c2-4489-954c-80886417a41b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 17:49:52.614826 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application [None req-d45346f6-b3c2-4489-954c-80886417a41b None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 15 17:49:52.614826 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 17:49:52.614826 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 17:49:52.614826 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 17:49:52.614826 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 17:49:52.614826 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 17:49:52.614826 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 17:49:52.614826 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 17:49:52.614826 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 17:49:52.614826 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 17:49:52.614826 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 17:49:52.614826 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 17:49:52.614826 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 17:49:52.614826 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 17:49:52.614826 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 17:49:52.614826 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 17:49:52.615943 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 17:49:52.615943 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 17:49:52.615943 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 17:49:52.615943 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 17:49:52.615943 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 17:49:52.615943 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 17:49:52.615943 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 17:49:52.615943 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 17:49:52.615943 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 17:49:52.615943 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 17:49:52.615943 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 17:49:52.615943 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application with Lock( Sep 15 17:49:52.615943 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 17:49:52.615943 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._enter() Sep 15 17:49:52.615943 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 17:49:52.615943 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 17:49:52.617215 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 17:49:52.617215 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.creator() Sep 15 17:49:52.617215 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 17:49:52.617215 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application created_value = creator( Sep 15 17:49:52.617215 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 17:49:52.617215 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 17:49:52.617215 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 17:49:52.617215 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 17:49:52.617215 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 17:49:52.617215 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 17:49:52.617215 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 15 17:49:52.617215 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Sep 15 17:49:52.617215 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 553/1084] 10.222.0.25 () {56 vars in 1120 bytes} [Thu Sep 15 17:49:52 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 15 17:49:52.622048 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45346f6-b3c2-4489-954c-80886417a41b None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:49:52.689572 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720fdec9-435a-4ea3-b100-fdae3877eda1 None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:49:52.715421 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:49:52.729632 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45346f6-b3c2-4489-954c-80886417a41b None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:49:52.738966 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d3c989-cd29-494d-9c74-30e39ffa5b0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:49:52.739939 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d3c989-cd29-494d-9c74-30e39ffa5b0a None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:49:52.739939 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d3c989-cd29-494d-9c74-30e39ffa5b0a None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:49:52.739939 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d3c989-cd29-494d-9c74-30e39ffa5b0a None admin] PATH_INFO: `/v3/users/e8ccf4c7485d4d3e8fd7acbdf3d6a6ff` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:49:52.740814 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d3c989-cd29-494d-9c74-30e39ffa5b0a None admin] RBAC: Authorizing `identity:get_user(user_id=e8ccf4c7485d4d3e8fd7acbdf3d6a6ff)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:49:52.742239 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d3c989-cd29-494d-9c74-30e39ffa5b0a None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:49:52.743865 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 532/1085] 10.222.0.25 () {56 vars in 1177 bytes} [Thu Sep 15 17:49:52 2022] GET /identity/v3/users/e8ccf4c7485d4d3e8fd7acbdf3d6a6ff => generated 285 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 17:49:52.750918 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d3c989-cd29-494d-9c74-30e39ffa5b0a None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:49:52.775784 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27886894-78d3-47d6-8b8d-7fb747ea97c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:49:52.776399 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27886894-78d3-47d6-8b8d-7fb747ea97c8 None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:49:52.776782 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27886894-78d3-47d6-8b8d-7fb747ea97c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:49:52.776937 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27886894-78d3-47d6-8b8d-7fb747ea97c8 None admin] PATH_INFO: `/v3/roles` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:49:52.777635 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27886894-78d3-47d6-8b8d-7fb747ea97c8 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81593) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 17:49:52.778393 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27886894-78d3-47d6-8b8d-7fb747ea97c8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:49:52.779319 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27886894-78d3-47d6-8b8d-7fb747ea97c8 None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:49:52.788057 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 554/1086] 10.222.0.25 () {56 vars in 1115 bytes} [Thu Sep 15 17:49:52 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 17:49:52.794120 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27886894-78d3-47d6-8b8d-7fb747ea97c8 None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:49:52.818701 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:49:52.863368 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d3c989-cd29-494d-9c74-30e39ffa5b0a None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:49:52.907829 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba925267-9b87-46eb-9826-c4130b24be03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:49:52.908468 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba925267-9b87-46eb-9826-c4130b24be03 None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:49:52.908748 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba925267-9b87-46eb-9826-c4130b24be03 None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:49:52.909021 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba925267-9b87-46eb-9826-c4130b24be03 None admin] PATH_INFO: `/v3/projects/2e01052d505748a3b5b2f06f06cf7819` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:49:52.910925 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba925267-9b87-46eb-9826-c4130b24be03 None admin] RBAC: Authorizing `identity:get_project(project_id=2e01052d505748a3b5b2f06f06cf7819)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:49:52.911057 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27886894-78d3-47d6-8b8d-7fb747ea97c8 None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:49:52.912010 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba925267-9b87-46eb-9826-c4130b24be03 None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:49:52.913903 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 533/1087] 10.222.0.25 () {56 vars in 1186 bytes} [Thu Sep 15 17:49:52 2022] GET /identity/v3/projects/2e01052d505748a3b5b2f06f06cf7819 => generated 311 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 17:49:52.922571 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba925267-9b87-46eb-9826-c4130b24be03 None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:49:52.955510 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519cacdd-72be-4af9-891c-eb8c5704661b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:49:52.956155 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519cacdd-72be-4af9-891c-eb8c5704661b None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:49:52.956435 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519cacdd-72be-4af9-891c-eb8c5704661b None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:49:52.956709 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519cacdd-72be-4af9-891c-eb8c5704661b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:49:52.967734 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519cacdd-72be-4af9-891c-eb8c5704661b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:49:52.969266 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519cacdd-72be-4af9-891c-eb8c5704661b None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:49:52.976055 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:49:52.984480 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application [None req-519cacdd-72be-4af9-891c-eb8c5704661b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 17:49:52.984480 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 17:49:52.984480 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 17:49:52.984480 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 17:49:52.984480 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 17:49:52.984480 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 17:49:52.984480 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 17:49:52.984480 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 17:49:52.984480 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 17:49:52.984480 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 17:49:52.984480 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 17:49:52.984480 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 17:49:52.984480 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 15 17:49:52.984480 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 15 17:49:52.984480 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 15 17:49:52.984480 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 15 17:49:52.985498 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 17:49:52.985498 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 17:49:52.985498 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 17:49:52.985498 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 17:49:52.985498 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 17:49:52.985498 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 17:49:52.985498 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 17:49:52.985498 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application with Lock( Sep 15 17:49:52.985498 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 17:49:52.985498 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._enter() Sep 15 17:49:52.985498 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 17:49:52.985498 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 17:49:52.985498 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 17:49:52.985498 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.creator() Sep 15 17:49:52.985498 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 17:49:52.985498 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application created_value = creator( Sep 15 17:49:52.985498 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 15 17:49:52.986408 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 15 17:49:52.986408 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 17:49:52.986408 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Sep 15 17:49:52.986408 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 555/1088] 10.222.0.25 () {56 vars in 1108 bytes} [Thu Sep 15 17:49:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 15 17:49:52.991244 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519cacdd-72be-4af9-891c-eb8c5704661b None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:49:53.032842 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba925267-9b87-46eb-9826-c4130b24be03 None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:49:53.067528 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:49:53.070492 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffcf2ad6-1d35-4f11-b02f-285436b5ef94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:49:53.071159 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcf2ad6-1d35-4f11-b02f-285436b5ef94 None admin] REQUEST_METHOD: `PUT` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:49:53.071436 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcf2ad6-1d35-4f11-b02f-285436b5ef94 None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:49:53.071735 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcf2ad6-1d35-4f11-b02f-285436b5ef94 None admin] PATH_INFO: `/v3/projects/2e01052d505748a3b5b2f06f06cf7819/users/e8ccf4c7485d4d3e8fd7acbdf3d6a6ff/roles/a9e42be86923434f8af52d3fc07fb4f7` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:49:53.073777 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffcf2ad6-1d35-4f11-b02f-285436b5ef94 None admin] RBAC: Authorizing `identity:create_grant(project_id=2e01052d505748a3b5b2f06f06cf7819, user_id=e8ccf4c7485d4d3e8fd7acbdf3d6a6ff, role_id=a9e42be86923434f8af52d3fc07fb4f7)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:49:53.075209 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffcf2ad6-1d35-4f11-b02f-285436b5ef94 None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:49:53.094783 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 534/1089] 10.222.0.25 () {58 vars in 1439 bytes} [Thu Sep 15 17:49:52 2022] PUT /identity/v3/projects/2e01052d505748a3b5b2f06f06cf7819/users/e8ccf4c7485d4d3e8fd7acbdf3d6a6ff/roles/a9e42be86923434f8af52d3fc07fb4f7 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 15 17:49:53.110455 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519cacdd-72be-4af9-891c-eb8c5704661b None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:49:53.149669 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b66b8e1-3149-4cca-a134-34a9a021f2c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:49:53.150227 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b66b8e1-3149-4cca-a134-34a9a021f2c2 None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:49:53.150505 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b66b8e1-3149-4cca-a134-34a9a021f2c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:49:53.150781 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b66b8e1-3149-4cca-a134-34a9a021f2c2 None admin] PATH_INFO: `/v3/domains` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:49:53.151462 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b66b8e1-3149-4cca-a134-34a9a021f2c2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81593) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 17:49:53.151767 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b66b8e1-3149-4cca-a134-34a9a021f2c2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:49:53.153207 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b66b8e1-3149-4cca-a134-34a9a021f2c2 None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:49:53.167629 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 556/1090] 10.222.0.25 () {56 vars in 1109 bytes} [Thu Sep 15 17:49:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 17:49:53.174346 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffcf2ad6-1d35-4f11-b02f-285436b5ef94 None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:49:53.295893 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffcf2ad6-1d35-4f11-b02f-285436b5ef94 None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:49:53.311305 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:49:53.336943 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2596e599-3c7a-4e03-9454-cae49896d568 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:49:53.337607 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2596e599-3c7a-4e03-9454-cae49896d568 None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:49:53.337889 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2596e599-3c7a-4e03-9454-cae49896d568 None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:49:53.338164 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2596e599-3c7a-4e03-9454-cae49896d568 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:49:53.346775 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2596e599-3c7a-4e03-9454-cae49896d568 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:49:53.348222 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2596e599-3c7a-4e03-9454-cae49896d568 None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:49:53.360587 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application [None req-2596e599-3c7a-4e03-9454-cae49896d568 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 15 17:49:53.360587 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 17:49:53.360587 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 17:49:53.360587 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 17:49:53.360587 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 17:49:53.360587 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 17:49:53.360587 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 17:49:53.360587 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 17:49:53.360587 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 17:49:53.360587 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 17:49:53.360587 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 17:49:53.360587 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 17:49:53.360587 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 15 17:49:53.360587 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 15 17:49:53.360587 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 15 17:49:53.360587 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 15 17:49:53.361785 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 17:49:53.361785 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 17:49:53.361785 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 15 17:49:53.361785 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 15 17:49:53.361785 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 15 17:49:53.361785 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 15 17:49:53.361785 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 17:49:53.361785 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 17:49:53.361785 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 17:49:53.361785 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 17:49:53.361785 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 17:49:53.361785 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application with Lock( Sep 15 17:49:53.361785 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 17:49:53.361785 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._enter() Sep 15 17:49:53.361785 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 17:49:53.361785 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 17:49:53.361785 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 17:49:53.361785 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.creator() Sep 15 17:49:53.363192 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 17:49:53.363192 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application created_value = creator( Sep 15 17:49:53.363192 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 15 17:49:53.363192 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 15 17:49:53.363192 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 15 17:49:53.363192 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 15 17:49:53.363192 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 15 17:49:53.363192 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 15 17:49:53.363192 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 15 17:49:53.363192 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Sep 15 17:49:53.363192 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 535/1091] 10.222.0.25 () {56 vars in 1093 bytes} [Thu Sep 15 17:49:53 2022] GET /identity/v3/users/nova => generated 82 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 17:49:53.367621 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b66b8e1-3149-4cca-a134-34a9a021f2c2 None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:49:53.479269 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b66b8e1-3149-4cca-a134-34a9a021f2c2 None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:49:53.510518 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:49:53.517775 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ccf3fa-386a-474e-81ea-e926d45ffbdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:49:53.517775 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ccf3fa-386a-474e-81ea-e926d45ffbdb None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:49:53.518261 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ccf3fa-386a-474e-81ea-e926d45ffbdb None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:49:53.518737 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ccf3fa-386a-474e-81ea-e926d45ffbdb None admin] PATH_INFO: `/v3/users` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:49:53.519222 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ccf3fa-386a-474e-81ea-e926d45ffbdb None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81593) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 17:49:53.519568 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ccf3fa-386a-474e-81ea-e926d45ffbdb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:49:53.520848 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ccf3fa-386a-474e-81ea-e926d45ffbdb None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:49:53.539150 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 557/1092] 10.222.0.25 () {56 vars in 1133 bytes} [Thu Sep 15 17:49:53 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 17:49:53.545076 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2596e599-3c7a-4e03-9454-cae49896d568 None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:49:53.659022 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2596e599-3c7a-4e03-9454-cae49896d568 None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:49:53.694866 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5217934c-fbea-472a-965c-021840e287e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:49:53.695539 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5217934c-fbea-472a-965c-021840e287e1 None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:49:53.695748 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5217934c-fbea-472a-965c-021840e287e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:49:53.696028 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5217934c-fbea-472a-965c-021840e287e1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:49:53.743599 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:49:53.774002 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5217934c-fbea-472a-965c-021840e287e1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:49:53.775460 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5217934c-fbea-472a-965c-021840e287e1 None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:49:53.897880 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 536/1093] 10.222.0.25 () {58 vars in 1282 bytes} [Thu Sep 15 17:49:53 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 15 17:49:53.903712 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ccf3fa-386a-474e-81ea-e926d45ffbdb None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:49:54.021441 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ccf3fa-386a-474e-81ea-e926d45ffbdb None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:49:54.063236 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f860171-f6be-41ee-97be-801a76bb489d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:49:54.063846 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f860171-f6be-41ee-97be-801a76bb489d None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:49:54.064116 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f860171-f6be-41ee-97be-801a76bb489d None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:49:54.064384 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f860171-f6be-41ee-97be-801a76bb489d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:49:54.074434 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f860171-f6be-41ee-97be-801a76bb489d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:49:54.075864 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f860171-f6be-41ee-97be-801a76bb489d None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:49:54.090604 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application [None req-4f860171-f6be-41ee-97be-801a76bb489d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 17:49:54.090604 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 17:49:54.090604 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 17:49:54.090604 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 17:49:54.090604 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 17:49:54.090604 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 17:49:54.090604 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 17:49:54.090604 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 17:49:54.090604 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 17:49:54.090604 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 17:49:54.090604 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 17:49:54.090604 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 17:49:54.090604 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 15 17:49:54.090604 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 15 17:49:54.090604 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 15 17:49:54.090604 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 15 17:49:54.093815 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 17:49:54.093815 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 17:49:54.093815 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 17:49:54.093815 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 17:49:54.093815 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 17:49:54.093815 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 17:49:54.093815 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 17:49:54.093815 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application with Lock( Sep 15 17:49:54.093815 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 17:49:54.093815 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._enter() Sep 15 17:49:54.093815 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 17:49:54.093815 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 17:49:54.093815 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 17:49:54.093815 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.creator() Sep 15 17:49:54.093815 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 17:49:54.093815 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application created_value = creator( Sep 15 17:49:54.093815 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 15 17:49:54.095629 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 15 17:49:54.095629 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 17:49:54.095629 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Sep 15 17:49:54.095629 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 558/1094] 10.222.0.25 () {56 vars in 1108 bytes} [Thu Sep 15 17:49:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 17:49:54.100666 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5217934c-fbea-472a-965c-021840e287e1 None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:49:54.201498 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:49:54.256400 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5217934c-fbea-472a-965c-021840e287e1 None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:49:54.297351 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b84af0-8313-4821-8169-97d2692def2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:49:54.297886 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b84af0-8313-4821-8169-97d2692def2e None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:49:54.298161 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b84af0-8313-4821-8169-97d2692def2e None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:49:54.298427 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b84af0-8313-4821-8169-97d2692def2e None admin] PATH_INFO: `/v3/domains` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:49:54.299068 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b84af0-8313-4821-8169-97d2692def2e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81592) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 17:49:54.299366 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b84af0-8313-4821-8169-97d2692def2e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:49:54.300714 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b84af0-8313-4821-8169-97d2692def2e None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:49:54.312331 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 537/1095] 10.222.0.25 () {56 vars in 1109 bytes} [Thu Sep 15 17:49:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 17:49:54.318042 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f860171-f6be-41ee-97be-801a76bb489d None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:49:54.376113 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:49:54.436143 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f860171-f6be-41ee-97be-801a76bb489d None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:49:54.470619 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1319dcd-ac14-4d27-a91b-10a032e9e558 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:49:54.471245 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1319dcd-ac14-4d27-a91b-10a032e9e558 None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:49:54.472259 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1319dcd-ac14-4d27-a91b-10a032e9e558 None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:49:54.472259 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1319dcd-ac14-4d27-a91b-10a032e9e558 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:49:54.479451 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1319dcd-ac14-4d27-a91b-10a032e9e558 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:49:54.481218 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1319dcd-ac14-4d27-a91b-10a032e9e558 None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:49:54.494327 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application [None req-f1319dcd-ac14-4d27-a91b-10a032e9e558 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 15 17:49:54.494327 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 17:49:54.494327 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 17:49:54.494327 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 17:49:54.494327 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 17:49:54.494327 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 17:49:54.494327 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 17:49:54.494327 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 17:49:54.494327 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 17:49:54.494327 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 17:49:54.494327 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 17:49:54.494327 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 17:49:54.494327 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 15 17:49:54.494327 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 15 17:49:54.494327 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 15 17:49:54.495322 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 15 17:49:54.495322 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 17:49:54.495322 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 17:49:54.495322 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 17:49:54.495322 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 17:49:54.495322 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 17:49:54.495322 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 17:49:54.495322 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 17:49:54.495322 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application with Lock( Sep 15 17:49:54.495322 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 17:49:54.495322 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._enter() Sep 15 17:49:54.495322 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 17:49:54.495322 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 17:49:54.495322 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 17:49:54.495322 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.creator() Sep 15 17:49:54.495322 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 17:49:54.495322 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application created_value = creator( Sep 15 17:49:54.496265 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 15 17:49:54.496265 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 15 17:49:54.496265 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 15 17:49:54.496265 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 15 17:49:54.496265 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 15 17:49:54.496265 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 15 17:49:54.496265 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 15 17:49:54.496265 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Sep 15 17:49:54.496265 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 559/1096] 10.222.0.25 () {56 vars in 1111 bytes} [Thu Sep 15 17:49:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 17:49:54.502003 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b84af0-8313-4821-8169-97d2692def2e None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:49:54.632079 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b84af0-8313-4821-8169-97d2692def2e None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:49:54.662669 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:49:54.668559 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c85e4d-d059-4b32-ad5d-1caeede275ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:49:54.669214 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c85e4d-d059-4b32-ad5d-1caeede275ed None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:49:54.669540 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c85e4d-d059-4b32-ad5d-1caeede275ed None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:49:54.669824 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c85e4d-d059-4b32-ad5d-1caeede275ed None admin] PATH_INFO: `/v3/projects` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:49:54.670524 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c85e4d-d059-4b32-ad5d-1caeede275ed None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81592) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 17:49:54.672185 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c85e4d-d059-4b32-ad5d-1caeede275ed None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:49:54.673408 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c85e4d-d059-4b32-ad5d-1caeede275ed None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:49:54.686153 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 538/1097] 10.222.0.25 () {56 vars in 1148 bytes} [Thu Sep 15 17:49:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 17:49:54.696206 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1319dcd-ac14-4d27-a91b-10a032e9e558 None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:49:54.816074 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1319dcd-ac14-4d27-a91b-10a032e9e558 None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:49:54.817800 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:49:54.857644 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe611c2d-78b7-4f70-bd49-abe48be94b05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:49:54.858329 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe611c2d-78b7-4f70-bd49-abe48be94b05 None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:49:54.858776 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe611c2d-78b7-4f70-bd49-abe48be94b05 None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:49:54.859100 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe611c2d-78b7-4f70-bd49-abe48be94b05 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:49:54.859953 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe611c2d-78b7-4f70-bd49-abe48be94b05 None admin] RBAC: Adding query filter params (role.id=99a6f32f74a84d0989c7527d9985370e, scope.project.id=1213c0d1b584404ba3998e136f166e89, user.id=fe2244818e4d4dca9c424cd078653e6a) {{(pid=81593) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 17:49:54.860325 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe611c2d-78b7-4f70-bd49-abe48be94b05 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:49:54.865992 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe611c2d-78b7-4f70-bd49-abe48be94b05 None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:49:54.873845 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 560/1098] 10.222.0.25 () {56 vars in 1374 bytes} [Thu Sep 15 17:49:54 2022] GET /identity/v3/role_assignments?user.id=fe2244818e4d4dca9c424cd078653e6a&scope.project.id=1213c0d1b584404ba3998e136f166e89&role.id=99a6f32f74a84d0989c7527d9985370e => generated 608 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 17:49:55.385079 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1312e5da-3502-47cb-b567-a6daf3e328cd None None] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:49:55.385622 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1312e5da-3502-47cb-b567-a6daf3e328cd None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:49:55.385711 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1312e5da-3502-47cb-b567-a6daf3e328cd None None] PATH_INFO: `/` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:49:55.386989 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 539/1099] 10.222.0.25 () {54 vars in 927 bytes} [Thu Sep 15 17:49:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 17:49:55.393073 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6093ff-89de-4fee-be67-91b2e2c89302 None None] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:49:55.393585 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6093ff-89de-4fee-be67-91b2e2c89302 None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:49:55.393691 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6093ff-89de-4fee-be67-91b2e2c89302 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:49:55.413951 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.auth.core [None req-ff6093ff-89de-4fee-be67-91b2e2c89302 None None] MFA Rules not processed for user `5cfa58ef86774ab7800bf91930bf6028`. Rule list: `[]` (Enabled: `True`). {{(pid=81593) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 17:49:55.415168 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-ff6093ff-89de-4fee-be67-91b2e2c89302 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 17:49:55.486431 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 561/1100] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Sep 15 17:49:55 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 15 17:49:55.757999 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1312e5da-3502-47cb-b567-a6daf3e328cd None None] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:49:55.876365 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1312e5da-3502-47cb-b567-a6daf3e328cd None None] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:49:55.910220 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e3ca08-b34d-4a02-8a10-3629568114ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:49:55.910840 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e3ca08-b34d-4a02-8a10-3629568114ae None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:49:55.911119 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e3ca08-b34d-4a02-8a10-3629568114ae None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:49:55.911392 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e3ca08-b34d-4a02-8a10-3629568114ae None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:49:55.921893 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e3ca08-b34d-4a02-8a10-3629568114ae None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 17:49:55.926685 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application [None req-22e3ca08-b34d-4a02-8a10-3629568114ae None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 15 17:49:55.926685 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 17:49:55.926685 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 17:49:55.926685 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 17:49:55.926685 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 17:49:55.926685 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 17:49:55.926685 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 17:49:55.926685 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 17:49:55.926685 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 17:49:55.926685 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 17:49:55.926685 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 17:49:55.926685 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 17:49:55.926685 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 17:49:55.926685 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 17:49:55.926685 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 17:49:55.926685 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 17:49:55.927824 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 17:49:55.927824 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 17:49:55.927824 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 17:49:55.927824 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 17:49:55.927824 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 17:49:55.927824 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 17:49:55.927824 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 17:49:55.927824 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 17:49:55.927824 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 17:49:55.927824 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 17:49:55.927824 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 17:49:55.927824 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application with Lock( Sep 15 17:49:55.927824 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 17:49:55.927824 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._enter() Sep 15 17:49:55.927824 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 17:49:55.927824 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 17:49:55.928746 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 17:49:55.928746 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.creator() Sep 15 17:49:55.928746 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 17:49:55.928746 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application created_value = creator( Sep 15 17:49:55.928746 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 17:49:55.928746 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 17:49:55.928746 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 17:49:55.928746 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 17:49:55.928746 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 17:49:55.928746 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 17:49:55.928746 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 15 17:49:55.928746 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Sep 15 17:49:55.928746 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 540/1101] 10.222.0.25 () {56 vars in 1096 bytes} [Thu Sep 15 17:49:55 2022] GET /identity/v3/roles/admin => generated 83 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 17:49:55.933827 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6093ff-89de-4fee-be67-91b2e2c89302 None None] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:49:56.025088 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:49:56.031563 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6093ff-89de-4fee-be67-91b2e2c89302 None None] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:49:56.065119 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b8de12-4da6-4b8b-8137-b7e26123d943 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:49:56.065810 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b8de12-4da6-4b8b-8137-b7e26123d943 None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:49:56.066048 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b8de12-4da6-4b8b-8137-b7e26123d943 None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:49:56.066312 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b8de12-4da6-4b8b-8137-b7e26123d943 None admin] PATH_INFO: `/v3/roles` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:49:56.066973 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b8de12-4da6-4b8b-8137-b7e26123d943 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81593) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 17:49:56.067270 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b8de12-4da6-4b8b-8137-b7e26123d943 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:49:56.068848 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b8de12-4da6-4b8b-8137-b7e26123d943 None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:49:56.077739 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 562/1102] 10.222.0.25 () {56 vars in 1099 bytes} [Thu Sep 15 17:49:55 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 17:49:56.084276 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e3ca08-b34d-4a02-8a10-3629568114ae None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:49:56.136784 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:49:56.187062 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e3ca08-b34d-4a02-8a10-3629568114ae None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:49:56.220504 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f682c6f0-e6f2-41fe-9189-6c521622f28d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:49:56.221128 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f682c6f0-e6f2-41fe-9189-6c521622f28d None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:49:56.221433 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f682c6f0-e6f2-41fe-9189-6c521622f28d None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:49:56.221712 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f682c6f0-e6f2-41fe-9189-6c521622f28d None admin] PATH_INFO: `/v3/users/e8ccf4c7485d4d3e8fd7acbdf3d6a6ff` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:49:56.222846 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f682c6f0-e6f2-41fe-9189-6c521622f28d None admin] RBAC: Authorizing `identity:get_user(user_id=e8ccf4c7485d4d3e8fd7acbdf3d6a6ff)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:49:56.224258 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f682c6f0-e6f2-41fe-9189-6c521622f28d None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:49:56.225859 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 541/1103] 10.222.0.25 () {56 vars in 1177 bytes} [Thu Sep 15 17:49:56 2022] GET /identity/v3/users/e8ccf4c7485d4d3e8fd7acbdf3d6a6ff => generated 285 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 17:49:56.232111 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b8de12-4da6-4b8b-8137-b7e26123d943 None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:49:56.330981 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b8de12-4da6-4b8b-8137-b7e26123d943 None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:49:56.366526 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b2ccb4-8d01-4db7-841a-7cbab2ee1a8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:49:56.367134 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b2ccb4-8d01-4db7-841a-7cbab2ee1a8e None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:49:56.367414 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b2ccb4-8d01-4db7-841a-7cbab2ee1a8e None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:49:56.367688 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b2ccb4-8d01-4db7-841a-7cbab2ee1a8e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:49:56.394857 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:49:56.435181 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b2ccb4-8d01-4db7-841a-7cbab2ee1a8e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:49:56.437218 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b2ccb4-8d01-4db7-841a-7cbab2ee1a8e None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:49:56.532622 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 563/1104] 10.222.0.25 () {58 vars in 1282 bytes} [Thu Sep 15 17:49:56 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 15 17:49:56.538525 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f682c6f0-e6f2-41fe-9189-6c521622f28d None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:49:56.636973 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f682c6f0-e6f2-41fe-9189-6c521622f28d None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:49:56.656021 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:49:56.670324 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9329d099-429f-429d-9fa4-cb9428e9aebc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:49:56.671488 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9329d099-429f-429d-9fa4-cb9428e9aebc None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:49:56.671759 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9329d099-429f-429d-9fa4-cb9428e9aebc None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:49:56.672026 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9329d099-429f-429d-9fa4-cb9428e9aebc None admin] PATH_INFO: `/v3/projects/2e01052d505748a3b5b2f06f06cf7819` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:49:56.673153 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9329d099-429f-429d-9fa4-cb9428e9aebc None admin] RBAC: Authorizing `identity:get_project(project_id=2e01052d505748a3b5b2f06f06cf7819)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:49:56.674598 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9329d099-429f-429d-9fa4-cb9428e9aebc None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:49:56.676313 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 542/1105] 10.222.0.25 () {56 vars in 1186 bytes} [Thu Sep 15 17:49:56 2022] GET /identity/v3/projects/2e01052d505748a3b5b2f06f06cf7819 => generated 311 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 17:49:56.682516 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b2ccb4-8d01-4db7-841a-7cbab2ee1a8e None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:49:56.740569 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:49:56.782261 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b2ccb4-8d01-4db7-841a-7cbab2ee1a8e None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:49:56.816715 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1bc011b-9cde-43d4-80dc-6fb273b0db59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:49:56.817333 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bc011b-9cde-43d4-80dc-6fb273b0db59 None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:49:56.817619 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bc011b-9cde-43d4-80dc-6fb273b0db59 None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:49:56.817892 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bc011b-9cde-43d4-80dc-6fb273b0db59 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:49:56.818609 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1bc011b-9cde-43d4-80dc-6fb273b0db59 None admin] RBAC: Adding query filter params (role.id=a9e42be86923434f8af52d3fc07fb4f7, scope.project.id=2e01052d505748a3b5b2f06f06cf7819, user.id=e8ccf4c7485d4d3e8fd7acbdf3d6a6ff) {{(pid=81593) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 17:49:56.818915 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1bc011b-9cde-43d4-80dc-6fb273b0db59 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:49:56.820348 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1bc011b-9cde-43d4-80dc-6fb273b0db59 None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:49:56.826080 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 564/1106] 10.222.0.25 () {56 vars in 1374 bytes} [Thu Sep 15 17:49:56 2022] GET /identity/v3/role_assignments?user.id=e8ccf4c7485d4d3e8fd7acbdf3d6a6ff&scope.project.id=2e01052d505748a3b5b2f06f06cf7819&role.id=a9e42be86923434f8af52d3fc07fb4f7 => generated 608 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 17:49:58.992177 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e50948f-b015-4bad-82b0-09e7f6bd60e1 None None] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:49:58.992884 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e50948f-b015-4bad-82b0-09e7f6bd60e1 None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:49:58.992884 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e50948f-b015-4bad-82b0-09e7f6bd60e1 None None] PATH_INFO: `/` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:49:58.994108 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 543/1107] 10.222.0.25 () {54 vars in 927 bytes} [Thu Sep 15 17:49:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 17:49:58.999531 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896bec93-76ed-445d-919f-9ef9774e2489 None None] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:49:58.999977 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896bec93-76ed-445d-919f-9ef9774e2489 None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:49:59.000071 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896bec93-76ed-445d-919f-9ef9774e2489 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:49:59.019311 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.auth.core [None req-896bec93-76ed-445d-919f-9ef9774e2489 None None] MFA Rules not processed for user `5cfa58ef86774ab7800bf91930bf6028`. Rule list: `[]` (Enabled: `True`). {{(pid=81593) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 17:49:59.020709 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-896bec93-76ed-445d-919f-9ef9774e2489 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 17:49:59.090161 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 565/1108] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Sep 15 17:49:58 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 15 17:49:59.360947 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e50948f-b015-4bad-82b0-09e7f6bd60e1 None None] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:49:59.472673 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e50948f-b015-4bad-82b0-09e7f6bd60e1 None None] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:49:59.510873 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae48bb3-fe94-498d-947d-661e74571c36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:49:59.511506 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae48bb3-fe94-498d-947d-661e74571c36 None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:49:59.511785 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae48bb3-fe94-498d-947d-661e74571c36 None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:49:59.512055 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae48bb3-fe94-498d-947d-661e74571c36 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:49:59.513179 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae48bb3-fe94-498d-947d-661e74571c36 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:49:59.514786 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae48bb3-fe94-498d-947d-661e74571c36 None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:49:59.516370 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 544/1109] 10.222.0.25 () {56 vars in 1108 bytes} [Thu Sep 15 17:49:59 2022] GET /identity/v3/domains/default => generated 199 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 17:49:59.522502 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896bec93-76ed-445d-919f-9ef9774e2489 None None] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:49:59.582510 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:49:59.629671 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896bec93-76ed-445d-919f-9ef9774e2489 None None] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:49:59.666810 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18a74fe-86d8-4cd9-acf3-b4b891b32904 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:49:59.667602 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18a74fe-86d8-4cd9-acf3-b4b891b32904 None admin] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:49:59.667877 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18a74fe-86d8-4cd9-acf3-b4b891b32904 None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:49:59.668139 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18a74fe-86d8-4cd9-acf3-b4b891b32904 None admin] PATH_INFO: `/v3/users` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:49:59.668811 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c18a74fe-86d8-4cd9-acf3-b4b891b32904 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:49:59.670269 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c18a74fe-86d8-4cd9-acf3-b4b891b32904 None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:49:59.692808 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 566/1110] 10.222.0.25 () {60 vars in 1132 bytes} [Thu Sep 15 17:49:59 2022] POST /identity/v3/users => generated 286 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 15 17:50:01.950647 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3466d08d-af09-41d4-bba0-09651ed4d34b None None] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:50:01.951397 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3466d08d-af09-41d4-bba0-09651ed4d34b None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:50:01.951397 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3466d08d-af09-41d4-bba0-09651ed4d34b None None] PATH_INFO: `/` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:50:01.953129 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 545/1111] 10.222.0.25 () {54 vars in 927 bytes} [Thu Sep 15 17:50:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 17:50:01.958668 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69fec5c-f601-496a-a471-69529e7e2e8a None None] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:50:01.959118 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69fec5c-f601-496a-a471-69529e7e2e8a None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:50:01.959230 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69fec5c-f601-496a-a471-69529e7e2e8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:50:01.977988 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.auth.core [None req-b69fec5c-f601-496a-a471-69529e7e2e8a None None] MFA Rules not processed for user `5cfa58ef86774ab7800bf91930bf6028`. Rule list: `[]` (Enabled: `True`). {{(pid=81593) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 17:50:01.979188 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-b69fec5c-f601-496a-a471-69529e7e2e8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 17:50:02.052540 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 567/1112] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Sep 15 17:50:01 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 15 17:50:02.338285 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3466d08d-af09-41d4-bba0-09651ed4d34b None None] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:50:02.399417 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:50:02.463112 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3466d08d-af09-41d4-bba0-09651ed4d34b None None] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:50:02.508666 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2a3445-fd92-4103-979a-024333390590 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:50:02.509329 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2a3445-fd92-4103-979a-024333390590 None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:50:02.509616 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2a3445-fd92-4103-979a-024333390590 None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:50:02.509892 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2a3445-fd92-4103-979a-024333390590 None admin] PATH_INFO: `/v3/roles/0dd1b9f5b7924e20a665ce50d6e34dc7` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:50:02.511332 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2a3445-fd92-4103-979a-024333390590 None admin] RBAC: Authorizing `identity:get_role(role_id=0dd1b9f5b7924e20a665ce50d6e34dc7)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:50:02.512698 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2a3445-fd92-4103-979a-024333390590 None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:50:02.514306 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 546/1113] 10.222.0.25 () {56 vars in 1177 bytes} [Thu Sep 15 17:50:02 2022] GET /identity/v3/roles/0dd1b9f5b7924e20a665ce50d6e34dc7 => generated 223 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 17:50:02.520452 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69fec5c-f601-496a-a471-69529e7e2e8a None None] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:50:02.574993 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:50:02.641247 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69fec5c-f601-496a-a471-69529e7e2e8a None None] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:50:02.675594 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9c7ffb-200a-476f-9a60-4cccd9c77914 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:50:02.676169 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9c7ffb-200a-476f-9a60-4cccd9c77914 None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:50:02.676289 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9c7ffb-200a-476f-9a60-4cccd9c77914 None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:50:02.676904 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9c7ffb-200a-476f-9a60-4cccd9c77914 None admin] PATH_INFO: `/v3/users/ecaff648157749c58cb136bfb7662b1f` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:50:02.690472 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9c7ffb-200a-476f-9a60-4cccd9c77914 None admin] RBAC: Authorizing `identity:get_user(user_id=ecaff648157749c58cb136bfb7662b1f)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:50:02.691909 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9c7ffb-200a-476f-9a60-4cccd9c77914 None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:50:02.693581 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 568/1114] 10.222.0.25 () {56 vars in 1177 bytes} [Thu Sep 15 17:50:02 2022] GET /identity/v3/users/ecaff648157749c58cb136bfb7662b1f => generated 286 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 17:50:02.700548 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2a3445-fd92-4103-979a-024333390590 None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:50:02.817976 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2a3445-fd92-4103-979a-024333390590 None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:50:02.842929 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:50:02.854300 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c71d0f-6d1e-4d08-9748-c744694785bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:50:02.855157 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c71d0f-6d1e-4d08-9748-c744694785bd None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:50:02.855434 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c71d0f-6d1e-4d08-9748-c744694785bd None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:50:02.855706 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c71d0f-6d1e-4d08-9748-c744694785bd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:50:02.923258 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c71d0f-6d1e-4d08-9748-c744694785bd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:50:02.924636 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c71d0f-6d1e-4d08-9748-c744694785bd None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:50:03.032292 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 547/1115] 10.222.0.25 () {58 vars in 1282 bytes} [Thu Sep 15 17:50:02 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 15 17:50:03.038495 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9c7ffb-200a-476f-9a60-4cccd9c77914 None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:50:03.141399 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:50:03.148502 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9c7ffb-200a-476f-9a60-4cccd9c77914 None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:50:03.183598 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6600833a-8d55-4b32-ad52-80b51f52c1de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:50:03.184156 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6600833a-8d55-4b32-ad52-80b51f52c1de None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:50:03.184439 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6600833a-8d55-4b32-ad52-80b51f52c1de None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:50:03.184715 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6600833a-8d55-4b32-ad52-80b51f52c1de None admin] PATH_INFO: `/v3/projects/2e01052d505748a3b5b2f06f06cf7819` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:50:03.185865 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6600833a-8d55-4b32-ad52-80b51f52c1de None admin] RBAC: Authorizing `identity:get_project(project_id=2e01052d505748a3b5b2f06f06cf7819)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:50:03.187405 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6600833a-8d55-4b32-ad52-80b51f52c1de None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:50:03.189020 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 569/1116] 10.222.0.25 () {56 vars in 1186 bytes} [Thu Sep 15 17:50:03 2022] GET /identity/v3/projects/2e01052d505748a3b5b2f06f06cf7819 => generated 311 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 17:50:03.195268 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c71d0f-6d1e-4d08-9748-c744694785bd None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:50:03.220252 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:50:03.294370 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c71d0f-6d1e-4d08-9748-c744694785bd None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:50:03.329193 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694156f4-dd25-446f-a50c-0950d59d85e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:50:03.329833 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694156f4-dd25-446f-a50c-0950d59d85e4 None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:50:03.330110 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694156f4-dd25-446f-a50c-0950d59d85e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:50:03.330381 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694156f4-dd25-446f-a50c-0950d59d85e4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:50:03.331112 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-694156f4-dd25-446f-a50c-0950d59d85e4 None admin] RBAC: Adding query filter params (role.id=0dd1b9f5b7924e20a665ce50d6e34dc7, scope.project.id=2e01052d505748a3b5b2f06f06cf7819, user.id=ecaff648157749c58cb136bfb7662b1f) {{(pid=81592) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 17:50:03.331419 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-694156f4-dd25-446f-a50c-0950d59d85e4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:50:03.332840 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-694156f4-dd25-446f-a50c-0950d59d85e4 None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:50:03.338781 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 548/1117] 10.222.0.25 () {56 vars in 1374 bytes} [Thu Sep 15 17:50:03 2022] GET /identity/v3/role_assignments?user.id=ecaff648157749c58cb136bfb7662b1f&scope.project.id=2e01052d505748a3b5b2f06f06cf7819&role.id=0dd1b9f5b7924e20a665ce50d6e34dc7 => generated 259 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 17:50:05.597251 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1f7523-decc-42fc-9264-38921ccf630c None None] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:50:05.598046 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1f7523-decc-42fc-9264-38921ccf630c None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:50:05.598046 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1f7523-decc-42fc-9264-38921ccf630c None None] PATH_INFO: `/` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:50:05.599299 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 570/1118] 10.222.0.25 () {54 vars in 927 bytes} [Thu Sep 15 17:50:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 17:50:05.607308 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0bb724-ad36-4957-97cf-dcfc973384a4 None None] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:50:05.608351 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0bb724-ad36-4957-97cf-dcfc973384a4 None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:50:05.608547 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0bb724-ad36-4957-97cf-dcfc973384a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:50:05.633820 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.auth.core [None req-ea0bb724-ad36-4957-97cf-dcfc973384a4 None None] MFA Rules not processed for user `5cfa58ef86774ab7800bf91930bf6028`. Rule list: `[]` (Enabled: `True`). {{(pid=81592) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 17:50:05.635500 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-ea0bb724-ad36-4957-97cf-dcfc973384a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 17:50:05.723270 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 549/1119] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Sep 15 17:50:05 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 15 17:50:05.998839 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1f7523-decc-42fc-9264-38921ccf630c None None] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:50:06.111038 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1f7523-decc-42fc-9264-38921ccf630c None None] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:50:06.164235 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8bfb60-d47a-416f-85d0-2fec89f0a3f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:50:06.165349 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8bfb60-d47a-416f-85d0-2fec89f0a3f7 None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:50:06.165840 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8bfb60-d47a-416f-85d0-2fec89f0a3f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:50:06.166329 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8bfb60-d47a-416f-85d0-2fec89f0a3f7 None admin] PATH_INFO: `/v3/roles/0dd1b9f5b7924e20a665ce50d6e34dc7` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:50:06.168830 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff8bfb60-d47a-416f-85d0-2fec89f0a3f7 None admin] RBAC: Authorizing `identity:get_role(role_id=0dd1b9f5b7924e20a665ce50d6e34dc7)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:50:06.171526 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff8bfb60-d47a-416f-85d0-2fec89f0a3f7 None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:50:06.173226 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 571/1120] 10.222.0.25 () {56 vars in 1177 bytes} [Thu Sep 15 17:50:05 2022] GET /identity/v3/roles/0dd1b9f5b7924e20a665ce50d6e34dc7 => generated 223 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 17:50:06.179365 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0bb724-ad36-4957-97cf-dcfc973384a4 None None] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:50:06.205763 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:50:06.295069 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0bb724-ad36-4957-97cf-dcfc973384a4 None None] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:50:06.331550 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27fca6f-a801-4f44-8a81-4387346165c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:50:06.332271 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27fca6f-a801-4f44-8a81-4387346165c8 None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:50:06.332550 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27fca6f-a801-4f44-8a81-4387346165c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:50:06.332823 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27fca6f-a801-4f44-8a81-4387346165c8 None admin] PATH_INFO: `/v3/users/ecaff648157749c58cb136bfb7662b1f` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:50:06.333980 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b27fca6f-a801-4f44-8a81-4387346165c8 None admin] RBAC: Authorizing `identity:get_user(user_id=ecaff648157749c58cb136bfb7662b1f)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:50:06.335439 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b27fca6f-a801-4f44-8a81-4387346165c8 None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:50:06.337373 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 550/1121] 10.222.0.25 () {56 vars in 1177 bytes} [Thu Sep 15 17:50:06 2022] GET /identity/v3/users/ecaff648157749c58cb136bfb7662b1f => generated 286 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 17:50:06.346404 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8bfb60-d47a-416f-85d0-2fec89f0a3f7 None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:50:06.379609 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:50:06.457320 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8bfb60-d47a-416f-85d0-2fec89f0a3f7 None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:50:06.497243 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39861141-8313-4d22-bf7c-1b49d873b516 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:50:06.497998 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39861141-8313-4d22-bf7c-1b49d873b516 None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:50:06.498284 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39861141-8313-4d22-bf7c-1b49d873b516 None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:50:06.499151 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39861141-8313-4d22-bf7c-1b49d873b516 None admin] PATH_INFO: `/v3/projects/2e01052d505748a3b5b2f06f06cf7819` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:50:06.500376 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39861141-8313-4d22-bf7c-1b49d873b516 None admin] RBAC: Authorizing `identity:get_project(project_id=2e01052d505748a3b5b2f06f06cf7819)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:50:06.501860 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39861141-8313-4d22-bf7c-1b49d873b516 None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:50:06.503607 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 572/1122] 10.222.0.25 () {56 vars in 1186 bytes} [Thu Sep 15 17:50:06 2022] GET /identity/v3/projects/2e01052d505748a3b5b2f06f06cf7819 => generated 311 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 17:50:06.510057 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27fca6f-a801-4f44-8a81-4387346165c8 None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:50:06.607551 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:50:06.625570 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27fca6f-a801-4f44-8a81-4387346165c8 None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:50:06.664190 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a5305b-e943-492b-81b0-c0873ba26e86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:50:06.664909 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a5305b-e943-492b-81b0-c0873ba26e86 None admin] REQUEST_METHOD: `PUT` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:50:06.665193 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a5305b-e943-492b-81b0-c0873ba26e86 None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:50:06.665500 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a5305b-e943-492b-81b0-c0873ba26e86 None admin] PATH_INFO: `/v3/projects/2e01052d505748a3b5b2f06f06cf7819/users/ecaff648157749c58cb136bfb7662b1f/roles/0dd1b9f5b7924e20a665ce50d6e34dc7` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:50:06.667750 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a5305b-e943-492b-81b0-c0873ba26e86 None admin] RBAC: Authorizing `identity:create_grant(project_id=2e01052d505748a3b5b2f06f06cf7819, user_id=ecaff648157749c58cb136bfb7662b1f, role_id=0dd1b9f5b7924e20a665ce50d6e34dc7)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:50:06.669233 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a5305b-e943-492b-81b0-c0873ba26e86 None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:50:06.683296 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 551/1123] 10.222.0.25 () {58 vars in 1439 bytes} [Thu Sep 15 17:50:06 2022] PUT /identity/v3/projects/2e01052d505748a3b5b2f06f06cf7819/users/ecaff648157749c58cb136bfb7662b1f/roles/0dd1b9f5b7924e20a665ce50d6e34dc7 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 17:50:08.884962 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2dadf04-1c32-453f-bad1-fff0158112bb None None] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:50:08.885552 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2dadf04-1c32-453f-bad1-fff0158112bb None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:50:08.885552 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2dadf04-1c32-453f-bad1-fff0158112bb None None] PATH_INFO: `/` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:50:08.886888 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 573/1124] 10.222.0.25 () {54 vars in 927 bytes} [Thu Sep 15 17:50:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 17:50:08.894482 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e7df6f-9f4e-40ec-9b5e-05fec2265d69 None None] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:50:08.894912 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e7df6f-9f4e-40ec-9b5e-05fec2265d69 None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:50:08.895024 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e7df6f-9f4e-40ec-9b5e-05fec2265d69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:50:08.914161 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.auth.core [None req-97e7df6f-9f4e-40ec-9b5e-05fec2265d69 None None] MFA Rules not processed for user `5cfa58ef86774ab7800bf91930bf6028`. Rule list: `[]` (Enabled: `True`). {{(pid=81592) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 17:50:08.915355 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-97e7df6f-9f4e-40ec-9b5e-05fec2265d69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 17:50:08.983414 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 552/1125] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Sep 15 17:50:08 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 15 17:50:09.251775 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2dadf04-1c32-453f-bad1-fff0158112bb None None] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:50:09.354319 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:50:09.360661 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2dadf04-1c32-453f-bad1-fff0158112bb None None] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:50:09.396921 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a436be83-97cf-4ff5-bdec-9259470f3084 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:50:09.397612 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a436be83-97cf-4ff5-bdec-9259470f3084 None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:50:09.397892 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a436be83-97cf-4ff5-bdec-9259470f3084 None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:50:09.398200 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a436be83-97cf-4ff5-bdec-9259470f3084 None admin] PATH_INFO: `/v3/roles/0dd1b9f5b7924e20a665ce50d6e34dc7` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:50:09.399776 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a436be83-97cf-4ff5-bdec-9259470f3084 None admin] RBAC: Authorizing `identity:get_role(role_id=0dd1b9f5b7924e20a665ce50d6e34dc7)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:50:09.401148 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a436be83-97cf-4ff5-bdec-9259470f3084 None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:50:09.402512 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 574/1126] 10.222.0.25 () {56 vars in 1177 bytes} [Thu Sep 15 17:50:09 2022] GET /identity/v3/roles/0dd1b9f5b7924e20a665ce50d6e34dc7 => generated 223 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 17:50:09.408526 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e7df6f-9f4e-40ec-9b5e-05fec2265d69 None None] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:50:09.492124 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:50:09.516710 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e7df6f-9f4e-40ec-9b5e-05fec2265d69 None None] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:50:09.559430 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043b82e7-b45a-4396-be89-8fe1015ae574 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:50:09.560120 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043b82e7-b45a-4396-be89-8fe1015ae574 None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:50:09.560397 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043b82e7-b45a-4396-be89-8fe1015ae574 None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:50:09.560711 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043b82e7-b45a-4396-be89-8fe1015ae574 None admin] PATH_INFO: `/v3/users/ecaff648157749c58cb136bfb7662b1f` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:50:09.562285 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-043b82e7-b45a-4396-be89-8fe1015ae574 None admin] RBAC: Authorizing `identity:get_user(user_id=ecaff648157749c58cb136bfb7662b1f)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:50:09.563891 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-043b82e7-b45a-4396-be89-8fe1015ae574 None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:50:09.565766 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 553/1127] 10.222.0.25 () {56 vars in 1177 bytes} [Thu Sep 15 17:50:09 2022] GET /identity/v3/users/ecaff648157749c58cb136bfb7662b1f => generated 286 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 17:50:09.574544 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a436be83-97cf-4ff5-bdec-9259470f3084 None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:50:09.680409 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a436be83-97cf-4ff5-bdec-9259470f3084 None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:50:09.718860 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317b0a42-9a3b-4b63-8d81-a05cae5b0514 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:50:09.719466 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317b0a42-9a3b-4b63-8d81-a05cae5b0514 None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:50:09.719741 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317b0a42-9a3b-4b63-8d81-a05cae5b0514 None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:50:09.720012 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317b0a42-9a3b-4b63-8d81-a05cae5b0514 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:50:09.758015 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:50:09.791244 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-317b0a42-9a3b-4b63-8d81-a05cae5b0514 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:50:09.792616 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-317b0a42-9a3b-4b63-8d81-a05cae5b0514 None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:50:09.908173 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 575/1128] 10.222.0.25 () {58 vars in 1282 bytes} [Thu Sep 15 17:50:09 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 15 17:50:09.914830 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043b82e7-b45a-4396-be89-8fe1015ae574 None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:50:10.017089 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043b82e7-b45a-4396-be89-8fe1015ae574 None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:50:10.053256 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19aa6764-0310-4fd1-97a2-9ba6f25d82e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:50:10.053830 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19aa6764-0310-4fd1-97a2-9ba6f25d82e9 None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:50:10.054106 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19aa6764-0310-4fd1-97a2-9ba6f25d82e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:50:10.054376 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19aa6764-0310-4fd1-97a2-9ba6f25d82e9 None admin] PATH_INFO: `/v3/projects/2e01052d505748a3b5b2f06f06cf7819` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:50:10.055575 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19aa6764-0310-4fd1-97a2-9ba6f25d82e9 None admin] RBAC: Authorizing `identity:get_project(project_id=2e01052d505748a3b5b2f06f06cf7819)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:50:10.056994 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19aa6764-0310-4fd1-97a2-9ba6f25d82e9 None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:50:10.058651 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 554/1129] 10.222.0.25 () {56 vars in 1186 bytes} [Thu Sep 15 17:50:09 2022] GET /identity/v3/projects/2e01052d505748a3b5b2f06f06cf7819 => generated 311 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 17:50:10.065464 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317b0a42-9a3b-4b63-8d81-a05cae5b0514 None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:50:10.135848 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:50:10.177759 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317b0a42-9a3b-4b63-8d81-a05cae5b0514 None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:50:10.220576 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8693d52e-c420-4e7a-b1dd-83fcf15f562f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:50:10.221169 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8693d52e-c420-4e7a-b1dd-83fcf15f562f None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:50:10.221489 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8693d52e-c420-4e7a-b1dd-83fcf15f562f None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:50:10.221489 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8693d52e-c420-4e7a-b1dd-83fcf15f562f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:50:10.221489 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8693d52e-c420-4e7a-b1dd-83fcf15f562f None admin] RBAC: Adding query filter params (role.id=0dd1b9f5b7924e20a665ce50d6e34dc7, scope.project.id=2e01052d505748a3b5b2f06f06cf7819, user.id=ecaff648157749c58cb136bfb7662b1f) {{(pid=81593) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 17:50:10.221489 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8693d52e-c420-4e7a-b1dd-83fcf15f562f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:50:10.225122 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8693d52e-c420-4e7a-b1dd-83fcf15f562f None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:50:10.231446 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 576/1130] 10.222.0.25 () {56 vars in 1374 bytes} [Thu Sep 15 17:50:10 2022] GET /identity/v3/role_assignments?user.id=ecaff648157749c58cb136bfb7662b1f&scope.project.id=2e01052d505748a3b5b2f06f06cf7819&role.id=0dd1b9f5b7924e20a665ce50d6e34dc7 => generated 608 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 17:50:12.418686 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31dce234-4ea0-49e3-812e-c76b6dc738cf None None] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:50:12.419253 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31dce234-4ea0-49e3-812e-c76b6dc738cf None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:50:12.419253 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31dce234-4ea0-49e3-812e-c76b6dc738cf None None] PATH_INFO: `/` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:50:12.420573 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 555/1131] 10.222.0.25 () {54 vars in 927 bytes} [Thu Sep 15 17:50:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 17:50:12.425933 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aac4666-951d-401d-9c05-9631c17915e6 None None] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:50:12.426385 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aac4666-951d-401d-9c05-9631c17915e6 None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:50:12.426485 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aac4666-951d-401d-9c05-9631c17915e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:50:12.444127 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.auth.core [None req-9aac4666-951d-401d-9c05-9631c17915e6 None None] MFA Rules not processed for user `5cfa58ef86774ab7800bf91930bf6028`. Rule list: `[]` (Enabled: `True`). {{(pid=81593) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 17:50:12.445337 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-9aac4666-951d-401d-9c05-9631c17915e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 17:50:12.508437 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 577/1132] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Sep 15 17:50:12 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 15 17:50:12.774507 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31dce234-4ea0-49e3-812e-c76b6dc738cf None None] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:50:12.789667 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:50:12.872636 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31dce234-4ea0-49e3-812e-c76b6dc738cf None None] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:50:12.915551 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cafe780a-6468-42cc-b4cb-7958b1741d36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:50:12.916185 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafe780a-6468-42cc-b4cb-7958b1741d36 None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:50:12.916460 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafe780a-6468-42cc-b4cb-7958b1741d36 None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:50:12.916727 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafe780a-6468-42cc-b4cb-7958b1741d36 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:50:12.917857 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cafe780a-6468-42cc-b4cb-7958b1741d36 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:50:12.919271 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cafe780a-6468-42cc-b4cb-7958b1741d36 None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:50:12.921786 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 556/1133] 10.222.0.25 () {56 vars in 1108 bytes} [Thu Sep 15 17:50:12 2022] GET /identity/v3/domains/default => generated 199 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 17:50:12.927522 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aac4666-951d-401d-9c05-9631c17915e6 None None] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:50:12.987793 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:50:13.026426 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aac4666-951d-401d-9c05-9631c17915e6 None None] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:50:13.059998 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b91b493-0f9d-4245-bc75-cf140f8c4c38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:50:13.061214 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b91b493-0f9d-4245-bc75-cf140f8c4c38 None admin] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:50:13.061519 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b91b493-0f9d-4245-bc75-cf140f8c4c38 None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:50:13.061791 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b91b493-0f9d-4245-bc75-cf140f8c4c38 None admin] PATH_INFO: `/v3/projects` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:50:13.062434 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b91b493-0f9d-4245-bc75-cf140f8c4c38 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:50:13.063898 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b91b493-0f9d-4245-bc75-cf140f8c4c38 None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:50:13.090041 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 578/1134] 10.222.0.25 () {60 vars in 1141 bytes} [Thu Sep 15 17:50:12 2022] POST /identity/v3/projects => generated 311 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 17:50:15.289994 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb71a8f-c1b0-4f6f-86c2-6574169d6b3e None None] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:50:15.290572 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb71a8f-c1b0-4f6f-86c2-6574169d6b3e None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:50:15.290572 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb71a8f-c1b0-4f6f-86c2-6574169d6b3e None None] PATH_INFO: `/` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:50:15.291912 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 557/1135] 10.222.0.25 () {54 vars in 927 bytes} [Thu Sep 15 17:50:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 17:50:15.297606 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815b34c7-5e25-4ee2-93b2-0f5d2edf54a6 None None] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:50:15.298124 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815b34c7-5e25-4ee2-93b2-0f5d2edf54a6 None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:50:15.298124 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815b34c7-5e25-4ee2-93b2-0f5d2edf54a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:50:15.316138 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.auth.core [None req-815b34c7-5e25-4ee2-93b2-0f5d2edf54a6 None None] MFA Rules not processed for user `5cfa58ef86774ab7800bf91930bf6028`. Rule list: `[]` (Enabled: `True`). {{(pid=81593) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 17:50:15.317337 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-815b34c7-5e25-4ee2-93b2-0f5d2edf54a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 17:50:15.382886 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 579/1136] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Sep 15 17:50:15 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 15 17:50:15.654313 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb71a8f-c1b0-4f6f-86c2-6574169d6b3e None None] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:50:15.732932 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:50:15.754165 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb71a8f-c1b0-4f6f-86c2-6574169d6b3e None None] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:50:15.786904 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19c520f-1167-43a0-abeb-d7b2c71997e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:50:15.787511 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19c520f-1167-43a0-abeb-d7b2c71997e6 None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:50:15.787789 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19c520f-1167-43a0-abeb-d7b2c71997e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:50:15.788058 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19c520f-1167-43a0-abeb-d7b2c71997e6 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:50:15.789153 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b19c520f-1167-43a0-abeb-d7b2c71997e6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:50:15.790597 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b19c520f-1167-43a0-abeb-d7b2c71997e6 None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:50:15.792145 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 558/1137] 10.222.0.25 () {56 vars in 1108 bytes} [Thu Sep 15 17:50:15 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 17:50:15.797898 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815b34c7-5e25-4ee2-93b2-0f5d2edf54a6 None None] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:50:15.841695 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:50:15.895037 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815b34c7-5e25-4ee2-93b2-0f5d2edf54a6 None None] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:50:15.927886 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd5ebfd-2a87-45e7-944d-1e674ff49b1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:50:15.928485 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd5ebfd-2a87-45e7-944d-1e674ff49b1c None admin] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:50:15.928758 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd5ebfd-2a87-45e7-944d-1e674ff49b1c None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:50:15.929021 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd5ebfd-2a87-45e7-944d-1e674ff49b1c None admin] PATH_INFO: `/v3/users` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:50:15.929694 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd5ebfd-2a87-45e7-944d-1e674ff49b1c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:50:15.931112 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd5ebfd-2a87-45e7-944d-1e674ff49b1c None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:50:15.952151 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 580/1138] 10.222.0.25 () {60 vars in 1132 bytes} [Thu Sep 15 17:50:15 2022] POST /identity/v3/users => generated 286 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 17:50:18.134055 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d070966-4954-4a4f-a7a3-e36292165938 None None] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:50:18.134621 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d070966-4954-4a4f-a7a3-e36292165938 None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:50:18.134621 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d070966-4954-4a4f-a7a3-e36292165938 None None] PATH_INFO: `/` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:50:18.135922 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 559/1139] 10.222.0.25 () {54 vars in 927 bytes} [Thu Sep 15 17:50:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 17:50:18.141866 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4ec976-17c4-49af-b848-e54c68580090 None None] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:50:18.142337 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4ec976-17c4-49af-b848-e54c68580090 None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:50:18.142430 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4ec976-17c4-49af-b848-e54c68580090 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:50:18.161077 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.auth.core [None req-6e4ec976-17c4-49af-b848-e54c68580090 None None] MFA Rules not processed for user `5cfa58ef86774ab7800bf91930bf6028`. Rule list: `[]` (Enabled: `True`). {{(pid=81593) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 17:50:18.162303 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-6e4ec976-17c4-49af-b848-e54c68580090 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 17:50:18.228588 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 581/1140] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Sep 15 17:50:18 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 15 17:50:18.498089 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d070966-4954-4a4f-a7a3-e36292165938 None None] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:50:18.598776 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d070966-4954-4a4f-a7a3-e36292165938 None None] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:50:18.632862 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ed9303-e2d7-4166-9489-2e46c6a0bb4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:50:18.633521 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ed9303-e2d7-4166-9489-2e46c6a0bb4d None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:50:18.633803 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ed9303-e2d7-4166-9489-2e46c6a0bb4d None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:50:18.634075 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ed9303-e2d7-4166-9489-2e46c6a0bb4d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:50:18.644949 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ed9303-e2d7-4166-9489-2e46c6a0bb4d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 17:50:18.649805 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application [None req-48ed9303-e2d7-4166-9489-2e46c6a0bb4d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 15 17:50:18.649805 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 17:50:18.649805 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 17:50:18.649805 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 17:50:18.649805 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 17:50:18.649805 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 17:50:18.649805 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 17:50:18.649805 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 17:50:18.649805 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 17:50:18.649805 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 17:50:18.649805 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 17:50:18.649805 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 17:50:18.649805 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 17:50:18.649805 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 17:50:18.649805 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 17:50:18.649805 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 17:50:18.650980 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 17:50:18.650980 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 17:50:18.650980 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 17:50:18.650980 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 17:50:18.650980 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 17:50:18.650980 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 17:50:18.650980 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 17:50:18.650980 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 17:50:18.650980 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 17:50:18.650980 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 17:50:18.650980 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 17:50:18.650980 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application with Lock( Sep 15 17:50:18.650980 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 17:50:18.650980 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._enter() Sep 15 17:50:18.650980 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 17:50:18.650980 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 17:50:18.651914 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 17:50:18.651914 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.creator() Sep 15 17:50:18.651914 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 17:50:18.651914 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application created_value = creator( Sep 15 17:50:18.651914 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 17:50:18.651914 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 17:50:18.651914 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 17:50:18.651914 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 17:50:18.651914 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 17:50:18.651914 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 17:50:18.651914 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 15 17:50:18.651914 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Sep 15 17:50:18.651914 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 560/1141] 10.222.0.25 () {56 vars in 1096 bytes} [Thu Sep 15 17:50:18 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 17:50:18.657217 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4ec976-17c4-49af-b848-e54c68580090 None None] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:50:18.686764 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:50:18.766423 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4ec976-17c4-49af-b848-e54c68580090 None None] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:50:18.801122 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa5fa7d-0b09-45e4-9ec1-50504c0abb5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:50:18.801889 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa5fa7d-0b09-45e4-9ec1-50504c0abb5b None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:50:18.802171 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa5fa7d-0b09-45e4-9ec1-50504c0abb5b None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:50:18.802440 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa5fa7d-0b09-45e4-9ec1-50504c0abb5b None admin] PATH_INFO: `/v3/roles` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:50:18.803105 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa5fa7d-0b09-45e4-9ec1-50504c0abb5b None admin] RBAC: Adding query filter params (name=admin) {{(pid=81593) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 17:50:18.803408 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa5fa7d-0b09-45e4-9ec1-50504c0abb5b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:50:18.804791 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa5fa7d-0b09-45e4-9ec1-50504c0abb5b None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:50:18.813604 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 582/1142] 10.222.0.25 () {56 vars in 1099 bytes} [Thu Sep 15 17:50:18 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 17:50:18.819784 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ed9303-e2d7-4166-9489-2e46c6a0bb4d None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:50:18.832680 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:50:18.921471 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ed9303-e2d7-4166-9489-2e46c6a0bb4d None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:50:18.957953 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd731039-012f-452e-acf3-e66813a25e1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:50:18.958591 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd731039-012f-452e-acf3-e66813a25e1d None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:50:18.958868 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd731039-012f-452e-acf3-e66813a25e1d None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:50:18.959138 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd731039-012f-452e-acf3-e66813a25e1d None admin] PATH_INFO: `/v3/users/47760dbada6c4f338ee6ce3383286c5a` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:50:18.973527 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd731039-012f-452e-acf3-e66813a25e1d None admin] RBAC: Authorizing `identity:get_user(user_id=47760dbada6c4f338ee6ce3383286c5a)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:50:18.974979 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd731039-012f-452e-acf3-e66813a25e1d None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:50:18.976693 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 561/1143] 10.222.0.25 () {56 vars in 1177 bytes} [Thu Sep 15 17:50:18 2022] GET /identity/v3/users/47760dbada6c4f338ee6ce3383286c5a => generated 286 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 17:50:18.983392 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa5fa7d-0b09-45e4-9ec1-50504c0abb5b None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:50:19.075232 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:50:19.083987 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa5fa7d-0b09-45e4-9ec1-50504c0abb5b None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:50:19.119389 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec65e1a-110d-4299-9138-00351520c5b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:50:19.119987 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec65e1a-110d-4299-9138-00351520c5b7 None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:50:19.120265 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec65e1a-110d-4299-9138-00351520c5b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:50:19.120535 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec65e1a-110d-4299-9138-00351520c5b7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:50:19.186508 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec65e1a-110d-4299-9138-00351520c5b7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:50:19.187984 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec65e1a-110d-4299-9138-00351520c5b7 None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:50:19.275029 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:50:19.285337 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 583/1144] 10.222.0.25 () {58 vars in 1282 bytes} [Thu Sep 15 17:50:18 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 15 17:50:19.291289 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd731039-012f-452e-acf3-e66813a25e1d None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:50:19.361353 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:50:19.398796 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd731039-012f-452e-acf3-e66813a25e1d None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:50:19.433013 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe95c44-f098-4346-ba1b-5be69e411111 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:50:19.433670 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe95c44-f098-4346-ba1b-5be69e411111 None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:50:19.433955 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe95c44-f098-4346-ba1b-5be69e411111 None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:50:19.434231 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe95c44-f098-4346-ba1b-5be69e411111 None admin] PATH_INFO: `/v3/projects/f06ea9de5a69492a9aa146ef41ce3a04` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:50:19.435379 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe95c44-f098-4346-ba1b-5be69e411111 None admin] RBAC: Authorizing `identity:get_project(project_id=f06ea9de5a69492a9aa146ef41ce3a04)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:50:19.436799 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe95c44-f098-4346-ba1b-5be69e411111 None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:50:19.438451 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 562/1145] 10.222.0.25 () {56 vars in 1186 bytes} [Thu Sep 15 17:50:19 2022] GET /identity/v3/projects/f06ea9de5a69492a9aa146ef41ce3a04 => generated 311 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 17:50:19.444855 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec65e1a-110d-4299-9138-00351520c5b7 None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:50:19.541081 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec65e1a-110d-4299-9138-00351520c5b7 None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:50:19.574545 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dca66e8-eca1-4399-8738-c97e700012e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:50:19.575136 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dca66e8-eca1-4399-8738-c97e700012e7 None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:50:19.575408 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dca66e8-eca1-4399-8738-c97e700012e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:50:19.575701 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dca66e8-eca1-4399-8738-c97e700012e7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:50:19.576407 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dca66e8-eca1-4399-8738-c97e700012e7 None admin] RBAC: Adding query filter params (role.id=a9e42be86923434f8af52d3fc07fb4f7, scope.project.id=f06ea9de5a69492a9aa146ef41ce3a04, user.id=47760dbada6c4f338ee6ce3383286c5a) {{(pid=81593) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 17:50:19.576709 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dca66e8-eca1-4399-8738-c97e700012e7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:50:19.578289 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dca66e8-eca1-4399-8738-c97e700012e7 None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:50:19.583483 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 584/1146] 10.222.0.25 () {56 vars in 1374 bytes} [Thu Sep 15 17:50:19 2022] GET /identity/v3/role_assignments?user.id=47760dbada6c4f338ee6ce3383286c5a&scope.project.id=f06ea9de5a69492a9aa146ef41ce3a04&role.id=a9e42be86923434f8af52d3fc07fb4f7 => generated 259 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 17:50:21.724980 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19fb0a0-a093-43f2-a6ab-7d0e5faec604 None None] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:50:21.725799 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19fb0a0-a093-43f2-a6ab-7d0e5faec604 None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:50:21.725996 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19fb0a0-a093-43f2-a6ab-7d0e5faec604 None None] PATH_INFO: `/` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:50:21.727433 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 563/1147] 10.222.0.25 () {54 vars in 927 bytes} [Thu Sep 15 17:50:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 15 17:50:21.733597 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e509ed-f346-4c6e-a8ce-3f7537ee81fa None None] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:50:21.734109 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e509ed-f346-4c6e-a8ce-3f7537ee81fa None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:50:21.734220 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e509ed-f346-4c6e-a8ce-3f7537ee81fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:50:21.761757 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.auth.core [None req-78e509ed-f346-4c6e-a8ce-3f7537ee81fa None None] MFA Rules not processed for user `5cfa58ef86774ab7800bf91930bf6028`. Rule list: `[]` (Enabled: `True`). {{(pid=81593) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 17:50:21.763101 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-78e509ed-f346-4c6e-a8ce-3f7537ee81fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 17:50:21.820614 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:50:21.840022 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 585/1148] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Sep 15 17:50:21 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 15 17:50:22.114593 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19fb0a0-a093-43f2-a6ab-7d0e5faec604 None None] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:50:22.214601 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19fb0a0-a093-43f2-a6ab-7d0e5faec604 None None] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:50:22.255661 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d082f179-b4d9-44d8-805c-f0026a7b40c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:50:22.256288 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d082f179-b4d9-44d8-805c-f0026a7b40c8 None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:50:22.256565 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d082f179-b4d9-44d8-805c-f0026a7b40c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:50:22.256836 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d082f179-b4d9-44d8-805c-f0026a7b40c8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:50:22.258852 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:50:22.268557 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d082f179-b4d9-44d8-805c-f0026a7b40c8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 17:50:22.273634 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application [None req-d082f179-b4d9-44d8-805c-f0026a7b40c8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 15 17:50:22.273634 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 17:50:22.273634 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 17:50:22.273634 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 17:50:22.273634 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 17:50:22.273634 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 17:50:22.273634 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 17:50:22.273634 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 17:50:22.273634 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 17:50:22.273634 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 17:50:22.273634 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 17:50:22.273634 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 17:50:22.273634 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 17:50:22.273634 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 17:50:22.273634 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 17:50:22.273634 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 17:50:22.274998 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 17:50:22.274998 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 17:50:22.274998 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 17:50:22.274998 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 17:50:22.274998 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 17:50:22.274998 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 17:50:22.274998 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 17:50:22.274998 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 17:50:22.274998 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 17:50:22.274998 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 17:50:22.274998 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 17:50:22.274998 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application with Lock( Sep 15 17:50:22.274998 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 17:50:22.274998 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._enter() Sep 15 17:50:22.274998 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 17:50:22.274998 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 17:50:22.275900 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 17:50:22.275900 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.creator() Sep 15 17:50:22.275900 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 17:50:22.275900 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application created_value = creator( Sep 15 17:50:22.275900 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 17:50:22.275900 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 17:50:22.275900 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 17:50:22.275900 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 17:50:22.275900 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 17:50:22.275900 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 17:50:22.275900 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 15 17:50:22.275900 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Sep 15 17:50:22.275900 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 564/1149] 10.222.0.25 () {56 vars in 1096 bytes} [Thu Sep 15 17:50:22 2022] GET /identity/v3/roles/admin => generated 83 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 17:50:22.281805 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e509ed-f346-4c6e-a8ce-3f7537ee81fa None None] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:50:22.390072 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e509ed-f346-4c6e-a8ce-3f7537ee81fa None None] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:50:22.426306 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb26689-d1cb-4086-89ec-4a92debe326f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:50:22.426912 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb26689-d1cb-4086-89ec-4a92debe326f None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:50:22.427191 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb26689-d1cb-4086-89ec-4a92debe326f None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:50:22.427475 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb26689-d1cb-4086-89ec-4a92debe326f None admin] PATH_INFO: `/v3/roles` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:50:22.428135 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb26689-d1cb-4086-89ec-4a92debe326f None admin] RBAC: Adding query filter params (name=admin) {{(pid=81593) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 17:50:22.428439 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb26689-d1cb-4086-89ec-4a92debe326f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:50:22.429852 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb26689-d1cb-4086-89ec-4a92debe326f None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:50:22.438053 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 586/1150] 10.222.0.25 () {56 vars in 1099 bytes} [Thu Sep 15 17:50:22 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 17:50:22.443945 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d082f179-b4d9-44d8-805c-f0026a7b40c8 None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:50:22.545706 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d082f179-b4d9-44d8-805c-f0026a7b40c8 None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:50:22.579095 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c68abd-c2f0-42f9-a253-67c6c0b30b47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:50:22.579725 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c68abd-c2f0-42f9-a253-67c6c0b30b47 None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:50:22.580005 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c68abd-c2f0-42f9-a253-67c6c0b30b47 None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:50:22.580277 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c68abd-c2f0-42f9-a253-67c6c0b30b47 None admin] PATH_INFO: `/v3/users/47760dbada6c4f338ee6ce3383286c5a` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:50:22.581415 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c68abd-c2f0-42f9-a253-67c6c0b30b47 None admin] RBAC: Authorizing `identity:get_user(user_id=47760dbada6c4f338ee6ce3383286c5a)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:50:22.582886 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c68abd-c2f0-42f9-a253-67c6c0b30b47 None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:50:22.584472 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 565/1151] 10.222.0.25 () {56 vars in 1177 bytes} [Thu Sep 15 17:50:22 2022] GET /identity/v3/users/47760dbada6c4f338ee6ce3383286c5a => generated 286 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 17:50:22.590304 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb26689-d1cb-4086-89ec-4a92debe326f None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:50:22.642692 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:50:22.696032 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb26689-d1cb-4086-89ec-4a92debe326f None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:50:22.729692 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d758c59-93c1-4ec9-a2cd-998278f2a456 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:50:22.730325 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d758c59-93c1-4ec9-a2cd-998278f2a456 None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:50:22.730602 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d758c59-93c1-4ec9-a2cd-998278f2a456 None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:50:22.730871 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d758c59-93c1-4ec9-a2cd-998278f2a456 None admin] PATH_INFO: `/v3/projects/f06ea9de5a69492a9aa146ef41ce3a04` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:50:22.732649 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d758c59-93c1-4ec9-a2cd-998278f2a456 None admin] RBAC: Authorizing `identity:get_project(project_id=f06ea9de5a69492a9aa146ef41ce3a04)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:50:22.734124 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d758c59-93c1-4ec9-a2cd-998278f2a456 None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:50:22.735790 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 587/1152] 10.222.0.25 () {56 vars in 1186 bytes} [Thu Sep 15 17:50:22 2022] GET /identity/v3/projects/f06ea9de5a69492a9aa146ef41ce3a04 => generated 311 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 17:50:22.741911 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c68abd-c2f0-42f9-a253-67c6c0b30b47 None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:50:22.802990 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:50:22.842828 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c68abd-c2f0-42f9-a253-67c6c0b30b47 None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:50:22.877659 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be418d0-5a5b-47c5-aae0-4f07b4fcd5e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:50:22.878312 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be418d0-5a5b-47c5-aae0-4f07b4fcd5e0 None admin] REQUEST_METHOD: `PUT` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:50:22.878589 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be418d0-5a5b-47c5-aae0-4f07b4fcd5e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:50:22.878862 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be418d0-5a5b-47c5-aae0-4f07b4fcd5e0 None admin] PATH_INFO: `/v3/projects/f06ea9de5a69492a9aa146ef41ce3a04/users/47760dbada6c4f338ee6ce3383286c5a/roles/a9e42be86923434f8af52d3fc07fb4f7` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:50:22.880832 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be418d0-5a5b-47c5-aae0-4f07b4fcd5e0 None admin] RBAC: Authorizing `identity:create_grant(project_id=f06ea9de5a69492a9aa146ef41ce3a04, user_id=47760dbada6c4f338ee6ce3383286c5a, role_id=a9e42be86923434f8af52d3fc07fb4f7)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:50:22.882275 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be418d0-5a5b-47c5-aae0-4f07b4fcd5e0 None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:50:22.896659 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 566/1153] 10.222.0.25 () {58 vars in 1439 bytes} [Thu Sep 15 17:50:22 2022] PUT /identity/v3/projects/f06ea9de5a69492a9aa146ef41ce3a04/users/47760dbada6c4f338ee6ce3383286c5a/roles/a9e42be86923434f8af52d3fc07fb4f7 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 15 17:50:25.066322 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87a8c02-7edf-49cf-8d9e-2428069718c3 None None] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:50:25.066871 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87a8c02-7edf-49cf-8d9e-2428069718c3 None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:50:25.066871 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87a8c02-7edf-49cf-8d9e-2428069718c3 None None] PATH_INFO: `/` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:50:25.068226 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 588/1154] 10.222.0.25 () {54 vars in 927 bytes} [Thu Sep 15 17:50:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 17:50:25.073536 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3868f6-d2af-4f3d-a6f5-e4d407b97063 None None] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:50:25.073922 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3868f6-d2af-4f3d-a6f5-e4d407b97063 None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:50:25.074082 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3868f6-d2af-4f3d-a6f5-e4d407b97063 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:50:25.092641 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.auth.core [None req-5e3868f6-d2af-4f3d-a6f5-e4d407b97063 None None] MFA Rules not processed for user `5cfa58ef86774ab7800bf91930bf6028`. Rule list: `[]` (Enabled: `True`). {{(pid=81592) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 17:50:25.093867 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-5e3868f6-d2af-4f3d-a6f5-e4d407b97063 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 17:50:25.162626 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 567/1155] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Sep 15 17:50:25 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 15 17:50:25.438168 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87a8c02-7edf-49cf-8d9e-2428069718c3 None None] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:50:25.537439 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87a8c02-7edf-49cf-8d9e-2428069718c3 None None] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:50:25.553132 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:50:25.572136 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37b5b91-dc92-46f0-b6aa-5644880d9b5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:50:25.572760 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37b5b91-dc92-46f0-b6aa-5644880d9b5c None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:50:25.573030 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37b5b91-dc92-46f0-b6aa-5644880d9b5c None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:50:25.573324 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37b5b91-dc92-46f0-b6aa-5644880d9b5c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:50:25.584083 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37b5b91-dc92-46f0-b6aa-5644880d9b5c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 17:50:25.588775 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application [None req-b37b5b91-dc92-46f0-b6aa-5644880d9b5c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 15 17:50:25.588775 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 17:50:25.588775 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 17:50:25.588775 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 17:50:25.588775 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 17:50:25.588775 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 17:50:25.588775 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 17:50:25.588775 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 17:50:25.588775 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 17:50:25.588775 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 17:50:25.588775 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 17:50:25.588775 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 17:50:25.588775 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 17:50:25.588775 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 17:50:25.588775 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 17:50:25.588775 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 17:50:25.589927 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 17:50:25.589927 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 17:50:25.589927 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 17:50:25.589927 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 17:50:25.589927 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 17:50:25.589927 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 17:50:25.589927 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 17:50:25.589927 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 17:50:25.589927 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 17:50:25.589927 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 17:50:25.589927 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 17:50:25.589927 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application with Lock( Sep 15 17:50:25.589927 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 17:50:25.589927 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._enter() Sep 15 17:50:25.589927 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 17:50:25.589927 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 17:50:25.591196 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 17:50:25.591196 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.creator() Sep 15 17:50:25.591196 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 17:50:25.591196 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application created_value = creator( Sep 15 17:50:25.591196 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 17:50:25.591196 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 17:50:25.591196 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 17:50:25.591196 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 17:50:25.591196 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 17:50:25.591196 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 17:50:25.591196 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 15 17:50:25.591196 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Sep 15 17:50:25.591196 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 589/1156] 10.222.0.25 () {56 vars in 1096 bytes} [Thu Sep 15 17:50:25 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 17:50:25.596061 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3868f6-d2af-4f3d-a6f5-e4d407b97063 None None] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:50:25.650320 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:50:25.701162 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3868f6-d2af-4f3d-a6f5-e4d407b97063 None None] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:50:25.734859 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b306718d-e48c-4af9-aef2-80f1281e7054 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:50:25.735462 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b306718d-e48c-4af9-aef2-80f1281e7054 None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:50:25.735742 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b306718d-e48c-4af9-aef2-80f1281e7054 None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:50:25.736548 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b306718d-e48c-4af9-aef2-80f1281e7054 None admin] PATH_INFO: `/v3/roles` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:50:25.736664 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b306718d-e48c-4af9-aef2-80f1281e7054 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81592) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 17:50:25.736957 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b306718d-e48c-4af9-aef2-80f1281e7054 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:50:25.738349 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b306718d-e48c-4af9-aef2-80f1281e7054 None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:50:25.746314 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 568/1157] 10.222.0.25 () {56 vars in 1099 bytes} [Thu Sep 15 17:50:25 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 17:50:25.752872 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37b5b91-dc92-46f0-b6aa-5644880d9b5c None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:50:25.850855 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37b5b91-dc92-46f0-b6aa-5644880d9b5c None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:50:25.885573 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241180f7-654e-4705-8c44-48fc7d8a6a9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:50:25.886200 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241180f7-654e-4705-8c44-48fc7d8a6a9f None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:50:25.886480 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241180f7-654e-4705-8c44-48fc7d8a6a9f None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:50:25.886751 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241180f7-654e-4705-8c44-48fc7d8a6a9f None admin] PATH_INFO: `/v3/users/47760dbada6c4f338ee6ce3383286c5a` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:50:25.887904 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241180f7-654e-4705-8c44-48fc7d8a6a9f None admin] RBAC: Authorizing `identity:get_user(user_id=47760dbada6c4f338ee6ce3383286c5a)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:50:25.889362 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241180f7-654e-4705-8c44-48fc7d8a6a9f None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:50:25.890937 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 590/1158] 10.222.0.25 () {56 vars in 1177 bytes} [Thu Sep 15 17:50:25 2022] GET /identity/v3/users/47760dbada6c4f338ee6ce3383286c5a => generated 286 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 17:50:25.896744 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b306718d-e48c-4af9-aef2-80f1281e7054 None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:50:26.001154 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b306718d-e48c-4af9-aef2-80f1281e7054 None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:50:26.015798 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:50:26.037086 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd320b3c-7c51-41f2-b2a0-7990dcf25880 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:50:26.037725 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd320b3c-7c51-41f2-b2a0-7990dcf25880 None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:50:26.038004 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd320b3c-7c51-41f2-b2a0-7990dcf25880 None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:50:26.038277 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd320b3c-7c51-41f2-b2a0-7990dcf25880 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:50:26.102913 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd320b3c-7c51-41f2-b2a0-7990dcf25880 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:50:26.104604 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd320b3c-7c51-41f2-b2a0-7990dcf25880 None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:50:26.199049 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 569/1159] 10.222.0.25 () {58 vars in 1282 bytes} [Thu Sep 15 17:50:25 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 15 17:50:26.205056 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241180f7-654e-4705-8c44-48fc7d8a6a9f None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:50:26.250168 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:50:26.319457 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241180f7-654e-4705-8c44-48fc7d8a6a9f None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:50:26.353193 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8a7a6e-de75-49ad-9e70-e6c1fb26b698 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:50:26.353840 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8a7a6e-de75-49ad-9e70-e6c1fb26b698 None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:50:26.354369 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8a7a6e-de75-49ad-9e70-e6c1fb26b698 None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:50:26.354634 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8a7a6e-de75-49ad-9e70-e6c1fb26b698 None admin] PATH_INFO: `/v3/projects/f06ea9de5a69492a9aa146ef41ce3a04` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:50:26.355724 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c8a7a6e-de75-49ad-9e70-e6c1fb26b698 None admin] RBAC: Authorizing `identity:get_project(project_id=f06ea9de5a69492a9aa146ef41ce3a04)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:50:26.357474 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c8a7a6e-de75-49ad-9e70-e6c1fb26b698 None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:50:26.359091 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 591/1160] 10.222.0.25 () {56 vars in 1186 bytes} [Thu Sep 15 17:50:26 2022] GET /identity/v3/projects/f06ea9de5a69492a9aa146ef41ce3a04 => generated 311 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 17:50:26.365397 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd320b3c-7c51-41f2-b2a0-7990dcf25880 None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:50:26.380794 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:50:26.464139 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd320b3c-7c51-41f2-b2a0-7990dcf25880 None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:50:26.497979 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d9d1f9-2c20-4bf3-9126-75fbad8e6b65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:50:26.498587 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d9d1f9-2c20-4bf3-9126-75fbad8e6b65 None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:50:26.498864 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d9d1f9-2c20-4bf3-9126-75fbad8e6b65 None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:50:26.499129 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d9d1f9-2c20-4bf3-9126-75fbad8e6b65 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:50:26.499841 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d9d1f9-2c20-4bf3-9126-75fbad8e6b65 None admin] RBAC: Adding query filter params (role.id=a9e42be86923434f8af52d3fc07fb4f7, scope.project.id=f06ea9de5a69492a9aa146ef41ce3a04, user.id=47760dbada6c4f338ee6ce3383286c5a) {{(pid=81592) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 17:50:26.500142 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d9d1f9-2c20-4bf3-9126-75fbad8e6b65 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:50:26.501585 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d9d1f9-2c20-4bf3-9126-75fbad8e6b65 None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:50:26.507333 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 570/1161] 10.222.0.25 () {56 vars in 1374 bytes} [Thu Sep 15 17:50:26 2022] GET /identity/v3/role_assignments?user.id=47760dbada6c4f338ee6ce3383286c5a&scope.project.id=f06ea9de5a69492a9aa146ef41ce3a04&role.id=a9e42be86923434f8af52d3fc07fb4f7 => generated 608 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 17:50:28.709173 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f35afa-bc56-498c-a5ea-0efad42b4325 None None] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:50:28.709787 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f35afa-bc56-498c-a5ea-0efad42b4325 None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:50:28.709787 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f35afa-bc56-498c-a5ea-0efad42b4325 None None] PATH_INFO: `/` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:50:28.711104 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 592/1162] 10.222.0.25 () {54 vars in 927 bytes} [Thu Sep 15 17:50:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 17:50:28.717823 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cbe08d-9d9b-4d12-b0ac-c30bb67aa2b0 None None] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:50:28.718324 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cbe08d-9d9b-4d12-b0ac-c30bb67aa2b0 None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:50:28.718413 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cbe08d-9d9b-4d12-b0ac-c30bb67aa2b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:50:28.743203 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.auth.core [None req-80cbe08d-9d9b-4d12-b0ac-c30bb67aa2b0 None None] MFA Rules not processed for user `5cfa58ef86774ab7800bf91930bf6028`. Rule list: `[]` (Enabled: `True`). {{(pid=81592) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 17:50:28.744389 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-80cbe08d-9d9b-4d12-b0ac-c30bb67aa2b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 17:50:28.810969 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 571/1163] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Sep 15 17:50:28 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 15 17:50:29.078239 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f35afa-bc56-498c-a5ea-0efad42b4325 None None] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:50:29.191618 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f35afa-bc56-498c-a5ea-0efad42b4325 None None] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:50:29.205557 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:50:29.227449 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb58658-e86e-48f3-bfc3-17482e80aa9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:50:29.228115 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb58658-e86e-48f3-bfc3-17482e80aa9e None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:50:29.228434 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb58658-e86e-48f3-bfc3-17482e80aa9e None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:50:29.228768 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb58658-e86e-48f3-bfc3-17482e80aa9e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:50:29.303490 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb58658-e86e-48f3-bfc3-17482e80aa9e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:50:29.304959 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb58658-e86e-48f3-bfc3-17482e80aa9e None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:50:29.408979 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 593/1164] 10.222.0.25 () {58 vars in 1282 bytes} [Thu Sep 15 17:50:29 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 15 17:50:29.415066 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80cbe08d-9d9b-4d12-b0ac-c30bb67aa2b0 None None] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:50:29.429976 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:50:29.527128 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80cbe08d-9d9b-4d12-b0ac-c30bb67aa2b0 None None] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:50:29.564663 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1b89b7-e391-4d33-98c3-36319c79de9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:50:29.565319 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1b89b7-e391-4d33-98c3-36319c79de9f None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:50:29.565600 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1b89b7-e391-4d33-98c3-36319c79de9f None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:50:29.565869 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1b89b7-e391-4d33-98c3-36319c79de9f None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:50:29.572777 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e1b89b7-e391-4d33-98c3-36319c79de9f None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:50:29.574378 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e1b89b7-e391-4d33-98c3-36319c79de9f None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:50:29.587759 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application [None req-9e1b89b7-e391-4d33-98c3-36319c79de9f None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Sep 15 17:50:29.587759 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 17:50:29.587759 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Sep 15 17:50:29.587759 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Sep 15 17:50:29.587759 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 15 17:50:29.587759 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 15 17:50:29.587759 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 15 17:50:29.587759 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 15 17:50:29.587759 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Sep 15 17:50:29.587759 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Sep 15 17:50:29.587759 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 15 17:50:29.587759 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Sep 15 17:50:29.587759 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 17:50:29.587759 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 17:50:29.587759 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 17:50:29.587759 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 17:50:29.587759 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 17:50:29.589071 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 17:50:29.589071 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 17:50:29.589071 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 17:50:29.589071 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 17:50:29.589071 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 17:50:29.589071 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 17:50:29.589071 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 15 17:50:29.589071 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 15 17:50:29.589071 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 15 17:50:29.589071 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 15 17:50:29.589071 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 17:50:29.589071 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 17:50:29.589071 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 17:50:29.589071 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 17:50:29.589071 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 17:50:29.589071 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 17:50:29.590033 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 17:50:29.590033 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application with Lock( Sep 15 17:50:29.590033 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 17:50:29.590033 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._enter() Sep 15 17:50:29.590033 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 17:50:29.590033 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 17:50:29.590033 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 17:50:29.590033 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.creator() Sep 15 17:50:29.590033 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 17:50:29.590033 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application created_value = creator( Sep 15 17:50:29.590033 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Sep 15 17:50:29.590033 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 15 17:50:29.590033 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Sep 15 17:50:29.590033 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Sep 15 17:50:29.590033 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 572/1165] 10.222.0.25 () {56 vars in 1117 bytes} [Thu Sep 15 17:50:29 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 17:50:29.595090 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb58658-e86e-48f3-bfc3-17482e80aa9e None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:50:29.612657 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:50:29.707290 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb58658-e86e-48f3-bfc3-17482e80aa9e None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:50:29.746456 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8e8839-044e-430a-bb3b-edd02d874ccf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:50:29.747146 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8e8839-044e-430a-bb3b-edd02d874ccf None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:50:29.747399 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8e8839-044e-430a-bb3b-edd02d874ccf None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:50:29.747673 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8e8839-044e-430a-bb3b-edd02d874ccf None admin] PATH_INFO: `/v3/domains` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:50:29.748713 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a8e8839-044e-430a-bb3b-edd02d874ccf None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=81593) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 17:50:29.749262 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a8e8839-044e-430a-bb3b-edd02d874ccf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:50:29.750958 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a8e8839-044e-430a-bb3b-edd02d874ccf None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:50:29.758792 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 594/1166] 10.222.0.25 () {56 vars in 1115 bytes} [Thu Sep 15 17:50:29 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 17:50:31.927467 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31d030e-b835-49e7-9d9e-5bdf133a0a00 None None] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:50:31.927467 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31d030e-b835-49e7-9d9e-5bdf133a0a00 None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:50:31.927467 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31d030e-b835-49e7-9d9e-5bdf133a0a00 None None] PATH_INFO: `/` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:50:31.928654 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 573/1167] 10.222.0.25 () {54 vars in 927 bytes} [Thu Sep 15 17:50:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 17:50:31.934081 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9efd1c0-5396-427c-8cb6-c83e986ea35c None None] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:50:31.935072 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9efd1c0-5396-427c-8cb6-c83e986ea35c None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:50:31.935175 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9efd1c0-5396-427c-8cb6-c83e986ea35c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:50:31.953187 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.auth.core [None req-e9efd1c0-5396-427c-8cb6-c83e986ea35c None None] MFA Rules not processed for user `5cfa58ef86774ab7800bf91930bf6028`. Rule list: `[]` (Enabled: `True`). {{(pid=81593) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 17:50:31.954397 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-e9efd1c0-5396-427c-8cb6-c83e986ea35c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 17:50:32.019203 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 595/1168] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Sep 15 17:50:31 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 15 17:50:32.283777 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31d030e-b835-49e7-9d9e-5bdf133a0a00 None None] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:50:32.348522 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:50:32.382019 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31d030e-b835-49e7-9d9e-5bdf133a0a00 None None] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:50:32.414271 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d03516e-0f90-43c4-aec4-0f013f25e987 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:50:32.414868 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d03516e-0f90-43c4-aec4-0f013f25e987 None admin] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:50:32.415141 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d03516e-0f90-43c4-aec4-0f013f25e987 None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:50:32.415409 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d03516e-0f90-43c4-aec4-0f013f25e987 None admin] PATH_INFO: `/v3/domains` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:50:32.416063 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d03516e-0f90-43c4-aec4-0f013f25e987 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:50:32.417450 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d03516e-0f90-43c4-aec4-0f013f25e987 None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:50:32.435157 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 574/1169] 10.222.0.25 () {60 vars in 1138 bytes} [Thu Sep 15 17:50:32 2022] POST /identity/v3/domains => generated 267 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 17:50:34.624827 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd28b7c7-5cb0-4119-9576-a5aa95bbdc9a None None] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:50:34.625382 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd28b7c7-5cb0-4119-9576-a5aa95bbdc9a None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:50:34.625382 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd28b7c7-5cb0-4119-9576-a5aa95bbdc9a None None] PATH_INFO: `/` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:50:34.626753 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 596/1170] 10.222.0.25 () {54 vars in 927 bytes} [Thu Sep 15 17:50:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 17:50:34.632021 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfecc74e-1a31-4998-b5ed-8d4570e1a757 None None] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:50:34.632438 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfecc74e-1a31-4998-b5ed-8d4570e1a757 None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:50:34.632568 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfecc74e-1a31-4998-b5ed-8d4570e1a757 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:50:34.650976 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.auth.core [None req-bfecc74e-1a31-4998-b5ed-8d4570e1a757 None None] MFA Rules not processed for user `5cfa58ef86774ab7800bf91930bf6028`. Rule list: `[]` (Enabled: `True`). {{(pid=81592) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 17:50:34.652162 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-bfecc74e-1a31-4998-b5ed-8d4570e1a757 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 17:50:34.718194 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 575/1171] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Sep 15 17:50:34 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 15 17:50:34.988882 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd28b7c7-5cb0-4119-9576-a5aa95bbdc9a None None] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:50:34.997816 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:50:35.099064 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd28b7c7-5cb0-4119-9576-a5aa95bbdc9a None None] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:50:35.138816 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17de2730-8d47-444b-8adf-74b659d3e153 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:50:35.139546 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17de2730-8d47-444b-8adf-74b659d3e153 None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:50:35.139964 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17de2730-8d47-444b-8adf-74b659d3e153 None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:50:35.140356 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17de2730-8d47-444b-8adf-74b659d3e153 None admin] PATH_INFO: `/v3/domains/f7e1498602c74b6fa0d58f822fcbfcdc` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:50:35.151518 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17de2730-8d47-444b-8adf-74b659d3e153 None admin] RBAC: Authorizing `identity:get_domain(domain_id=f7e1498602c74b6fa0d58f822fcbfcdc)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:50:35.153007 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17de2730-8d47-444b-8adf-74b659d3e153 None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:50:35.154726 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 597/1172] 10.222.0.25 () {56 vars in 1183 bytes} [Thu Sep 15 17:50:34 2022] GET /identity/v3/domains/f7e1498602c74b6fa0d58f822fcbfcdc => generated 267 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 17:50:35.160641 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfecc74e-1a31-4998-b5ed-8d4570e1a757 None None] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:50:35.216965 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:50:35.259339 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfecc74e-1a31-4998-b5ed-8d4570e1a757 None None] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:50:35.292363 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ebd327-0f55-4fd8-a7ec-b9e17d8304fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:50:35.292970 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ebd327-0f55-4fd8-a7ec-b9e17d8304fc None admin] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:50:35.293248 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ebd327-0f55-4fd8-a7ec-b9e17d8304fc None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:50:35.294087 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ebd327-0f55-4fd8-a7ec-b9e17d8304fc None admin] PATH_INFO: `/v3/projects` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:50:35.294798 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ebd327-0f55-4fd8-a7ec-b9e17d8304fc None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:50:35.296231 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ebd327-0f55-4fd8-a7ec-b9e17d8304fc None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:50:35.323362 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 576/1173] 10.222.0.25 () {60 vars in 1141 bytes} [Thu Sep 15 17:50:35 2022] POST /identity/v3/projects => generated 361 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 15 17:50:37.548960 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a23be7-77da-40b5-ae8d-317104fc8ad0 None None] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:50:37.549565 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a23be7-77da-40b5-ae8d-317104fc8ad0 None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:50:37.549565 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a23be7-77da-40b5-ae8d-317104fc8ad0 None None] PATH_INFO: `/` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:50:37.550865 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 598/1174] 10.222.0.25 () {54 vars in 927 bytes} [Thu Sep 15 17:50:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 17:50:37.556204 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdec222-14f6-49cb-953d-487cab865cbd None None] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:50:37.556589 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdec222-14f6-49cb-953d-487cab865cbd None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:50:37.556762 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdec222-14f6-49cb-953d-487cab865cbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:50:37.574866 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.auth.core [None req-fbdec222-14f6-49cb-953d-487cab865cbd None None] MFA Rules not processed for user `5cfa58ef86774ab7800bf91930bf6028`. Rule list: `[]` (Enabled: `True`). {{(pid=81592) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 17:50:37.576066 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-fbdec222-14f6-49cb-953d-487cab865cbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 17:50:37.643368 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 577/1175] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Sep 15 17:50:37 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 15 17:50:37.923765 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a23be7-77da-40b5-ae8d-317104fc8ad0 None None] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:50:37.990216 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:50:38.026273 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a23be7-77da-40b5-ae8d-317104fc8ad0 None None] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:50:38.060240 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2318d11-a2a6-4e6a-bc95-efcb3c2a475e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:50:38.060867 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2318d11-a2a6-4e6a-bc95-efcb3c2a475e None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:50:38.061148 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2318d11-a2a6-4e6a-bc95-efcb3c2a475e None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:50:38.061458 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2318d11-a2a6-4e6a-bc95-efcb3c2a475e None admin] PATH_INFO: `/v3/domains/f7e1498602c74b6fa0d58f822fcbfcdc` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:50:38.062574 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2318d11-a2a6-4e6a-bc95-efcb3c2a475e None admin] RBAC: Authorizing `identity:get_domain(domain_id=f7e1498602c74b6fa0d58f822fcbfcdc)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:50:38.064026 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2318d11-a2a6-4e6a-bc95-efcb3c2a475e None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:50:38.065645 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 599/1176] 10.222.0.25 () {56 vars in 1183 bytes} [Thu Sep 15 17:50:37 2022] GET /identity/v3/domains/f7e1498602c74b6fa0d58f822fcbfcdc => generated 267 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 17:50:38.071497 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbdec222-14f6-49cb-953d-487cab865cbd None None] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:50:38.112971 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:50:38.174641 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbdec222-14f6-49cb-953d-487cab865cbd None None] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:50:38.208212 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d931e11e-56bb-46c9-a98f-82a94f110ce6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:50:38.208819 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d931e11e-56bb-46c9-a98f-82a94f110ce6 None admin] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:50:38.209097 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d931e11e-56bb-46c9-a98f-82a94f110ce6 None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:50:38.209402 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d931e11e-56bb-46c9-a98f-82a94f110ce6 None admin] PATH_INFO: `/v3/users` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:50:38.210051 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d931e11e-56bb-46c9-a98f-82a94f110ce6 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:50:38.211471 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d931e11e-56bb-46c9-a98f-82a94f110ce6 None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:50:38.232186 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 578/1177] 10.222.0.25 () {60 vars in 1132 bytes} [Thu Sep 15 17:50:38 2022] POST /identity/v3/users => generated 311 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 17:50:40.432977 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850f0a5f-ae2e-4514-9b61-d8ad8b31ead6 None None] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:50:40.433712 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850f0a5f-ae2e-4514-9b61-d8ad8b31ead6 None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:50:40.433712 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850f0a5f-ae2e-4514-9b61-d8ad8b31ead6 None None] PATH_INFO: `/` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:50:40.435146 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 600/1178] 10.222.0.25 () {54 vars in 927 bytes} [Thu Sep 15 17:50:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 17:50:40.441011 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161709ce-b284-4311-a72a-32c2fec91333 None None] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:50:40.441592 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161709ce-b284-4311-a72a-32c2fec91333 None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:50:40.441592 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161709ce-b284-4311-a72a-32c2fec91333 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:50:40.460339 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.auth.core [None req-161709ce-b284-4311-a72a-32c2fec91333 None None] MFA Rules not processed for user `5cfa58ef86774ab7800bf91930bf6028`. Rule list: `[]` (Enabled: `True`). {{(pid=81592) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 17:50:40.461593 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-161709ce-b284-4311-a72a-32c2fec91333 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 17:50:40.539342 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 579/1179] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Sep 15 17:50:40 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 15 17:50:40.814666 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850f0a5f-ae2e-4514-9b61-d8ad8b31ead6 None None] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:50:40.935193 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850f0a5f-ae2e-4514-9b61-d8ad8b31ead6 None None] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:50:40.970473 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b87ffc-b8fb-4cb8-8233-a2fcacff7570 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:50:40.971103 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b87ffc-b8fb-4cb8-8233-a2fcacff7570 None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:50:40.971380 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b87ffc-b8fb-4cb8-8233-a2fcacff7570 None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:50:40.971651 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b87ffc-b8fb-4cb8-8233-a2fcacff7570 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:50:40.973539 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:50:40.986019 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b87ffc-b8fb-4cb8-8233-a2fcacff7570 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 17:50:40.990786 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application [None req-d3b87ffc-b8fb-4cb8-8233-a2fcacff7570 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 15 17:50:40.990786 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 17:50:40.990786 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 17:50:40.990786 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 17:50:40.990786 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 17:50:40.990786 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 17:50:40.990786 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 17:50:40.990786 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 17:50:40.990786 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 17:50:40.990786 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 17:50:40.990786 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 17:50:40.990786 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 17:50:40.990786 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 17:50:40.990786 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 17:50:40.990786 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 17:50:40.990786 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 17:50:40.991991 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 17:50:40.991991 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 17:50:40.991991 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 17:50:40.991991 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 17:50:40.991991 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 17:50:40.991991 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 17:50:40.991991 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 17:50:40.991991 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 17:50:40.991991 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 17:50:40.991991 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 17:50:40.991991 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 17:50:40.991991 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application with Lock( Sep 15 17:50:40.991991 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 17:50:40.991991 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._enter() Sep 15 17:50:40.991991 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 17:50:40.991991 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 17:50:40.993106 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 17:50:40.993106 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.creator() Sep 15 17:50:40.993106 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 17:50:40.993106 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application created_value = creator( Sep 15 17:50:40.993106 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 17:50:40.993106 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 17:50:40.993106 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 17:50:40.993106 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 17:50:40.993106 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 17:50:40.993106 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 17:50:40.993106 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 15 17:50:40.993106 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Sep 15 17:50:40.993106 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 601/1180] 10.222.0.25 () {56 vars in 1096 bytes} [Thu Sep 15 17:50:40 2022] GET /identity/v3/roles/admin => generated 83 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 17:50:40.998515 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161709ce-b284-4311-a72a-32c2fec91333 None None] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:50:41.025115 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:50:41.098228 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161709ce-b284-4311-a72a-32c2fec91333 None None] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:50:41.133237 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf95b75c-c0df-40fa-8a83-aebe9733df96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:50:41.133909 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf95b75c-c0df-40fa-8a83-aebe9733df96 None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:50:41.134210 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf95b75c-c0df-40fa-8a83-aebe9733df96 None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:50:41.134515 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf95b75c-c0df-40fa-8a83-aebe9733df96 None admin] PATH_INFO: `/v3/roles` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:50:41.135234 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf95b75c-c0df-40fa-8a83-aebe9733df96 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81592) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 17:50:41.135576 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf95b75c-c0df-40fa-8a83-aebe9733df96 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:50:41.137728 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf95b75c-c0df-40fa-8a83-aebe9733df96 None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:50:41.146333 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 580/1181] 10.222.0.25 () {56 vars in 1099 bytes} [Thu Sep 15 17:50:40 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 17:50:41.152911 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b87ffc-b8fb-4cb8-8233-a2fcacff7570 None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:50:41.260803 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b87ffc-b8fb-4cb8-8233-a2fcacff7570 None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:50:41.295035 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f895e3-30b4-40a7-9370-613d100eeee7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:50:41.295661 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f895e3-30b4-40a7-9370-613d100eeee7 None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:50:41.295989 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f895e3-30b4-40a7-9370-613d100eeee7 None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:50:41.296210 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f895e3-30b4-40a7-9370-613d100eeee7 None admin] PATH_INFO: `/v3/users/3b6191884cf444f98f121b17f04691c8` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:50:41.311218 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f895e3-30b4-40a7-9370-613d100eeee7 None admin] RBAC: Authorizing `identity:get_user(user_id=3b6191884cf444f98f121b17f04691c8)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:50:41.312681 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f895e3-30b4-40a7-9370-613d100eeee7 None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:50:41.314374 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 602/1182] 10.222.0.25 () {56 vars in 1177 bytes} [Thu Sep 15 17:50:41 2022] GET /identity/v3/users/3b6191884cf444f98f121b17f04691c8 => generated 311 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 17:50:41.320255 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf95b75c-c0df-40fa-8a83-aebe9733df96 None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:50:41.412820 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:50:41.426936 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf95b75c-c0df-40fa-8a83-aebe9733df96 None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:50:41.461456 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba972a39-12be-4692-b271-3355b77094eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:50:41.462134 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba972a39-12be-4692-b271-3355b77094eb None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:50:41.462318 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba972a39-12be-4692-b271-3355b77094eb None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:50:41.462586 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba972a39-12be-4692-b271-3355b77094eb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:50:41.550895 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba972a39-12be-4692-b271-3355b77094eb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:50:41.552596 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba972a39-12be-4692-b271-3355b77094eb None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:50:41.647259 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:50:41.661142 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 581/1183] 10.222.0.25 () {58 vars in 1282 bytes} [Thu Sep 15 17:50:41 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 15 17:50:41.667221 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f895e3-30b4-40a7-9370-613d100eeee7 None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:50:41.721933 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:50:41.771384 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f895e3-30b4-40a7-9370-613d100eeee7 None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:50:41.805922 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abec2982-8da6-4f99-a88b-7a263f6d203c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:50:41.806551 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abec2982-8da6-4f99-a88b-7a263f6d203c None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:50:41.806816 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abec2982-8da6-4f99-a88b-7a263f6d203c None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:50:41.807125 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abec2982-8da6-4f99-a88b-7a263f6d203c None admin] PATH_INFO: `/v3/projects/e3cec32ce7ba4800a3afa1437f2a07d4` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:50:41.808208 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abec2982-8da6-4f99-a88b-7a263f6d203c None admin] RBAC: Authorizing `identity:get_project(project_id=e3cec32ce7ba4800a3afa1437f2a07d4)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:50:41.817413 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abec2982-8da6-4f99-a88b-7a263f6d203c None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:50:41.819210 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 603/1184] 10.222.0.25 () {56 vars in 1186 bytes} [Thu Sep 15 17:50:41 2022] GET /identity/v3/projects/e3cec32ce7ba4800a3afa1437f2a07d4 => generated 361 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 17:50:41.827074 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba972a39-12be-4692-b271-3355b77094eb None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:50:41.945444 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba972a39-12be-4692-b271-3355b77094eb None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:50:41.986124 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fff0172-357e-4562-a90d-c188e2954dad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:50:41.986777 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fff0172-357e-4562-a90d-c188e2954dad None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:50:41.987060 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fff0172-357e-4562-a90d-c188e2954dad None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:50:41.987379 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fff0172-357e-4562-a90d-c188e2954dad None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:50:41.988250 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fff0172-357e-4562-a90d-c188e2954dad None admin] RBAC: Adding query filter params (role.id=a9e42be86923434f8af52d3fc07fb4f7, scope.project.id=e3cec32ce7ba4800a3afa1437f2a07d4, user.id=3b6191884cf444f98f121b17f04691c8) {{(pid=81592) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 17:50:41.988624 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fff0172-357e-4562-a90d-c188e2954dad None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:50:41.990464 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fff0172-357e-4562-a90d-c188e2954dad None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:50:41.996619 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 582/1185] 10.222.0.25 () {56 vars in 1374 bytes} [Thu Sep 15 17:50:41 2022] GET /identity/v3/role_assignments?user.id=3b6191884cf444f98f121b17f04691c8&scope.project.id=e3cec32ce7ba4800a3afa1437f2a07d4&role.id=a9e42be86923434f8af52d3fc07fb4f7 => generated 259 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 17:50:44.312722 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b848af9b-203a-4c9e-a2c7-f6d6826fd3ac None None] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:50:44.313264 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b848af9b-203a-4c9e-a2c7-f6d6826fd3ac None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:50:44.313646 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b848af9b-203a-4c9e-a2c7-f6d6826fd3ac None None] PATH_INFO: `/` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:50:44.315330 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 604/1186] 10.222.0.25 () {54 vars in 927 bytes} [Thu Sep 15 17:50:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 17:50:44.320954 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cd6e41-9901-45a8-ad93-f36700cf7450 None None] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:50:44.321453 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cd6e41-9901-45a8-ad93-f36700cf7450 None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:50:44.321554 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cd6e41-9901-45a8-ad93-f36700cf7450 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:50:44.347221 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.auth.core [None req-02cd6e41-9901-45a8-ad93-f36700cf7450 None None] MFA Rules not processed for user `5cfa58ef86774ab7800bf91930bf6028`. Rule list: `[]` (Enabled: `True`). {{(pid=81592) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 17:50:44.348469 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-02cd6e41-9901-45a8-ad93-f36700cf7450 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 17:50:44.399804 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:50:44.422731 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 583/1187] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Sep 15 17:50:44 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 15 17:50:44.705812 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b848af9b-203a-4c9e-a2c7-f6d6826fd3ac None None] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:50:44.831675 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b848af9b-203a-4c9e-a2c7-f6d6826fd3ac None None] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:50:44.854856 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:50:44.875319 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13d6275-4ced-4292-b152-38add788481a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:50:44.876299 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13d6275-4ced-4292-b152-38add788481a None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:50:44.876735 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13d6275-4ced-4292-b152-38add788481a None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:50:44.877181 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13d6275-4ced-4292-b152-38add788481a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:50:44.893025 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d13d6275-4ced-4292-b152-38add788481a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 17:50:44.902784 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application [None req-d13d6275-4ced-4292-b152-38add788481a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 15 17:50:44.902784 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 17:50:44.902784 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 17:50:44.902784 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 17:50:44.902784 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 17:50:44.902784 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 17:50:44.902784 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 17:50:44.902784 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 17:50:44.902784 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 17:50:44.902784 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 17:50:44.902784 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 17:50:44.902784 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 17:50:44.902784 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 17:50:44.902784 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 17:50:44.902784 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 17:50:44.902784 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 17:50:44.904036 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 17:50:44.904036 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 17:50:44.904036 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 17:50:44.904036 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 17:50:44.904036 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 17:50:44.904036 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 17:50:44.904036 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 17:50:44.904036 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 17:50:44.904036 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 17:50:44.904036 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 17:50:44.904036 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 17:50:44.904036 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application with Lock( Sep 15 17:50:44.904036 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 17:50:44.904036 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._enter() Sep 15 17:50:44.904036 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 17:50:44.904036 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 17:50:44.905181 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 17:50:44.905181 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.creator() Sep 15 17:50:44.905181 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 17:50:44.905181 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application created_value = creator( Sep 15 17:50:44.905181 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 17:50:44.905181 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 17:50:44.905181 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 17:50:44.905181 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 17:50:44.905181 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 17:50:44.905181 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 17:50:44.905181 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 15 17:50:44.905181 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Sep 15 17:50:44.905181 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 605/1188] 10.222.0.25 () {56 vars in 1096 bytes} [Thu Sep 15 17:50:44 2022] GET /identity/v3/roles/admin => generated 83 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 17:50:44.910965 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02cd6e41-9901-45a8-ad93-f36700cf7450 None None] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:50:45.022220 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02cd6e41-9901-45a8-ad93-f36700cf7450 None None] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:50:45.057161 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1d23f1-15b6-4c71-a062-057bba073d40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:50:45.057796 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1d23f1-15b6-4c71-a062-057bba073d40 None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:50:45.058069 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1d23f1-15b6-4c71-a062-057bba073d40 None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:50:45.058386 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1d23f1-15b6-4c71-a062-057bba073d40 None admin] PATH_INFO: `/v3/roles` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:50:45.059079 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc1d23f1-15b6-4c71-a062-057bba073d40 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81592) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 17:50:45.059418 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc1d23f1-15b6-4c71-a062-057bba073d40 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:50:45.060898 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc1d23f1-15b6-4c71-a062-057bba073d40 None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:50:45.069857 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 584/1189] 10.222.0.25 () {56 vars in 1099 bytes} [Thu Sep 15 17:50:44 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 17:50:45.076435 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13d6275-4ced-4292-b152-38add788481a None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:50:45.186203 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13d6275-4ced-4292-b152-38add788481a None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:50:45.228224 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91642308-4ddb-474f-925d-0427495493a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:50:45.229455 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91642308-4ddb-474f-925d-0427495493a2 None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:50:45.229908 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91642308-4ddb-474f-925d-0427495493a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:50:45.230372 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91642308-4ddb-474f-925d-0427495493a2 None admin] PATH_INFO: `/v3/users/3b6191884cf444f98f121b17f04691c8` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:50:45.232159 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91642308-4ddb-474f-925d-0427495493a2 None admin] RBAC: Authorizing `identity:get_user(user_id=3b6191884cf444f98f121b17f04691c8)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:50:45.234597 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91642308-4ddb-474f-925d-0427495493a2 None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:50:45.237445 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 606/1190] 10.222.0.25 () {56 vars in 1177 bytes} [Thu Sep 15 17:50:45 2022] GET /identity/v3/users/3b6191884cf444f98f121b17f04691c8 => generated 311 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 17:50:45.243284 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1d23f1-15b6-4c71-a062-057bba073d40 None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:50:45.295040 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:50:45.350185 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1d23f1-15b6-4c71-a062-057bba073d40 None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:50:45.392407 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c44e80-9bf0-448c-b57b-f0d9b5aa4385 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:50:45.393034 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c44e80-9bf0-448c-b57b-f0d9b5aa4385 None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:50:45.393347 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c44e80-9bf0-448c-b57b-f0d9b5aa4385 None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:50:45.393626 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c44e80-9bf0-448c-b57b-f0d9b5aa4385 None admin] PATH_INFO: `/v3/projects/e3cec32ce7ba4800a3afa1437f2a07d4` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:50:45.394730 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c44e80-9bf0-448c-b57b-f0d9b5aa4385 None admin] RBAC: Authorizing `identity:get_project(project_id=e3cec32ce7ba4800a3afa1437f2a07d4)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:50:45.396160 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c44e80-9bf0-448c-b57b-f0d9b5aa4385 None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:50:45.397833 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 585/1191] 10.222.0.25 () {56 vars in 1186 bytes} [Thu Sep 15 17:50:45 2022] GET /identity/v3/projects/e3cec32ce7ba4800a3afa1437f2a07d4 => generated 361 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 17:50:45.404714 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91642308-4ddb-474f-925d-0427495493a2 None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:50:45.463324 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:50:45.518166 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91642308-4ddb-474f-925d-0427495493a2 None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:50:45.555681 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c29386-01a3-467d-b57c-831e0518b54b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:50:45.556338 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c29386-01a3-467d-b57c-831e0518b54b None admin] REQUEST_METHOD: `PUT` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:50:45.556653 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c29386-01a3-467d-b57c-831e0518b54b None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:50:45.556968 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c29386-01a3-467d-b57c-831e0518b54b None admin] PATH_INFO: `/v3/projects/e3cec32ce7ba4800a3afa1437f2a07d4/users/3b6191884cf444f98f121b17f04691c8/roles/a9e42be86923434f8af52d3fc07fb4f7` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:50:45.559597 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c29386-01a3-467d-b57c-831e0518b54b None admin] RBAC: Authorizing `identity:create_grant(project_id=e3cec32ce7ba4800a3afa1437f2a07d4, user_id=3b6191884cf444f98f121b17f04691c8, role_id=a9e42be86923434f8af52d3fc07fb4f7)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:50:45.561258 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c29386-01a3-467d-b57c-831e0518b54b None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:50:45.573992 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 607/1192] 10.222.0.25 () {58 vars in 1439 bytes} [Thu Sep 15 17:50:45 2022] PUT /identity/v3/projects/e3cec32ce7ba4800a3afa1437f2a07d4/users/3b6191884cf444f98f121b17f04691c8/roles/a9e42be86923434f8af52d3fc07fb4f7 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 17:50:47.791780 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc408b31-3926-4435-acc2-ea92794081a4 None None] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:50:47.792328 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc408b31-3926-4435-acc2-ea92794081a4 None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:50:47.792328 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc408b31-3926-4435-acc2-ea92794081a4 None None] PATH_INFO: `/` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:50:47.794257 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 586/1193] 10.222.0.25 () {54 vars in 927 bytes} [Thu Sep 15 17:50:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 17:50:47.800488 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59e4c04-7d89-44c9-8b82-0c5585564ffe None None] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:50:47.801003 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59e4c04-7d89-44c9-8b82-0c5585564ffe None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:50:47.801242 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59e4c04-7d89-44c9-8b82-0c5585564ffe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:50:47.822263 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.auth.core [None req-e59e4c04-7d89-44c9-8b82-0c5585564ffe None None] MFA Rules not processed for user `5cfa58ef86774ab7800bf91930bf6028`. Rule list: `[]` (Enabled: `True`). {{(pid=81593) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 17:50:47.823355 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-e59e4c04-7d89-44c9-8b82-0c5585564ffe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 17:50:47.902693 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 608/1194] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Sep 15 17:50:47 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 15 17:50:48.186420 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc408b31-3926-4435-acc2-ea92794081a4 None None] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:50:48.297768 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc408b31-3926-4435-acc2-ea92794081a4 None None] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:50:48.311606 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:50:48.344475 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22660eff-f44e-4134-978f-d7668051ebfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:50:48.345208 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22660eff-f44e-4134-978f-d7668051ebfd None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:50:48.345512 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22660eff-f44e-4134-978f-d7668051ebfd None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:50:48.345783 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22660eff-f44e-4134-978f-d7668051ebfd None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:50:48.357140 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22660eff-f44e-4134-978f-d7668051ebfd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 17:50:48.361976 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application [None req-22660eff-f44e-4134-978f-d7668051ebfd None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 15 17:50:48.361976 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 17:50:48.361976 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 17:50:48.361976 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 17:50:48.361976 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 17:50:48.361976 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 17:50:48.361976 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 17:50:48.361976 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 17:50:48.361976 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 17:50:48.361976 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 17:50:48.361976 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 17:50:48.361976 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 17:50:48.361976 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 17:50:48.361976 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 17:50:48.361976 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 17:50:48.361976 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 17:50:48.363802 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 17:50:48.363802 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 17:50:48.363802 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 17:50:48.363802 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 17:50:48.363802 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 17:50:48.363802 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 17:50:48.363802 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 17:50:48.363802 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 17:50:48.363802 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 17:50:48.363802 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 17:50:48.363802 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 17:50:48.363802 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application with Lock( Sep 15 17:50:48.363802 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 17:50:48.363802 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._enter() Sep 15 17:50:48.363802 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 17:50:48.363802 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 17:50:48.365272 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 17:50:48.365272 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.creator() Sep 15 17:50:48.365272 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 17:50:48.365272 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application created_value = creator( Sep 15 17:50:48.365272 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 17:50:48.365272 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 17:50:48.365272 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 17:50:48.365272 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 17:50:48.365272 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 17:50:48.365272 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 17:50:48.365272 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 15 17:50:48.365272 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Sep 15 17:50:48.365272 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 587/1195] 10.222.0.25 () {56 vars in 1096 bytes} [Thu Sep 15 17:50:48 2022] GET /identity/v3/roles/admin => generated 83 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 17:50:48.371599 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59e4c04-7d89-44c9-8b82-0c5585564ffe None None] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:50:48.412231 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:50:48.488692 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59e4c04-7d89-44c9-8b82-0c5585564ffe None None] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:50:48.525764 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7770791e-cd0f-4e21-b0e5-c242a6168847 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:50:48.526365 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7770791e-cd0f-4e21-b0e5-c242a6168847 None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:50:48.526638 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7770791e-cd0f-4e21-b0e5-c242a6168847 None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:50:48.526927 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7770791e-cd0f-4e21-b0e5-c242a6168847 None admin] PATH_INFO: `/v3/roles` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:50:48.528156 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7770791e-cd0f-4e21-b0e5-c242a6168847 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81593) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 17:50:48.528570 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7770791e-cd0f-4e21-b0e5-c242a6168847 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:50:48.529853 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7770791e-cd0f-4e21-b0e5-c242a6168847 None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:50:48.537997 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 609/1196] 10.222.0.25 () {56 vars in 1099 bytes} [Thu Sep 15 17:50:48 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 17:50:48.544538 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22660eff-f44e-4134-978f-d7668051ebfd None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:50:48.659634 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22660eff-f44e-4134-978f-d7668051ebfd None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:50:48.697388 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7fe51c-b778-4741-a5a9-e4a20bba55cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:50:48.698148 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7fe51c-b778-4741-a5a9-e4a20bba55cd None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:50:48.698514 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7fe51c-b778-4741-a5a9-e4a20bba55cd None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:50:48.699492 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7fe51c-b778-4741-a5a9-e4a20bba55cd None admin] PATH_INFO: `/v3/users/3b6191884cf444f98f121b17f04691c8` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:50:48.700767 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc7fe51c-b778-4741-a5a9-e4a20bba55cd None admin] RBAC: Authorizing `identity:get_user(user_id=3b6191884cf444f98f121b17f04691c8)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:50:48.702334 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc7fe51c-b778-4741-a5a9-e4a20bba55cd None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:50:48.704040 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 588/1197] 10.222.0.25 () {56 vars in 1177 bytes} [Thu Sep 15 17:50:48 2022] GET /identity/v3/users/3b6191884cf444f98f121b17f04691c8 => generated 311 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 17:50:48.710252 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7770791e-cd0f-4e21-b0e5-c242a6168847 None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:50:48.814805 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:50:48.817909 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7770791e-cd0f-4e21-b0e5-c242a6168847 None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:50:48.853162 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e691e80c-7d6a-4c40-bf96-e2194b0eb137 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:50:48.854050 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e691e80c-7d6a-4c40-bf96-e2194b0eb137 None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:50:48.854325 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e691e80c-7d6a-4c40-bf96-e2194b0eb137 None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:50:48.854594 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e691e80c-7d6a-4c40-bf96-e2194b0eb137 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:50:48.929596 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e691e80c-7d6a-4c40-bf96-e2194b0eb137 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:50:48.931080 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e691e80c-7d6a-4c40-bf96-e2194b0eb137 None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:50:49.043278 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:50:49.047654 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 610/1198] 10.222.0.25 () {58 vars in 1282 bytes} [Thu Sep 15 17:50:48 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 15 17:50:49.053522 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7fe51c-b778-4741-a5a9-e4a20bba55cd None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:50:49.098906 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:50:49.160338 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7fe51c-b778-4741-a5a9-e4a20bba55cd None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:50:49.195917 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627353a2-0de4-4804-ba6c-a7082807a9d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:50:49.196633 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627353a2-0de4-4804-ba6c-a7082807a9d1 None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:50:49.196918 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627353a2-0de4-4804-ba6c-a7082807a9d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:50:49.197196 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627353a2-0de4-4804-ba6c-a7082807a9d1 None admin] PATH_INFO: `/v3/projects/e3cec32ce7ba4800a3afa1437f2a07d4` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:50:49.198354 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-627353a2-0de4-4804-ba6c-a7082807a9d1 None admin] RBAC: Authorizing `identity:get_project(project_id=e3cec32ce7ba4800a3afa1437f2a07d4)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:50:49.200315 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-627353a2-0de4-4804-ba6c-a7082807a9d1 None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:50:49.202004 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 589/1199] 10.222.0.25 () {56 vars in 1186 bytes} [Thu Sep 15 17:50:49 2022] GET /identity/v3/projects/e3cec32ce7ba4800a3afa1437f2a07d4 => generated 361 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 17:50:49.208160 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e691e80c-7d6a-4c40-bf96-e2194b0eb137 None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:50:49.325445 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e691e80c-7d6a-4c40-bf96-e2194b0eb137 None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:50:49.365900 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da737354-9cc0-4c72-b10a-b48154d906e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:50:49.366337 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da737354-9cc0-4c72-b10a-b48154d906e5 None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:50:49.366619 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da737354-9cc0-4c72-b10a-b48154d906e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:50:49.366885 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da737354-9cc0-4c72-b10a-b48154d906e5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:50:49.367639 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da737354-9cc0-4c72-b10a-b48154d906e5 None admin] RBAC: Adding query filter params (role.id=a9e42be86923434f8af52d3fc07fb4f7, scope.project.id=e3cec32ce7ba4800a3afa1437f2a07d4, user.id=3b6191884cf444f98f121b17f04691c8) {{(pid=81593) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 17:50:49.367951 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da737354-9cc0-4c72-b10a-b48154d906e5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:50:49.369413 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da737354-9cc0-4c72-b10a-b48154d906e5 None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:50:49.376318 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 611/1200] 10.222.0.25 () {56 vars in 1374 bytes} [Thu Sep 15 17:50:49 2022] GET /identity/v3/role_assignments?user.id=3b6191884cf444f98f121b17f04691c8&scope.project.id=e3cec32ce7ba4800a3afa1437f2a07d4&role.id=a9e42be86923434f8af52d3fc07fb4f7 => generated 608 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 17:50:59.191702 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=46 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:50:59.373964 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=68 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:51:46.086482 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d396d28-9a85-4d4a-8eaa-a1fb944a5e9d None None] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:51:46.087165 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d396d28-9a85-4d4a-8eaa-a1fb944a5e9d None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:51:46.087398 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d396d28-9a85-4d4a-8eaa-a1fb944a5e9d None None] PATH_INFO: `/` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:51:46.089908 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 590/1201] 10.222.0.25 () {54 vars in 927 bytes} [Thu Sep 15 17:51:46 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 17:51:46.096749 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c58b79-5ccc-4d75-a0cf-2b387d838997 None None] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:51:46.097382 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c58b79-5ccc-4d75-a0cf-2b387d838997 None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:51:46.097485 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c58b79-5ccc-4d75-a0cf-2b387d838997 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:51:46.121375 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.auth.core [None req-97c58b79-5ccc-4d75-a0cf-2b387d838997 None None] MFA Rules not processed for user `5cfa58ef86774ab7800bf91930bf6028`. Rule list: `[]` (Enabled: `True`). {{(pid=81593) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 17:51:46.121608 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-97c58b79-5ccc-4d75-a0cf-2b387d838997 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 17:51:46.208531 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 612/1202] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Sep 15 17:51:46 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 15 17:51:46.560554 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d396d28-9a85-4d4a-8eaa-a1fb944a5e9d None None] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:51:46.719006 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d396d28-9a85-4d4a-8eaa-a1fb944a5e9d None None] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:51:46.780282 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d0d3b5-5d3c-42a0-9c66-fb7b6d57ce15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:51:46.781073 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d0d3b5-5d3c-42a0-9c66-fb7b6d57ce15 None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:51:46.781530 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d0d3b5-5d3c-42a0-9c66-fb7b6d57ce15 None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:51:46.781850 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d0d3b5-5d3c-42a0-9c66-fb7b6d57ce15 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:51:46.795411 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d0d3b5-5d3c-42a0-9c66-fb7b6d57ce15 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:51:46.796975 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d0d3b5-5d3c-42a0-9c66-fb7b6d57ce15 None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:51:46.814675 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application [None req-16d0d3b5-5d3c-42a0-9c66-fb7b6d57ce15 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 17:51:46.814675 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 17:51:46.814675 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 17:51:46.814675 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 17:51:46.814675 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 17:51:46.814675 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 17:51:46.814675 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 17:51:46.814675 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 17:51:46.814675 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 17:51:46.814675 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 17:51:46.814675 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 17:51:46.814675 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 17:51:46.814675 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 15 17:51:46.814675 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 15 17:51:46.814675 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 15 17:51:46.814675 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 15 17:51:46.816030 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 17:51:46.816030 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 17:51:46.816030 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 17:51:46.816030 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 17:51:46.816030 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 17:51:46.816030 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 17:51:46.816030 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 17:51:46.816030 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application with Lock( Sep 15 17:51:46.816030 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 17:51:46.816030 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._enter() Sep 15 17:51:46.816030 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 17:51:46.816030 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 17:51:46.816030 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 17:51:46.816030 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.creator() Sep 15 17:51:46.816030 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 17:51:46.816030 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application created_value = creator( Sep 15 17:51:46.816030 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 15 17:51:46.817151 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 15 17:51:46.817151 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 17:51:46.817151 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Sep 15 17:51:46.817151 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 591/1203] 10.222.0.25 () {56 vars in 1108 bytes} [Thu Sep 15 17:51:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 17:51:46.822428 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c58b79-5ccc-4d75-a0cf-2b387d838997 None None] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:51:46.963631 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c58b79-5ccc-4d75-a0cf-2b387d838997 None None] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:51:47.002999 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:51:47.011186 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b11c8b8-5899-497f-afe0-dad27d14bd6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:51:47.011787 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b11c8b8-5899-497f-afe0-dad27d14bd6f None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:51:47.012065 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b11c8b8-5899-497f-afe0-dad27d14bd6f None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:51:47.012336 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b11c8b8-5899-497f-afe0-dad27d14bd6f None admin] PATH_INFO: `/v3/domains` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:51:47.012983 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b11c8b8-5899-497f-afe0-dad27d14bd6f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81593) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 17:51:47.013335 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b11c8b8-5899-497f-afe0-dad27d14bd6f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:51:47.014960 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b11c8b8-5899-497f-afe0-dad27d14bd6f None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:51:47.031337 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 613/1204] 10.222.0.25 () {56 vars in 1109 bytes} [Thu Sep 15 17:51:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 17:51:47.039417 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d0d3b5-5d3c-42a0-9c66-fb7b6d57ce15 None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:51:47.108817 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:51:47.168001 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d0d3b5-5d3c-42a0-9c66-fb7b6d57ce15 None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:51:47.208103 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a40172-d7d4-4487-a891-6b9df0be17f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:51:47.208934 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a40172-d7d4-4487-a891-6b9df0be17f3 None admin] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:51:47.209290 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a40172-d7d4-4487-a891-6b9df0be17f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:51:47.209584 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a40172-d7d4-4487-a891-6b9df0be17f3 None admin] PATH_INFO: `/v3/users` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:51:47.210321 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a40172-d7d4-4487-a891-6b9df0be17f3 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:51:47.212784 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a40172-d7d4-4487-a891-6b9df0be17f3 None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:51:47.240497 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 592/1205] 10.222.0.25 () {60 vars in 1132 bytes} [Thu Sep 15 17:51:47 2022] POST /identity/v3/users => generated 251 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 17:51:49.688276 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468e0b7a-412d-4227-9d6c-f2383b43ea18 None None] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:51:49.688859 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468e0b7a-412d-4227-9d6c-f2383b43ea18 None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:51:49.688859 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468e0b7a-412d-4227-9d6c-f2383b43ea18 None None] PATH_INFO: `/` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:51:49.692911 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 614/1206] 10.222.0.25 () {54 vars in 927 bytes} [Thu Sep 15 17:51:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 15 17:51:49.698687 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe67856-f43e-4eac-b2b8-7103dcd5261f None None] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:51:49.699968 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe67856-f43e-4eac-b2b8-7103dcd5261f None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:51:49.699968 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe67856-f43e-4eac-b2b8-7103dcd5261f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:51:49.718954 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.auth.core [None req-6fe67856-f43e-4eac-b2b8-7103dcd5261f None None] MFA Rules not processed for user `5cfa58ef86774ab7800bf91930bf6028`. Rule list: `[]` (Enabled: `True`). {{(pid=81592) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 17:51:49.720501 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-6fe67856-f43e-4eac-b2b8-7103dcd5261f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 17:51:49.802234 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 593/1207] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Sep 15 17:51:49 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 15 17:51:50.095996 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468e0b7a-412d-4227-9d6c-f2383b43ea18 None None] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:51:50.223516 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468e0b7a-412d-4227-9d6c-f2383b43ea18 None None] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:51:50.265598 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ccb087-7b63-4615-b890-36ba967dc262 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:51:50.268616 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ccb087-7b63-4615-b890-36ba967dc262 None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:51:50.268904 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ccb087-7b63-4615-b890-36ba967dc262 None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:51:50.269183 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ccb087-7b63-4615-b890-36ba967dc262 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:51:50.284198 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ccb087-7b63-4615-b890-36ba967dc262 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 17:51:50.291024 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application [None req-b7ccb087-7b63-4615-b890-36ba967dc262 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 15 17:51:50.291024 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 17:51:50.291024 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 17:51:50.291024 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 17:51:50.291024 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 17:51:50.291024 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 17:51:50.291024 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 17:51:50.291024 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 17:51:50.291024 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 17:51:50.291024 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 17:51:50.291024 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 17:51:50.291024 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 17:51:50.291024 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 17:51:50.291024 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 17:51:50.291024 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 17:51:50.291024 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 17:51:50.292553 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 17:51:50.292553 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 17:51:50.292553 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 17:51:50.292553 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 17:51:50.292553 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 17:51:50.292553 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 17:51:50.292553 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 17:51:50.292553 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 17:51:50.292553 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 17:51:50.292553 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 17:51:50.292553 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 17:51:50.292553 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application with Lock( Sep 15 17:51:50.292553 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 17:51:50.292553 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._enter() Sep 15 17:51:50.292553 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 17:51:50.292553 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 17:51:50.293684 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 17:51:50.293684 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.creator() Sep 15 17:51:50.293684 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 17:51:50.293684 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application created_value = creator( Sep 15 17:51:50.293684 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 17:51:50.293684 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 17:51:50.293684 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 17:51:50.293684 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 17:51:50.293684 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 17:51:50.293684 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 17:51:50.293684 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 15 17:51:50.293684 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Sep 15 17:51:50.293684 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 615/1208] 10.222.0.25 () {56 vars in 1102 bytes} [Thu Sep 15 17:51:50 2022] GET /identity/v3/roles/service => generated 85 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 17:51:50.299497 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe67856-f43e-4eac-b2b8-7103dcd5261f None None] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:51:50.355053 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:51:50.443794 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe67856-f43e-4eac-b2b8-7103dcd5261f None None] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:51:50.497348 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2cf9ffa-470d-431a-99f9-9daef9204426 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:51:50.498723 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cf9ffa-470d-431a-99f9-9daef9204426 None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:51:50.498723 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cf9ffa-470d-431a-99f9-9daef9204426 None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:51:50.498908 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cf9ffa-470d-431a-99f9-9daef9204426 None admin] PATH_INFO: `/v3/roles` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:51:50.499695 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2cf9ffa-470d-431a-99f9-9daef9204426 None admin] RBAC: Adding query filter params (name=service) {{(pid=81592) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 17:51:50.500120 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2cf9ffa-470d-431a-99f9-9daef9204426 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:51:50.501948 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2cf9ffa-470d-431a-99f9-9daef9204426 None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:51:50.514000 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 594/1209] 10.222.0.25 () {56 vars in 1103 bytes} [Thu Sep 15 17:51:50 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 17:51:50.520670 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ccb087-7b63-4615-b890-36ba967dc262 None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:51:50.591173 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:51:50.671151 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ccb087-7b63-4615-b890-36ba967dc262 None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:51:50.715421 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e6b72b-4f16-4d90-afaf-12efd7fdd772 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:51:50.716209 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e6b72b-4f16-4d90-afaf-12efd7fdd772 None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:51:50.716953 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e6b72b-4f16-4d90-afaf-12efd7fdd772 None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:51:50.717384 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e6b72b-4f16-4d90-afaf-12efd7fdd772 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:51:50.733850 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e6b72b-4f16-4d90-afaf-12efd7fdd772 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:51:50.735459 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e6b72b-4f16-4d90-afaf-12efd7fdd772 None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:51:50.753166 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application [None req-e9e6b72b-4f16-4d90-afaf-12efd7fdd772 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 17:51:50.753166 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 17:51:50.753166 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 17:51:50.753166 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 17:51:50.753166 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 17:51:50.753166 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 17:51:50.753166 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 17:51:50.753166 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 17:51:50.753166 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 17:51:50.753166 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 17:51:50.753166 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 17:51:50.753166 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 17:51:50.753166 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 15 17:51:50.753166 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 15 17:51:50.753166 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 15 17:51:50.753166 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 15 17:51:50.761250 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 17:51:50.761250 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 17:51:50.761250 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 17:51:50.761250 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 17:51:50.761250 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 17:51:50.761250 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 17:51:50.761250 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 17:51:50.761250 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application with Lock( Sep 15 17:51:50.761250 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 17:51:50.761250 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._enter() Sep 15 17:51:50.761250 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 17:51:50.761250 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 17:51:50.761250 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 17:51:50.761250 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.creator() Sep 15 17:51:50.761250 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 17:51:50.761250 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application created_value = creator( Sep 15 17:51:50.761250 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 15 17:51:50.762457 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 15 17:51:50.762457 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 17:51:50.762457 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Sep 15 17:51:50.762457 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 616/1210] 10.222.0.25 () {56 vars in 1108 bytes} [Thu Sep 15 17:51:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 17:51:50.764812 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2cf9ffa-470d-431a-99f9-9daef9204426 None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:51:50.888436 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:51:50.896448 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2cf9ffa-470d-431a-99f9-9daef9204426 None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:51:50.942365 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e003bd-8f79-4a36-8f50-552dd75cb9ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:51:50.942982 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e003bd-8f79-4a36-8f50-552dd75cb9ae None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:51:50.943258 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e003bd-8f79-4a36-8f50-552dd75cb9ae None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:51:50.945555 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e003bd-8f79-4a36-8f50-552dd75cb9ae None admin] PATH_INFO: `/v3/domains` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:51:50.946277 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e003bd-8f79-4a36-8f50-552dd75cb9ae None admin] RBAC: Adding query filter params (name=Default) {{(pid=81592) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 17:51:50.946588 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e003bd-8f79-4a36-8f50-552dd75cb9ae None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:51:50.947954 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e003bd-8f79-4a36-8f50-552dd75cb9ae None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:51:50.963646 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 595/1211] 10.222.0.25 () {56 vars in 1109 bytes} [Thu Sep 15 17:51:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 17:51:50.970780 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e6b72b-4f16-4d90-afaf-12efd7fdd772 None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:51:51.088451 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e6b72b-4f16-4d90-afaf-12efd7fdd772 None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:51:51.090775 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:51:51.131539 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1404808d-ccd2-4b61-8df7-bce50758360d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:51:51.132940 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1404808d-ccd2-4b61-8df7-bce50758360d None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:51:51.133215 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1404808d-ccd2-4b61-8df7-bce50758360d None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:51:51.133548 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1404808d-ccd2-4b61-8df7-bce50758360d None admin] PATH_INFO: `/v3/users/placement` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:51:51.145131 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1404808d-ccd2-4b61-8df7-bce50758360d None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:51:51.146139 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1404808d-ccd2-4b61-8df7-bce50758360d None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:51:51.160151 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application [None req-1404808d-ccd2-4b61-8df7-bce50758360d None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 15 17:51:51.160151 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 17:51:51.160151 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 17:51:51.160151 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 17:51:51.160151 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 17:51:51.160151 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 17:51:51.160151 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 17:51:51.160151 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 17:51:51.160151 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 17:51:51.160151 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 17:51:51.160151 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 17:51:51.160151 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 17:51:51.160151 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 15 17:51:51.160151 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 15 17:51:51.160151 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 15 17:51:51.160151 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 15 17:51:51.161187 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 17:51:51.161187 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 17:51:51.161187 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 15 17:51:51.161187 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 15 17:51:51.161187 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 15 17:51:51.161187 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 15 17:51:51.161187 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 17:51:51.161187 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 17:51:51.161187 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 17:51:51.161187 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 17:51:51.161187 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 17:51:51.161187 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application with Lock( Sep 15 17:51:51.161187 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 17:51:51.161187 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._enter() Sep 15 17:51:51.161187 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 17:51:51.161187 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 17:51:51.161187 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 17:51:51.161187 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.creator() Sep 15 17:51:51.162175 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 17:51:51.162175 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application created_value = creator( Sep 15 17:51:51.162175 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 15 17:51:51.162175 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 15 17:51:51.162175 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 15 17:51:51.162175 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 15 17:51:51.162175 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 15 17:51:51.162175 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 15 17:51:51.162175 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 15 17:51:51.162175 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Sep 15 17:51:51.162175 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 617/1212] 10.222.0.25 () {56 vars in 1108 bytes} [Thu Sep 15 17:51:50 2022] GET /identity/v3/users/placement => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 15 17:51:51.170307 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e003bd-8f79-4a36-8f50-552dd75cb9ae None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:51:51.311841 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e003bd-8f79-4a36-8f50-552dd75cb9ae None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:51:51.349533 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54bebf2b-6820-4ac6-a24f-8e894f171e1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:51:51.350144 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bebf2b-6820-4ac6-a24f-8e894f171e1c None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:51:51.350419 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bebf2b-6820-4ac6-a24f-8e894f171e1c None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:51:51.350688 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bebf2b-6820-4ac6-a24f-8e894f171e1c None admin] PATH_INFO: `/v3/users` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:51:51.352204 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54bebf2b-6820-4ac6-a24f-8e894f171e1c None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81592) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 17:51:51.352499 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54bebf2b-6820-4ac6-a24f-8e894f171e1c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:51:51.354046 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54bebf2b-6820-4ac6-a24f-8e894f171e1c None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:51:51.377714 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 596/1213] 10.222.0.25 () {56 vars in 1143 bytes} [Thu Sep 15 17:51:51 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 17:51:51.379687 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1404808d-ccd2-4b61-8df7-bce50758360d None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:51:51.496288 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1404808d-ccd2-4b61-8df7-bce50758360d None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:51:51.532604 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c080e8-35b0-4b99-90d5-28970cc600c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:51:51.533415 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c080e8-35b0-4b99-90d5-28970cc600c0 None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:51:51.533743 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c080e8-35b0-4b99-90d5-28970cc600c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:51:51.534018 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c080e8-35b0-4b99-90d5-28970cc600c0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:51:51.572212 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:51:51.624032 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c080e8-35b0-4b99-90d5-28970cc600c0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:51:51.625630 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c080e8-35b0-4b99-90d5-28970cc600c0 None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:51:51.738695 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 618/1214] 10.222.0.25 () {58 vars in 1282 bytes} [Thu Sep 15 17:51:51 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 15 17:51:51.744719 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54bebf2b-6820-4ac6-a24f-8e894f171e1c None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:51:51.766555 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:51:51.870824 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54bebf2b-6820-4ac6-a24f-8e894f171e1c None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:51:51.919639 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b71a260-f551-4e8d-825c-379388c43484 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:51:51.920625 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b71a260-f551-4e8d-825c-379388c43484 None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:51:51.921100 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b71a260-f551-4e8d-825c-379388c43484 None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:51:51.921664 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b71a260-f551-4e8d-825c-379388c43484 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:51:51.935891 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b71a260-f551-4e8d-825c-379388c43484 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:51:51.937734 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b71a260-f551-4e8d-825c-379388c43484 None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:51:51.954685 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application [None req-4b71a260-f551-4e8d-825c-379388c43484 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 17:51:51.954685 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 17:51:51.954685 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 17:51:51.954685 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 17:51:51.954685 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 17:51:51.954685 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 17:51:51.954685 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 17:51:51.954685 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 17:51:51.954685 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 17:51:51.954685 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 17:51:51.954685 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 17:51:51.954685 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 17:51:51.954685 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 15 17:51:51.954685 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 15 17:51:51.954685 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 15 17:51:51.954685 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 15 17:51:51.955679 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 17:51:51.955679 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 17:51:51.955679 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 17:51:51.955679 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 17:51:51.955679 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 17:51:51.955679 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 17:51:51.955679 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 17:51:51.955679 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application with Lock( Sep 15 17:51:51.955679 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 17:51:51.955679 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._enter() Sep 15 17:51:51.955679 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 17:51:51.955679 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 17:51:51.955679 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 17:51:51.955679 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.creator() Sep 15 17:51:51.955679 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 17:51:51.955679 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application created_value = creator( Sep 15 17:51:51.955679 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 15 17:51:51.956786 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 15 17:51:51.956786 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 17:51:51.956786 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Sep 15 17:51:51.959080 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 597/1215] 10.222.0.25 () {56 vars in 1108 bytes} [Thu Sep 15 17:51:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 17:51:51.965365 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c080e8-35b0-4b99-90d5-28970cc600c0 None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:51:52.043704 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:51:52.101179 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c080e8-35b0-4b99-90d5-28970cc600c0 None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:51:52.146380 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc145e0-d2d3-4dbb-ab62-4ca128598bf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:51:52.146954 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc145e0-d2d3-4dbb-ab62-4ca128598bf9 None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:51:52.147220 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc145e0-d2d3-4dbb-ab62-4ca128598bf9 None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:51:52.148418 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc145e0-d2d3-4dbb-ab62-4ca128598bf9 None admin] PATH_INFO: `/v3/domains` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:51:52.149111 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc145e0-d2d3-4dbb-ab62-4ca128598bf9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81593) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 17:51:52.149503 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc145e0-d2d3-4dbb-ab62-4ca128598bf9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:51:52.151168 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc145e0-d2d3-4dbb-ab62-4ca128598bf9 None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:51:52.166551 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 619/1216] 10.222.0.25 () {56 vars in 1109 bytes} [Thu Sep 15 17:51:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 17:51:52.173026 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b71a260-f551-4e8d-825c-379388c43484 None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:51:52.270978 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:51:52.310472 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b71a260-f551-4e8d-825c-379388c43484 None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:51:52.360201 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082ea076-4c7f-4d6f-9f2f-0466e3f121a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:51:52.361473 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082ea076-4c7f-4d6f-9f2f-0466e3f121a2 None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:51:52.361963 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082ea076-4c7f-4d6f-9f2f-0466e3f121a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:51:52.362459 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082ea076-4c7f-4d6f-9f2f-0466e3f121a2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:51:52.377289 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-082ea076-4c7f-4d6f-9f2f-0466e3f121a2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:51:52.380702 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-082ea076-4c7f-4d6f-9f2f-0466e3f121a2 None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:51:52.405665 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application [None req-082ea076-4c7f-4d6f-9f2f-0466e3f121a2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 15 17:51:52.405665 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 17:51:52.405665 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 17:51:52.405665 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 17:51:52.405665 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 17:51:52.405665 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 17:51:52.405665 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 17:51:52.405665 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 17:51:52.405665 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 17:51:52.405665 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 17:51:52.405665 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 17:51:52.405665 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 17:51:52.405665 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 15 17:51:52.405665 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 15 17:51:52.405665 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 15 17:51:52.406700 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 15 17:51:52.406700 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 17:51:52.406700 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 17:51:52.406700 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 17:51:52.406700 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 17:51:52.406700 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 17:51:52.406700 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 17:51:52.406700 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 17:51:52.406700 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application with Lock( Sep 15 17:51:52.406700 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 17:51:52.406700 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._enter() Sep 15 17:51:52.406700 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 17:51:52.406700 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 17:51:52.406700 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 17:51:52.406700 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.creator() Sep 15 17:51:52.406700 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 17:51:52.406700 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application created_value = creator( Sep 15 17:51:52.407599 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 15 17:51:52.407599 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 15 17:51:52.407599 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 15 17:51:52.407599 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 15 17:51:52.407599 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 15 17:51:52.407599 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 15 17:51:52.407599 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 15 17:51:52.407599 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Sep 15 17:51:52.407599 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 598/1217] 10.222.0.25 () {56 vars in 1111 bytes} [Thu Sep 15 17:51:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 15 17:51:52.418583 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc145e0-d2d3-4dbb-ab62-4ca128598bf9 None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:51:52.556060 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc145e0-d2d3-4dbb-ab62-4ca128598bf9 None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:51:52.584647 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:51:52.598497 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b591e1cd-dd46-402c-bcbe-d49f991dac3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:51:52.599084 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b591e1cd-dd46-402c-bcbe-d49f991dac3c None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:51:52.599461 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b591e1cd-dd46-402c-bcbe-d49f991dac3c None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:51:52.599720 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b591e1cd-dd46-402c-bcbe-d49f991dac3c None admin] PATH_INFO: `/v3/projects` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:51:52.600404 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b591e1cd-dd46-402c-bcbe-d49f991dac3c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81593) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 17:51:52.600735 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b591e1cd-dd46-402c-bcbe-d49f991dac3c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:51:52.602663 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b591e1cd-dd46-402c-bcbe-d49f991dac3c None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:51:52.618592 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 620/1218] 10.222.0.25 () {56 vars in 1148 bytes} [Thu Sep 15 17:51:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 17:51:52.624768 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082ea076-4c7f-4d6f-9f2f-0466e3f121a2 None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:51:52.747590 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082ea076-4c7f-4d6f-9f2f-0466e3f121a2 None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:51:52.779786 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:51:52.786266 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fa3fcd-db21-4171-aa7a-f4b801f50d93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:51:52.786865 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fa3fcd-db21-4171-aa7a-f4b801f50d93 None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:51:52.787139 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fa3fcd-db21-4171-aa7a-f4b801f50d93 None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:51:52.787406 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fa3fcd-db21-4171-aa7a-f4b801f50d93 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:51:52.788134 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33fa3fcd-db21-4171-aa7a-f4b801f50d93 None admin] RBAC: Adding query filter params (role.id=17e337d9acf148e99d6c50170293fa05, scope.project.id=1213c0d1b584404ba3998e136f166e89, user.id=10af119bd39841ed8163993676230fca) {{(pid=81592) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 17:51:52.788459 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33fa3fcd-db21-4171-aa7a-f4b801f50d93 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:51:52.789915 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33fa3fcd-db21-4171-aa7a-f4b801f50d93 None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:51:52.795744 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 599/1219] 10.222.0.25 () {56 vars in 1374 bytes} [Thu Sep 15 17:51:52 2022] GET /identity/v3/role_assignments?user.id=10af119bd39841ed8163993676230fca&scope.project.id=1213c0d1b584404ba3998e136f166e89&role.id=17e337d9acf148e99d6c50170293fa05 => generated 259 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 17:51:55.125848 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe276c2-4087-4788-b829-6b0b37727be8 None None] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:51:55.126430 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe276c2-4087-4788-b829-6b0b37727be8 None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:51:55.126523 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe276c2-4087-4788-b829-6b0b37727be8 None None] PATH_INFO: `/` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:51:55.128271 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 621/1220] 10.222.0.25 () {54 vars in 927 bytes} [Thu Sep 15 17:51:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 17:51:55.134232 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdaa4c7-e2b5-4586-b18d-ed5aedc72c6f None None] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:51:55.134745 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdaa4c7-e2b5-4586-b18d-ed5aedc72c6f None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:51:55.134873 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdaa4c7-e2b5-4586-b18d-ed5aedc72c6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:51:55.153846 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.auth.core [None req-1cdaa4c7-e2b5-4586-b18d-ed5aedc72c6f None None] MFA Rules not processed for user `5cfa58ef86774ab7800bf91930bf6028`. Rule list: `[]` (Enabled: `True`). {{(pid=81592) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 17:51:55.155111 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-1cdaa4c7-e2b5-4586-b18d-ed5aedc72c6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 17:51:55.228995 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 600/1221] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Sep 15 17:51:55 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 15 17:51:55.510349 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe276c2-4087-4788-b829-6b0b37727be8 None None] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:51:55.633673 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe276c2-4087-4788-b829-6b0b37727be8 None None] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:51:55.670856 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15e36f5-9321-43b1-b248-a4629f3cff8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:51:55.671485 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15e36f5-9321-43b1-b248-a4629f3cff8a None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:51:55.671763 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15e36f5-9321-43b1-b248-a4629f3cff8a None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:51:55.672034 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15e36f5-9321-43b1-b248-a4629f3cff8a None admin] PATH_INFO: `/v3/roles/service` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:51:55.683204 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b15e36f5-9321-43b1-b248-a4629f3cff8a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 17:51:55.689015 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application [None req-b15e36f5-9321-43b1-b248-a4629f3cff8a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 15 17:51:55.689015 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 17:51:55.689015 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 17:51:55.689015 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 17:51:55.689015 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 17:51:55.689015 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 17:51:55.689015 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 17:51:55.689015 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 17:51:55.689015 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 17:51:55.689015 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 17:51:55.689015 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 17:51:55.689015 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 17:51:55.689015 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 17:51:55.689015 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 17:51:55.689015 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 17:51:55.689015 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 17:51:55.690276 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 17:51:55.690276 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 17:51:55.690276 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 17:51:55.690276 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 17:51:55.690276 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 17:51:55.690276 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 17:51:55.690276 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 17:51:55.690276 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 17:51:55.690276 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 17:51:55.690276 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 17:51:55.690276 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 17:51:55.690276 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application with Lock( Sep 15 17:51:55.690276 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 17:51:55.690276 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._enter() Sep 15 17:51:55.690276 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 17:51:55.690276 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 17:51:55.691584 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 17:51:55.691584 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.creator() Sep 15 17:51:55.691584 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 17:51:55.691584 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application created_value = creator( Sep 15 17:51:55.691584 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 17:51:55.691584 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 17:51:55.691584 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 17:51:55.691584 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 17:51:55.691584 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 17:51:55.691584 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 17:51:55.691584 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 15 17:51:55.691584 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Sep 15 17:51:55.691584 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 622/1222] 10.222.0.25 () {56 vars in 1102 bytes} [Thu Sep 15 17:51:55 2022] GET /identity/v3/roles/service => generated 85 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 17:51:55.696438 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cdaa4c7-e2b5-4586-b18d-ed5aedc72c6f None None] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:51:55.807935 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cdaa4c7-e2b5-4586-b18d-ed5aedc72c6f None None] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:51:55.831921 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:51:55.844410 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e104af4-c7ee-4e11-a88e-633808204809 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:51:55.845271 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e104af4-c7ee-4e11-a88e-633808204809 None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:51:55.845588 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e104af4-c7ee-4e11-a88e-633808204809 None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:51:55.845867 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e104af4-c7ee-4e11-a88e-633808204809 None admin] PATH_INFO: `/v3/roles` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:51:55.846709 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e104af4-c7ee-4e11-a88e-633808204809 None admin] RBAC: Adding query filter params (name=service) {{(pid=81592) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 17:51:55.847044 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e104af4-c7ee-4e11-a88e-633808204809 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:51:55.848730 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e104af4-c7ee-4e11-a88e-633808204809 None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:51:55.866467 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 601/1223] 10.222.0.25 () {56 vars in 1103 bytes} [Thu Sep 15 17:51:55 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 17:51:55.867866 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15e36f5-9321-43b1-b248-a4629f3cff8a None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:51:55.917276 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:51:55.983422 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15e36f5-9321-43b1-b248-a4629f3cff8a None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:51:56.017422 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f631b527-2fee-40a1-9ea7-f1e708ae296e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:51:56.018055 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f631b527-2fee-40a1-9ea7-f1e708ae296e None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:51:56.018331 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f631b527-2fee-40a1-9ea7-f1e708ae296e None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:51:56.018600 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f631b527-2fee-40a1-9ea7-f1e708ae296e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:51:56.029812 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f631b527-2fee-40a1-9ea7-f1e708ae296e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:51:56.031266 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f631b527-2fee-40a1-9ea7-f1e708ae296e None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:51:56.048653 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application [None req-f631b527-2fee-40a1-9ea7-f1e708ae296e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 17:51:56.048653 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 17:51:56.048653 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 17:51:56.048653 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 17:51:56.048653 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 17:51:56.048653 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 17:51:56.048653 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 17:51:56.048653 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 17:51:56.048653 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 17:51:56.048653 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 17:51:56.048653 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 17:51:56.048653 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 17:51:56.048653 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 15 17:51:56.048653 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 15 17:51:56.048653 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 15 17:51:56.048653 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 15 17:51:56.049900 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 17:51:56.049900 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 17:51:56.049900 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 17:51:56.049900 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 17:51:56.049900 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 17:51:56.049900 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 17:51:56.049900 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 17:51:56.049900 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application with Lock( Sep 15 17:51:56.049900 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 17:51:56.049900 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._enter() Sep 15 17:51:56.049900 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 17:51:56.049900 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 17:51:56.049900 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 17:51:56.049900 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.creator() Sep 15 17:51:56.049900 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 17:51:56.049900 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application created_value = creator( Sep 15 17:51:56.049900 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 15 17:51:56.050816 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 15 17:51:56.050816 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 17:51:56.050816 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Sep 15 17:51:56.050816 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 623/1224] 10.222.0.25 () {56 vars in 1108 bytes} [Thu Sep 15 17:51:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 17:51:56.056577 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e104af4-c7ee-4e11-a88e-633808204809 None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:51:56.166500 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e104af4-c7ee-4e11-a88e-633808204809 None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:51:56.208415 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8967982-7ca6-4900-8d31-ed3961648b9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:51:56.209190 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8967982-7ca6-4900-8d31-ed3961648b9c None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:51:56.209546 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8967982-7ca6-4900-8d31-ed3961648b9c None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:51:56.210324 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8967982-7ca6-4900-8d31-ed3961648b9c None admin] PATH_INFO: `/v3/domains` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:51:56.211162 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8967982-7ca6-4900-8d31-ed3961648b9c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81592) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 17:51:56.211499 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8967982-7ca6-4900-8d31-ed3961648b9c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:51:56.213091 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8967982-7ca6-4900-8d31-ed3961648b9c None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:51:56.232324 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 602/1225] 10.222.0.25 () {56 vars in 1109 bytes} [Thu Sep 15 17:51:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 17:51:56.233885 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f631b527-2fee-40a1-9ea7-f1e708ae296e None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:51:56.343968 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:51:56.350972 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f631b527-2fee-40a1-9ea7-f1e708ae296e None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:51:56.388960 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f5381c-b08e-487b-8128-f2e160a00dd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:51:56.389706 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f5381c-b08e-487b-8128-f2e160a00dd3 None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:51:56.389991 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f5381c-b08e-487b-8128-f2e160a00dd3 None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:51:56.390311 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f5381c-b08e-487b-8128-f2e160a00dd3 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:51:56.399032 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f5381c-b08e-487b-8128-f2e160a00dd3 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:51:56.400642 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f5381c-b08e-487b-8128-f2e160a00dd3 None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:51:56.412697 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application [None req-86f5381c-b08e-487b-8128-f2e160a00dd3 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 15 17:51:56.412697 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 17:51:56.412697 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 17:51:56.412697 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 17:51:56.412697 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 17:51:56.412697 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 17:51:56.412697 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 17:51:56.412697 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 17:51:56.412697 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 17:51:56.412697 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 17:51:56.412697 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 17:51:56.412697 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 17:51:56.412697 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 15 17:51:56.412697 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 15 17:51:56.412697 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 15 17:51:56.412697 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 15 17:51:56.414275 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 17:51:56.414275 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 17:51:56.414275 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 15 17:51:56.414275 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 15 17:51:56.414275 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 15 17:51:56.414275 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 15 17:51:56.414275 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 17:51:56.414275 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 17:51:56.414275 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 17:51:56.414275 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 17:51:56.414275 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 17:51:56.414275 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application with Lock( Sep 15 17:51:56.414275 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 17:51:56.414275 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._enter() Sep 15 17:51:56.414275 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 17:51:56.414275 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 17:51:56.414275 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 17:51:56.414275 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.creator() Sep 15 17:51:56.415267 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 17:51:56.415267 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application created_value = creator( Sep 15 17:51:56.415267 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 15 17:51:56.415267 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 15 17:51:56.415267 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 15 17:51:56.415267 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 15 17:51:56.415267 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 15 17:51:56.415267 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 15 17:51:56.415267 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 15 17:51:56.415267 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Sep 15 17:51:56.415267 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 624/1226] 10.222.0.25 () {56 vars in 1108 bytes} [Thu Sep 15 17:51:56 2022] GET /identity/v3/users/placement => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 17:51:56.421165 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8967982-7ca6-4900-8d31-ed3961648b9c None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:51:56.480052 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:51:56.540280 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8967982-7ca6-4900-8d31-ed3961648b9c None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:51:56.577697 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990231d0-fea9-4286-8c44-1c6dfef4c084 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:51:56.578314 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990231d0-fea9-4286-8c44-1c6dfef4c084 None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:51:56.578592 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990231d0-fea9-4286-8c44-1c6dfef4c084 None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:51:56.578870 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990231d0-fea9-4286-8c44-1c6dfef4c084 None admin] PATH_INFO: `/v3/users` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:51:56.579604 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-990231d0-fea9-4286-8c44-1c6dfef4c084 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81592) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 17:51:56.579911 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-990231d0-fea9-4286-8c44-1c6dfef4c084 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:51:56.581408 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-990231d0-fea9-4286-8c44-1c6dfef4c084 None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:51:56.605325 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 603/1227] 10.222.0.25 () {56 vars in 1143 bytes} [Thu Sep 15 17:51:56 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 17:51:56.610990 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f5381c-b08e-487b-8128-f2e160a00dd3 None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:51:56.723093 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f5381c-b08e-487b-8128-f2e160a00dd3 None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:51:56.757530 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d959eefa-5eb2-4320-becd-b0bdf8ebdf23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:51:56.758162 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d959eefa-5eb2-4320-becd-b0bdf8ebdf23 None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:51:56.758443 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d959eefa-5eb2-4320-becd-b0bdf8ebdf23 None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:51:56.758716 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d959eefa-5eb2-4320-becd-b0bdf8ebdf23 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:51:56.770088 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d959eefa-5eb2-4320-becd-b0bdf8ebdf23 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:51:56.771553 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d959eefa-5eb2-4320-becd-b0bdf8ebdf23 None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:51:56.794412 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application [None req-d959eefa-5eb2-4320-becd-b0bdf8ebdf23 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 17:51:56.794412 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 17:51:56.794412 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 17:51:56.794412 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 17:51:56.794412 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 17:51:56.794412 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 17:51:56.794412 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 17:51:56.794412 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 17:51:56.794412 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 17:51:56.794412 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 17:51:56.794412 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 17:51:56.794412 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 17:51:56.794412 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 15 17:51:56.794412 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 15 17:51:56.794412 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 15 17:51:56.794412 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 15 17:51:56.795575 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 17:51:56.795575 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 17:51:56.795575 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 17:51:56.795575 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 17:51:56.795575 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 17:51:56.795575 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 17:51:56.795575 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 17:51:56.795575 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application with Lock( Sep 15 17:51:56.795575 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 17:51:56.795575 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._enter() Sep 15 17:51:56.795575 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 17:51:56.795575 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 17:51:56.795575 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 17:51:56.795575 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.creator() Sep 15 17:51:56.795575 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 17:51:56.795575 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application created_value = creator( Sep 15 17:51:56.795575 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 15 17:51:56.796597 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 15 17:51:56.796597 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 17:51:56.796597 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Sep 15 17:51:56.796597 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 625/1228] 10.222.0.25 () {56 vars in 1108 bytes} [Thu Sep 15 17:51:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 17:51:56.801714 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990231d0-fea9-4286-8c44-1c6dfef4c084 None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:51:56.907310 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990231d0-fea9-4286-8c44-1c6dfef4c084 None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:51:56.909823 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:51:56.950616 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0758ab2e-010f-44d4-a1c8-d9632097e01d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:51:56.951381 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0758ab2e-010f-44d4-a1c8-d9632097e01d None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:51:56.951744 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0758ab2e-010f-44d4-a1c8-d9632097e01d None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:51:56.952052 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0758ab2e-010f-44d4-a1c8-d9632097e01d None admin] PATH_INFO: `/v3/domains` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:51:56.952825 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0758ab2e-010f-44d4-a1c8-d9632097e01d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81592) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 17:51:56.953128 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0758ab2e-010f-44d4-a1c8-d9632097e01d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:51:56.955052 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0758ab2e-010f-44d4-a1c8-d9632097e01d None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:51:56.969518 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 604/1229] 10.222.0.25 () {56 vars in 1109 bytes} [Thu Sep 15 17:51:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 17:51:56.975366 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d959eefa-5eb2-4320-becd-b0bdf8ebdf23 None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:51:56.989235 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:51:57.091768 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d959eefa-5eb2-4320-becd-b0bdf8ebdf23 None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:51:57.128598 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1532aeeb-d2ee-4439-9e20-d85c28739a49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:51:57.129227 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1532aeeb-d2ee-4439-9e20-d85c28739a49 None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:51:57.129529 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1532aeeb-d2ee-4439-9e20-d85c28739a49 None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:51:57.129803 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1532aeeb-d2ee-4439-9e20-d85c28739a49 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:51:57.137186 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1532aeeb-d2ee-4439-9e20-d85c28739a49 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:51:57.138770 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1532aeeb-d2ee-4439-9e20-d85c28739a49 None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:51:57.151770 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application [None req-1532aeeb-d2ee-4439-9e20-d85c28739a49 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 15 17:51:57.151770 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 17:51:57.151770 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 17:51:57.151770 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 17:51:57.151770 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 17:51:57.151770 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 17:51:57.151770 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 17:51:57.151770 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 17:51:57.151770 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 17:51:57.151770 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 17:51:57.151770 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 17:51:57.151770 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 17:51:57.151770 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 15 17:51:57.151770 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 15 17:51:57.151770 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 15 17:51:57.152865 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 15 17:51:57.152865 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 17:51:57.152865 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 17:51:57.152865 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 17:51:57.152865 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 17:51:57.152865 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 17:51:57.152865 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 17:51:57.152865 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 17:51:57.152865 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application with Lock( Sep 15 17:51:57.152865 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 17:51:57.152865 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._enter() Sep 15 17:51:57.152865 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 17:51:57.152865 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 17:51:57.152865 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 17:51:57.152865 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.creator() Sep 15 17:51:57.152865 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 17:51:57.152865 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application created_value = creator( Sep 15 17:51:57.158733 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 15 17:51:57.158733 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 15 17:51:57.158733 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 15 17:51:57.158733 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 15 17:51:57.158733 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 15 17:51:57.158733 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 15 17:51:57.158733 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 15 17:51:57.158733 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Sep 15 17:51:57.158733 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 626/1230] 10.222.0.25 () {56 vars in 1111 bytes} [Thu Sep 15 17:51:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 17:51:57.159371 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0758ab2e-010f-44d4-a1c8-d9632097e01d None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:51:57.267986 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0758ab2e-010f-44d4-a1c8-d9632097e01d None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:51:57.307104 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2d1bf1-da31-4b4d-b061-0b017e97374f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:51:57.307710 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2d1bf1-da31-4b4d-b061-0b017e97374f None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:51:57.307989 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2d1bf1-da31-4b4d-b061-0b017e97374f None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:51:57.308262 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2d1bf1-da31-4b4d-b061-0b017e97374f None admin] PATH_INFO: `/v3/projects` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:51:57.308957 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2d1bf1-da31-4b4d-b061-0b017e97374f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81592) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 17:51:57.310304 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2d1bf1-da31-4b4d-b061-0b017e97374f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:51:57.310708 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2d1bf1-da31-4b4d-b061-0b017e97374f None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:51:57.324392 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 605/1231] 10.222.0.25 () {56 vars in 1148 bytes} [Thu Sep 15 17:51:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 17:51:57.330488 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1532aeeb-d2ee-4439-9e20-d85c28739a49 None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:51:57.405826 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:51:57.450740 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1532aeeb-d2ee-4439-9e20-d85c28739a49 None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:51:57.499519 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28e2547-84eb-4969-bee7-db243a2eb001 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:51:57.500207 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28e2547-84eb-4969-bee7-db243a2eb001 None admin] REQUEST_METHOD: `PUT` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:51:57.500488 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28e2547-84eb-4969-bee7-db243a2eb001 None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:51:57.500764 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28e2547-84eb-4969-bee7-db243a2eb001 None admin] PATH_INFO: `/v3/projects/1213c0d1b584404ba3998e136f166e89/users/10af119bd39841ed8163993676230fca/roles/17e337d9acf148e99d6c50170293fa05` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:51:57.516885 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28e2547-84eb-4969-bee7-db243a2eb001 None admin] RBAC: Authorizing `identity:create_grant(project_id=1213c0d1b584404ba3998e136f166e89, user_id=10af119bd39841ed8163993676230fca, role_id=17e337d9acf148e99d6c50170293fa05)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:51:57.518503 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28e2547-84eb-4969-bee7-db243a2eb001 None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:51:57.531327 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 627/1232] 10.222.0.25 () {58 vars in 1439 bytes} [Thu Sep 15 17:51:57 2022] PUT /identity/v3/projects/1213c0d1b584404ba3998e136f166e89/users/10af119bd39841ed8163993676230fca/roles/17e337d9acf148e99d6c50170293fa05 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 17:51:59.826019 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46860f66-bc31-4451-90de-fb93fef18230 None None] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:51:59.826572 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46860f66-bc31-4451-90de-fb93fef18230 None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:51:59.826572 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46860f66-bc31-4451-90de-fb93fef18230 None None] PATH_INFO: `/` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:51:59.828114 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 606/1233] 10.222.0.25 () {54 vars in 927 bytes} [Thu Sep 15 17:51:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 17:51:59.834174 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183d58d9-2342-43ba-aafc-f69b19a1b7d9 None None] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:51:59.835192 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183d58d9-2342-43ba-aafc-f69b19a1b7d9 None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:51:59.835282 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183d58d9-2342-43ba-aafc-f69b19a1b7d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:51:59.855550 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.auth.core [None req-183d58d9-2342-43ba-aafc-f69b19a1b7d9 None None] MFA Rules not processed for user `5cfa58ef86774ab7800bf91930bf6028`. Rule list: `[]` (Enabled: `True`). {{(pid=81593) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 17:51:59.856999 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-183d58d9-2342-43ba-aafc-f69b19a1b7d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 17:51:59.934983 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 628/1234] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Sep 15 17:51:59 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 15 17:52:00.230477 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46860f66-bc31-4451-90de-fb93fef18230 None None] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:52:00.259143 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:52:00.351688 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46860f66-bc31-4451-90de-fb93fef18230 None None] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:52:00.393040 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3555b033-a12a-469c-b5ae-950485a39b40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:52:00.393774 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3555b033-a12a-469c-b5ae-950485a39b40 None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:52:00.394180 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3555b033-a12a-469c-b5ae-950485a39b40 None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:52:00.394553 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3555b033-a12a-469c-b5ae-950485a39b40 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:52:00.407209 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3555b033-a12a-469c-b5ae-950485a39b40 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 17:52:00.412098 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application [None req-3555b033-a12a-469c-b5ae-950485a39b40 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 15 17:52:00.412098 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 17:52:00.412098 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 17:52:00.412098 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 17:52:00.412098 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 17:52:00.412098 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 17:52:00.412098 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 17:52:00.412098 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 17:52:00.412098 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 17:52:00.412098 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 17:52:00.412098 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 17:52:00.412098 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 17:52:00.412098 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 17:52:00.412098 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 17:52:00.412098 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 17:52:00.412098 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 17:52:00.413306 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 17:52:00.413306 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 17:52:00.413306 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 17:52:00.413306 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 17:52:00.413306 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 17:52:00.413306 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 17:52:00.413306 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 17:52:00.413306 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 17:52:00.413306 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 17:52:00.413306 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 17:52:00.413306 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 17:52:00.413306 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application with Lock( Sep 15 17:52:00.413306 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 17:52:00.413306 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._enter() Sep 15 17:52:00.413306 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 17:52:00.413306 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 17:52:00.414289 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 17:52:00.414289 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.creator() Sep 15 17:52:00.414289 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 17:52:00.414289 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application created_value = creator( Sep 15 17:52:00.414289 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 17:52:00.414289 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 17:52:00.414289 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 17:52:00.414289 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 17:52:00.414289 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 17:52:00.414289 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 17:52:00.414289 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 15 17:52:00.414289 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Sep 15 17:52:00.414289 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 607/1235] 10.222.0.25 () {56 vars in 1102 bytes} [Thu Sep 15 17:52:00 2022] GET /identity/v3/roles/service => generated 85 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 17:52:00.419610 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183d58d9-2342-43ba-aafc-f69b19a1b7d9 None None] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:52:00.475122 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:52:00.536297 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183d58d9-2342-43ba-aafc-f69b19a1b7d9 None None] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:52:00.576899 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e81e160-45ce-4cf0-b1b1-d4af7e60450f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:52:00.577511 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e81e160-45ce-4cf0-b1b1-d4af7e60450f None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:52:00.577792 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e81e160-45ce-4cf0-b1b1-d4af7e60450f None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:52:00.578062 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e81e160-45ce-4cf0-b1b1-d4af7e60450f None admin] PATH_INFO: `/v3/roles` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:52:00.578737 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e81e160-45ce-4cf0-b1b1-d4af7e60450f None admin] RBAC: Adding query filter params (name=service) {{(pid=81593) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 17:52:00.579043 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e81e160-45ce-4cf0-b1b1-d4af7e60450f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:52:00.580465 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e81e160-45ce-4cf0-b1b1-d4af7e60450f None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:52:00.595619 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 629/1236] 10.222.0.25 () {56 vars in 1103 bytes} [Thu Sep 15 17:52:00 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 17:52:00.597000 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3555b033-a12a-469c-b5ae-950485a39b40 None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:52:00.697870 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:52:00.716121 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3555b033-a12a-469c-b5ae-950485a39b40 None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:52:00.752948 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075da575-b722-4a93-acb1-d682e517f1cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:52:00.753719 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075da575-b722-4a93-acb1-d682e517f1cf None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:52:00.753994 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075da575-b722-4a93-acb1-d682e517f1cf None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:52:00.754267 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075da575-b722-4a93-acb1-d682e517f1cf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:52:00.765886 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-075da575-b722-4a93-acb1-d682e517f1cf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:52:00.767427 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-075da575-b722-4a93-acb1-d682e517f1cf None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:52:00.783824 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application [None req-075da575-b722-4a93-acb1-d682e517f1cf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 17:52:00.783824 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 17:52:00.783824 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 17:52:00.783824 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 17:52:00.783824 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 17:52:00.783824 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 17:52:00.783824 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 17:52:00.783824 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 17:52:00.783824 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 17:52:00.783824 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 17:52:00.783824 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 17:52:00.783824 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 17:52:00.783824 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 15 17:52:00.783824 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 15 17:52:00.783824 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 15 17:52:00.783824 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 15 17:52:00.785082 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 17:52:00.785082 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 17:52:00.785082 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 17:52:00.785082 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 17:52:00.785082 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 17:52:00.785082 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 17:52:00.785082 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 17:52:00.785082 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application with Lock( Sep 15 17:52:00.785082 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 17:52:00.785082 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._enter() Sep 15 17:52:00.785082 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 17:52:00.785082 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 17:52:00.785082 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 17:52:00.785082 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.creator() Sep 15 17:52:00.785082 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 17:52:00.785082 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application created_value = creator( Sep 15 17:52:00.785082 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 15 17:52:00.786114 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 15 17:52:00.786114 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 17:52:00.786114 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Sep 15 17:52:00.786114 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 608/1237] 10.222.0.25 () {56 vars in 1108 bytes} [Thu Sep 15 17:52:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 17:52:00.791151 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e81e160-45ce-4cf0-b1b1-d4af7e60450f None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:52:00.903545 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e81e160-45ce-4cf0-b1b1-d4af7e60450f None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:52:00.914380 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:52:00.943933 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545fde60-5e88-4f95-a665-d35993b4edeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:52:00.944657 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545fde60-5e88-4f95-a665-d35993b4edeb None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:52:00.945005 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545fde60-5e88-4f95-a665-d35993b4edeb None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:52:00.945366 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545fde60-5e88-4f95-a665-d35993b4edeb None admin] PATH_INFO: `/v3/domains` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:52:00.946011 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-545fde60-5e88-4f95-a665-d35993b4edeb None admin] RBAC: Adding query filter params (name=Default) {{(pid=81593) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 17:52:00.946310 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-545fde60-5e88-4f95-a665-d35993b4edeb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:52:00.947676 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-545fde60-5e88-4f95-a665-d35993b4edeb None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:52:00.960052 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 630/1238] 10.222.0.25 () {56 vars in 1109 bytes} [Thu Sep 15 17:52:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 17:52:00.965866 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075da575-b722-4a93-acb1-d682e517f1cf None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:52:01.088789 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075da575-b722-4a93-acb1-d682e517f1cf None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:52:01.129607 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b8a5d5-ee4e-48d0-9ff3-7a1476d8d17d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:52:01.130248 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b8a5d5-ee4e-48d0-9ff3-7a1476d8d17d None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:52:01.130526 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b8a5d5-ee4e-48d0-9ff3-7a1476d8d17d None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:52:01.130800 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b8a5d5-ee4e-48d0-9ff3-7a1476d8d17d None admin] PATH_INFO: `/v3/users/placement` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:52:01.133882 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:52:01.142175 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b8a5d5-ee4e-48d0-9ff3-7a1476d8d17d None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:52:01.144038 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b8a5d5-ee4e-48d0-9ff3-7a1476d8d17d None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:52:01.156746 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application [None req-70b8a5d5-ee4e-48d0-9ff3-7a1476d8d17d None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 15 17:52:01.156746 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 17:52:01.156746 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 17:52:01.156746 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 17:52:01.156746 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 17:52:01.156746 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 17:52:01.156746 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 17:52:01.156746 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 17:52:01.156746 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 17:52:01.156746 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 17:52:01.156746 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 17:52:01.156746 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 17:52:01.156746 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 15 17:52:01.156746 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 15 17:52:01.156746 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 15 17:52:01.156746 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 15 17:52:01.158301 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 17:52:01.158301 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 17:52:01.158301 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 15 17:52:01.158301 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 15 17:52:01.158301 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 15 17:52:01.158301 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 15 17:52:01.158301 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 17:52:01.158301 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 17:52:01.158301 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 17:52:01.158301 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 17:52:01.158301 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 17:52:01.158301 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application with Lock( Sep 15 17:52:01.158301 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 17:52:01.158301 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._enter() Sep 15 17:52:01.158301 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 17:52:01.158301 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 17:52:01.158301 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 17:52:01.158301 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.creator() Sep 15 17:52:01.159696 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 17:52:01.159696 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application created_value = creator( Sep 15 17:52:01.159696 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 15 17:52:01.159696 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 15 17:52:01.159696 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 15 17:52:01.159696 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 15 17:52:01.159696 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 15 17:52:01.159696 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 15 17:52:01.159696 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 15 17:52:01.159696 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Sep 15 17:52:01.159696 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 609/1239] 10.222.0.25 () {56 vars in 1108 bytes} [Thu Sep 15 17:52:00 2022] GET /identity/v3/users/placement => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 17:52:01.164817 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545fde60-5e88-4f95-a665-d35993b4edeb None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:52:01.280952 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545fde60-5e88-4f95-a665-d35993b4edeb None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:52:01.319386 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3b6f69-6009-4255-b120-9c73093c8f7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:52:01.319988 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3b6f69-6009-4255-b120-9c73093c8f7f None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:52:01.320262 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3b6f69-6009-4255-b120-9c73093c8f7f None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:52:01.320532 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3b6f69-6009-4255-b120-9c73093c8f7f None admin] PATH_INFO: `/v3/users` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:52:01.321330 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b3b6f69-6009-4255-b120-9c73093c8f7f None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81593) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 17:52:01.321672 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b3b6f69-6009-4255-b120-9c73093c8f7f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:52:01.323408 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b3b6f69-6009-4255-b120-9c73093c8f7f None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:52:01.347948 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 631/1240] 10.222.0.25 () {56 vars in 1143 bytes} [Thu Sep 15 17:52:01 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 17:52:01.349155 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b8a5d5-ee4e-48d0-9ff3-7a1476d8d17d None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:52:01.467498 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b8a5d5-ee4e-48d0-9ff3-7a1476d8d17d None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:52:01.504609 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dfcb15b-6933-4006-9b33-19a73a39e343 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:52:01.505224 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfcb15b-6933-4006-9b33-19a73a39e343 None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:52:01.505541 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfcb15b-6933-4006-9b33-19a73a39e343 None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:52:01.505816 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfcb15b-6933-4006-9b33-19a73a39e343 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:52:01.578871 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:52:01.588144 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dfcb15b-6933-4006-9b33-19a73a39e343 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:52:01.589741 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dfcb15b-6933-4006-9b33-19a73a39e343 None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:52:01.726642 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 610/1241] 10.222.0.25 () {58 vars in 1282 bytes} [Thu Sep 15 17:52:01 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 15 17:52:01.732532 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3b6f69-6009-4255-b120-9c73093c8f7f None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:52:01.762804 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:52:01.844915 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3b6f69-6009-4255-b120-9c73093c8f7f None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:52:01.886263 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897f117e-ef0e-42c6-b59d-7629354e9f5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:52:01.886897 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897f117e-ef0e-42c6-b59d-7629354e9f5e None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:52:01.887206 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897f117e-ef0e-42c6-b59d-7629354e9f5e None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:52:01.887521 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897f117e-ef0e-42c6-b59d-7629354e9f5e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:52:01.899804 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-897f117e-ef0e-42c6-b59d-7629354e9f5e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:52:01.901290 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-897f117e-ef0e-42c6-b59d-7629354e9f5e None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:52:01.920855 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application [None req-897f117e-ef0e-42c6-b59d-7629354e9f5e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 17:52:01.920855 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 17:52:01.920855 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 17:52:01.920855 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 17:52:01.920855 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 17:52:01.920855 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 17:52:01.920855 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 17:52:01.920855 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 17:52:01.920855 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 17:52:01.920855 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 17:52:01.920855 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 17:52:01.920855 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 17:52:01.920855 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 15 17:52:01.920855 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 15 17:52:01.920855 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 15 17:52:01.920855 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 15 17:52:01.922543 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 17:52:01.922543 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 17:52:01.922543 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 17:52:01.922543 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 17:52:01.922543 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 17:52:01.922543 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 17:52:01.922543 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 17:52:01.922543 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application with Lock( Sep 15 17:52:01.922543 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 17:52:01.922543 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._enter() Sep 15 17:52:01.922543 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 17:52:01.922543 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 17:52:01.922543 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 17:52:01.922543 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.creator() Sep 15 17:52:01.922543 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 17:52:01.922543 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application created_value = creator( Sep 15 17:52:01.922543 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 15 17:52:01.923602 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 15 17:52:01.923602 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 17:52:01.923602 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Sep 15 17:52:01.923602 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 632/1242] 10.222.0.25 () {56 vars in 1108 bytes} [Thu Sep 15 17:52:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 17:52:01.933708 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dfcb15b-6933-4006-9b33-19a73a39e343 None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:52:02.047951 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:52:02.054903 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dfcb15b-6933-4006-9b33-19a73a39e343 None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:52:02.093227 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb35a19b-bae6-4622-bcc5-b7a7292e6ad0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:52:02.093992 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb35a19b-bae6-4622-bcc5-b7a7292e6ad0 None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:52:02.094268 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb35a19b-bae6-4622-bcc5-b7a7292e6ad0 None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:52:02.094540 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb35a19b-bae6-4622-bcc5-b7a7292e6ad0 None admin] PATH_INFO: `/v3/domains` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:52:02.095183 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb35a19b-bae6-4622-bcc5-b7a7292e6ad0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81592) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 17:52:02.095488 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb35a19b-bae6-4622-bcc5-b7a7292e6ad0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:52:02.096845 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb35a19b-bae6-4622-bcc5-b7a7292e6ad0 None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:52:02.110977 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 611/1243] 10.222.0.25 () {56 vars in 1109 bytes} [Thu Sep 15 17:52:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 17:52:02.117867 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897f117e-ef0e-42c6-b59d-7629354e9f5e None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:52:02.211253 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:52:02.236160 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897f117e-ef0e-42c6-b59d-7629354e9f5e None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:52:02.279508 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d2f618-a3b8-4e9e-a670-d6553dc26308 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:52:02.279508 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d2f618-a3b8-4e9e-a670-d6553dc26308 None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:52:02.279508 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d2f618-a3b8-4e9e-a670-d6553dc26308 None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:52:02.279897 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d2f618-a3b8-4e9e-a670-d6553dc26308 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:52:02.286473 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d2f618-a3b8-4e9e-a670-d6553dc26308 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:52:02.288066 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d2f618-a3b8-4e9e-a670-d6553dc26308 None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:52:02.299983 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application [None req-81d2f618-a3b8-4e9e-a670-d6553dc26308 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 15 17:52:02.299983 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 17:52:02.299983 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 17:52:02.299983 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 17:52:02.299983 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 17:52:02.299983 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 17:52:02.299983 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 17:52:02.299983 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 17:52:02.299983 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 17:52:02.299983 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 17:52:02.299983 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 17:52:02.299983 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 17:52:02.299983 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 15 17:52:02.299983 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 15 17:52:02.299983 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 15 17:52:02.301018 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 15 17:52:02.301018 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 17:52:02.301018 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 17:52:02.301018 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 17:52:02.301018 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 17:52:02.301018 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 17:52:02.301018 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 17:52:02.301018 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 17:52:02.301018 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application with Lock( Sep 15 17:52:02.301018 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 17:52:02.301018 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._enter() Sep 15 17:52:02.301018 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 17:52:02.301018 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 17:52:02.301018 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 17:52:02.301018 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.creator() Sep 15 17:52:02.301018 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 17:52:02.301018 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application created_value = creator( Sep 15 17:52:02.302068 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 15 17:52:02.302068 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 15 17:52:02.302068 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 15 17:52:02.302068 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 15 17:52:02.302068 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 15 17:52:02.302068 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 15 17:52:02.302068 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 15 17:52:02.302068 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Sep 15 17:52:02.302068 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 633/1244] 10.222.0.25 () {56 vars in 1111 bytes} [Thu Sep 15 17:52:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 15 17:52:02.308120 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb35a19b-bae6-4622-bcc5-b7a7292e6ad0 None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:52:02.423543 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb35a19b-bae6-4622-bcc5-b7a7292e6ad0 None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:52:02.464416 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4414d967-8bb2-45db-81c8-9937303cc2d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:52:02.465167 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4414d967-8bb2-45db-81c8-9937303cc2d0 None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:52:02.465524 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4414d967-8bb2-45db-81c8-9937303cc2d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:52:02.465809 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4414d967-8bb2-45db-81c8-9937303cc2d0 None admin] PATH_INFO: `/v3/projects` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:52:02.466684 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4414d967-8bb2-45db-81c8-9937303cc2d0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81592) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 17:52:02.467065 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4414d967-8bb2-45db-81c8-9937303cc2d0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:52:02.468745 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4414d967-8bb2-45db-81c8-9937303cc2d0 None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:52:02.482450 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 612/1245] 10.222.0.25 () {56 vars in 1148 bytes} [Thu Sep 15 17:52:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 17:52:02.488512 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d2f618-a3b8-4e9e-a670-d6553dc26308 None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:52:02.605766 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d2f618-a3b8-4e9e-a670-d6553dc26308 None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:52:02.646343 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eaa0483-0c84-42cc-bea4-de80fb5561f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:52:02.647050 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eaa0483-0c84-42cc-bea4-de80fb5561f5 None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:52:02.647367 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eaa0483-0c84-42cc-bea4-de80fb5561f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:52:02.647675 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eaa0483-0c84-42cc-bea4-de80fb5561f5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:52:02.648603 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eaa0483-0c84-42cc-bea4-de80fb5561f5 None admin] RBAC: Adding query filter params (role.id=17e337d9acf148e99d6c50170293fa05, scope.project.id=1213c0d1b584404ba3998e136f166e89, user.id=10af119bd39841ed8163993676230fca) {{(pid=81593) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 17:52:02.649025 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eaa0483-0c84-42cc-bea4-de80fb5561f5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:52:02.650741 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eaa0483-0c84-42cc-bea4-de80fb5561f5 None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:52:02.657377 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 634/1246] 10.222.0.25 () {56 vars in 1374 bytes} [Thu Sep 15 17:52:02 2022] GET /identity/v3/role_assignments?user.id=10af119bd39841ed8163993676230fca&scope.project.id=1213c0d1b584404ba3998e136f166e89&role.id=17e337d9acf148e99d6c50170293fa05 => generated 608 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 17:52:05.107629 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427c4d64-2e6f-4cf6-a3bc-44b75bba3241 None None] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:52:05.108210 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427c4d64-2e6f-4cf6-a3bc-44b75bba3241 None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:52:05.108210 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427c4d64-2e6f-4cf6-a3bc-44b75bba3241 None None] PATH_INFO: `/` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:52:05.109564 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 613/1247] 10.222.0.25 () {54 vars in 927 bytes} [Thu Sep 15 17:52:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 17:52:05.116487 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893fec8f-393f-4ce9-a8cf-69a6f1643925 None None] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:52:05.117007 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893fec8f-393f-4ce9-a8cf-69a6f1643925 None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:52:05.117007 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893fec8f-393f-4ce9-a8cf-69a6f1643925 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:52:05.124284 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:52:05.138575 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.auth.core [None req-893fec8f-393f-4ce9-a8cf-69a6f1643925 None None] MFA Rules not processed for user `5cfa58ef86774ab7800bf91930bf6028`. Rule list: `[]` (Enabled: `True`). {{(pid=81593) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 17:52:05.139797 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-893fec8f-393f-4ce9-a8cf-69a6f1643925 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 17:52:05.211975 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 635/1248] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Sep 15 17:52:05 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 15 17:52:05.518521 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427c4d64-2e6f-4cf6-a3bc-44b75bba3241 None None] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:52:05.540471 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:52:05.645535 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427c4d64-2e6f-4cf6-a3bc-44b75bba3241 None None] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:52:05.681872 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462476dd-4108-4f02-932b-82d11e052434 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:52:05.682503 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462476dd-4108-4f02-932b-82d11e052434 None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:52:05.682777 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462476dd-4108-4f02-932b-82d11e052434 None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:52:05.683040 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462476dd-4108-4f02-932b-82d11e052434 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:52:05.694779 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462476dd-4108-4f02-932b-82d11e052434 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 17:52:05.700176 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application [None req-462476dd-4108-4f02-932b-82d11e052434 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 15 17:52:05.700176 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 17:52:05.700176 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 17:52:05.700176 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 17:52:05.700176 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 17:52:05.700176 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 17:52:05.700176 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 17:52:05.700176 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 17:52:05.700176 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 17:52:05.700176 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 17:52:05.700176 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 17:52:05.700176 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 17:52:05.700176 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 17:52:05.700176 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 17:52:05.700176 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 17:52:05.700176 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 17:52:05.701763 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 17:52:05.701763 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 17:52:05.701763 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 17:52:05.701763 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 17:52:05.701763 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 17:52:05.701763 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 17:52:05.701763 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 17:52:05.701763 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 17:52:05.701763 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 17:52:05.701763 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 17:52:05.701763 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 17:52:05.701763 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application with Lock( Sep 15 17:52:05.701763 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 17:52:05.701763 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._enter() Sep 15 17:52:05.701763 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 17:52:05.701763 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 17:52:05.703031 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 17:52:05.703031 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.creator() Sep 15 17:52:05.703031 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 17:52:05.703031 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application created_value = creator( Sep 15 17:52:05.703031 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 17:52:05.703031 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 17:52:05.703031 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 17:52:05.703031 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 17:52:05.703031 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 17:52:05.703031 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 17:52:05.703031 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 15 17:52:05.703031 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Sep 15 17:52:05.703031 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 614/1249] 10.222.0.25 () {56 vars in 1096 bytes} [Thu Sep 15 17:52:05 2022] GET /identity/v3/roles/admin => generated 83 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 15 17:52:05.707965 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893fec8f-393f-4ce9-a8cf-69a6f1643925 None None] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:52:05.820208 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893fec8f-393f-4ce9-a8cf-69a6f1643925 None None] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:52:05.850860 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:52:05.857096 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbcd7f77-9bd1-4452-9a73-09b1443eafab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:52:05.857859 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcd7f77-9bd1-4452-9a73-09b1443eafab None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:52:05.858170 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcd7f77-9bd1-4452-9a73-09b1443eafab None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:52:05.858477 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcd7f77-9bd1-4452-9a73-09b1443eafab None admin] PATH_INFO: `/v3/roles` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:52:05.859156 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbcd7f77-9bd1-4452-9a73-09b1443eafab None admin] RBAC: Adding query filter params (name=admin) {{(pid=81593) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 17:52:05.859455 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbcd7f77-9bd1-4452-9a73-09b1443eafab None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:52:05.860836 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbcd7f77-9bd1-4452-9a73-09b1443eafab None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:52:05.874659 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 636/1250] 10.222.0.25 () {56 vars in 1099 bytes} [Thu Sep 15 17:52:05 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 17:52:05.875807 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462476dd-4108-4f02-932b-82d11e052434 None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:52:05.964572 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:52:05.989364 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462476dd-4108-4f02-932b-82d11e052434 None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:52:06.025408 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f78052-5c93-4bb2-ac9e-26f10d152574 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:52:06.026193 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f78052-5c93-4bb2-ac9e-26f10d152574 None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:52:06.026475 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f78052-5c93-4bb2-ac9e-26f10d152574 None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:52:06.026747 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f78052-5c93-4bb2-ac9e-26f10d152574 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:52:06.037562 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f78052-5c93-4bb2-ac9e-26f10d152574 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:52:06.039003 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f78052-5c93-4bb2-ac9e-26f10d152574 None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:52:06.054103 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application [None req-12f78052-5c93-4bb2-ac9e-26f10d152574 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 17:52:06.054103 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 17:52:06.054103 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 17:52:06.054103 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 17:52:06.054103 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 17:52:06.054103 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 17:52:06.054103 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 17:52:06.054103 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 17:52:06.054103 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 17:52:06.054103 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 17:52:06.054103 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 17:52:06.054103 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 17:52:06.054103 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 15 17:52:06.054103 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 15 17:52:06.054103 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 15 17:52:06.054103 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 15 17:52:06.055308 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 17:52:06.055308 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 17:52:06.055308 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 17:52:06.055308 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 17:52:06.055308 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 17:52:06.055308 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 17:52:06.055308 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 17:52:06.055308 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application with Lock( Sep 15 17:52:06.055308 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 17:52:06.055308 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._enter() Sep 15 17:52:06.055308 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 17:52:06.055308 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 17:52:06.055308 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 17:52:06.055308 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.creator() Sep 15 17:52:06.055308 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 17:52:06.055308 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application created_value = creator( Sep 15 17:52:06.055308 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 15 17:52:06.056239 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 15 17:52:06.056239 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 17:52:06.056239 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Sep 15 17:52:06.056239 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 615/1251] 10.222.0.25 () {56 vars in 1108 bytes} [Thu Sep 15 17:52:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 17:52:06.061751 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbcd7f77-9bd1-4452-9a73-09b1443eafab None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:52:06.180361 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbcd7f77-9bd1-4452-9a73-09b1443eafab None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:52:06.219631 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31825d3e-1cfe-44e2-90b5-5f80c5c0c7b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:52:06.220268 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31825d3e-1cfe-44e2-90b5-5f80c5c0c7b0 None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:52:06.220547 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31825d3e-1cfe-44e2-90b5-5f80c5c0c7b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:52:06.220822 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31825d3e-1cfe-44e2-90b5-5f80c5c0c7b0 None admin] PATH_INFO: `/v3/domains` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:52:06.221497 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31825d3e-1cfe-44e2-90b5-5f80c5c0c7b0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81593) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 17:52:06.221800 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31825d3e-1cfe-44e2-90b5-5f80c5c0c7b0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:52:06.223171 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31825d3e-1cfe-44e2-90b5-5f80c5c0c7b0 None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:52:06.236840 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 637/1252] 10.222.0.25 () {56 vars in 1109 bytes} [Thu Sep 15 17:52:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 17:52:06.243703 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f78052-5c93-4bb2-ac9e-26f10d152574 None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:52:06.355401 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f78052-5c93-4bb2-ac9e-26f10d152574 None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:52:06.385807 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:52:06.394310 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81e139d-71d0-42e0-b9b7-af761517026a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:52:06.394946 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81e139d-71d0-42e0-b9b7-af761517026a None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:52:06.395226 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81e139d-71d0-42e0-b9b7-af761517026a None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:52:06.395500 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81e139d-71d0-42e0-b9b7-af761517026a None admin] PATH_INFO: `/v3/users/placement` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:52:06.403945 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81e139d-71d0-42e0-b9b7-af761517026a None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:52:06.405450 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81e139d-71d0-42e0-b9b7-af761517026a None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:52:06.416606 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application [None req-b81e139d-71d0-42e0-b9b7-af761517026a None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 15 17:52:06.416606 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 17:52:06.416606 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 17:52:06.416606 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 17:52:06.416606 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 17:52:06.416606 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 17:52:06.416606 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 17:52:06.416606 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 17:52:06.416606 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 17:52:06.416606 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 17:52:06.416606 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 17:52:06.416606 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 17:52:06.416606 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 15 17:52:06.416606 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 15 17:52:06.416606 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 15 17:52:06.416606 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 15 17:52:06.418145 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 17:52:06.418145 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 17:52:06.418145 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 15 17:52:06.418145 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 15 17:52:06.418145 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 15 17:52:06.418145 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 15 17:52:06.418145 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 17:52:06.418145 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 17:52:06.418145 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 17:52:06.418145 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 17:52:06.418145 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 17:52:06.418145 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application with Lock( Sep 15 17:52:06.418145 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 17:52:06.418145 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._enter() Sep 15 17:52:06.418145 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 17:52:06.418145 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 17:52:06.418145 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 17:52:06.418145 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.creator() Sep 15 17:52:06.419685 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 17:52:06.419685 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application created_value = creator( Sep 15 17:52:06.419685 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 15 17:52:06.419685 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 15 17:52:06.419685 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 15 17:52:06.419685 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 15 17:52:06.419685 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 15 17:52:06.419685 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 15 17:52:06.419685 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 15 17:52:06.419685 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Sep 15 17:52:06.419685 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 616/1253] 10.222.0.25 () {56 vars in 1108 bytes} [Thu Sep 15 17:52:06 2022] GET /identity/v3/users/placement => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 15 17:52:06.424166 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31825d3e-1cfe-44e2-90b5-5f80c5c0c7b0 None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:52:06.488586 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:52:06.536055 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31825d3e-1cfe-44e2-90b5-5f80c5c0c7b0 None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:52:06.572180 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0aa506-f088-4ab4-9007-f32cda7e0e80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:52:06.572801 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0aa506-f088-4ab4-9007-f32cda7e0e80 None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:52:06.573078 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0aa506-f088-4ab4-9007-f32cda7e0e80 None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:52:06.573376 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0aa506-f088-4ab4-9007-f32cda7e0e80 None admin] PATH_INFO: `/v3/users` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:52:06.574119 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a0aa506-f088-4ab4-9007-f32cda7e0e80 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81593) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 17:52:06.574421 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a0aa506-f088-4ab4-9007-f32cda7e0e80 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:52:06.575888 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a0aa506-f088-4ab4-9007-f32cda7e0e80 None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:52:06.595966 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 638/1254] 10.222.0.25 () {56 vars in 1143 bytes} [Thu Sep 15 17:52:06 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 17:52:06.603514 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81e139d-71d0-42e0-b9b7-af761517026a None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:52:06.718782 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81e139d-71d0-42e0-b9b7-af761517026a None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:52:06.754580 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7416b85a-9261-4e84-9338-5f845ec55978 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:52:06.755126 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7416b85a-9261-4e84-9338-5f845ec55978 None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:52:06.755407 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7416b85a-9261-4e84-9338-5f845ec55978 None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:52:06.755680 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7416b85a-9261-4e84-9338-5f845ec55978 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:52:06.814775 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:52:06.827748 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7416b85a-9261-4e84-9338-5f845ec55978 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:52:06.829223 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7416b85a-9261-4e84-9338-5f845ec55978 None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:52:06.938868 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 617/1255] 10.222.0.25 () {58 vars in 1282 bytes} [Thu Sep 15 17:52:06 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 15 17:52:06.944951 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0aa506-f088-4ab4-9007-f32cda7e0e80 None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:52:07.058327 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0aa506-f088-4ab4-9007-f32cda7e0e80 None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:52:07.071717 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:52:07.095641 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775f5e65-867e-4a92-bf9b-ac2f2bd69800 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:52:07.096276 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775f5e65-867e-4a92-bf9b-ac2f2bd69800 None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:52:07.096555 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775f5e65-867e-4a92-bf9b-ac2f2bd69800 None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:52:07.096829 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775f5e65-867e-4a92-bf9b-ac2f2bd69800 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:52:07.109242 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775f5e65-867e-4a92-bf9b-ac2f2bd69800 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:52:07.111802 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775f5e65-867e-4a92-bf9b-ac2f2bd69800 None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:52:07.128364 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application [None req-775f5e65-867e-4a92-bf9b-ac2f2bd69800 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 17:52:07.128364 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 17:52:07.128364 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 17:52:07.128364 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 17:52:07.128364 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 17:52:07.128364 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 17:52:07.128364 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 17:52:07.128364 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 17:52:07.128364 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 17:52:07.128364 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 17:52:07.128364 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 17:52:07.128364 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 17:52:07.128364 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 15 17:52:07.128364 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 15 17:52:07.128364 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 15 17:52:07.128364 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 15 17:52:07.129667 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 17:52:07.129667 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 17:52:07.129667 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 17:52:07.129667 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 17:52:07.129667 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 17:52:07.129667 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 17:52:07.129667 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 17:52:07.129667 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application with Lock( Sep 15 17:52:07.129667 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 17:52:07.129667 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._enter() Sep 15 17:52:07.129667 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 17:52:07.129667 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 17:52:07.129667 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 17:52:07.129667 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.creator() Sep 15 17:52:07.129667 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 17:52:07.129667 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application created_value = creator( Sep 15 17:52:07.129667 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 15 17:52:07.131454 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 15 17:52:07.131454 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 17:52:07.131454 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Sep 15 17:52:07.131454 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 639/1256] 10.222.0.25 () {56 vars in 1108 bytes} [Thu Sep 15 17:52:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 17:52:07.135792 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7416b85a-9261-4e84-9338-5f845ec55978 None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:52:07.221475 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:52:07.233831 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7416b85a-9261-4e84-9338-5f845ec55978 None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:52:07.266403 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff2835e-9320-4e61-b013-fe15dab61dde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:52:07.267002 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff2835e-9320-4e61-b013-fe15dab61dde None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:52:07.267260 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff2835e-9320-4e61-b013-fe15dab61dde None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:52:07.267527 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff2835e-9320-4e61-b013-fe15dab61dde None admin] PATH_INFO: `/v3/domains` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:52:07.268158 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff2835e-9320-4e61-b013-fe15dab61dde None admin] RBAC: Adding query filter params (name=Default) {{(pid=81592) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 17:52:07.268454 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff2835e-9320-4e61-b013-fe15dab61dde None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:52:07.269843 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff2835e-9320-4e61-b013-fe15dab61dde None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:52:07.281511 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 618/1257] 10.222.0.25 () {56 vars in 1109 bytes} [Thu Sep 15 17:52:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 17:52:07.287293 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775f5e65-867e-4a92-bf9b-ac2f2bd69800 None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:52:07.386849 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775f5e65-867e-4a92-bf9b-ac2f2bd69800 None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:52:07.425649 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500dce40-bb99-4f91-8e96-4c28b21f15f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:52:07.426268 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500dce40-bb99-4f91-8e96-4c28b21f15f0 None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:52:07.426547 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500dce40-bb99-4f91-8e96-4c28b21f15f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:52:07.426818 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500dce40-bb99-4f91-8e96-4c28b21f15f0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:52:07.433871 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-500dce40-bb99-4f91-8e96-4c28b21f15f0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:52:07.435330 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-500dce40-bb99-4f91-8e96-4c28b21f15f0 None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:52:07.446937 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application [None req-500dce40-bb99-4f91-8e96-4c28b21f15f0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 15 17:52:07.446937 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 17:52:07.446937 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 17:52:07.446937 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 17:52:07.446937 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 17:52:07.446937 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 17:52:07.446937 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 17:52:07.446937 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 17:52:07.446937 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 17:52:07.446937 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 17:52:07.446937 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 17:52:07.446937 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 17:52:07.446937 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 15 17:52:07.446937 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 15 17:52:07.446937 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 15 17:52:07.447975 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 15 17:52:07.447975 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 17:52:07.447975 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 17:52:07.447975 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 17:52:07.447975 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 17:52:07.447975 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 17:52:07.447975 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 17:52:07.447975 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 17:52:07.447975 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application with Lock( Sep 15 17:52:07.447975 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 17:52:07.447975 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._enter() Sep 15 17:52:07.447975 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 17:52:07.447975 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 17:52:07.447975 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 17:52:07.447975 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.creator() Sep 15 17:52:07.447975 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 17:52:07.447975 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application created_value = creator( Sep 15 17:52:07.449261 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 15 17:52:07.449261 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 15 17:52:07.449261 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 15 17:52:07.449261 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 15 17:52:07.449261 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 15 17:52:07.449261 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 15 17:52:07.449261 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 15 17:52:07.449261 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Sep 15 17:52:07.449261 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 640/1258] 10.222.0.25 () {56 vars in 1111 bytes} [Thu Sep 15 17:52:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 17:52:07.453872 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff2835e-9320-4e61-b013-fe15dab61dde None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:52:07.552606 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff2835e-9320-4e61-b013-fe15dab61dde None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:52:07.586005 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f284337e-44bc-496f-928b-93a04636e3f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:52:07.586611 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f284337e-44bc-496f-928b-93a04636e3f8 None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:52:07.586904 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f284337e-44bc-496f-928b-93a04636e3f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:52:07.587174 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f284337e-44bc-496f-928b-93a04636e3f8 None admin] PATH_INFO: `/v3/projects` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:52:07.587896 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f284337e-44bc-496f-928b-93a04636e3f8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81592) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 17:52:07.588176 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f284337e-44bc-496f-928b-93a04636e3f8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:52:07.589727 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f284337e-44bc-496f-928b-93a04636e3f8 None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:52:07.609012 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 619/1259] 10.222.0.25 () {56 vars in 1148 bytes} [Thu Sep 15 17:52:07 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 17:52:07.610178 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500dce40-bb99-4f91-8e96-4c28b21f15f0 None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:52:07.637118 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:52:07.709766 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500dce40-bb99-4f91-8e96-4c28b21f15f0 None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:52:07.743616 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df9f5f2-333c-4b21-8bf5-486f1f405b79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:52:07.744213 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df9f5f2-333c-4b21-8bf5-486f1f405b79 None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:52:07.744489 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df9f5f2-333c-4b21-8bf5-486f1f405b79 None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:52:07.744759 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df9f5f2-333c-4b21-8bf5-486f1f405b79 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:52:07.745700 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df9f5f2-333c-4b21-8bf5-486f1f405b79 None admin] RBAC: Adding query filter params (role.id=a9e42be86923434f8af52d3fc07fb4f7, scope.project.id=1213c0d1b584404ba3998e136f166e89, user.id=10af119bd39841ed8163993676230fca) {{(pid=81593) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 17:52:07.746009 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df9f5f2-333c-4b21-8bf5-486f1f405b79 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:52:07.747445 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df9f5f2-333c-4b21-8bf5-486f1f405b79 None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:52:07.752769 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 641/1260] 10.222.0.25 () {56 vars in 1374 bytes} [Thu Sep 15 17:52:07 2022] GET /identity/v3/role_assignments?user.id=10af119bd39841ed8163993676230fca&scope.project.id=1213c0d1b584404ba3998e136f166e89&role.id=a9e42be86923434f8af52d3fc07fb4f7 => generated 259 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 17:52:09.913075 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce68d15a-7e59-431e-bdda-466835332de3 None None] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:52:09.913659 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce68d15a-7e59-431e-bdda-466835332de3 None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:52:09.913659 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce68d15a-7e59-431e-bdda-466835332de3 None None] PATH_INFO: `/` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:52:09.914994 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 620/1261] 10.222.0.25 () {54 vars in 927 bytes} [Thu Sep 15 17:52:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 17:52:09.920110 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807febee-2f69-4d6a-a56a-291550f89860 None None] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:52:09.920544 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807febee-2f69-4d6a-a56a-291550f89860 None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:52:09.920639 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807febee-2f69-4d6a-a56a-291550f89860 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:52:09.939281 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.auth.core [None req-807febee-2f69-4d6a-a56a-291550f89860 None None] MFA Rules not processed for user `5cfa58ef86774ab7800bf91930bf6028`. Rule list: `[]` (Enabled: `True`). {{(pid=81593) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 17:52:09.940454 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-807febee-2f69-4d6a-a56a-291550f89860 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 17:52:10.005684 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 642/1262] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Sep 15 17:52:09 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 15 17:52:10.277796 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce68d15a-7e59-431e-bdda-466835332de3 None None] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:52:10.289237 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:52:10.377949 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce68d15a-7e59-431e-bdda-466835332de3 None None] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:52:10.410748 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06923424-740c-42e6-9359-8b6531610467 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:52:10.411374 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06923424-740c-42e6-9359-8b6531610467 None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:52:10.411655 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06923424-740c-42e6-9359-8b6531610467 None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:52:10.411986 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06923424-740c-42e6-9359-8b6531610467 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:52:10.422024 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06923424-740c-42e6-9359-8b6531610467 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 17:52:10.428045 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application [None req-06923424-740c-42e6-9359-8b6531610467 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 15 17:52:10.428045 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 17:52:10.428045 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 17:52:10.428045 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 17:52:10.428045 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 17:52:10.428045 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 17:52:10.428045 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 17:52:10.428045 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 17:52:10.428045 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 17:52:10.428045 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 17:52:10.428045 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 17:52:10.428045 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 17:52:10.428045 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 17:52:10.428045 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 17:52:10.428045 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 17:52:10.428045 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 17:52:10.429136 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 17:52:10.429136 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 17:52:10.429136 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 17:52:10.429136 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 17:52:10.429136 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 17:52:10.429136 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 17:52:10.429136 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 17:52:10.429136 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 17:52:10.429136 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 17:52:10.429136 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 17:52:10.429136 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 17:52:10.429136 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application with Lock( Sep 15 17:52:10.429136 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 17:52:10.429136 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._enter() Sep 15 17:52:10.429136 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 17:52:10.429136 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 17:52:10.430063 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 17:52:10.430063 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.creator() Sep 15 17:52:10.430063 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 17:52:10.430063 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application created_value = creator( Sep 15 17:52:10.430063 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 17:52:10.430063 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 17:52:10.430063 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 17:52:10.430063 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 17:52:10.430063 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 17:52:10.430063 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 17:52:10.430063 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 15 17:52:10.430063 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Sep 15 17:52:10.430063 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 621/1263] 10.222.0.25 () {56 vars in 1096 bytes} [Thu Sep 15 17:52:10 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 17:52:10.435691 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807febee-2f69-4d6a-a56a-291550f89860 None None] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:52:10.454301 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:52:10.534482 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807febee-2f69-4d6a-a56a-291550f89860 None None] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:52:10.566731 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3bb70cd-0826-4c1a-bfef-baa8804faf4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:52:10.567331 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bb70cd-0826-4c1a-bfef-baa8804faf4a None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:52:10.567608 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bb70cd-0826-4c1a-bfef-baa8804faf4a None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:52:10.567879 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bb70cd-0826-4c1a-bfef-baa8804faf4a None admin] PATH_INFO: `/v3/roles` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:52:10.569079 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3bb70cd-0826-4c1a-bfef-baa8804faf4a None admin] RBAC: Adding query filter params (name=admin) {{(pid=81593) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 17:52:10.569405 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3bb70cd-0826-4c1a-bfef-baa8804faf4a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:52:10.570765 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3bb70cd-0826-4c1a-bfef-baa8804faf4a None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:52:10.578572 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 643/1264] 10.222.0.25 () {56 vars in 1099 bytes} [Thu Sep 15 17:52:10 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 17:52:10.585118 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06923424-740c-42e6-9359-8b6531610467 None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:52:10.658311 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:52:10.691938 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06923424-740c-42e6-9359-8b6531610467 None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:52:10.724991 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab41c03c-89cf-43eb-98c3-00130ccc506b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:52:10.725633 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab41c03c-89cf-43eb-98c3-00130ccc506b None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:52:10.726168 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab41c03c-89cf-43eb-98c3-00130ccc506b None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:52:10.726443 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab41c03c-89cf-43eb-98c3-00130ccc506b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:52:10.736164 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab41c03c-89cf-43eb-98c3-00130ccc506b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:52:10.737629 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab41c03c-89cf-43eb-98c3-00130ccc506b None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:52:10.752271 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application [None req-ab41c03c-89cf-43eb-98c3-00130ccc506b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 17:52:10.752271 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 17:52:10.752271 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 17:52:10.752271 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 17:52:10.752271 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 17:52:10.752271 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 17:52:10.752271 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 17:52:10.752271 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 17:52:10.752271 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 17:52:10.752271 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 17:52:10.752271 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 17:52:10.752271 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 17:52:10.752271 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 15 17:52:10.752271 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 15 17:52:10.752271 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 15 17:52:10.752271 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 15 17:52:10.753445 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 17:52:10.753445 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 17:52:10.753445 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 17:52:10.753445 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 17:52:10.753445 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 17:52:10.753445 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 17:52:10.753445 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 17:52:10.753445 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application with Lock( Sep 15 17:52:10.753445 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 17:52:10.753445 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._enter() Sep 15 17:52:10.753445 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 17:52:10.753445 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 17:52:10.753445 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 17:52:10.753445 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.creator() Sep 15 17:52:10.753445 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 17:52:10.753445 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application created_value = creator( Sep 15 17:52:10.753445 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 15 17:52:10.754562 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 15 17:52:10.754562 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 17:52:10.754562 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Sep 15 17:52:10.754562 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 622/1265] 10.222.0.25 () {56 vars in 1108 bytes} [Thu Sep 15 17:52:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 15 17:52:10.761585 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3bb70cd-0826-4c1a-bfef-baa8804faf4a None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:52:10.839747 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:52:10.859006 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3bb70cd-0826-4c1a-bfef-baa8804faf4a None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:52:10.891424 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630272cf-bde1-406c-9633-3a2161863717 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:52:10.892017 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630272cf-bde1-406c-9633-3a2161863717 None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:52:10.892289 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630272cf-bde1-406c-9633-3a2161863717 None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:52:10.892554 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630272cf-bde1-406c-9633-3a2161863717 None admin] PATH_INFO: `/v3/domains` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:52:10.893177 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-630272cf-bde1-406c-9633-3a2161863717 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81593) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 17:52:10.893502 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-630272cf-bde1-406c-9633-3a2161863717 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:52:10.894864 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-630272cf-bde1-406c-9633-3a2161863717 None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:52:10.906132 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 644/1266] 10.222.0.25 () {56 vars in 1109 bytes} [Thu Sep 15 17:52:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 17:52:10.912361 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab41c03c-89cf-43eb-98c3-00130ccc506b None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:52:11.010641 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab41c03c-89cf-43eb-98c3-00130ccc506b None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:52:11.030174 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:52:11.044698 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82baba3a-c01b-49bc-92e1-a2d50ac285ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:52:11.045346 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82baba3a-c01b-49bc-92e1-a2d50ac285ca None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:52:11.045635 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82baba3a-c01b-49bc-92e1-a2d50ac285ca None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:52:11.045911 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82baba3a-c01b-49bc-92e1-a2d50ac285ca None admin] PATH_INFO: `/v3/users/placement` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:52:11.053371 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82baba3a-c01b-49bc-92e1-a2d50ac285ca None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:52:11.054806 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82baba3a-c01b-49bc-92e1-a2d50ac285ca None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:52:11.066005 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application [None req-82baba3a-c01b-49bc-92e1-a2d50ac285ca None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 15 17:52:11.066005 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 17:52:11.066005 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 17:52:11.066005 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 17:52:11.066005 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 17:52:11.066005 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 17:52:11.066005 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 17:52:11.066005 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 17:52:11.066005 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 17:52:11.066005 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 17:52:11.066005 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 17:52:11.066005 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 17:52:11.066005 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 15 17:52:11.066005 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 15 17:52:11.066005 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 15 17:52:11.066005 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 15 17:52:11.071738 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 17:52:11.071738 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 17:52:11.071738 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 15 17:52:11.071738 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 15 17:52:11.071738 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 15 17:52:11.071738 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 15 17:52:11.071738 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 17:52:11.071738 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 17:52:11.071738 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 17:52:11.071738 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 17:52:11.071738 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 17:52:11.071738 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application with Lock( Sep 15 17:52:11.071738 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 17:52:11.071738 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._enter() Sep 15 17:52:11.071738 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 17:52:11.071738 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 17:52:11.071738 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 17:52:11.071738 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.creator() Sep 15 17:52:11.073560 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 17:52:11.073560 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application created_value = creator( Sep 15 17:52:11.073560 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 15 17:52:11.073560 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 15 17:52:11.073560 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 15 17:52:11.073560 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 15 17:52:11.073560 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 15 17:52:11.073560 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 15 17:52:11.073560 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 15 17:52:11.073560 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Sep 15 17:52:11.073560 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 623/1267] 10.222.0.25 () {56 vars in 1108 bytes} [Thu Sep 15 17:52:10 2022] GET /identity/v3/users/placement => generated 87 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 17:52:11.074189 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630272cf-bde1-406c-9633-3a2161863717 None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:52:11.170186 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630272cf-bde1-406c-9633-3a2161863717 None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:52:11.203247 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa26c446-cd7b-4dcb-abc1-abd19df5c2d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:52:11.203841 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa26c446-cd7b-4dcb-abc1-abd19df5c2d9 None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:52:11.204134 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa26c446-cd7b-4dcb-abc1-abd19df5c2d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:52:11.204374 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa26c446-cd7b-4dcb-abc1-abd19df5c2d9 None admin] PATH_INFO: `/v3/users` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:52:11.205078 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa26c446-cd7b-4dcb-abc1-abd19df5c2d9 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81593) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 17:52:11.205404 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa26c446-cd7b-4dcb-abc1-abd19df5c2d9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:52:11.206844 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa26c446-cd7b-4dcb-abc1-abd19df5c2d9 None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:52:11.215819 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:52:11.224129 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 645/1268] 10.222.0.25 () {56 vars in 1143 bytes} [Thu Sep 15 17:52:11 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 17:52:11.230924 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82baba3a-c01b-49bc-92e1-a2d50ac285ca None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:52:11.327189 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82baba3a-c01b-49bc-92e1-a2d50ac285ca None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:52:11.360220 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87b87e6-834c-40dd-8063-f69a812f25b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:52:11.360836 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87b87e6-834c-40dd-8063-f69a812f25b5 None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:52:11.361117 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87b87e6-834c-40dd-8063-f69a812f25b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:52:11.361420 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87b87e6-834c-40dd-8063-f69a812f25b5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:52:11.371659 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c87b87e6-834c-40dd-8063-f69a812f25b5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:52:11.373091 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c87b87e6-834c-40dd-8063-f69a812f25b5 None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:52:11.387273 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application [None req-c87b87e6-834c-40dd-8063-f69a812f25b5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 17:52:11.387273 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 17:52:11.387273 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 17:52:11.387273 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 17:52:11.387273 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 17:52:11.387273 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 17:52:11.387273 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 17:52:11.387273 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 17:52:11.387273 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 17:52:11.387273 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 17:52:11.387273 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 17:52:11.387273 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 17:52:11.387273 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 15 17:52:11.387273 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 15 17:52:11.387273 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 15 17:52:11.387273 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 15 17:52:11.388435 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 17:52:11.388435 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 17:52:11.388435 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 17:52:11.388435 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 17:52:11.388435 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 17:52:11.388435 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 17:52:11.388435 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 17:52:11.388435 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application with Lock( Sep 15 17:52:11.388435 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 17:52:11.388435 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._enter() Sep 15 17:52:11.388435 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 17:52:11.388435 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 17:52:11.388435 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 17:52:11.388435 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.creator() Sep 15 17:52:11.388435 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 17:52:11.388435 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application created_value = creator( Sep 15 17:52:11.388435 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 15 17:52:11.389557 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 15 17:52:11.389557 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 17:52:11.389557 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Sep 15 17:52:11.389557 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 624/1269] 10.222.0.25 () {56 vars in 1108 bytes} [Thu Sep 15 17:52:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 17:52:11.394065 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa26c446-cd7b-4dcb-abc1-abd19df5c2d9 None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:52:11.494137 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa26c446-cd7b-4dcb-abc1-abd19df5c2d9 None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:52:11.530135 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ccfa74d-c0ea-4b3a-8147-286d6e4ff9bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:52:11.530726 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccfa74d-c0ea-4b3a-8147-286d6e4ff9bd None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:52:11.530998 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccfa74d-c0ea-4b3a-8147-286d6e4ff9bd None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:52:11.531263 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccfa74d-c0ea-4b3a-8147-286d6e4ff9bd None admin] PATH_INFO: `/v3/domains` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:52:11.531894 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ccfa74d-c0ea-4b3a-8147-286d6e4ff9bd None admin] RBAC: Adding query filter params (name=Default) {{(pid=81593) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 17:52:11.532190 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ccfa74d-c0ea-4b3a-8147-286d6e4ff9bd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:52:11.533571 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ccfa74d-c0ea-4b3a-8147-286d6e4ff9bd None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:52:11.544435 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 646/1270] 10.222.0.25 () {56 vars in 1109 bytes} [Thu Sep 15 17:52:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 17:52:11.550122 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87b87e6-834c-40dd-8063-f69a812f25b5 None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:52:11.581705 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:52:11.653154 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87b87e6-834c-40dd-8063-f69a812f25b5 None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:52:11.685482 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11dad594-898d-4827-a741-7e318fe33bac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:52:11.686103 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11dad594-898d-4827-a741-7e318fe33bac None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:52:11.686384 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11dad594-898d-4827-a741-7e318fe33bac None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:52:11.686659 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11dad594-898d-4827-a741-7e318fe33bac None admin] PATH_INFO: `/v3/projects/service` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:52:11.693635 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11dad594-898d-4827-a741-7e318fe33bac None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:52:11.695079 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11dad594-898d-4827-a741-7e318fe33bac None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:52:11.706106 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application [None req-11dad594-898d-4827-a741-7e318fe33bac None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 15 17:52:11.706106 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 17:52:11.706106 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 17:52:11.706106 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 17:52:11.706106 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 17:52:11.706106 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 17:52:11.706106 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 17:52:11.706106 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 17:52:11.706106 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 17:52:11.706106 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 17:52:11.706106 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 17:52:11.706106 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 17:52:11.706106 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 15 17:52:11.706106 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 15 17:52:11.706106 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 15 17:52:11.707163 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 15 17:52:11.707163 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 17:52:11.707163 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 17:52:11.707163 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 17:52:11.707163 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 17:52:11.707163 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 17:52:11.707163 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 17:52:11.707163 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 17:52:11.707163 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application with Lock( Sep 15 17:52:11.707163 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 17:52:11.707163 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._enter() Sep 15 17:52:11.707163 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 17:52:11.707163 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 17:52:11.707163 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 17:52:11.707163 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.creator() Sep 15 17:52:11.707163 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 17:52:11.707163 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application created_value = creator( Sep 15 17:52:11.708122 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 15 17:52:11.708122 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 15 17:52:11.708122 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 15 17:52:11.708122 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 15 17:52:11.708122 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 15 17:52:11.708122 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 15 17:52:11.708122 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 15 17:52:11.708122 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Sep 15 17:52:11.708122 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 625/1271] 10.222.0.25 () {56 vars in 1111 bytes} [Thu Sep 15 17:52:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 17:52:11.713627 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ccfa74d-c0ea-4b3a-8147-286d6e4ff9bd None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:52:11.773945 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:52:11.816288 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ccfa74d-c0ea-4b3a-8147-286d6e4ff9bd None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:52:11.848822 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5c4855-947b-4e6f-a9e6-6c33b5a7fe5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:52:11.849448 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5c4855-947b-4e6f-a9e6-6c33b5a7fe5b None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:52:11.849722 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5c4855-947b-4e6f-a9e6-6c33b5a7fe5b None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:52:11.849987 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5c4855-947b-4e6f-a9e6-6c33b5a7fe5b None admin] PATH_INFO: `/v3/projects` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:52:11.850660 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff5c4855-947b-4e6f-a9e6-6c33b5a7fe5b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81593) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 17:52:11.851222 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff5c4855-947b-4e6f-a9e6-6c33b5a7fe5b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:52:11.852639 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff5c4855-947b-4e6f-a9e6-6c33b5a7fe5b None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:52:11.864048 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 647/1272] 10.222.0.25 () {56 vars in 1148 bytes} [Thu Sep 15 17:52:11 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 17:52:11.870569 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11dad594-898d-4827-a741-7e318fe33bac None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:52:11.960211 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:52:11.969002 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11dad594-898d-4827-a741-7e318fe33bac None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:52:12.002654 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df0d1bc-7d61-4a17-9d75-d83115545f75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:52:12.003297 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df0d1bc-7d61-4a17-9d75-d83115545f75 None admin] REQUEST_METHOD: `PUT` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:52:12.003574 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df0d1bc-7d61-4a17-9d75-d83115545f75 None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:52:12.003848 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df0d1bc-7d61-4a17-9d75-d83115545f75 None admin] PATH_INFO: `/v3/projects/1213c0d1b584404ba3998e136f166e89/users/10af119bd39841ed8163993676230fca/roles/a9e42be86923434f8af52d3fc07fb4f7` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:52:12.005785 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df0d1bc-7d61-4a17-9d75-d83115545f75 None admin] RBAC: Authorizing `identity:create_grant(project_id=1213c0d1b584404ba3998e136f166e89, user_id=10af119bd39841ed8163993676230fca, role_id=a9e42be86923434f8af52d3fc07fb4f7)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:52:12.007211 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df0d1bc-7d61-4a17-9d75-d83115545f75 None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:52:12.019975 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 626/1273] 10.222.0.25 () {58 vars in 1439 bytes} [Thu Sep 15 17:52:11 2022] PUT /identity/v3/projects/1213c0d1b584404ba3998e136f166e89/users/10af119bd39841ed8163993676230fca/roles/a9e42be86923434f8af52d3fc07fb4f7 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 17:52:14.194666 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aaf26fb-b6eb-44f2-922f-dc66127150a8 None None] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:52:14.195218 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aaf26fb-b6eb-44f2-922f-dc66127150a8 None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:52:14.195218 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aaf26fb-b6eb-44f2-922f-dc66127150a8 None None] PATH_INFO: `/` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:52:14.196446 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 648/1274] 10.222.0.25 () {54 vars in 927 bytes} [Thu Sep 15 17:52:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 17:52:14.201635 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506edb16-03ae-46cd-8a8a-ed2936b3558d None None] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:52:14.202050 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506edb16-03ae-46cd-8a8a-ed2936b3558d None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:52:14.202179 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506edb16-03ae-46cd-8a8a-ed2936b3558d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:52:14.220548 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.auth.core [None req-506edb16-03ae-46cd-8a8a-ed2936b3558d None None] MFA Rules not processed for user `5cfa58ef86774ab7800bf91930bf6028`. Rule list: `[]` (Enabled: `True`). {{(pid=81592) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 17:52:14.221749 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-506edb16-03ae-46cd-8a8a-ed2936b3558d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 17:52:14.285931 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 627/1275] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Sep 15 17:52:14 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 15 17:52:14.551929 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aaf26fb-b6eb-44f2-922f-dc66127150a8 None None] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:52:14.664421 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aaf26fb-b6eb-44f2-922f-dc66127150a8 None None] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:52:14.682262 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:52:14.699071 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee09680-0fe9-438e-adf9-e712ba4e603c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:52:14.699694 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee09680-0fe9-438e-adf9-e712ba4e603c None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:52:14.699972 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee09680-0fe9-438e-adf9-e712ba4e603c None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:52:14.700244 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee09680-0fe9-438e-adf9-e712ba4e603c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:52:14.710218 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee09680-0fe9-438e-adf9-e712ba4e603c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 17:52:14.715024 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application [None req-cee09680-0fe9-438e-adf9-e712ba4e603c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 15 17:52:14.715024 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 17:52:14.715024 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 17:52:14.715024 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 17:52:14.715024 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 17:52:14.715024 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 17:52:14.715024 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 17:52:14.715024 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 17:52:14.715024 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 17:52:14.715024 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 17:52:14.715024 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 17:52:14.715024 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 17:52:14.715024 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 17:52:14.715024 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 17:52:14.715024 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 17:52:14.715024 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 17:52:14.716220 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 17:52:14.716220 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 17:52:14.716220 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 17:52:14.716220 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 17:52:14.716220 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 17:52:14.716220 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 17:52:14.716220 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 17:52:14.716220 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 17:52:14.716220 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 17:52:14.716220 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 17:52:14.716220 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 17:52:14.716220 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application with Lock( Sep 15 17:52:14.716220 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 17:52:14.716220 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._enter() Sep 15 17:52:14.716220 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 17:52:14.716220 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 17:52:14.717712 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 17:52:14.717712 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.creator() Sep 15 17:52:14.717712 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 17:52:14.717712 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application created_value = creator( Sep 15 17:52:14.717712 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 17:52:14.717712 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 17:52:14.717712 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 17:52:14.717712 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 17:52:14.717712 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 17:52:14.717712 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 17:52:14.717712 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 15 17:52:14.717712 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Sep 15 17:52:14.717712 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 649/1276] 10.222.0.25 () {56 vars in 1096 bytes} [Thu Sep 15 17:52:14 2022] GET /identity/v3/roles/admin => generated 83 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 17:52:14.722086 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506edb16-03ae-46cd-8a8a-ed2936b3558d None None] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:52:14.807976 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:52:14.826147 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506edb16-03ae-46cd-8a8a-ed2936b3558d None None] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:52:14.859823 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844365e7-ad91-4cb0-8c2e-5e9bb6110559 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:52:14.860418 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844365e7-ad91-4cb0-8c2e-5e9bb6110559 None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:52:14.860697 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844365e7-ad91-4cb0-8c2e-5e9bb6110559 None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:52:14.860968 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844365e7-ad91-4cb0-8c2e-5e9bb6110559 None admin] PATH_INFO: `/v3/roles` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:52:14.861653 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-844365e7-ad91-4cb0-8c2e-5e9bb6110559 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81592) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 17:52:14.861956 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-844365e7-ad91-4cb0-8c2e-5e9bb6110559 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:52:14.863299 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-844365e7-ad91-4cb0-8c2e-5e9bb6110559 None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:52:14.871196 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 628/1277] 10.222.0.25 () {56 vars in 1099 bytes} [Thu Sep 15 17:52:14 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 17:52:14.877090 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee09680-0fe9-438e-adf9-e712ba4e603c None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:52:14.974010 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee09680-0fe9-438e-adf9-e712ba4e603c None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:52:15.006569 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aeb67fe-36b3-420b-8a20-b03055c26277 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:52:15.007181 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aeb67fe-36b3-420b-8a20-b03055c26277 None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:52:15.007452 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aeb67fe-36b3-420b-8a20-b03055c26277 None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:52:15.007716 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aeb67fe-36b3-420b-8a20-b03055c26277 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:52:15.017244 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aeb67fe-36b3-420b-8a20-b03055c26277 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:52:15.018707 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aeb67fe-36b3-420b-8a20-b03055c26277 None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:52:15.033750 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application [None req-4aeb67fe-36b3-420b-8a20-b03055c26277 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 17:52:15.033750 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 17:52:15.033750 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 17:52:15.033750 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 17:52:15.033750 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 17:52:15.033750 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 17:52:15.033750 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 17:52:15.033750 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 17:52:15.033750 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 17:52:15.033750 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 17:52:15.033750 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 17:52:15.033750 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 17:52:15.033750 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 15 17:52:15.033750 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 15 17:52:15.033750 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 15 17:52:15.033750 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 15 17:52:15.034915 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 17:52:15.034915 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 17:52:15.034915 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 17:52:15.034915 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 17:52:15.034915 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 17:52:15.034915 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 17:52:15.034915 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 17:52:15.034915 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application with Lock( Sep 15 17:52:15.034915 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 17:52:15.034915 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._enter() Sep 15 17:52:15.034915 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 17:52:15.034915 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 17:52:15.034915 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 17:52:15.034915 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.creator() Sep 15 17:52:15.034915 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 17:52:15.034915 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application created_value = creator( Sep 15 17:52:15.034915 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 15 17:52:15.035841 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 15 17:52:15.035841 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 17:52:15.035841 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Sep 15 17:52:15.035841 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 650/1278] 10.222.0.25 () {56 vars in 1108 bytes} [Thu Sep 15 17:52:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 17:52:15.040827 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844365e7-ad91-4cb0-8c2e-5e9bb6110559 None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:52:15.141847 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844365e7-ad91-4cb0-8c2e-5e9bb6110559 None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:52:15.173650 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23da187e-3c27-4526-a33e-0f1afee62cf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:52:15.174244 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23da187e-3c27-4526-a33e-0f1afee62cf2 None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:52:15.174521 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23da187e-3c27-4526-a33e-0f1afee62cf2 None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:52:15.174791 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23da187e-3c27-4526-a33e-0f1afee62cf2 None admin] PATH_INFO: `/v3/domains` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:52:15.175417 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23da187e-3c27-4526-a33e-0f1afee62cf2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81592) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 17:52:15.175716 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23da187e-3c27-4526-a33e-0f1afee62cf2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:52:15.177053 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23da187e-3c27-4526-a33e-0f1afee62cf2 None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:52:15.188305 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 629/1279] 10.222.0.25 () {56 vars in 1109 bytes} [Thu Sep 15 17:52:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 17:52:15.194617 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aeb67fe-36b3-420b-8a20-b03055c26277 None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:52:15.225272 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:52:15.292609 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aeb67fe-36b3-420b-8a20-b03055c26277 None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:52:15.325560 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46cfc2db-e4ad-4f6f-abd3-7d1dbc03b441 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:52:15.326179 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cfc2db-e4ad-4f6f-abd3-7d1dbc03b441 None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:52:15.326458 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cfc2db-e4ad-4f6f-abd3-7d1dbc03b441 None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:52:15.326731 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cfc2db-e4ad-4f6f-abd3-7d1dbc03b441 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:52:15.334568 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46cfc2db-e4ad-4f6f-abd3-7d1dbc03b441 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:52:15.336025 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46cfc2db-e4ad-4f6f-abd3-7d1dbc03b441 None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:52:15.346798 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application [None req-46cfc2db-e4ad-4f6f-abd3-7d1dbc03b441 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 15 17:52:15.346798 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 17:52:15.346798 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 17:52:15.346798 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 17:52:15.346798 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 17:52:15.346798 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 17:52:15.346798 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 17:52:15.346798 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 17:52:15.346798 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 17:52:15.346798 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 17:52:15.346798 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 17:52:15.346798 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 17:52:15.346798 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 15 17:52:15.346798 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 15 17:52:15.346798 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 15 17:52:15.346798 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 15 17:52:15.347910 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 17:52:15.347910 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 17:52:15.347910 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 15 17:52:15.347910 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 15 17:52:15.347910 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 15 17:52:15.347910 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 15 17:52:15.347910 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 17:52:15.347910 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 17:52:15.347910 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 17:52:15.347910 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 17:52:15.347910 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 17:52:15.347910 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application with Lock( Sep 15 17:52:15.347910 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 17:52:15.347910 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._enter() Sep 15 17:52:15.347910 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 17:52:15.347910 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 17:52:15.347910 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 17:52:15.347910 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.creator() Sep 15 17:52:15.349110 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 17:52:15.349110 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application created_value = creator( Sep 15 17:52:15.349110 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 15 17:52:15.349110 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 15 17:52:15.349110 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 15 17:52:15.349110 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 15 17:52:15.349110 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 15 17:52:15.349110 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 15 17:52:15.349110 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 15 17:52:15.349110 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Sep 15 17:52:15.349110 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 651/1280] 10.222.0.25 () {56 vars in 1108 bytes} [Thu Sep 15 17:52:15 2022] GET /identity/v3/users/placement => generated 87 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 17:52:15.354125 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23da187e-3c27-4526-a33e-0f1afee62cf2 None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:52:15.357934 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:52:15.450439 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23da187e-3c27-4526-a33e-0f1afee62cf2 None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:52:15.483901 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729ea5cf-23dc-4f25-807f-c1086f9e6656 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:52:15.484492 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729ea5cf-23dc-4f25-807f-c1086f9e6656 None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:52:15.484821 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729ea5cf-23dc-4f25-807f-c1086f9e6656 None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:52:15.485091 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729ea5cf-23dc-4f25-807f-c1086f9e6656 None admin] PATH_INFO: `/v3/users` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:52:15.485835 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-729ea5cf-23dc-4f25-807f-c1086f9e6656 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81592) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 17:52:15.486134 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-729ea5cf-23dc-4f25-807f-c1086f9e6656 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:52:15.487536 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-729ea5cf-23dc-4f25-807f-c1086f9e6656 None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:52:15.503877 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 630/1281] 10.222.0.25 () {56 vars in 1143 bytes} [Thu Sep 15 17:52:15 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 17:52:15.510194 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46cfc2db-e4ad-4f6f-abd3-7d1dbc03b441 None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:52:15.599932 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:52:15.609697 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46cfc2db-e4ad-4f6f-abd3-7d1dbc03b441 None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:52:15.642981 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5c5397-0991-42d4-a045-aa76841b8329 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:52:15.643579 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5c5397-0991-42d4-a045-aa76841b8329 None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:52:15.643857 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5c5397-0991-42d4-a045-aa76841b8329 None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:52:15.644128 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5c5397-0991-42d4-a045-aa76841b8329 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:52:15.708510 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c5c5397-0991-42d4-a045-aa76841b8329 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:52:15.709926 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c5c5397-0991-42d4-a045-aa76841b8329 None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:52:15.793893 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:52:15.805187 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 652/1282] 10.222.0.25 () {58 vars in 1282 bytes} [Thu Sep 15 17:52:15 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 15 17:52:15.811009 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729ea5cf-23dc-4f25-807f-c1086f9e6656 None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:52:15.871342 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:52:15.908824 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729ea5cf-23dc-4f25-807f-c1086f9e6656 None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:52:15.942331 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11756a1e-082e-4044-9d1a-55e702eeeb44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:52:15.943473 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11756a1e-082e-4044-9d1a-55e702eeeb44 None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:52:15.943754 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11756a1e-082e-4044-9d1a-55e702eeeb44 None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:52:15.944025 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11756a1e-082e-4044-9d1a-55e702eeeb44 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:52:15.953785 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11756a1e-082e-4044-9d1a-55e702eeeb44 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:52:15.955223 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11756a1e-082e-4044-9d1a-55e702eeeb44 None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:52:15.969721 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application [None req-11756a1e-082e-4044-9d1a-55e702eeeb44 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 17:52:15.969721 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 17:52:15.969721 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 17:52:15.969721 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 17:52:15.969721 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 17:52:15.969721 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 17:52:15.969721 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 17:52:15.969721 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 17:52:15.969721 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 17:52:15.969721 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 17:52:15.969721 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 17:52:15.969721 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 17:52:15.969721 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 15 17:52:15.969721 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 15 17:52:15.969721 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 15 17:52:15.969721 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 15 17:52:15.970867 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 17:52:15.970867 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 17:52:15.970867 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 17:52:15.970867 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 17:52:15.970867 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 17:52:15.970867 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 17:52:15.970867 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 17:52:15.970867 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application with Lock( Sep 15 17:52:15.970867 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 17:52:15.970867 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._enter() Sep 15 17:52:15.970867 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 17:52:15.970867 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 17:52:15.970867 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 17:52:15.970867 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.creator() Sep 15 17:52:15.970867 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 17:52:15.970867 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application created_value = creator( Sep 15 17:52:15.970867 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 15 17:52:15.971783 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 15 17:52:15.971783 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 17:52:15.971783 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Sep 15 17:52:15.971783 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 631/1283] 10.222.0.25 () {56 vars in 1108 bytes} [Thu Sep 15 17:52:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 17:52:15.977388 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5c5397-0991-42d4-a045-aa76841b8329 None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:52:16.072760 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5c5397-0991-42d4-a045-aa76841b8329 None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:52:16.106281 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46b2609-54b7-485d-a99b-3e59a9972297 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:52:16.106883 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46b2609-54b7-485d-a99b-3e59a9972297 None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:52:16.107158 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46b2609-54b7-485d-a99b-3e59a9972297 None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:52:16.107423 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46b2609-54b7-485d-a99b-3e59a9972297 None admin] PATH_INFO: `/v3/domains` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:52:16.108058 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a46b2609-54b7-485d-a99b-3e59a9972297 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81593) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 17:52:16.108353 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a46b2609-54b7-485d-a99b-3e59a9972297 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:52:16.109766 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a46b2609-54b7-485d-a99b-3e59a9972297 None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:52:16.124333 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 653/1284] 10.222.0.25 () {56 vars in 1109 bytes} [Thu Sep 15 17:52:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 17:52:16.128973 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11756a1e-082e-4044-9d1a-55e702eeeb44 None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:52:16.226103 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11756a1e-082e-4044-9d1a-55e702eeeb44 None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:52:16.238862 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:52:16.258674 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e60ab64-3461-4367-8fe6-7409d60da3bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:52:16.259286 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e60ab64-3461-4367-8fe6-7409d60da3bb None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:52:16.259563 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e60ab64-3461-4367-8fe6-7409d60da3bb None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:52:16.259836 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e60ab64-3461-4367-8fe6-7409d60da3bb None admin] PATH_INFO: `/v3/projects/service` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:52:16.266217 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e60ab64-3461-4367-8fe6-7409d60da3bb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:52:16.267631 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e60ab64-3461-4367-8fe6-7409d60da3bb None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:52:16.278926 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application [None req-7e60ab64-3461-4367-8fe6-7409d60da3bb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 15 17:52:16.278926 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 17:52:16.278926 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 17:52:16.278926 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 17:52:16.278926 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 17:52:16.278926 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 17:52:16.278926 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 17:52:16.278926 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 17:52:16.278926 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 17:52:16.278926 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 17:52:16.278926 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 17:52:16.278926 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 17:52:16.278926 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 15 17:52:16.278926 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 15 17:52:16.278926 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 15 17:52:16.279992 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 15 17:52:16.279992 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 17:52:16.279992 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 17:52:16.279992 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 17:52:16.279992 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 17:52:16.279992 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 17:52:16.279992 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 17:52:16.279992 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 17:52:16.279992 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application with Lock( Sep 15 17:52:16.279992 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 17:52:16.279992 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._enter() Sep 15 17:52:16.279992 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 17:52:16.279992 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 17:52:16.279992 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 17:52:16.279992 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.creator() Sep 15 17:52:16.279992 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 17:52:16.279992 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application created_value = creator( Sep 15 17:52:16.281054 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 15 17:52:16.281054 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 15 17:52:16.281054 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 15 17:52:16.281054 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 15 17:52:16.281054 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 15 17:52:16.281054 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 15 17:52:16.281054 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 15 17:52:16.281054 dv-cinder-835384-27-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Sep 15 17:52:16.281054 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 632/1285] 10.222.0.25 () {56 vars in 1111 bytes} [Thu Sep 15 17:52:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 17:52:16.285924 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46b2609-54b7-485d-a99b-3e59a9972297 None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:52:16.334831 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:52:16.385512 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46b2609-54b7-485d-a99b-3e59a9972297 None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:52:16.418428 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6b295b-8fdd-4310-bf8e-34f0a4f88577 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:52:16.419017 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6b295b-8fdd-4310-bf8e-34f0a4f88577 None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:52:16.419290 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6b295b-8fdd-4310-bf8e-34f0a4f88577 None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:52:16.419553 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6b295b-8fdd-4310-bf8e-34f0a4f88577 None admin] PATH_INFO: `/v3/projects` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:52:16.420226 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6b295b-8fdd-4310-bf8e-34f0a4f88577 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81593) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 17:52:16.420521 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6b295b-8fdd-4310-bf8e-34f0a4f88577 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:52:16.421979 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6b295b-8fdd-4310-bf8e-34f0a4f88577 None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:52:16.433491 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 654/1286] 10.222.0.25 () {56 vars in 1148 bytes} [Thu Sep 15 17:52:16 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 17:52:16.439661 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e60ab64-3461-4367-8fe6-7409d60da3bb None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:52:16.538526 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e60ab64-3461-4367-8fe6-7409d60da3bb None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:52:16.570466 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a2c710-2b91-4c53-ad74-f7d50fe1cf1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:52:16.571062 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a2c710-2b91-4c53-ad74-f7d50fe1cf1b None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:52:16.571342 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a2c710-2b91-4c53-ad74-f7d50fe1cf1b None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:52:16.571620 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a2c710-2b91-4c53-ad74-f7d50fe1cf1b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:52:16.572331 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a2c710-2b91-4c53-ad74-f7d50fe1cf1b None admin] RBAC: Adding query filter params (role.id=a9e42be86923434f8af52d3fc07fb4f7, scope.project.id=1213c0d1b584404ba3998e136f166e89, user.id=10af119bd39841ed8163993676230fca) {{(pid=81592) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 17:52:16.572645 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a2c710-2b91-4c53-ad74-f7d50fe1cf1b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:52:16.574080 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a2c710-2b91-4c53-ad74-f7d50fe1cf1b None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:52:16.579907 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 633/1287] 10.222.0.25 () {56 vars in 1374 bytes} [Thu Sep 15 17:52:16 2022] GET /identity/v3/role_assignments?user.id=10af119bd39841ed8163993676230fca&scope.project.id=1213c0d1b584404ba3998e136f166e89&role.id=a9e42be86923434f8af52d3fc07fb4f7 => generated 608 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 17:52:18.755798 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748ac520-5fa5-4db6-a49d-d25149ecc36c None None] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:52:18.756329 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748ac520-5fa5-4db6-a49d-d25149ecc36c None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:52:18.756329 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748ac520-5fa5-4db6-a49d-d25149ecc36c None None] PATH_INFO: `/` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:52:18.758321 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 655/1288] 10.222.0.25 () {54 vars in 927 bytes} [Thu Sep 15 17:52:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 17:52:18.763569 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a003d181-0024-48ea-a0f4-a78f74cf7438 None None] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:52:18.764001 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a003d181-0024-48ea-a0f4-a78f74cf7438 None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:52:18.764102 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a003d181-0024-48ea-a0f4-a78f74cf7438 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:52:18.781888 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.auth.core [None req-a003d181-0024-48ea-a0f4-a78f74cf7438 None None] MFA Rules not processed for user `5cfa58ef86774ab7800bf91930bf6028`. Rule list: `[]` (Enabled: `True`). {{(pid=81592) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 17:52:18.783062 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-a003d181-0024-48ea-a0f4-a78f74cf7438 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 17:52:18.811557 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:52:18.848296 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 634/1289] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Sep 15 17:52:18 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 15 17:52:19.119437 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748ac520-5fa5-4db6-a49d-d25149ecc36c None None] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:52:19.218307 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748ac520-5fa5-4db6-a49d-d25149ecc36c None None] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:52:19.228963 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:52:19.251682 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d93dbb-d2bc-4a7a-8472-9fb82279d4d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:52:19.252296 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d93dbb-d2bc-4a7a-8472-9fb82279d4d5 None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:52:19.252569 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d93dbb-d2bc-4a7a-8472-9fb82279d4d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:52:19.252837 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d93dbb-d2bc-4a7a-8472-9fb82279d4d5 None admin] PATH_INFO: `/v3/services/placement` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:52:19.253438 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d93dbb-d2bc-4a7a-8472-9fb82279d4d5 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:52:19.254791 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d93dbb-d2bc-4a7a-8472-9fb82279d4d5 None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:52:19.263824 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application [None req-60d93dbb-d2bc-4a7a-8472-9fb82279d4d5 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Sep 15 17:52:19.263824 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 17:52:19.263824 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 15 17:52:19.263824 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 15 17:52:19.263824 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 15 17:52:19.263824 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 15 17:52:19.263824 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 15 17:52:19.263824 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 15 17:52:19.263824 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 15 17:52:19.263824 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Sep 15 17:52:19.263824 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 15 17:52:19.263824 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Sep 15 17:52:19.263824 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 17:52:19.263824 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 17:52:19.263824 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 17:52:19.263824 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 17:52:19.263824 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 17:52:19.265035 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 17:52:19.265035 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 17:52:19.265035 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 17:52:19.265035 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 17:52:19.265035 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 17:52:19.265035 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 17:52:19.265035 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 15 17:52:19.265035 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 15 17:52:19.265035 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 15 17:52:19.265035 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 15 17:52:19.265035 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 17:52:19.265035 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 17:52:19.265035 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 17:52:19.265035 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 17:52:19.265035 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 17:52:19.265035 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 17:52:19.266130 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 17:52:19.266130 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application with Lock( Sep 15 17:52:19.266130 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 17:52:19.266130 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._enter() Sep 15 17:52:19.266130 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 17:52:19.266130 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 17:52:19.266130 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 17:52:19.266130 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.creator() Sep 15 17:52:19.266130 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 17:52:19.266130 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application created_value = creator( Sep 15 17:52:19.266130 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 15 17:52:19.266130 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 15 17:52:19.266130 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 15 17:52:19.266130 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Sep 15 17:52:19.266130 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 656/1290] 10.222.0.25 () {56 vars in 1117 bytes} [Thu Sep 15 17:52:19 2022] GET /identity/v3/services/placement => generated 90 bytes in 146 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 17:52:19.271497 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a003d181-0024-48ea-a0f4-a78f74cf7438 None None] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:52:19.366954 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a003d181-0024-48ea-a0f4-a78f74cf7438 None None] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:52:19.399735 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d495f34f-949a-42f5-97b0-b579d9e36f14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:52:19.400271 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d495f34f-949a-42f5-97b0-b579d9e36f14 None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:52:19.400547 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d495f34f-949a-42f5-97b0-b579d9e36f14 None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:52:19.400816 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d495f34f-949a-42f5-97b0-b579d9e36f14 None admin] PATH_INFO: `/v3/services` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:52:19.401470 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d495f34f-949a-42f5-97b0-b579d9e36f14 None admin] RBAC: Adding query filter params (name=placement) {{(pid=81592) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 17:52:19.401776 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d495f34f-949a-42f5-97b0-b579d9e36f14 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:52:19.403129 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d495f34f-949a-42f5-97b0-b579d9e36f14 None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:52:19.407784 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 635/1291] 10.222.0.25 () {56 vars in 1116 bytes} [Thu Sep 15 17:52:19 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 17:52:19.413640 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d93dbb-d2bc-4a7a-8472-9fb82279d4d5 None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:52:19.511710 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d93dbb-d2bc-4a7a-8472-9fb82279d4d5 None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:52:19.546113 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1839168d-1fcb-44cf-baad-fccab5c3f47e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:52:19.546729 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1839168d-1fcb-44cf-baad-fccab5c3f47e None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:52:19.547026 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1839168d-1fcb-44cf-baad-fccab5c3f47e None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:52:19.547283 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1839168d-1fcb-44cf-baad-fccab5c3f47e None admin] PATH_INFO: `/v3/services` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:52:19.547911 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1839168d-1fcb-44cf-baad-fccab5c3f47e None admin] RBAC: Adding query filter params (type=placement) {{(pid=81593) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 17:52:19.548215 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1839168d-1fcb-44cf-baad-fccab5c3f47e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:52:19.549611 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1839168d-1fcb-44cf-baad-fccab5c3f47e None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:52:19.554594 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 657/1292] 10.222.0.25 () {56 vars in 1116 bytes} [Thu Sep 15 17:52:19 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 17:52:21.670547 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81544104-10f6-4e51-9999-8e925d8fb140 None None] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:52:21.671141 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81544104-10f6-4e51-9999-8e925d8fb140 None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:52:21.671141 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81544104-10f6-4e51-9999-8e925d8fb140 None None] PATH_INFO: `/` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:52:21.672411 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 636/1293] 10.222.0.25 () {54 vars in 927 bytes} [Thu Sep 15 17:52:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 17:52:21.678345 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c123f2d-0f21-420b-819e-d464695a608c None None] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:52:21.678840 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c123f2d-0f21-420b-819e-d464695a608c None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:52:21.678840 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c123f2d-0f21-420b-819e-d464695a608c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:52:21.697502 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.auth.core [None req-9c123f2d-0f21-420b-819e-d464695a608c None None] MFA Rules not processed for user `5cfa58ef86774ab7800bf91930bf6028`. Rule list: `[]` (Enabled: `True`). {{(pid=81593) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 17:52:21.698720 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-9c123f2d-0f21-420b-819e-d464695a608c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 17:52:21.727508 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:52:21.765180 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 658/1294] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Sep 15 17:52:21 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 15 17:52:22.031531 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81544104-10f6-4e51-9999-8e925d8fb140 None None] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:52:22.062898 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:52:22.133178 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81544104-10f6-4e51-9999-8e925d8fb140 None None] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:52:22.165957 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aec7ed4-de3e-42c3-8596-b92d2e30b073 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:52:22.166552 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aec7ed4-de3e-42c3-8596-b92d2e30b073 None admin] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:52:22.166821 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aec7ed4-de3e-42c3-8596-b92d2e30b073 None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:52:22.167088 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aec7ed4-de3e-42c3-8596-b92d2e30b073 None admin] PATH_INFO: `/v3/services` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:52:22.167727 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aec7ed4-de3e-42c3-8596-b92d2e30b073 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:52:22.169074 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aec7ed4-de3e-42c3-8596-b92d2e30b073 None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:52:22.186489 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 637/1295] 10.222.0.25 () {60 vars in 1141 bytes} [Thu Sep 15 17:52:22 2022] POST /identity/v3/services => generated 246 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 17:52:24.353512 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a6d1e2-10b4-43fa-9bf3-7b08f7dc1510 None None] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:52:24.354070 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a6d1e2-10b4-43fa-9bf3-7b08f7dc1510 None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:52:24.354070 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a6d1e2-10b4-43fa-9bf3-7b08f7dc1510 None None] PATH_INFO: `/` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:52:24.355381 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 659/1296] 10.222.0.25 () {54 vars in 927 bytes} [Thu Sep 15 17:52:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 17:52:24.360426 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5912adf-f48e-464a-a8aa-6a0217a8b36f None None] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:52:24.360794 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5912adf-f48e-464a-a8aa-6a0217a8b36f None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:52:24.360981 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5912adf-f48e-464a-a8aa-6a0217a8b36f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:52:24.379433 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.auth.core [None req-a5912adf-f48e-464a-a8aa-6a0217a8b36f None None] MFA Rules not processed for user `5cfa58ef86774ab7800bf91930bf6028`. Rule list: `[]` (Enabled: `True`). {{(pid=81592) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 17:52:24.380676 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-a5912adf-f48e-464a-a8aa-6a0217a8b36f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 17:52:24.450464 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 638/1297] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Sep 15 17:52:24 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 15 17:52:24.722507 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a6d1e2-10b4-43fa-9bf3-7b08f7dc1510 None None] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:52:24.821192 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a6d1e2-10b4-43fa-9bf3-7b08f7dc1510 None None] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:52:24.853507 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1286a178-5170-4281-b228-4decdddf0421 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:52:24.854122 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1286a178-5170-4281-b228-4decdddf0421 None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:52:24.854400 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1286a178-5170-4281-b228-4decdddf0421 None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:52:24.854671 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1286a178-5170-4281-b228-4decdddf0421 None admin] PATH_INFO: `/v3/services/placement` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:52:24.855247 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1286a178-5170-4281-b228-4decdddf0421 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:52:24.856610 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1286a178-5170-4281-b228-4decdddf0421 None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:52:24.865691 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application [None req-1286a178-5170-4281-b228-4decdddf0421 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Sep 15 17:52:24.865691 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 17:52:24.865691 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 15 17:52:24.865691 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 15 17:52:24.865691 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 15 17:52:24.865691 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 15 17:52:24.865691 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 15 17:52:24.865691 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 15 17:52:24.865691 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 15 17:52:24.865691 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Sep 15 17:52:24.865691 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 15 17:52:24.865691 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Sep 15 17:52:24.865691 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 17:52:24.865691 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 17:52:24.865691 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 17:52:24.865691 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 17:52:24.865691 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 17:52:24.867038 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 17:52:24.867038 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 17:52:24.867038 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 17:52:24.867038 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 17:52:24.867038 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 17:52:24.867038 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 17:52:24.867038 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 15 17:52:24.867038 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 15 17:52:24.867038 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 15 17:52:24.867038 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 15 17:52:24.867038 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 17:52:24.867038 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 17:52:24.867038 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 17:52:24.867038 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 17:52:24.867038 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 17:52:24.867038 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 17:52:24.868318 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 17:52:24.868318 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application with Lock( Sep 15 17:52:24.868318 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 17:52:24.868318 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._enter() Sep 15 17:52:24.868318 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 17:52:24.868318 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 17:52:24.868318 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 17:52:24.868318 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.creator() Sep 15 17:52:24.868318 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 17:52:24.868318 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application created_value = creator( Sep 15 17:52:24.868318 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 15 17:52:24.868318 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 15 17:52:24.868318 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 15 17:52:24.868318 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Sep 15 17:52:24.868318 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 660/1298] 10.222.0.25 () {56 vars in 1117 bytes} [Thu Sep 15 17:52:24 2022] GET /identity/v3/services/placement => generated 90 bytes in 145 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 17:52:24.872666 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5912adf-f48e-464a-a8aa-6a0217a8b36f None None] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:52:24.891033 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:52:24.971306 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5912adf-f48e-464a-a8aa-6a0217a8b36f None None] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:52:25.005204 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d891b0f-b0ee-48f2-ac0c-89c9502ccec7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:52:25.005836 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d891b0f-b0ee-48f2-ac0c-89c9502ccec7 None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:52:25.006118 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d891b0f-b0ee-48f2-ac0c-89c9502ccec7 None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:52:25.006395 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d891b0f-b0ee-48f2-ac0c-89c9502ccec7 None admin] PATH_INFO: `/v3/services` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:52:25.007025 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d891b0f-b0ee-48f2-ac0c-89c9502ccec7 None admin] RBAC: Adding query filter params (name=placement) {{(pid=81592) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 17:52:25.007332 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d891b0f-b0ee-48f2-ac0c-89c9502ccec7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:52:25.008684 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d891b0f-b0ee-48f2-ac0c-89c9502ccec7 None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:52:25.013654 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 639/1299] 10.222.0.25 () {56 vars in 1116 bytes} [Thu Sep 15 17:52:24 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 17:52:25.019931 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1286a178-5170-4281-b228-4decdddf0421 None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:52:25.053209 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:52:25.127804 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1286a178-5170-4281-b228-4decdddf0421 None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:52:25.163697 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6373d75-4152-47d6-9ec3-3201c75f972d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:52:25.164354 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6373d75-4152-47d6-9ec3-3201c75f972d None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:52:25.164657 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6373d75-4152-47d6-9ec3-3201c75f972d None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:52:25.164951 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6373d75-4152-47d6-9ec3-3201c75f972d None admin] PATH_INFO: `/v3/endpoints` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:52:25.165736 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6373d75-4152-47d6-9ec3-3201c75f972d None admin] RBAC: Adding query filter params (interface=public, service_id=fd46e3f5613c4eef809533ec767e8425, region_id=RegionOne) {{(pid=81593) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 17:52:25.166065 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6373d75-4152-47d6-9ec3-3201c75f972d None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:52:25.167584 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6373d75-4152-47d6-9ec3-3201c75f972d None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:52:25.172950 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 661/1300] 10.222.0.25 () {56 vars in 1251 bytes} [Thu Sep 15 17:52:25 2022] GET /identity/v3/endpoints?service_id=fd46e3f5613c4eef809533ec767e8425&interface=public®ion_id=RegionOne => generated 194 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 17:52:25.179514 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d891b0f-b0ee-48f2-ac0c-89c9502ccec7 None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:52:25.260041 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:52:25.281319 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d891b0f-b0ee-48f2-ac0c-89c9502ccec7 None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:52:25.316376 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f6c86a-55f6-4d37-9c87-daab1f03f498 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:52:25.317007 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f6c86a-55f6-4d37-9c87-daab1f03f498 None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:52:25.317327 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f6c86a-55f6-4d37-9c87-daab1f03f498 None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:52:25.317644 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f6c86a-55f6-4d37-9c87-daab1f03f498 None admin] PATH_INFO: `/v3/services` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:52:25.318297 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f6c86a-55f6-4d37-9c87-daab1f03f498 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:52:25.319767 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f6c86a-55f6-4d37-9c87-daab1f03f498 None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:52:25.327076 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 640/1301] 10.222.0.25 () {56 vars in 1087 bytes} [Thu Sep 15 17:52:25 2022] GET /identity/v3/services => generated 2191 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 17:52:27.511017 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ff4389-ad77-42c9-8fcc-8d57649f8f26 None None] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:52:27.511566 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ff4389-ad77-42c9-8fcc-8d57649f8f26 None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:52:27.511566 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ff4389-ad77-42c9-8fcc-8d57649f8f26 None None] PATH_INFO: `/` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:52:27.512884 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 662/1302] 10.222.0.25 () {54 vars in 927 bytes} [Thu Sep 15 17:52:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 17:52:27.518116 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48011e13-9b5d-42de-97b5-f002c24ed2ff None None] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:52:27.518508 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48011e13-9b5d-42de-97b5-f002c24ed2ff None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:52:27.518664 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48011e13-9b5d-42de-97b5-f002c24ed2ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:52:27.537339 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.auth.core [None req-48011e13-9b5d-42de-97b5-f002c24ed2ff None None] MFA Rules not processed for user `5cfa58ef86774ab7800bf91930bf6028`. Rule list: `[]` (Enabled: `True`). {{(pid=81592) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 17:52:27.538510 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-48011e13-9b5d-42de-97b5-f002c24ed2ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 17:52:27.601024 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 641/1303] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Sep 15 17:52:27 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 15 17:52:27.876663 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ff4389-ad77-42c9-8fcc-8d57649f8f26 None None] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:52:27.970874 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:52:27.978257 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ff4389-ad77-42c9-8fcc-8d57649f8f26 None None] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:52:28.010715 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d0db62-8d9a-4494-bdb3-3ccd96c9e804 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:52:28.011330 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d0db62-8d9a-4494-bdb3-3ccd96c9e804 None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:52:28.011609 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d0db62-8d9a-4494-bdb3-3ccd96c9e804 None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:52:28.011882 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d0db62-8d9a-4494-bdb3-3ccd96c9e804 None admin] PATH_INFO: `/v3/services/placement` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:52:28.012456 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d0db62-8d9a-4494-bdb3-3ccd96c9e804 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:52:28.013849 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d0db62-8d9a-4494-bdb3-3ccd96c9e804 None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:52:28.023115 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application [None req-c3d0db62-8d9a-4494-bdb3-3ccd96c9e804 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Sep 15 17:52:28.023115 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 17:52:28.023115 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 15 17:52:28.023115 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 15 17:52:28.023115 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 15 17:52:28.023115 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 15 17:52:28.023115 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 15 17:52:28.023115 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 15 17:52:28.023115 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 15 17:52:28.023115 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Sep 15 17:52:28.023115 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 15 17:52:28.023115 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Sep 15 17:52:28.023115 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 17:52:28.023115 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 17:52:28.023115 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 17:52:28.023115 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 17:52:28.023115 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 17:52:28.024360 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 17:52:28.024360 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 17:52:28.024360 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 17:52:28.024360 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 17:52:28.024360 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 17:52:28.024360 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 17:52:28.024360 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 15 17:52:28.024360 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 15 17:52:28.024360 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 15 17:52:28.024360 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 15 17:52:28.024360 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 17:52:28.024360 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 17:52:28.024360 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 17:52:28.024360 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 17:52:28.024360 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 17:52:28.024360 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 17:52:28.025227 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 17:52:28.025227 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application with Lock( Sep 15 17:52:28.025227 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 17:52:28.025227 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._enter() Sep 15 17:52:28.025227 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 17:52:28.025227 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 17:52:28.025227 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 17:52:28.025227 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.creator() Sep 15 17:52:28.025227 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 17:52:28.025227 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application created_value = creator( Sep 15 17:52:28.025227 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 15 17:52:28.025227 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 15 17:52:28.025227 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 15 17:52:28.025227 dv-cinder-835384-27-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Sep 15 17:52:28.025227 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 663/1304] 10.222.0.25 () {56 vars in 1117 bytes} [Thu Sep 15 17:52:27 2022] GET /identity/v3/services/placement => generated 90 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 17:52:28.030297 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48011e13-9b5d-42de-97b5-f002c24ed2ff None None] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:52:28.102844 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:52:28.127249 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48011e13-9b5d-42de-97b5-f002c24ed2ff None None] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:52:28.160289 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ab7951-950e-49d5-9731-9d3db3965a1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:52:28.160900 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ab7951-950e-49d5-9731-9d3db3965a1d None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:52:28.161177 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ab7951-950e-49d5-9731-9d3db3965a1d None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:52:28.161475 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ab7951-950e-49d5-9731-9d3db3965a1d None admin] PATH_INFO: `/v3/services` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:52:28.162098 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ab7951-950e-49d5-9731-9d3db3965a1d None admin] RBAC: Adding query filter params (name=placement) {{(pid=81592) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 17:52:28.162395 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ab7951-950e-49d5-9731-9d3db3965a1d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:52:28.163737 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ab7951-950e-49d5-9731-9d3db3965a1d None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:52:28.168632 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 642/1305] 10.222.0.25 () {56 vars in 1116 bytes} [Thu Sep 15 17:52:28 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 17:52:28.174333 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d0db62-8d9a-4494-bdb3-3ccd96c9e804 None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:52:28.271943 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d0db62-8d9a-4494-bdb3-3ccd96c9e804 None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:52:28.304362 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c86caf-cc50-4287-a0ed-aa0bfb8e92cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:52:28.304944 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c86caf-cc50-4287-a0ed-aa0bfb8e92cc None admin] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:52:28.305215 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c86caf-cc50-4287-a0ed-aa0bfb8e92cc None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:52:28.305508 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c86caf-cc50-4287-a0ed-aa0bfb8e92cc None admin] PATH_INFO: `/v3/endpoints` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:52:28.306163 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c86caf-cc50-4287-a0ed-aa0bfb8e92cc None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:52:28.307518 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c86caf-cc50-4287-a0ed-aa0bfb8e92cc None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:52:28.326229 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 664/1306] 10.222.0.25 () {60 vars in 1144 bytes} [Thu Sep 15 17:52:28 2022] POST /identity/v3/endpoints => generated 331 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 17:52:38.166249 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=30 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:52:38.322169 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:53:32.277851 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b35a64f-b459-4c9f-abc8-4b34067f358d None None] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:53:32.278343 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b35a64f-b459-4c9f-abc8-4b34067f358d None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:53:32.278666 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b35a64f-b459-4c9f-abc8-4b34067f358d None None] PATH_INFO: `/` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:53:32.284453 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 643/1307] 10.222.0.25 () {54 vars in 927 bytes} [Thu Sep 15 17:53:32 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 17:53:32.286112 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f240659-f65e-4a5e-8654-fe8df88e86a6 None None] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:53:32.286912 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f240659-f65e-4a5e-8654-fe8df88e86a6 None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:53:32.287355 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f240659-f65e-4a5e-8654-fe8df88e86a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:53:32.448830 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.auth.core [None req-2f240659-f65e-4a5e-8654-fe8df88e86a6 None None] MFA Rules not processed for user `5cfa58ef86774ab7800bf91930bf6028`. Rule list: `[]` (Enabled: `True`). {{(pid=81593) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 17:53:32.452740 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-2f240659-f65e-4a5e-8654-fe8df88e86a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 17:53:32.564137 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 665/1308] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Sep 15 17:53:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 280 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 17:53:32.858720 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b164b50-2235-4221-aa0c-593b23a9144e None None] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:53:32.859899 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b164b50-2235-4221-aa0c-593b23a9144e None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:53:32.860411 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b164b50-2235-4221-aa0c-593b23a9144e None None] PATH_INFO: `/` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:53:32.862679 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 644/1309] 10.222.0.25 () {54 vars in 965 bytes} [Thu Sep 15 17:53:32 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 17:53:32.868711 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975373a5-8d7e-4eb9-8cb2-c70f175e91a5 None None] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:53:32.869064 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975373a5-8d7e-4eb9-8cb2-c70f175e91a5 None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:53:32.869264 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975373a5-8d7e-4eb9-8cb2-c70f175e91a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:53:32.963788 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.auth.core [None req-975373a5-8d7e-4eb9-8cb2-c70f175e91a5 None None] MFA Rules not processed for user `a32274b4781b40fea9f28da8a9bde5ca`. Rule list: `[]` (Enabled: `True`). {{(pid=81593) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 17:53:32.965056 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-975373a5-8d7e-4eb9-8cb2-c70f175e91a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 17:53:32.988416 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:53:33.050298 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 666/1310] 10.222.0.25 () {58 vars in 1062 bytes} [Thu Sep 15 17:53:32 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 17:53:33.059418 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b164b50-2235-4221-aa0c-593b23a9144e None None] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:53:33.061391 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-4b164b50-2235-4221-aa0c-593b23a9144e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 17:53:33.181974 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b164b50-2235-4221-aa0c-593b23a9144e None None] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:53:33.263549 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40f2a99-d999-46c4-b734-12c075bf2ee6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a32274b4781b40fea9f28da8a9bde5ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1213c0d1b584404ba3998e136f166e89', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:53:33.264288 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40f2a99-d999-46c4-b734-12c075bf2ee6 service neutron] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:53:33.264677 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40f2a99-d999-46c4-b734-12c075bf2ee6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:53:33.265017 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40f2a99-d999-46c4-b734-12c075bf2ee6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:53:33.267351 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-d40f2a99-d999-46c4-b734-12c075bf2ee6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 17:53:33.324462 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:53:33.383190 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d40f2a99-d999-46c4-b734-12c075bf2ee6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:53:33.384634 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d40f2a99-d999-46c4-b734-12c075bf2ee6 service neutron] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:53:33.406924 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 645/1311] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 15 17:53:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 15 17:53:35.896022 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cf52fa-12be-4460-bb4a-9d4c0c375422 None None] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:53:35.896550 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cf52fa-12be-4460-bb4a-9d4c0c375422 None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:53:35.896642 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cf52fa-12be-4460-bb4a-9d4c0c375422 None None] PATH_INFO: `/` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:53:35.897984 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 667/1312] 10.222.0.25 () {54 vars in 927 bytes} [Thu Sep 15 17:53:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 17:53:35.903457 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95969d14-5d7c-4284-af47-61d9ddd6ef6c None None] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:53:35.903882 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95969d14-5d7c-4284-af47-61d9ddd6ef6c None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:53:35.903979 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95969d14-5d7c-4284-af47-61d9ddd6ef6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:53:35.989032 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.auth.core [None req-95969d14-5d7c-4284-af47-61d9ddd6ef6c None None] MFA Rules not processed for user `5cfa58ef86774ab7800bf91930bf6028`. Rule list: `[]` (Enabled: `True`). {{(pid=81592) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 17:53:35.990272 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-95969d14-5d7c-4284-af47-61d9ddd6ef6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 17:53:36.086817 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 646/1313] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Sep 15 17:53:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 17:53:36.410361 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4f963d-e729-4411-a753-dec000c26e07 None None] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:53:36.410650 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4f963d-e729-4411-a753-dec000c26e07 None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:53:36.410926 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4f963d-e729-4411-a753-dec000c26e07 None None] PATH_INFO: `/` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:53:36.412298 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 668/1314] 10.222.0.25 () {54 vars in 965 bytes} [Thu Sep 15 17:53:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 17:53:36.418633 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25c9c38-ffd7-441f-ac3d-a0318fb42d92 None None] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:53:36.419001 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25c9c38-ffd7-441f-ac3d-a0318fb42d92 None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:53:36.419347 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25c9c38-ffd7-441f-ac3d-a0318fb42d92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:53:36.431235 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:53:36.496863 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.auth.core [None req-b25c9c38-ffd7-441f-ac3d-a0318fb42d92 None None] MFA Rules not processed for user `a32274b4781b40fea9f28da8a9bde5ca`. Rule list: `[]` (Enabled: `True`). {{(pid=81592) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 17:53:36.498106 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-b25c9c38-ffd7-441f-ac3d-a0318fb42d92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 17:53:36.578478 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 647/1315] 10.222.0.25 () {58 vars in 1062 bytes} [Thu Sep 15 17:53:36 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 17:53:36.587516 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4f963d-e729-4411-a753-dec000c26e07 None None] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:53:36.589126 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-eb4f963d-e729-4411-a753-dec000c26e07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 17:53:36.696886 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4f963d-e729-4411-a753-dec000c26e07 None None] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:53:36.766559 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:53:36.768910 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a2299e-cdcf-4093-baa0-d043673d6ed1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a32274b4781b40fea9f28da8a9bde5ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1213c0d1b584404ba3998e136f166e89', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:53:36.769544 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a2299e-cdcf-4093-baa0-d043673d6ed1 service neutron] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:53:36.770022 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a2299e-cdcf-4093-baa0-d043673d6ed1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:53:36.770498 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a2299e-cdcf-4093-baa0-d043673d6ed1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:53:36.772306 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-f5a2299e-cdcf-4093-baa0-d043673d6ed1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 17:53:36.877521 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a2299e-cdcf-4093-baa0-d043673d6ed1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:53:36.878882 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a2299e-cdcf-4093-baa0-d043673d6ed1 service neutron] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:53:36.896992 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 669/1316] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 15 17:53:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 17:53:39.540372 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec3411f-5b5e-4ad2-8a5e-8263d5cca803 None None] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:53:39.540938 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec3411f-5b5e-4ad2-8a5e-8263d5cca803 None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:53:39.540938 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec3411f-5b5e-4ad2-8a5e-8263d5cca803 None None] PATH_INFO: `/` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:53:39.542402 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 648/1317] 10.222.0.25 () {54 vars in 927 bytes} [Thu Sep 15 17:53:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 17:53:39.548871 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24560356-f68f-4656-8dd7-18a1e4c69b67 None None] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:53:39.549246 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24560356-f68f-4656-8dd7-18a1e4c69b67 None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:53:39.549456 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24560356-f68f-4656-8dd7-18a1e4c69b67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:53:39.615683 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.auth.core [None req-24560356-f68f-4656-8dd7-18a1e4c69b67 None None] MFA Rules not processed for user `823825bfaf1b44a7ba5999ca5e7b26ce`. Rule list: `[]` (Enabled: `True`). {{(pid=81593) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 17:53:39.616913 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-24560356-f68f-4656-8dd7-18a1e4c69b67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 17:53:39.670478 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:53:39.715762 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 670/1318] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Sep 15 17:53:39 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 17:53:40.002037 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec3411f-5b5e-4ad2-8a5e-8263d5cca803 None None] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:53:40.003576 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-eec3411f-5b5e-4ad2-8a5e-8263d5cca803 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 17:53:40.105876 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec3411f-5b5e-4ad2-8a5e-8263d5cca803 None None] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:53:40.109606 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:53:40.181362 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73914974-62c6-42f6-b4e2-af62af3e33fe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a32274b4781b40fea9f28da8a9bde5ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1213c0d1b584404ba3998e136f166e89', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:53:40.181904 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73914974-62c6-42f6-b4e2-af62af3e33fe service neutron] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:53:40.182183 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73914974-62c6-42f6-b4e2-af62af3e33fe service neutron] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:53:40.182453 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73914974-62c6-42f6-b4e2-af62af3e33fe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:53:40.184046 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-73914974-62c6-42f6-b4e2-af62af3e33fe service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 17:53:40.290385 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73914974-62c6-42f6-b4e2-af62af3e33fe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:53:40.291815 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73914974-62c6-42f6-b4e2-af62af3e33fe service neutron] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:53:40.309338 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 649/1319] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 15 17:53:40 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 17:53:42.999802 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f41d822-7836-40e1-97f9-6810b74cb56f None None] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:53:43.000536 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f41d822-7836-40e1-97f9-6810b74cb56f None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:53:43.000536 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f41d822-7836-40e1-97f9-6810b74cb56f None None] PATH_INFO: `/` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:53:43.001779 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 671/1320] 10.222.0.25 () {54 vars in 927 bytes} [Thu Sep 15 17:53:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 17:53:43.007145 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3214046e-b3ea-4dcb-9c99-b8db1ed7bca2 None None] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:53:43.007567 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3214046e-b3ea-4dcb-9c99-b8db1ed7bca2 None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:53:43.007681 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3214046e-b3ea-4dcb-9c99-b8db1ed7bca2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:53:43.053933 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:53:43.079352 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.auth.core [None req-3214046e-b3ea-4dcb-9c99-b8db1ed7bca2 None None] MFA Rules not processed for user `5cfa58ef86774ab7800bf91930bf6028`. Rule list: `[]` (Enabled: `True`). {{(pid=81592) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 17:53:43.080545 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-3214046e-b3ea-4dcb-9c99-b8db1ed7bca2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 17:53:43.174119 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 650/1321] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Sep 15 17:53:43 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 17:53:43.461523 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f41d822-7836-40e1-97f9-6810b74cb56f None None] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:53:43.463082 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-6f41d822-7836-40e1-97f9-6810b74cb56f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 17:53:43.563239 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f41d822-7836-40e1-97f9-6810b74cb56f None None] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:53:43.638333 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6011a424-c24d-4796-a50d-8b1ea5b5eb8a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a32274b4781b40fea9f28da8a9bde5ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1213c0d1b584404ba3998e136f166e89', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:53:43.638932 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6011a424-c24d-4796-a50d-8b1ea5b5eb8a service neutron] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:53:43.639211 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6011a424-c24d-4796-a50d-8b1ea5b5eb8a service neutron] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:53:43.639484 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6011a424-c24d-4796-a50d-8b1ea5b5eb8a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:53:43.641074 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-6011a424-c24d-4796-a50d-8b1ea5b5eb8a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 17:53:43.647844 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:53:43.747806 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6011a424-c24d-4796-a50d-8b1ea5b5eb8a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:53:43.749269 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6011a424-c24d-4796-a50d-8b1ea5b5eb8a service neutron] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:53:43.766970 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 672/1322] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 15 17:53:43 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 17:53:46.568057 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0566445-fff5-40ec-83b3-4c61f6015528 None None] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:53:46.568658 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0566445-fff5-40ec-83b3-4c61f6015528 None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:53:46.568658 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0566445-fff5-40ec-83b3-4c61f6015528 None None] PATH_INFO: `/` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:53:46.569974 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 651/1323] 10.222.0.25 () {54 vars in 927 bytes} [Thu Sep 15 17:53:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 17:53:46.575134 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ee4fd0-2b4d-4b13-9275-84c70354c564 None None] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:53:46.575549 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ee4fd0-2b4d-4b13-9275-84c70354c564 None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:53:46.575694 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ee4fd0-2b4d-4b13-9275-84c70354c564 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:53:46.654135 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.auth.core [None req-00ee4fd0-2b4d-4b13-9275-84c70354c564 None None] MFA Rules not processed for user `5cfa58ef86774ab7800bf91930bf6028`. Rule list: `[]` (Enabled: `True`). {{(pid=81593) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 17:53:46.655535 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-00ee4fd0-2b4d-4b13-9275-84c70354c564 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 17:53:46.718216 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:53:46.763406 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 673/1324] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Sep 15 17:53:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 17:53:47.047884 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0566445-fff5-40ec-83b3-4c61f6015528 None None] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:53:47.049469 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-f0566445-fff5-40ec-83b3-4c61f6015528 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 17:53:47.195957 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0566445-fff5-40ec-83b3-4c61f6015528 None None] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:53:47.209593 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:53:47.291992 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5ca87d-5d58-48fc-8b35-957e162ac624 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a32274b4781b40fea9f28da8a9bde5ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1213c0d1b584404ba3998e136f166e89', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:53:47.292629 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5ca87d-5d58-48fc-8b35-957e162ac624 service neutron] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:53:47.292904 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5ca87d-5d58-48fc-8b35-957e162ac624 service neutron] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:53:47.293170 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5ca87d-5d58-48fc-8b35-957e162ac624 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:53:47.294817 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-ce5ca87d-5d58-48fc-8b35-957e162ac624 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 17:53:47.427185 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce5ca87d-5d58-48fc-8b35-957e162ac624 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:53:47.428626 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce5ca87d-5d58-48fc-8b35-957e162ac624 service neutron] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:53:47.447729 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 652/1325] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 15 17:53:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 401 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 15 17:53:49.703682 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb5223b-67a6-4398-a571-0001c22d9044 None None] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:53:49.704225 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb5223b-67a6-4398-a571-0001c22d9044 None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:53:49.704225 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb5223b-67a6-4398-a571-0001c22d9044 None None] PATH_INFO: `/` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:53:49.705582 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 674/1326] 10.222.0.25 () {54 vars in 927 bytes} [Thu Sep 15 17:53:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 17:53:49.710876 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3bd481-5e8a-4e20-86f2-5d879998b301 None None] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:53:49.711302 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3bd481-5e8a-4e20-86f2-5d879998b301 None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:53:49.711430 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3bd481-5e8a-4e20-86f2-5d879998b301 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:53:49.774133 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:53:49.788413 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.auth.core [None req-6a3bd481-5e8a-4e20-86f2-5d879998b301 None None] MFA Rules not processed for user `5cfa58ef86774ab7800bf91930bf6028`. Rule list: `[]` (Enabled: `True`). {{(pid=81592) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 17:53:49.789705 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-6a3bd481-5e8a-4e20-86f2-5d879998b301 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 17:53:49.888016 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 653/1327] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Sep 15 17:53:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 17:53:50.176020 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb5223b-67a6-4398-a571-0001c22d9044 None None] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:53:50.177592 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-deb5223b-67a6-4398-a571-0001c22d9044 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 17:53:50.288282 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb5223b-67a6-4398-a571-0001c22d9044 None None] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:53:50.362074 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6be26b-6c5f-4a17-8cd0-7a56796582c6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a32274b4781b40fea9f28da8a9bde5ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1213c0d1b584404ba3998e136f166e89', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:53:50.362688 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6be26b-6c5f-4a17-8cd0-7a56796582c6 service neutron] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:53:50.362962 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6be26b-6c5f-4a17-8cd0-7a56796582c6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:53:50.363233 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6be26b-6c5f-4a17-8cd0-7a56796582c6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:53:50.364841 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-5c6be26b-6c5f-4a17-8cd0-7a56796582c6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 17:53:50.383093 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:53:50.491964 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6be26b-6c5f-4a17-8cd0-7a56796582c6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:53:50.493454 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6be26b-6c5f-4a17-8cd0-7a56796582c6 service neutron] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:53:50.514242 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 675/1328] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 15 17:53:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 17:53:52.730719 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdee02db-6cd4-4938-be13-bba3dabed3a7 None None] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:53:52.731201 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdee02db-6cd4-4938-be13-bba3dabed3a7 None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:53:52.731297 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdee02db-6cd4-4938-be13-bba3dabed3a7 None None] PATH_INFO: `/` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:53:52.732660 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 654/1329] 10.222.0.25 () {54 vars in 927 bytes} [Thu Sep 15 17:53:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 17:53:52.738267 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589be260-d817-43b3-b2c8-650bbbdf8918 None None] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:53:52.738747 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589be260-d817-43b3-b2c8-650bbbdf8918 None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:53:52.738885 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589be260-d817-43b3-b2c8-650bbbdf8918 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:53:52.805968 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.auth.core [None req-589be260-d817-43b3-b2c8-650bbbdf8918 None None] MFA Rules not processed for user `823825bfaf1b44a7ba5999ca5e7b26ce`. Rule list: `[]` (Enabled: `True`). {{(pid=81593) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 17:53:52.807101 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-589be260-d817-43b3-b2c8-650bbbdf8918 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 17:53:52.873520 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:53:52.906563 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 676/1330] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Sep 15 17:53:52 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 17:53:53.189355 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdee02db-6cd4-4938-be13-bba3dabed3a7 None None] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:53:53.190916 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-bdee02db-6cd4-4938-be13-bba3dabed3a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 17:53:53.304060 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdee02db-6cd4-4938-be13-bba3dabed3a7 None None] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:53:53.326376 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:53:53.385877 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02643a4-146d-4185-afd6-48c10644b46d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a32274b4781b40fea9f28da8a9bde5ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1213c0d1b584404ba3998e136f166e89', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:53:53.386475 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02643a4-146d-4185-afd6-48c10644b46d service neutron] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:53:53.386747 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02643a4-146d-4185-afd6-48c10644b46d service neutron] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:53:53.387014 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02643a4-146d-4185-afd6-48c10644b46d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:53:53.388596 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-d02643a4-146d-4185-afd6-48c10644b46d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 17:53:53.500011 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02643a4-146d-4185-afd6-48c10644b46d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:53:53.501476 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02643a4-146d-4185-afd6-48c10644b46d service neutron] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:53:53.520975 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 655/1331] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 15 17:53:53 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 17:53:56.105537 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b716f49c-a6da-4836-a907-b3dd937f9714 None None] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:53:56.106068 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b716f49c-a6da-4836-a907-b3dd937f9714 None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:53:56.106068 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b716f49c-a6da-4836-a907-b3dd937f9714 None None] PATH_INFO: `/` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:53:56.108053 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 677/1332] 10.222.0.25 () {54 vars in 927 bytes} [Thu Sep 15 17:53:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 17:53:56.113156 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0f979c-4552-485c-8199-04b3bfd20d34 None None] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:53:56.113657 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0f979c-4552-485c-8199-04b3bfd20d34 None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:53:56.113754 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0f979c-4552-485c-8199-04b3bfd20d34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:53:56.181245 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:53:56.184212 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.auth.core [None req-de0f979c-4552-485c-8199-04b3bfd20d34 None None] MFA Rules not processed for user `5cfa58ef86774ab7800bf91930bf6028`. Rule list: `[]` (Enabled: `True`). {{(pid=81592) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 17:53:56.185961 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-de0f979c-4552-485c-8199-04b3bfd20d34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 17:53:56.283502 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 656/1333] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Sep 15 17:53:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 17:53:56.604423 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b716f49c-a6da-4836-a907-b3dd937f9714 None None] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:53:56.606040 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-b716f49c-a6da-4836-a907-b3dd937f9714 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 17:53:56.708856 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b716f49c-a6da-4836-a907-b3dd937f9714 None None] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:53:56.782651 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1852a57-f82a-4f67-bf96-d2b4f2b6a349 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a32274b4781b40fea9f28da8a9bde5ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1213c0d1b584404ba3998e136f166e89', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:53:56.783249 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1852a57-f82a-4f67-bf96-d2b4f2b6a349 service neutron] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:53:56.783522 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1852a57-f82a-4f67-bf96-d2b4f2b6a349 service neutron] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:53:56.783788 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1852a57-f82a-4f67-bf96-d2b4f2b6a349 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:53:56.785475 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-f1852a57-f82a-4f67-bf96-d2b4f2b6a349 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 17:53:56.812785 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:53:56.895505 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1852a57-f82a-4f67-bf96-d2b4f2b6a349 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:53:56.896858 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1852a57-f82a-4f67-bf96-d2b4f2b6a349 service neutron] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:53:56.914599 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 678/1334] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 15 17:53:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 17:53:59.131588 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead88ad5-7341-4800-8ecd-610ac1b53d80 None None] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:53:59.132158 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead88ad5-7341-4800-8ecd-610ac1b53d80 None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:53:59.132158 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead88ad5-7341-4800-8ecd-610ac1b53d80 None None] PATH_INFO: `/` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:53:59.133502 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 657/1335] 10.222.0.25 () {54 vars in 927 bytes} [Thu Sep 15 17:53:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 17:53:59.139550 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311b1eb0-e073-4ffb-952e-f7c82f33fd01 None None] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:53:59.139938 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311b1eb0-e073-4ffb-952e-f7c82f33fd01 None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:53:59.140036 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311b1eb0-e073-4ffb-952e-f7c82f33fd01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:53:59.206531 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.auth.core [None req-311b1eb0-e073-4ffb-952e-f7c82f33fd01 None None] MFA Rules not processed for user `5cfa58ef86774ab7800bf91930bf6028`. Rule list: `[]` (Enabled: `True`). {{(pid=81593) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 17:53:59.207717 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-311b1eb0-e073-4ffb-952e-f7c82f33fd01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 17:53:59.280218 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:53:59.302260 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 679/1336] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Sep 15 17:53:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 17:53:59.586894 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead88ad5-7341-4800-8ecd-610ac1b53d80 None None] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:53:59.588423 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-ead88ad5-7341-4800-8ecd-610ac1b53d80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 17:53:59.690704 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead88ad5-7341-4800-8ecd-610ac1b53d80 None None] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:53:59.719396 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:53:59.767515 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc10558-8f2d-4062-a392-83cd34ea1229 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a32274b4781b40fea9f28da8a9bde5ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1213c0d1b584404ba3998e136f166e89', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:53:59.768115 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc10558-8f2d-4062-a392-83cd34ea1229 service neutron] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:53:59.768393 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc10558-8f2d-4062-a392-83cd34ea1229 service neutron] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:53:59.768664 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc10558-8f2d-4062-a392-83cd34ea1229 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:53:59.770303 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-7cc10558-8f2d-4062-a392-83cd34ea1229 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 17:53:59.879901 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc10558-8f2d-4062-a392-83cd34ea1229 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:53:59.881364 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc10558-8f2d-4062-a392-83cd34ea1229 service neutron] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:53:59.899175 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 658/1337] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 15 17:53:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 17:54:02.549795 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88df92b-1ea2-4d52-9475-0c7f9e33e5f3 None None] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:54:02.550533 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88df92b-1ea2-4d52-9475-0c7f9e33e5f3 None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:54:02.550533 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88df92b-1ea2-4d52-9475-0c7f9e33e5f3 None None] PATH_INFO: `/` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:54:02.552503 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 680/1338] 10.222.0.25 () {54 vars in 927 bytes} [Thu Sep 15 17:54:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 15 17:54:02.557991 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebbdece-749a-45ed-a624-baa58316d488 None None] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:54:02.558440 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebbdece-749a-45ed-a624-baa58316d488 None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:54:02.558536 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebbdece-749a-45ed-a624-baa58316d488 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:54:02.627334 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.auth.core [None req-9ebbdece-749a-45ed-a624-baa58316d488 None None] MFA Rules not processed for user `5cfa58ef86774ab7800bf91930bf6028`. Rule list: `[]` (Enabled: `True`). {{(pid=81592) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 17:54:02.628554 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-9ebbdece-749a-45ed-a624-baa58316d488 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 17:54:02.643412 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:54:02.731431 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 659/1339] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Sep 15 17:54:02 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 17:54:03.016578 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88df92b-1ea2-4d52-9475-0c7f9e33e5f3 None None] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:54:03.018180 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-b88df92b-1ea2-4d52-9475-0c7f9e33e5f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 17:54:03.119587 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88df92b-1ea2-4d52-9475-0c7f9e33e5f3 None None] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:54:03.193653 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34588f20-8e21-471b-9083-8ef84db9f91d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a32274b4781b40fea9f28da8a9bde5ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1213c0d1b584404ba3998e136f166e89', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:54:03.194244 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34588f20-8e21-471b-9083-8ef84db9f91d service neutron] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:54:03.194521 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34588f20-8e21-471b-9083-8ef84db9f91d service neutron] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:54:03.194787 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34588f20-8e21-471b-9083-8ef84db9f91d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:54:03.196362 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-34588f20-8e21-471b-9083-8ef84db9f91d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 17:54:03.231013 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:54:03.304406 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34588f20-8e21-471b-9083-8ef84db9f91d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:54:03.305792 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34588f20-8e21-471b-9083-8ef84db9f91d service neutron] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:54:03.323642 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 681/1340] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 15 17:54:03 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 17:54:07.468899 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5686af1d-36ca-432d-8658-c95f9e756571 None None] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:54:07.469466 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5686af1d-36ca-432d-8658-c95f9e756571 None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:54:07.469466 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5686af1d-36ca-432d-8658-c95f9e756571 None None] PATH_INFO: `/` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:54:07.470987 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 660/1341] 10.222.0.25 () {54 vars in 927 bytes} [Thu Sep 15 17:54:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 17:54:07.476533 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ac4127-d1e0-42a8-b45c-1298bf9df7f1 None None] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:54:07.477010 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ac4127-d1e0-42a8-b45c-1298bf9df7f1 None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:54:07.477092 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ac4127-d1e0-42a8-b45c-1298bf9df7f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:54:07.560146 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.auth.core [None req-c0ac4127-d1e0-42a8-b45c-1298bf9df7f1 None None] MFA Rules not processed for user `5cfa58ef86774ab7800bf91930bf6028`. Rule list: `[]` (Enabled: `True`). {{(pid=81593) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 17:54:07.561393 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-c0ac4127-d1e0-42a8-b45c-1298bf9df7f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 17:54:07.663981 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:54:07.682379 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 682/1342] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Sep 15 17:54:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 17:54:07.972254 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5686af1d-36ca-432d-8658-c95f9e756571 None None] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:54:07.973993 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-5686af1d-36ca-432d-8658-c95f9e756571 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 17:54:08.090928 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5686af1d-36ca-432d-8658-c95f9e756571 None None] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:54:08.131574 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:54:08.171414 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f7eb6e-a1fc-4580-88aa-c9f1e575e517 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a32274b4781b40fea9f28da8a9bde5ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1213c0d1b584404ba3998e136f166e89', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:54:08.172009 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f7eb6e-a1fc-4580-88aa-c9f1e575e517 service neutron] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:54:08.172279 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f7eb6e-a1fc-4580-88aa-c9f1e575e517 service neutron] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:54:08.172542 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f7eb6e-a1fc-4580-88aa-c9f1e575e517 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:54:08.174320 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-c3f7eb6e-a1fc-4580-88aa-c9f1e575e517 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 17:54:08.285104 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f7eb6e-a1fc-4580-88aa-c9f1e575e517 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:54:08.286592 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f7eb6e-a1fc-4580-88aa-c9f1e575e517 service neutron] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:54:08.305386 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 661/1343] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 15 17:54:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 17:54:11.102224 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911bc123-d823-436d-a78a-91f38674119e None None] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:54:11.102762 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911bc123-d823-436d-a78a-91f38674119e None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:54:11.102762 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911bc123-d823-436d-a78a-91f38674119e None None] PATH_INFO: `/` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:54:11.104186 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 683/1344] 10.222.0.25 () {54 vars in 927 bytes} [Thu Sep 15 17:54:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 17:54:11.110085 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b48e2a-e328-4bf0-88b1-e3cba806ee0b None None] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:54:11.110642 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b48e2a-e328-4bf0-88b1-e3cba806ee0b None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:54:11.110642 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b48e2a-e328-4bf0-88b1-e3cba806ee0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:54:11.186822 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.auth.core [None req-a3b48e2a-e328-4bf0-88b1-e3cba806ee0b None None] MFA Rules not processed for user `5cfa58ef86774ab7800bf91930bf6028`. Rule list: `[]` (Enabled: `True`). {{(pid=81592) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 17:54:11.188051 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-a3b48e2a-e328-4bf0-88b1-e3cba806ee0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 17:54:11.207276 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:54:11.297379 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 662/1345] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Sep 15 17:54:11 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 17:54:11.600369 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911bc123-d823-436d-a78a-91f38674119e None None] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:54:11.601945 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-911bc123-d823-436d-a78a-91f38674119e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 17:54:11.716275 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911bc123-d823-436d-a78a-91f38674119e None None] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:54:11.798757 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00adbfb9-6332-44a9-8163-d53ce1ec07a5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a32274b4781b40fea9f28da8a9bde5ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1213c0d1b584404ba3998e136f166e89', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:54:11.799386 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00adbfb9-6332-44a9-8163-d53ce1ec07a5 service neutron] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:54:11.799654 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00adbfb9-6332-44a9-8163-d53ce1ec07a5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:54:11.799927 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00adbfb9-6332-44a9-8163-d53ce1ec07a5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:54:11.801610 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-00adbfb9-6332-44a9-8163-d53ce1ec07a5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 17:54:11.861547 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:54:11.937939 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00adbfb9-6332-44a9-8163-d53ce1ec07a5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:54:11.939394 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00adbfb9-6332-44a9-8163-d53ce1ec07a5 service neutron] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:54:11.959766 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 684/1346] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 15 17:54:11 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 17:54:16.266804 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8be3153-4e83-47bf-a07a-156af3e5846a None None] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:54:16.267410 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8be3153-4e83-47bf-a07a-156af3e5846a None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:54:16.267410 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8be3153-4e83-47bf-a07a-156af3e5846a None None] PATH_INFO: `/` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:54:16.268703 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 663/1347] 10.222.0.25 () {54 vars in 927 bytes} [Thu Sep 15 17:54:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 17:54:16.274231 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31101433-d7f5-4e89-a14c-1d3d60cf034c None None] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:54:16.274700 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31101433-d7f5-4e89-a14c-1d3d60cf034c None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:54:16.274850 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31101433-d7f5-4e89-a14c-1d3d60cf034c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:54:16.346930 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.auth.core [None req-31101433-d7f5-4e89-a14c-1d3d60cf034c None None] MFA Rules not processed for user `5cfa58ef86774ab7800bf91930bf6028`. Rule list: `[]` (Enabled: `True`). {{(pid=81593) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 17:54:16.348158 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-31101433-d7f5-4e89-a14c-1d3d60cf034c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 17:54:16.444602 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:54:16.446992 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 685/1348] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Sep 15 17:54:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 17:54:16.728423 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8be3153-4e83-47bf-a07a-156af3e5846a None None] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:54:16.730005 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-d8be3153-4e83-47bf-a07a-156af3e5846a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 17:54:16.834359 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8be3153-4e83-47bf-a07a-156af3e5846a None None] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:54:16.882835 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:54:16.908351 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65006099-6def-4fad-83e0-485dbad4671b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a32274b4781b40fea9f28da8a9bde5ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1213c0d1b584404ba3998e136f166e89', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:54:16.908953 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65006099-6def-4fad-83e0-485dbad4671b service neutron] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:54:16.909227 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65006099-6def-4fad-83e0-485dbad4671b service neutron] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:54:16.909523 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65006099-6def-4fad-83e0-485dbad4671b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:54:16.911109 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-65006099-6def-4fad-83e0-485dbad4671b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 17:54:17.024107 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65006099-6def-4fad-83e0-485dbad4671b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:54:17.025571 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65006099-6def-4fad-83e0-485dbad4671b service neutron] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:54:17.044132 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 664/1349] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 15 17:54:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 17:54:22.143794 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47726b4a-3736-4758-96bf-354fb9d74bbd None None] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:54:22.144299 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47726b4a-3736-4758-96bf-354fb9d74bbd None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:54:22.144396 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47726b4a-3736-4758-96bf-354fb9d74bbd None None] PATH_INFO: `/` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:54:22.148133 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 686/1350] 10.222.0.25 () {54 vars in 921 bytes} [Thu Sep 15 17:54:22 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 17:54:22.154256 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58595c55-193c-4cee-9e77-4e3ffd0c385b None None] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:54:22.155120 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58595c55-193c-4cee-9e77-4e3ffd0c385b None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:54:22.155609 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58595c55-193c-4cee-9e77-4e3ffd0c385b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:54:22.243559 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.auth.core [None req-58595c55-193c-4cee-9e77-4e3ffd0c385b None None] MFA Rules not processed for user `10af119bd39841ed8163993676230fca`. Rule list: `[]` (Enabled: `True`). {{(pid=81592) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 17:54:22.245048 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-58595c55-193c-4cee-9e77-4e3ffd0c385b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 17:54:22.269650 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:54:22.403186 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 665/1351] 10.222.0.25 () {58 vars in 1018 bytes} [Thu Sep 15 17:54:22 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 250 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 17:54:26.981084 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c414f284-8cd9-4944-9761-68d6003a178d None None] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:54:26.981658 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c414f284-8cd9-4944-9761-68d6003a178d None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:54:26.981658 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c414f284-8cd9-4944-9761-68d6003a178d None None] PATH_INFO: `/` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:54:26.983000 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 687/1352] 10.222.0.25 () {54 vars in 921 bytes} [Thu Sep 15 17:54:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 17:54:26.988038 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb49484-f447-4e81-8fd4-69eb3cd7d683 None None] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:54:26.988929 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb49484-f447-4e81-8fd4-69eb3cd7d683 None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:54:26.989454 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb49484-f447-4e81-8fd4-69eb3cd7d683 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:54:27.083265 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.auth.core [None req-fcb49484-f447-4e81-8fd4-69eb3cd7d683 None None] MFA Rules not processed for user `10af119bd39841ed8163993676230fca`. Rule list: `[]` (Enabled: `True`). {{(pid=81592) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 17:54:27.084888 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-fcb49484-f447-4e81-8fd4-69eb3cd7d683 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 17:54:27.185935 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:54:27.246302 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 666/1353] 10.222.0.25 () {58 vars in 1018 bytes} [Thu Sep 15 17:54:26 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 259 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 17:54:28.487434 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5339e6-0432-4f8f-82a9-0c28dd38a7cb None None] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:54:28.487975 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5339e6-0432-4f8f-82a9-0c28dd38a7cb None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:54:28.487975 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5339e6-0432-4f8f-82a9-0c28dd38a7cb None None] PATH_INFO: `/` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:54:28.489339 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 688/1354] 10.222.0.25 () {54 vars in 921 bytes} [Thu Sep 15 17:54:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 17:54:28.494475 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88f165d-5afd-406d-a6ef-d240fef5759c None None] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:54:28.494942 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88f165d-5afd-406d-a6ef-d240fef5759c None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:54:28.495041 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88f165d-5afd-406d-a6ef-d240fef5759c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:54:28.574107 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.auth.core [None req-d88f165d-5afd-406d-a6ef-d240fef5759c None None] MFA Rules not processed for user `10af119bd39841ed8163993676230fca`. Rule list: `[]` (Enabled: `True`). {{(pid=81592) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 17:54:28.575332 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-d88f165d-5afd-406d-a6ef-d240fef5759c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 17:54:28.691281 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 667/1355] 10.222.0.25 () {58 vars in 1018 bytes} [Thu Sep 15 17:54:28 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 17:54:32.319155 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100c3003-0782-4437-8640-c59656833e95 None None] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:54:32.319691 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100c3003-0782-4437-8640-c59656833e95 None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:54:32.319691 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100c3003-0782-4437-8640-c59656833e95 None None] PATH_INFO: `/` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:54:32.325182 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 689/1356] 10.222.0.25 () {54 vars in 927 bytes} [Thu Sep 15 17:54:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 17:54:32.327307 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c09b48-8da0-4554-b343-b6bc40f957d0 None None] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:54:32.328196 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c09b48-8da0-4554-b343-b6bc40f957d0 None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:54:32.328690 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c09b48-8da0-4554-b343-b6bc40f957d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:54:32.375005 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:54:32.414194 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.auth.core [None req-38c09b48-8da0-4554-b343-b6bc40f957d0 None None] MFA Rules not processed for user `5cfa58ef86774ab7800bf91930bf6028`. Rule list: `[]` (Enabled: `True`). {{(pid=81592) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 17:54:32.415369 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-38c09b48-8da0-4554-b343-b6bc40f957d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 17:54:32.551838 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 668/1357] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Sep 15 17:54:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 17:54:32.873954 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5877ae0b-4d25-4fd6-97aa-7e6059a696ea None None] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:54:32.874601 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5877ae0b-4d25-4fd6-97aa-7e6059a696ea None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:54:32.875048 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5877ae0b-4d25-4fd6-97aa-7e6059a696ea None None] PATH_INFO: `/` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:54:32.876976 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 690/1358] 10.222.0.25 () {54 vars in 962 bytes} [Thu Sep 15 17:54:32 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 17:54:32.890503 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015f6050-eaf4-48c0-b1e5-339fe93dd424 None None] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:54:32.890785 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015f6050-eaf4-48c0-b1e5-339fe93dd424 None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:54:32.891070 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015f6050-eaf4-48c0-b1e5-339fe93dd424 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:54:33.001535 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.auth.core [None req-015f6050-eaf4-48c0-b1e5-339fe93dd424 None None] MFA Rules not processed for user `fe2244818e4d4dca9c424cd078653e6a`. Rule list: `[]` (Enabled: `True`). {{(pid=81592) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 17:54:33.002938 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-015f6050-eaf4-48c0-b1e5-339fe93dd424 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 17:54:33.061219 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:54:33.161230 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 669/1359] 10.222.0.25 () {58 vars in 1059 bytes} [Thu Sep 15 17:54:32 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 271 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 17:54:33.170464 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5877ae0b-4d25-4fd6-97aa-7e6059a696ea None None] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:54:33.173383 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-5877ae0b-4d25-4fd6-97aa-7e6059a696ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 17:54:33.348598 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5877ae0b-4d25-4fd6-97aa-7e6059a696ea None None] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:54:33.428553 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:54:33.485986 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357dbeae-879a-476b-9c1e-5f90379fb977 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe2244818e4d4dca9c424cd078653e6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1213c0d1b584404ba3998e136f166e89', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:54:33.486600 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357dbeae-879a-476b-9c1e-5f90379fb977 service nova] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:54:33.486871 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357dbeae-879a-476b-9c1e-5f90379fb977 service nova] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:54:33.487135 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357dbeae-879a-476b-9c1e-5f90379fb977 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:54:33.488760 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-357dbeae-879a-476b-9c1e-5f90379fb977 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 17:54:33.600181 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357dbeae-879a-476b-9c1e-5f90379fb977 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:54:33.601968 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357dbeae-879a-476b-9c1e-5f90379fb977 service nova] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:54:33.623278 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 691/1360] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 15 17:54:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 453 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 17:54:36.084884 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d64dc5-ec71-42f4-9012-6c0cb3682ce4 None None] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:54:36.085473 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d64dc5-ec71-42f4-9012-6c0cb3682ce4 None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:54:36.085473 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d64dc5-ec71-42f4-9012-6c0cb3682ce4 None None] PATH_INFO: `/` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:54:36.086953 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 670/1361] 10.222.0.25 () {54 vars in 927 bytes} [Thu Sep 15 17:54:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 17:54:36.093252 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc8d05d-d3fc-4cf9-a12e-02b1d5e74616 None None] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:54:36.093729 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc8d05d-d3fc-4cf9-a12e-02b1d5e74616 None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:54:36.093841 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc8d05d-d3fc-4cf9-a12e-02b1d5e74616 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:54:36.168183 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.auth.core [None req-9cc8d05d-d3fc-4cf9-a12e-02b1d5e74616 None None] MFA Rules not processed for user `5cfa58ef86774ab7800bf91930bf6028`. Rule list: `[]` (Enabled: `True`). {{(pid=81593) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 17:54:36.169458 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-9cc8d05d-d3fc-4cf9-a12e-02b1d5e74616 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 17:54:36.216110 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:54:36.297850 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 692/1362] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Sep 15 17:54:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 17:54:36.597946 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d64dc5-ec71-42f4-9012-6c0cb3682ce4 None None] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:54:36.599945 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-a4d64dc5-ec71-42f4-9012-6c0cb3682ce4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 17:54:36.791970 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d64dc5-ec71-42f4-9012-6c0cb3682ce4 None None] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:54:36.802161 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:54:36.930493 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b8cb94-58d4-4e85-96cb-6fc0ec9f0045 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe2244818e4d4dca9c424cd078653e6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1213c0d1b584404ba3998e136f166e89', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:54:36.931123 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b8cb94-58d4-4e85-96cb-6fc0ec9f0045 service nova] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:54:36.931394 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b8cb94-58d4-4e85-96cb-6fc0ec9f0045 service nova] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:54:36.931658 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b8cb94-58d4-4e85-96cb-6fc0ec9f0045 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:54:36.933946 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-84b8cb94-58d4-4e85-96cb-6fc0ec9f0045 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 17:54:37.032585 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b8cb94-58d4-4e85-96cb-6fc0ec9f0045 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:54:37.034233 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b8cb94-58d4-4e85-96cb-6fc0ec9f0045 service nova] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:54:37.053960 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 671/1363] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 15 17:54:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 457 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 17:54:39.618700 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec3bbc6-7411-4af1-be17-5af51457f8bb None None] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:54:39.619246 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec3bbc6-7411-4af1-be17-5af51457f8bb None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:54:39.619246 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec3bbc6-7411-4af1-be17-5af51457f8bb None None] PATH_INFO: `/` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:54:39.620845 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 693/1364] 10.222.0.25 () {54 vars in 927 bytes} [Thu Sep 15 17:54:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 17:54:39.626294 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2303e1-64cb-481f-aabe-d78c2f053376 None None] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:54:39.626803 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2303e1-64cb-481f-aabe-d78c2f053376 None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:54:39.626886 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2303e1-64cb-481f-aabe-d78c2f053376 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:54:39.643055 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:54:39.701252 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.auth.core [None req-cd2303e1-64cb-481f-aabe-d78c2f053376 None None] MFA Rules not processed for user `5cfa58ef86774ab7800bf91930bf6028`. Rule list: `[]` (Enabled: `True`). {{(pid=81592) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 17:54:39.703037 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-cd2303e1-64cb-481f-aabe-d78c2f053376 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 17:54:39.812246 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 672/1365] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Sep 15 17:54:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 17:54:40.109538 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401a5084-29cc-43c2-9d1a-e35968c5b254 None None] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:54:40.110165 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401a5084-29cc-43c2-9d1a-e35968c5b254 None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:54:40.110654 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401a5084-29cc-43c2-9d1a-e35968c5b254 None None] PATH_INFO: `/` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:54:40.112315 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 694/1366] 10.222.0.25 () {54 vars in 962 bytes} [Thu Sep 15 17:54:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 17:54:40.118225 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f385a162-f3d5-4aaf-ac2e-4afa9936eb72 None None] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:54:40.118520 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f385a162-f3d5-4aaf-ac2e-4afa9936eb72 None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:54:40.118796 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f385a162-f3d5-4aaf-ac2e-4afa9936eb72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:54:40.201972 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.auth.core [None req-f385a162-f3d5-4aaf-ac2e-4afa9936eb72 None None] MFA Rules not processed for user `fe2244818e4d4dca9c424cd078653e6a`. Rule list: `[]` (Enabled: `True`). {{(pid=81592) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 17:54:40.203157 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-f385a162-f3d5-4aaf-ac2e-4afa9936eb72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 17:54:40.240748 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:54:40.373073 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 673/1367] 10.222.0.25 () {58 vars in 1059 bytes} [Thu Sep 15 17:54:40 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 256 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 17:54:40.382984 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401a5084-29cc-43c2-9d1a-e35968c5b254 None None] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:54:40.384523 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-401a5084-29cc-43c2-9d1a-e35968c5b254 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 17:54:40.553781 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401a5084-29cc-43c2-9d1a-e35968c5b254 None None] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:54:40.578335 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:54:40.722732 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c1f052-382b-4ee0-a177-da1468eaf63c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe2244818e4d4dca9c424cd078653e6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1213c0d1b584404ba3998e136f166e89', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:54:40.724859 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c1f052-382b-4ee0-a177-da1468eaf63c service nova] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:54:40.725370 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c1f052-382b-4ee0-a177-da1468eaf63c service nova] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:54:40.725853 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c1f052-382b-4ee0-a177-da1468eaf63c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:54:40.728941 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-55c1f052-382b-4ee0-a177-da1468eaf63c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 17:54:40.764867 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273885e9-3be1-4ddd-aefa-108ad218ea17 None None] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:54:40.765861 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273885e9-3be1-4ddd-aefa-108ad218ea17 None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:54:40.765861 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273885e9-3be1-4ddd-aefa-108ad218ea17 None None] PATH_INFO: `/` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:54:40.768368 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 674/1368] 10.222.0.25 () {54 vars in 927 bytes} [Thu Sep 15 17:54:40 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 17:54:40.776939 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb1d797-9f7b-4c83-af1d-974ea29ff137 None None] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:54:40.777418 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb1d797-9f7b-4c83-af1d-974ea29ff137 None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:54:40.777881 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb1d797-9f7b-4c83-af1d-974ea29ff137 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:54:40.866910 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.auth.core [None req-adb1d797-9f7b-4c83-af1d-974ea29ff137 None None] MFA Rules not processed for user `5cfa58ef86774ab7800bf91930bf6028`. Rule list: `[]` (Enabled: `True`). {{(pid=81592) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 17:54:40.868143 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-adb1d797-9f7b-4c83-af1d-974ea29ff137 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 17:54:40.877392 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c1f052-382b-4ee0-a177-da1468eaf63c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:54:40.879116 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c1f052-382b-4ee0-a177-da1468eaf63c service nova] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:54:40.903415 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 695/1369] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 15 17:54:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 521 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 17:54:40.985863 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:54:40.997597 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 675/1370] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Sep 15 17:54:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 17:54:41.352748 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f9537d-025c-49e1-9658-4dc783c635c7 None None] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:54:41.353173 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f9537d-025c-49e1-9658-4dc783c635c7 None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:54:41.353581 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f9537d-025c-49e1-9658-4dc783c635c7 None None] PATH_INFO: `/` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:54:41.355787 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 696/1371] 10.222.0.25 () {54 vars in 964 bytes} [Thu Sep 15 17:54:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 17:54:41.360666 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91a1ab8-3d2a-4b1a-93dd-40b5b232cd78 None None] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:54:41.361065 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91a1ab8-3d2a-4b1a-93dd-40b5b232cd78 None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:54:41.361482 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91a1ab8-3d2a-4b1a-93dd-40b5b232cd78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:54:41.454820 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.auth.core [None req-e91a1ab8-3d2a-4b1a-93dd-40b5b232cd78 None None] MFA Rules not processed for user `1b232e7a841145ba93c6d8462ccb751a`. Rule list: `[]` (Enabled: `True`). {{(pid=81592) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 17:54:41.456200 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-e91a1ab8-3d2a-4b1a-93dd-40b5b232cd78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 17:54:41.544774 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 676/1372] 10.222.0.25 () {58 vars in 1061 bytes} [Thu Sep 15 17:54:41 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 17:54:41.552639 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f9537d-025c-49e1-9658-4dc783c635c7 None None] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:54:41.554801 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-26f9537d-025c-49e1-9658-4dc783c635c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 17:54:41.587587 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:54:41.685555 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f9537d-025c-49e1-9658-4dc783c635c7 None None] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:54:41.782819 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5826d2-36bd-4f71-8211-6aebb4a6013e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b232e7a841145ba93c6d8462ccb751a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1213c0d1b584404ba3998e136f166e89', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:54:41.783808 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5826d2-36bd-4f71-8211-6aebb4a6013e service cinder] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:54:41.784140 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5826d2-36bd-4f71-8211-6aebb4a6013e service cinder] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:54:41.784311 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5826d2-36bd-4f71-8211-6aebb4a6013e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:54:41.786146 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-5f5826d2-36bd-4f71-8211-6aebb4a6013e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 17:54:41.920072 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:54:41.964416 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f5826d2-36bd-4f71-8211-6aebb4a6013e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:54:41.966035 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f5826d2-36bd-4f71-8211-6aebb4a6013e service cinder] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:54:41.987986 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 697/1373] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 15 17:54:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 436 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 17:54:43.213204 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51576a5c-4c84-4418-8c22-1a8bf7523620 None None] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:54:43.213819 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51576a5c-4c84-4418-8c22-1a8bf7523620 None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:54:43.213819 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51576a5c-4c84-4418-8c22-1a8bf7523620 None None] PATH_INFO: `/` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:54:43.215144 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 677/1374] 10.222.0.25 () {54 vars in 927 bytes} [Thu Sep 15 17:54:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 17:54:43.220887 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1650eba8-b589-4f49-a6dd-3247db0f1ee1 None None] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:54:43.221471 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1650eba8-b589-4f49-a6dd-3247db0f1ee1 None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:54:43.221471 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1650eba8-b589-4f49-a6dd-3247db0f1ee1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:54:43.292778 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.auth.core [None req-1650eba8-b589-4f49-a6dd-3247db0f1ee1 None None] MFA Rules not processed for user `5cfa58ef86774ab7800bf91930bf6028`. Rule list: `[]` (Enabled: `True`). {{(pid=81593) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 17:54:43.294100 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-1650eba8-b589-4f49-a6dd-3247db0f1ee1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 17:54:43.395228 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 698/1375] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Sep 15 17:54:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 17:54:43.687989 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51576a5c-4c84-4418-8c22-1a8bf7523620 None None] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:54:43.689559 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-51576a5c-4c84-4418-8c22-1a8bf7523620 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 17:54:43.787587 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:54:43.856002 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51576a5c-4c84-4418-8c22-1a8bf7523620 None None] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:54:43.978655 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7025518-1e83-47d8-b13c-ed8a1abce19b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe2244818e4d4dca9c424cd078653e6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1213c0d1b584404ba3998e136f166e89', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:54:43.979474 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7025518-1e83-47d8-b13c-ed8a1abce19b service nova] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:54:43.979749 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7025518-1e83-47d8-b13c-ed8a1abce19b service nova] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:54:43.980015 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7025518-1e83-47d8-b13c-ed8a1abce19b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:54:43.981658 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-a7025518-1e83-47d8-b13c-ed8a1abce19b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 17:54:44.049436 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:54:44.127936 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7025518-1e83-47d8-b13c-ed8a1abce19b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:54:44.129822 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7025518-1e83-47d8-b13c-ed8a1abce19b service nova] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:54:44.153776 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 678/1376] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 15 17:54:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 466 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 17:54:46.486133 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca93997-bcd6-4dc7-b422-6165bcd85623 None None] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:54:46.486750 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca93997-bcd6-4dc7-b422-6165bcd85623 None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:54:46.486750 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca93997-bcd6-4dc7-b422-6165bcd85623 None None] PATH_INFO: `/` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:54:46.488179 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 699/1377] 10.222.0.25 () {54 vars in 927 bytes} [Thu Sep 15 17:54:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 17:54:46.493738 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a04a0a-49f5-4660-a0f2-e8ae4c79f4f2 None None] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:54:46.494254 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a04a0a-49f5-4660-a0f2-e8ae4c79f4f2 None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:54:46.494254 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a04a0a-49f5-4660-a0f2-e8ae4c79f4f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:54:46.574786 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.auth.core [None req-01a04a0a-49f5-4660-a0f2-e8ae4c79f4f2 None None] MFA Rules not processed for user `5cfa58ef86774ab7800bf91930bf6028`. Rule list: `[]` (Enabled: `True`). {{(pid=81592) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 17:54:46.576268 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-01a04a0a-49f5-4660-a0f2-e8ae4c79f4f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 17:54:46.711913 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 679/1378] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Sep 15 17:54:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 17:54:47.006809 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca93997-bcd6-4dc7-b422-6165bcd85623 None None] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:54:47.008662 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-3ca93997-bcd6-4dc7-b422-6165bcd85623 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 17:54:47.053106 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:54:47.183948 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca93997-bcd6-4dc7-b422-6165bcd85623 None None] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:54:47.317464 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:54:47.325182 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed642ed-617a-4cbc-80d0-69348813fedb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe2244818e4d4dca9c424cd078653e6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1213c0d1b584404ba3998e136f166e89', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:54:47.326115 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed642ed-617a-4cbc-80d0-69348813fedb service nova] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:54:47.326397 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed642ed-617a-4cbc-80d0-69348813fedb service nova] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:54:47.326673 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed642ed-617a-4cbc-80d0-69348813fedb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:54:47.328382 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-9ed642ed-617a-4cbc-80d0-69348813fedb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 17:54:47.442894 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed642ed-617a-4cbc-80d0-69348813fedb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:54:47.444585 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed642ed-617a-4cbc-80d0-69348813fedb service nova] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:54:47.466522 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 700/1379] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 15 17:54:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 460 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 17:54:49.975310 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fdebb4-3c46-4455-84fe-79cfc461dce2 None None] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:54:49.975746 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fdebb4-3c46-4455-84fe-79cfc461dce2 None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:54:49.975956 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fdebb4-3c46-4455-84fe-79cfc461dce2 None None] PATH_INFO: `/` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:54:49.977334 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 680/1380] 10.222.0.25 () {54 vars in 927 bytes} [Thu Sep 15 17:54:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 17:54:49.984064 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b664f1f7-84b1-446a-9d7a-7bf9e5723313 None None] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:54:49.984512 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b664f1f7-84b1-446a-9d7a-7bf9e5723313 None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:54:49.985002 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b664f1f7-84b1-446a-9d7a-7bf9e5723313 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:54:50.076135 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.auth.core [None req-b664f1f7-84b1-446a-9d7a-7bf9e5723313 None None] MFA Rules not processed for user `5cfa58ef86774ab7800bf91930bf6028`. Rule list: `[]` (Enabled: `True`). {{(pid=81593) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 17:54:50.077436 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-b664f1f7-84b1-446a-9d7a-7bf9e5723313 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 17:54:50.174832 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:54:50.232669 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 701/1381] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Sep 15 17:54:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 250 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 17:54:50.620963 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9fdebb4-3c46-4455-84fe-79cfc461dce2 None None] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:54:50.623043 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-c9fdebb4-3c46-4455-84fe-79cfc461dce2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 17:54:50.661164 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:54:50.793238 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9fdebb4-3c46-4455-84fe-79cfc461dce2 None None] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:54:50.939716 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:54:50.967588 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e6bbf3-767a-4cb7-a0db-b3996bf9252e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe2244818e4d4dca9c424cd078653e6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1213c0d1b584404ba3998e136f166e89', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:54:50.968301 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e6bbf3-767a-4cb7-a0db-b3996bf9252e service nova] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:54:50.968576 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e6bbf3-767a-4cb7-a0db-b3996bf9252e service nova] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:54:50.968801 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e6bbf3-767a-4cb7-a0db-b3996bf9252e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:54:50.970764 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-a4e6bbf3-767a-4cb7-a0db-b3996bf9252e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 17:54:51.131598 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e6bbf3-767a-4cb7-a0db-b3996bf9252e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:54:51.133370 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e6bbf3-767a-4cb7-a0db-b3996bf9252e service nova] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:54:51.155241 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 681/1382] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 15 17:54:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 536 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 17:54:53.579699 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edee650-7db1-431d-8ab4-8f4f0fec60b4 None None] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:54:53.580273 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edee650-7db1-431d-8ab4-8f4f0fec60b4 None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:54:53.580490 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edee650-7db1-431d-8ab4-8f4f0fec60b4 None None] PATH_INFO: `/` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:54:53.582344 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 702/1383] 10.222.0.25 () {54 vars in 927 bytes} [Thu Sep 15 17:54:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 15 17:54:53.588563 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40302911-748f-4992-8798-0f8775aa69ec None None] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:54:53.589540 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40302911-748f-4992-8798-0f8775aa69ec None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:54:53.589784 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40302911-748f-4992-8798-0f8775aa69ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:54:53.693697 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.auth.core [None req-40302911-748f-4992-8798-0f8775aa69ec None None] MFA Rules not processed for user `5cfa58ef86774ab7800bf91930bf6028`. Rule list: `[]` (Enabled: `True`). {{(pid=81592) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 17:54:53.694928 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-40302911-748f-4992-8798-0f8775aa69ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 17:54:53.760347 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:54:53.814601 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 682/1384] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Sep 15 17:54:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 17:54:54.107896 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5edee650-7db1-431d-8ab4-8f4f0fec60b4 None None] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:54:54.109541 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-5edee650-7db1-431d-8ab4-8f4f0fec60b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 17:54:54.278423 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5edee650-7db1-431d-8ab4-8f4f0fec60b4 None None] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:54:54.340035 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:54:54.428220 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599f1ce0-287e-4359-a9c0-3b2e7095d7ef service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe2244818e4d4dca9c424cd078653e6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1213c0d1b584404ba3998e136f166e89', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:54:54.428826 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599f1ce0-287e-4359-a9c0-3b2e7095d7ef service nova] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:54:54.429101 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599f1ce0-287e-4359-a9c0-3b2e7095d7ef service nova] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:54:54.429399 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599f1ce0-287e-4359-a9c0-3b2e7095d7ef service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:54:54.431051 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-599f1ce0-287e-4359-a9c0-3b2e7095d7ef service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 17:54:54.535230 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599f1ce0-287e-4359-a9c0-3b2e7095d7ef service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:54:54.536949 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599f1ce0-287e-4359-a9c0-3b2e7095d7ef service nova] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:54:54.556688 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 703/1385] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 15 17:54:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 449 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 17:54:56.804784 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff9a7e9-e588-4b42-b98e-9eeb3e85df84 None None] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:54:56.805366 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff9a7e9-e588-4b42-b98e-9eeb3e85df84 None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:54:56.805366 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff9a7e9-e588-4b42-b98e-9eeb3e85df84 None None] PATH_INFO: `/` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:54:56.806749 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 683/1386] 10.222.0.25 () {54 vars in 927 bytes} [Thu Sep 15 17:54:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 17:54:56.813243 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5c848a-8839-4b6c-ad7c-44ebab315d0f None None] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:54:56.813807 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5c848a-8839-4b6c-ad7c-44ebab315d0f None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:54:56.813900 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5c848a-8839-4b6c-ad7c-44ebab315d0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:54:56.910405 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.auth.core [None req-db5c848a-8839-4b6c-ad7c-44ebab315d0f None None] MFA Rules not processed for user `5cfa58ef86774ab7800bf91930bf6028`. Rule list: `[]` (Enabled: `True`). {{(pid=81593) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 17:54:56.911644 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-db5c848a-8839-4b6c-ad7c-44ebab315d0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 17:54:56.930201 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:54:57.055375 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 704/1387] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Sep 15 17:54:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 17:54:57.391046 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff9a7e9-e588-4b42-b98e-9eeb3e85df84 None None] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:54:57.392701 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-5ff9a7e9-e588-4b42-b98e-9eeb3e85df84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 17:54:57.562304 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff9a7e9-e588-4b42-b98e-9eeb3e85df84 None None] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:54:57.612548 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:54:57.687145 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b6d309-b627-4d42-9708-f9235fb1b6b2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe2244818e4d4dca9c424cd078653e6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1213c0d1b584404ba3998e136f166e89', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:54:57.687673 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b6d309-b627-4d42-9708-f9235fb1b6b2 service nova] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:54:57.688477 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b6d309-b627-4d42-9708-f9235fb1b6b2 service nova] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:54:57.688477 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b6d309-b627-4d42-9708-f9235fb1b6b2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:54:57.689932 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-e1b6d309-b627-4d42-9708-f9235fb1b6b2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 17:54:57.791341 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b6d309-b627-4d42-9708-f9235fb1b6b2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:54:57.793683 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b6d309-b627-4d42-9708-f9235fb1b6b2 service nova] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:54:57.813714 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 684/1388] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 15 17:54:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 423 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 15 17:54:57.977395 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6e66aa-a000-4440-9970-0274af0ea8a5 None None] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:54:57.977935 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6e66aa-a000-4440-9970-0274af0ea8a5 None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:54:57.977935 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6e66aa-a000-4440-9970-0274af0ea8a5 None None] PATH_INFO: `/` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:54:57.979832 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 705/1389] 10.222.0.25 () {54 vars in 927 bytes} [Thu Sep 15 17:54:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 17:54:57.985348 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f671f74b-0541-4117-8cff-bdfe7d529a25 None None] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:54:57.985641 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f671f74b-0541-4117-8cff-bdfe7d529a25 None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:54:57.986051 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f671f74b-0541-4117-8cff-bdfe7d529a25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:54:58.076872 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:54:58.080784 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.auth.core [None req-f671f74b-0541-4117-8cff-bdfe7d529a25 None None] MFA Rules not processed for user `5cfa58ef86774ab7800bf91930bf6028`. Rule list: `[]` (Enabled: `True`). {{(pid=81592) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 17:54:58.082479 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-f671f74b-0541-4117-8cff-bdfe7d529a25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 17:54:58.201559 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 685/1390] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Sep 15 17:54:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 17:54:58.511621 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ba252c-0f6f-4bd2-ad4d-3efd73c7e3ce None None] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:54:58.511939 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ba252c-0f6f-4bd2-ad4d-3efd73c7e3ce None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:54:58.512205 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ba252c-0f6f-4bd2-ad4d-3efd73c7e3ce None None] PATH_INFO: `/` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:54:58.513609 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 706/1391] 10.222.0.25 () {54 vars in 962 bytes} [Thu Sep 15 17:54:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 17:54:58.520279 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24cb5ba-5dd7-4c09-b306-2955488d63e9 None None] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:54:58.520739 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24cb5ba-5dd7-4c09-b306-2955488d63e9 None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:54:58.521225 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24cb5ba-5dd7-4c09-b306-2955488d63e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:54:58.645802 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.auth.core [None req-a24cb5ba-5dd7-4c09-b306-2955488d63e9 None None] MFA Rules not processed for user `c194f79928aa4a4d94619c417b4e39e9`. Rule list: `[]` (Enabled: `True`). {{(pid=81592) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 17:54:58.647054 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-a24cb5ba-5dd7-4c09-b306-2955488d63e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 17:54:58.755834 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:54:58.763186 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 686/1392] 10.222.0.25 () {58 vars in 1059 bytes} [Thu Sep 15 17:54:58 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 17:54:58.778223 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ba252c-0f6f-4bd2-ad4d-3efd73c7e3ce None None] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:54:58.779953 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-b1ba252c-0f6f-4bd2-ad4d-3efd73c7e3ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 17:54:58.899002 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ba252c-0f6f-4bd2-ad4d-3efd73c7e3ce None None] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:54:58.950497 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:54:59.006261 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c91561-f076-417f-955a-b62fd49caa56 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c194f79928aa4a4d94619c417b4e39e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1213c0d1b584404ba3998e136f166e89', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:54:59.006941 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c91561-f076-417f-955a-b62fd49caa56 service glance] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:54:59.007059 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c91561-f076-417f-955a-b62fd49caa56 service glance] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:54:59.007313 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c91561-f076-417f-955a-b62fd49caa56 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:54:59.008988 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-05c91561-f076-417f-955a-b62fd49caa56 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 17:54:59.141099 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c91561-f076-417f-955a-b62fd49caa56 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:54:59.142907 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c91561-f076-417f-955a-b62fd49caa56 service glance] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:54:59.169046 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 707/1393] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 15 17:54:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 388 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 15 17:54:59.996714 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fb188e-e739-4b69-b834-dfd7f01b0b93 None None] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:54:59.997373 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fb188e-e739-4b69-b834-dfd7f01b0b93 None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:54:59.997767 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fb188e-e739-4b69-b834-dfd7f01b0b93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:55:00.102043 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.auth.core [None req-20fb188e-e739-4b69-b834-dfd7f01b0b93 None None] MFA Rules not processed for user `d899ec4fcbeb4de382c7f0a779ca8ed5`. Rule list: `[]` (Enabled: `True`). {{(pid=81592) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 17:55:00.103323 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-20fb188e-e739-4b69-b834-dfd7f01b0b93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 17:55:00.133168 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bc32c4-28c0-4777-adfa-325fb5ea2e79 None None] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:55:00.133900 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bc32c4-28c0-4777-adfa-325fb5ea2e79 None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:55:00.133900 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bc32c4-28c0-4777-adfa-325fb5ea2e79 None None] PATH_INFO: `/` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:55:00.135253 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 708/1394] 10.222.0.25 () {54 vars in 927 bytes} [Thu Sep 15 17:55:00 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 15 17:55:00.144514 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6cfc46-ba77-4546-9e63-beb85a79a6b5 None None] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:55:00.144805 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6cfc46-ba77-4546-9e63-beb85a79a6b5 None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:55:00.145073 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6cfc46-ba77-4546-9e63-beb85a79a6b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:55:00.210035 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 687/1395] 10.222.0.25 () {58 vars in 1009 bytes} [Thu Sep 15 17:54:59 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 17:55:00.224108 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.auth.core [None req-4d6cfc46-ba77-4546-9e63-beb85a79a6b5 None None] MFA Rules not processed for user `5cfa58ef86774ab7800bf91930bf6028`. Rule list: `[]` (Enabled: `True`). {{(pid=81593) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 17:55:00.225412 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-4d6cfc46-ba77-4546-9e63-beb85a79a6b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 17:55:00.250015 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:55:00.258316 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c35211-4b0e-4129-b39f-1da85dc08073 None None] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:55:00.258604 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c35211-4b0e-4129-b39f-1da85dc08073 None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:55:00.258880 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c35211-4b0e-4129-b39f-1da85dc08073 None None] PATH_INFO: `/` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:55:00.260260 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 688/1396] 10.222.0.25 () {54 vars in 943 bytes} [Thu Sep 15 17:55:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 15 17:55:00.267835 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b85d47c-060c-4a51-be1e-b548e4640852 None None] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:55:00.268122 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b85d47c-060c-4a51-be1e-b548e4640852 None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:55:00.268399 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b85d47c-060c-4a51-be1e-b548e4640852 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:55:00.351677 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 709/1397] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Sep 15 17:55:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 17:55:00.358101 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.auth.core [None req-9b85d47c-060c-4a51-be1e-b548e4640852 None None] MFA Rules not processed for user `685f7ad4c6fe4c878d542dddd6d81593`. Rule list: `[]` (Enabled: `True`). {{(pid=81592) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 17:55:00.360074 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-9b85d47c-060c-4a51-be1e-b548e4640852 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 17:55:00.400970 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:55:00.511908 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 689/1398] 10.222.0.25 () {58 vars in 1040 bytes} [Thu Sep 15 17:55:00 2022] POST /identity/v3/auth/tokens => generated 3304 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 17:55:00.522654 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6cfc46-ba77-4546-9e63-beb85a79a6b5 None None] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:55:00.523974 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-4d6cfc46-ba77-4546-9e63-beb85a79a6b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 17:55:00.664498 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6cfc46-ba77-4546-9e63-beb85a79a6b5 None None] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:55:00.668598 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b85d47c-060c-4a51-be1e-b548e4640852 None None] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:55:00.669884 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-9b85d47c-060c-4a51-be1e-b548e4640852 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 17:55:00.724724 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:55:00.793941 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b85d47c-060c-4a51-be1e-b548e4640852 None None] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:55:00.795952 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81bc0ac4-523e-452a-bdb5-41c8d17e87ea service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '685f7ad4c6fe4c878d542dddd6d81593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1213c0d1b584404ba3998e136f166e89', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:55:00.796571 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bc0ac4-523e-452a-bdb5-41c8d17e87ea service swift] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:55:00.796856 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bc0ac4-523e-452a-bdb5-41c8d17e87ea service swift] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:55:00.797123 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bc0ac4-523e-452a-bdb5-41c8d17e87ea service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:55:00.798854 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-81bc0ac4-523e-452a-bdb5-41c8d17e87ea service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 17:55:00.874446 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:55:00.920126 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81bc0ac4-523e-452a-bdb5-41c8d17e87ea service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:55:00.923580 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81bc0ac4-523e-452a-bdb5-41c8d17e87ea service swift] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:55:00.938163 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 710/1399] 10.222.0.25 () {60 vars in 1384 bytes} [Thu Sep 15 17:55:00 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 416 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 15 17:55:00.973129 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba70a83-09f8-4385-8f42-4674fefeca79 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe2244818e4d4dca9c424cd078653e6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1213c0d1b584404ba3998e136f166e89', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:55:00.973785 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba70a83-09f8-4385-8f42-4674fefeca79 service nova] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:55:00.974065 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba70a83-09f8-4385-8f42-4674fefeca79 service nova] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:55:00.974338 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba70a83-09f8-4385-8f42-4674fefeca79 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:55:00.976252 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-8ba70a83-09f8-4385-8f42-4674fefeca79 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 17:55:01.109481 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba70a83-09f8-4385-8f42-4674fefeca79 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:55:01.111155 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba70a83-09f8-4385-8f42-4674fefeca79 service nova] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:55:01.133532 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 690/1400] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 15 17:55:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 465 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 15 17:55:03.503623 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9a4ce7-ebb0-432d-ad05-8df504c73b8e None None] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:55:03.504237 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9a4ce7-ebb0-432d-ad05-8df504c73b8e None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:55:03.504237 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9a4ce7-ebb0-432d-ad05-8df504c73b8e None None] PATH_INFO: `/` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:55:03.505880 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 711/1401] 10.222.0.25 () {54 vars in 927 bytes} [Thu Sep 15 17:55:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 17:55:03.512001 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55929c3d-c446-4fc4-b776-9672a08c0138 None None] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:55:03.512542 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55929c3d-c446-4fc4-b776-9672a08c0138 None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:55:03.512542 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55929c3d-c446-4fc4-b776-9672a08c0138 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:55:03.591249 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.auth.core [None req-55929c3d-c446-4fc4-b776-9672a08c0138 None None] MFA Rules not processed for user `5cfa58ef86774ab7800bf91930bf6028`. Rule list: `[]` (Enabled: `True`). {{(pid=81592) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 17:55:03.592501 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-55929c3d-c446-4fc4-b776-9672a08c0138 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 17:55:03.597583 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:55:03.732718 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 691/1402] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Sep 15 17:55:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 17:55:04.066020 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9a4ce7-ebb0-432d-ad05-8df504c73b8e None None] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:55:04.071642 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-4e9a4ce7-ebb0-432d-ad05-8df504c73b8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 17:55:04.177407 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:55:04.306956 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9a4ce7-ebb0-432d-ad05-8df504c73b8e None None] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:55:04.460628 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e13cbec-af1d-47d5-8205-e4878e99bf63 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe2244818e4d4dca9c424cd078653e6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1213c0d1b584404ba3998e136f166e89', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:55:04.461156 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e13cbec-af1d-47d5-8205-e4878e99bf63 service nova] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:55:04.461476 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e13cbec-af1d-47d5-8205-e4878e99bf63 service nova] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:55:04.461750 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e13cbec-af1d-47d5-8205-e4878e99bf63 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:55:04.463391 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-2e13cbec-af1d-47d5-8205-e4878e99bf63 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 17:55:04.518187 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:55:04.573446 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e13cbec-af1d-47d5-8205-e4878e99bf63 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:55:04.575140 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e13cbec-af1d-47d5-8205-e4878e99bf63 service nova] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:55:04.597346 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 712/1403] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 15 17:55:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 532 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 17:55:06.969711 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d97e4f-1b20-48ae-9f3b-10d4109a95bf None None] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:55:06.970301 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d97e4f-1b20-48ae-9f3b-10d4109a95bf None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:55:06.970301 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d97e4f-1b20-48ae-9f3b-10d4109a95bf None None] PATH_INFO: `/` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:55:06.971597 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 692/1404] 10.222.0.25 () {54 vars in 927 bytes} [Thu Sep 15 17:55:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 17:55:06.981684 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab449ee-86bd-477d-a1f7-fbc66f1a1aa2 None None] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:55:06.981684 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab449ee-86bd-477d-a1f7-fbc66f1a1aa2 None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:55:06.981684 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab449ee-86bd-477d-a1f7-fbc66f1a1aa2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:55:07.052152 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.auth.core [None req-8ab449ee-86bd-477d-a1f7-fbc66f1a1aa2 None None] MFA Rules not processed for user `5cfa58ef86774ab7800bf91930bf6028`. Rule list: `[]` (Enabled: `True`). {{(pid=81593) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 17:55:07.053748 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-8ab449ee-86bd-477d-a1f7-fbc66f1a1aa2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 17:55:07.177348 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 713/1405] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Sep 15 17:55:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 17:55:07.473611 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d97e4f-1b20-48ae-9f3b-10d4109a95bf None None] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:55:07.475273 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-95d97e4f-1b20-48ae-9f3b-10d4109a95bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 17:55:07.665342 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:55:07.683679 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d97e4f-1b20-48ae-9f3b-10d4109a95bf None None] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:55:07.824924 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f347c41-7ba3-4f1d-a46d-7fc5376baac5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe2244818e4d4dca9c424cd078653e6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1213c0d1b584404ba3998e136f166e89', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:55:07.825555 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f347c41-7ba3-4f1d-a46d-7fc5376baac5 service nova] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:55:07.825834 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f347c41-7ba3-4f1d-a46d-7fc5376baac5 service nova] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:55:07.826104 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f347c41-7ba3-4f1d-a46d-7fc5376baac5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:55:07.827718 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-4f347c41-7ba3-4f1d-a46d-7fc5376baac5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 17:55:07.934464 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f347c41-7ba3-4f1d-a46d-7fc5376baac5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:55:07.936112 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f347c41-7ba3-4f1d-a46d-7fc5376baac5 service nova] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:55:07.953924 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:55:07.965093 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 693/1406] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 15 17:55:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 492 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 17:55:10.263931 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899b51ce-5b5a-489b-aa3c-f37e3f3b5437 None None] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:55:10.264746 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899b51ce-5b5a-489b-aa3c-f37e3f3b5437 None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:55:10.264746 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899b51ce-5b5a-489b-aa3c-f37e3f3b5437 None None] PATH_INFO: `/` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:55:10.265892 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 714/1407] 10.222.0.25 () {54 vars in 927 bytes} [Thu Sep 15 17:55:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 17:55:10.271581 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd966a36-47ea-4163-81b5-e3af1cafc1c8 None None] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:55:10.272251 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd966a36-47ea-4163-81b5-e3af1cafc1c8 None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:55:10.272251 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd966a36-47ea-4163-81b5-e3af1cafc1c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:55:10.389865 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.auth.core [None req-dd966a36-47ea-4163-81b5-e3af1cafc1c8 None None] MFA Rules not processed for user `5cfa58ef86774ab7800bf91930bf6028`. Rule list: `[]` (Enabled: `True`). {{(pid=81592) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 17:55:10.391126 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-dd966a36-47ea-4163-81b5-e3af1cafc1c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 17:55:10.517026 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 694/1408] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Sep 15 17:55:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 17:55:10.813260 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899b51ce-5b5a-489b-aa3c-f37e3f3b5437 None None] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:55:10.814815 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-899b51ce-5b5a-489b-aa3c-f37e3f3b5437 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 17:55:10.839666 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:55:11.003030 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899b51ce-5b5a-489b-aa3c-f37e3f3b5437 None None] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:55:11.104309 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:55:11.129980 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f497ca0-a7c4-46f4-96cb-96f37710b4bc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe2244818e4d4dca9c424cd078653e6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1213c0d1b584404ba3998e136f166e89', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:55:11.130586 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f497ca0-a7c4-46f4-96cb-96f37710b4bc service nova] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:55:11.131434 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f497ca0-a7c4-46f4-96cb-96f37710b4bc service nova] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:55:11.131698 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f497ca0-a7c4-46f4-96cb-96f37710b4bc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:55:11.133316 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-0f497ca0-a7c4-46f4-96cb-96f37710b4bc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 17:55:11.236255 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f497ca0-a7c4-46f4-96cb-96f37710b4bc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:55:11.237916 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f497ca0-a7c4-46f4-96cb-96f37710b4bc service nova] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:55:11.260268 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 715/1409] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 15 17:55:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 447 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 17:55:20.515438 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=68 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:55:21.257002 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=54 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:55:24.700794 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fe8e2c-5ca2-4f9f-9f82-2a08a1ca3a6b None None] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:55:24.701380 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fe8e2c-5ca2-4f9f-9f82-2a08a1ca3a6b None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:55:24.701380 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fe8e2c-5ca2-4f9f-9f82-2a08a1ca3a6b None None] PATH_INFO: `/` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:55:24.702741 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 695/1410] 10.222.0.25 () {54 vars in 918 bytes} [Thu Sep 15 17:55:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 17:55:24.708069 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20538e45-f273-49eb-a5e5-3ffcacf75be2 None None] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:55:24.708561 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20538e45-f273-49eb-a5e5-3ffcacf75be2 None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:55:24.708671 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20538e45-f273-49eb-a5e5-3ffcacf75be2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:55:24.784858 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.auth.core [None req-20538e45-f273-49eb-a5e5-3ffcacf75be2 None None] MFA Rules not processed for user `10af119bd39841ed8163993676230fca`. Rule list: `[]` (Enabled: `True`). {{(pid=81593) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 17:55:24.786112 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-20538e45-f273-49eb-a5e5-3ffcacf75be2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 17:55:24.903546 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 716/1411] 10.222.0.25 () {58 vars in 1015 bytes} [Thu Sep 15 17:55:24 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 17:55:24.920796 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a013f3f-ab48-42ba-83a2-a32951edb95e None None] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:55:24.921064 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a013f3f-ab48-42ba-83a2-a32951edb95e None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:55:24.921360 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a013f3f-ab48-42ba-83a2-a32951edb95e None None] PATH_INFO: `/` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:55:24.922722 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 696/1412] 10.222.0.25 () {54 vars in 918 bytes} [Thu Sep 15 17:55:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 17:55:24.928221 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c318fb-ed33-49c0-bac5-6fe1669cd2bc None None] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:55:24.928506 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c318fb-ed33-49c0-bac5-6fe1669cd2bc None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:55:24.928776 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c318fb-ed33-49c0-bac5-6fe1669cd2bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:55:25.003849 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:55:25.007065 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.auth.core [None req-a0c318fb-ed33-49c0-bac5-6fe1669cd2bc None None] MFA Rules not processed for user `fe2244818e4d4dca9c424cd078653e6a`. Rule list: `[]` (Enabled: `True`). {{(pid=81593) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 17:55:25.008887 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-a0c318fb-ed33-49c0-bac5-6fe1669cd2bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 17:55:25.129858 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 717/1413] 10.222.0.25 () {58 vars in 1015 bytes} [Thu Sep 15 17:55:24 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 17:55:27.768750 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6c606a-9f89-499b-8c34-d8fd82b78b13 None None] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:55:27.769358 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6c606a-9f89-499b-8c34-d8fd82b78b13 None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:55:27.769358 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6c606a-9f89-499b-8c34-d8fd82b78b13 None None] PATH_INFO: `/` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:55:27.770674 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 697/1414] 127.0.0.1 () {54 vars in 917 bytes} [Thu Sep 15 17:55:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 17:55:27.776115 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d207e2-7272-479c-8d15-245178b3b2fc None None] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:55:27.776644 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d207e2-7272-479c-8d15-245178b3b2fc None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:55:27.776788 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d207e2-7272-479c-8d15-245178b3b2fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:55:27.844659 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.auth.core [None req-81d207e2-7272-479c-8d15-245178b3b2fc None None] MFA Rules not processed for user `5cfa58ef86774ab7800bf91930bf6028`. Rule list: `[]` (Enabled: `True`). {{(pid=81593) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 17:55:27.845908 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-81d207e2-7272-479c-8d15-245178b3b2fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 17:55:27.902838 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:55:27.948356 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 718/1415] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Sep 15 17:55:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 17:55:28.250639 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6c606a-9f89-499b-8c34-d8fd82b78b13 None None] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:55:28.252364 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-2a6c606a-9f89-499b-8c34-d8fd82b78b13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 17:55:28.427022 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6c606a-9f89-499b-8c34-d8fd82b78b13 None None] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:55:28.506870 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:55:28.551571 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18048c54-dece-4d2a-9ed9-f7c67b620c45 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe2244818e4d4dca9c424cd078653e6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1213c0d1b584404ba3998e136f166e89', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:55:28.552184 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18048c54-dece-4d2a-9ed9-f7c67b620c45 service nova] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:55:28.552467 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18048c54-dece-4d2a-9ed9-f7c67b620c45 service nova] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:55:28.552742 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18048c54-dece-4d2a-9ed9-f7c67b620c45 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:55:28.554396 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-18048c54-dece-4d2a-9ed9-f7c67b620c45 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 17:55:28.650015 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18048c54-dece-4d2a-9ed9-f7c67b620c45 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:55:28.652616 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18048c54-dece-4d2a-9ed9-f7c67b620c45 service nova] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:55:28.671542 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 698/1416] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 15 17:55:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 422 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 17:55:29.836213 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638efa72-8a1b-4953-a7e1-8b368db7c306 None None] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:55:29.836810 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638efa72-8a1b-4953-a7e1-8b368db7c306 None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:55:29.836810 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638efa72-8a1b-4953-a7e1-8b368db7c306 None None] PATH_INFO: `/` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:55:29.838152 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 719/1417] 127.0.0.1 () {54 vars in 901 bytes} [Thu Sep 15 17:55:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 17:55:29.846043 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34f9cb9-e2b8-43c1-b4a0-da1b070ee7c9 None None] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:55:29.846553 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34f9cb9-e2b8-43c1-b4a0-da1b070ee7c9 None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:55:29.846905 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34f9cb9-e2b8-43c1-b4a0-da1b070ee7c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:55:29.933525 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.auth.core [None req-e34f9cb9-e2b8-43c1-b4a0-da1b070ee7c9 None None] MFA Rules not processed for user `5cfa58ef86774ab7800bf91930bf6028`. Rule list: `[]` (Enabled: `True`). {{(pid=81592) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 17:55:29.934769 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-e34f9cb9-e2b8-43c1-b4a0-da1b070ee7c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 17:55:29.965127 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:55:30.040145 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 699/1418] 127.0.0.1 () {58 vars in 998 bytes} [Thu Sep 15 17:55:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 17:55:30.191801 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638efa72-8a1b-4953-a7e1-8b368db7c306 None None] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:55:30.193401 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-638efa72-8a1b-4953-a7e1-8b368db7c306 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 17:55:30.342526 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638efa72-8a1b-4953-a7e1-8b368db7c306 None None] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:55:30.385246 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:55:30.460958 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f39c11a-cc8c-4b3e-8400-17c66db1fb20 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe2244818e4d4dca9c424cd078653e6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1213c0d1b584404ba3998e136f166e89', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:55:30.461603 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f39c11a-cc8c-4b3e-8400-17c66db1fb20 service nova] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:55:30.461879 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f39c11a-cc8c-4b3e-8400-17c66db1fb20 service nova] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:55:30.462144 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f39c11a-cc8c-4b3e-8400-17c66db1fb20 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:55:30.463787 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-1f39c11a-cc8c-4b3e-8400-17c66db1fb20 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 17:55:30.557263 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f39c11a-cc8c-4b3e-8400-17c66db1fb20 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:55:30.559511 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f39c11a-cc8c-4b3e-8400-17c66db1fb20 service nova] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:55:30.577576 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 720/1419] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 15 17:55:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 386 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 17:55:31.729109 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c404f5-7123-4260-877b-c34b3a265c57 None None] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:55:31.729731 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c404f5-7123-4260-877b-c34b3a265c57 None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:55:31.729830 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c404f5-7123-4260-877b-c34b3a265c57 None None] PATH_INFO: `/` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:55:31.731127 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 700/1420] 127.0.0.1 () {54 vars in 901 bytes} [Thu Sep 15 17:55:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 17:55:31.737808 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eaf67ac-dd88-4231-b3e9-6b60090368cb None None] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:55:31.738325 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eaf67ac-dd88-4231-b3e9-6b60090368cb None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:55:31.738421 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eaf67ac-dd88-4231-b3e9-6b60090368cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:55:31.793867 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:55:31.816327 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.auth.core [None req-2eaf67ac-dd88-4231-b3e9-6b60090368cb None None] MFA Rules not processed for user `5cfa58ef86774ab7800bf91930bf6028`. Rule list: `[]` (Enabled: `True`). {{(pid=81593) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 17:55:31.817615 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-2eaf67ac-dd88-4231-b3e9-6b60090368cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 17:55:31.918426 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 721/1421] 127.0.0.1 () {58 vars in 998 bytes} [Thu Sep 15 17:55:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 17:55:32.074126 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c404f5-7123-4260-877b-c34b3a265c57 None None] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:55:32.075913 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-e0c404f5-7123-4260-877b-c34b3a265c57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 17:55:32.231754 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c404f5-7123-4260-877b-c34b3a265c57 None None] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:55:32.244353 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:55:32.355261 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149731a3-b135-42dc-bd84-206b31239eea service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe2244818e4d4dca9c424cd078653e6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1213c0d1b584404ba3998e136f166e89', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:55:32.355778 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149731a3-b135-42dc-bd84-206b31239eea service nova] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:55:32.356054 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149731a3-b135-42dc-bd84-206b31239eea service nova] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:55:32.356325 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149731a3-b135-42dc-bd84-206b31239eea service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:55:32.357982 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-149731a3-b135-42dc-bd84-206b31239eea service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 17:55:32.456221 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149731a3-b135-42dc-bd84-206b31239eea service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:55:32.457894 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149731a3-b135-42dc-bd84-206b31239eea service nova] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:55:32.477022 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 701/1422] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 15 17:55:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 403 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 17:55:33.617837 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeeef0d2-ea91-431a-acf9-fe46c540457b None None] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:55:33.618888 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeeef0d2-ea91-431a-acf9-fe46c540457b None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:55:33.618888 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeeef0d2-ea91-431a-acf9-fe46c540457b None None] PATH_INFO: `/` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:55:33.619763 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 722/1423] 127.0.0.1 () {54 vars in 901 bytes} [Thu Sep 15 17:55:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 17:55:33.627334 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b184d7-e0ad-4d47-99e7-7c2b74d1cd73 None None] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:55:33.627909 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b184d7-e0ad-4d47-99e7-7c2b74d1cd73 None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:55:33.627909 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b184d7-e0ad-4d47-99e7-7c2b74d1cd73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:55:33.648126 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:55:33.711588 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.auth.core [None req-f4b184d7-e0ad-4d47-99e7-7c2b74d1cd73 None None] MFA Rules not processed for user `5cfa58ef86774ab7800bf91930bf6028`. Rule list: `[]` (Enabled: `True`). {{(pid=81592) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 17:55:33.712771 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-f4b184d7-e0ad-4d47-99e7-7c2b74d1cd73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 17:55:33.816067 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 702/1424] 127.0.0.1 () {58 vars in 998 bytes} [Thu Sep 15 17:55:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 17:55:33.973848 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeeef0d2-ea91-431a-acf9-fe46c540457b None None] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:55:33.975277 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-eeeef0d2-ea91-431a-acf9-fe46c540457b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 17:55:34.118136 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:55:34.158370 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeeef0d2-ea91-431a-acf9-fe46c540457b None None] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:55:34.277641 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5310150-368a-46df-a333-8ec12b5fc15f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe2244818e4d4dca9c424cd078653e6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1213c0d1b584404ba3998e136f166e89', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:55:34.278244 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5310150-368a-46df-a333-8ec12b5fc15f service nova] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:55:34.278523 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5310150-368a-46df-a333-8ec12b5fc15f service nova] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:55:34.278791 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5310150-368a-46df-a333-8ec12b5fc15f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:55:34.280392 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-f5310150-368a-46df-a333-8ec12b5fc15f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 17:55:34.357840 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:55:34.373201 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5310150-368a-46df-a333-8ec12b5fc15f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:55:34.374871 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5310150-368a-46df-a333-8ec12b5fc15f service nova] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:55:34.394134 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 723/1425] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 15 17:55:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 421 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 17:55:35.524627 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4bc1a0-2bdc-4010-8107-e4ed9b521569 None None] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:55:35.525219 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4bc1a0-2bdc-4010-8107-e4ed9b521569 None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:55:35.525219 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4bc1a0-2bdc-4010-8107-e4ed9b521569 None None] PATH_INFO: `/` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:55:35.527258 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 703/1426] 127.0.0.1 () {54 vars in 901 bytes} [Thu Sep 15 17:55:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 17:55:35.534279 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760388d3-bd41-4424-b211-e6f36e9dc92b None None] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:55:35.534816 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760388d3-bd41-4424-b211-e6f36e9dc92b None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:55:35.534816 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760388d3-bd41-4424-b211-e6f36e9dc92b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:55:35.641060 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.auth.core [None req-760388d3-bd41-4424-b211-e6f36e9dc92b None None] MFA Rules not processed for user `5cfa58ef86774ab7800bf91930bf6028`. Rule list: `[]` (Enabled: `True`). {{(pid=81593) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 17:55:35.642829 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-760388d3-bd41-4424-b211-e6f36e9dc92b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 17:55:35.743788 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 724/1427] 127.0.0.1 () {58 vars in 998 bytes} [Thu Sep 15 17:55:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 17:55:35.895479 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4bc1a0-2bdc-4010-8107-e4ed9b521569 None None] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:55:35.897221 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-2b4bc1a0-2bdc-4010-8107-e4ed9b521569 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 17:55:35.987386 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:55:36.056880 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4bc1a0-2bdc-4010-8107-e4ed9b521569 None None] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:55:36.172070 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2abf08b2-b563-49a8-adf8-769cd630f2d6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe2244818e4d4dca9c424cd078653e6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1213c0d1b584404ba3998e136f166e89', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:55:36.172680 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abf08b2-b563-49a8-adf8-769cd630f2d6 service nova] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:55:36.172956 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abf08b2-b563-49a8-adf8-769cd630f2d6 service nova] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:55:36.173224 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abf08b2-b563-49a8-adf8-769cd630f2d6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:55:36.174860 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-2abf08b2-b563-49a8-adf8-769cd630f2d6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 17:55:36.226329 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:55:36.269654 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2abf08b2-b563-49a8-adf8-769cd630f2d6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:55:36.271246 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2abf08b2-b563-49a8-adf8-769cd630f2d6 service nova] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:55:36.289497 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 704/1428] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 15 17:55:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 395 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 17:55:37.361211 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8555eb-ce7b-4a3e-9191-fad2ca666d04 None None] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:55:37.362132 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8555eb-ce7b-4a3e-9191-fad2ca666d04 None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:55:37.362132 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8555eb-ce7b-4a3e-9191-fad2ca666d04 None None] PATH_INFO: `/` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:55:37.363654 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 725/1429] 127.0.0.1 () {54 vars in 901 bytes} [Thu Sep 15 17:55:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 17:55:37.371110 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b8042a-de92-4d6d-ab27-0bec1bf3783d None None] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:55:37.371650 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b8042a-de92-4d6d-ab27-0bec1bf3783d None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:55:37.371747 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b8042a-de92-4d6d-ab27-0bec1bf3783d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:55:37.450441 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.auth.core [None req-a2b8042a-de92-4d6d-ab27-0bec1bf3783d None None] MFA Rules not processed for user `5cfa58ef86774ab7800bf91930bf6028`. Rule list: `[]` (Enabled: `True`). {{(pid=81592) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 17:55:37.451762 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-a2b8042a-de92-4d6d-ab27-0bec1bf3783d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 17:55:37.557767 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 705/1430] 127.0.0.1 () {58 vars in 998 bytes} [Thu Sep 15 17:55:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 17:55:37.735062 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8555eb-ce7b-4a3e-9191-fad2ca666d04 None None] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:55:37.736716 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-ba8555eb-ce7b-4a3e-9191-fad2ca666d04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 17:55:37.786836 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:55:37.893931 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8555eb-ce7b-4a3e-9191-fad2ca666d04 None None] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:55:38.036983 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8404341-8d6c-4cac-993e-a5b48e4c7c97 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe2244818e4d4dca9c424cd078653e6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1213c0d1b584404ba3998e136f166e89', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:55:38.037631 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8404341-8d6c-4cac-993e-a5b48e4c7c97 service nova] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:55:38.037903 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8404341-8d6c-4cac-993e-a5b48e4c7c97 service nova] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:55:38.038170 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8404341-8d6c-4cac-993e-a5b48e4c7c97 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:55:38.039824 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-c8404341-8d6c-4cac-993e-a5b48e4c7c97 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 17:55:38.047803 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:55:38.152986 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8404341-8d6c-4cac-993e-a5b48e4c7c97 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:55:38.154719 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8404341-8d6c-4cac-993e-a5b48e4c7c97 service nova] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:55:38.173765 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 726/1431] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 15 17:55:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 439 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 17:55:39.260400 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bb5c74-7ac4-403e-8e79-ee19820693ff None None] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:55:39.261516 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bb5c74-7ac4-403e-8e79-ee19820693ff None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:55:39.261516 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bb5c74-7ac4-403e-8e79-ee19820693ff None None] PATH_INFO: `/` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:55:39.262806 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 706/1432] 127.0.0.1 () {54 vars in 901 bytes} [Thu Sep 15 17:55:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 17:55:39.269043 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4f4600-0f4c-405f-b522-b7907a6072f3 None None] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:55:39.269502 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4f4600-0f4c-405f-b522-b7907a6072f3 None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:55:39.269611 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4f4600-0f4c-405f-b522-b7907a6072f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:55:39.349531 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.auth.core [None req-eb4f4600-0f4c-405f-b522-b7907a6072f3 None None] MFA Rules not processed for user `5cfa58ef86774ab7800bf91930bf6028`. Rule list: `[]` (Enabled: `True`). {{(pid=81593) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 17:55:39.350751 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-eb4f4600-0f4c-405f-b522-b7907a6072f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 17:55:39.423465 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:55:39.453696 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 727/1433] 127.0.0.1 () {58 vars in 998 bytes} [Thu Sep 15 17:55:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 17:55:39.608243 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39bb5c74-7ac4-403e-8e79-ee19820693ff None None] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:55:39.610010 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-39bb5c74-7ac4-403e-8e79-ee19820693ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 17:55:39.636131 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:55:39.772937 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39bb5c74-7ac4-403e-8e79-ee19820693ff None None] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:55:39.864391 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:55:39.890992 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a9facd-6cbf-4093-8abd-24f4af93d08c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe2244818e4d4dca9c424cd078653e6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1213c0d1b584404ba3998e136f166e89', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:55:39.891608 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a9facd-6cbf-4093-8abd-24f4af93d08c service nova] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:55:39.891887 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a9facd-6cbf-4093-8abd-24f4af93d08c service nova] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:55:39.892159 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a9facd-6cbf-4093-8abd-24f4af93d08c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:55:39.893819 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-45a9facd-6cbf-4093-8abd-24f4af93d08c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 17:55:39.991556 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a9facd-6cbf-4093-8abd-24f4af93d08c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:55:39.993205 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a9facd-6cbf-4093-8abd-24f4af93d08c service nova] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:55:40.011957 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 707/1434] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 15 17:55:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 404 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 17:55:41.089331 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721a8eac-563d-49e5-a7d9-a51f0c32b8b1 None None] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:55:41.089900 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721a8eac-563d-49e5-a7d9-a51f0c32b8b1 None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:55:41.089900 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721a8eac-563d-49e5-a7d9-a51f0c32b8b1 None None] PATH_INFO: `/` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:55:41.091217 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 728/1435] 127.0.0.1 () {54 vars in 901 bytes} [Thu Sep 15 17:55:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 17:55:41.097888 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf36f153-ef04-46b5-825a-bfc3dbfae1d8 None None] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:55:41.098633 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf36f153-ef04-46b5-825a-bfc3dbfae1d8 None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:55:41.098750 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf36f153-ef04-46b5-825a-bfc3dbfae1d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:55:41.179822 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.auth.core [None req-cf36f153-ef04-46b5-825a-bfc3dbfae1d8 None None] MFA Rules not processed for user `5cfa58ef86774ab7800bf91930bf6028`. Rule list: `[]` (Enabled: `True`). {{(pid=81592) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 17:55:41.180955 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-cf36f153-ef04-46b5-825a-bfc3dbfae1d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 17:55:41.224165 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:55:41.280789 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 708/1436] 127.0.0.1 () {58 vars in 998 bytes} [Thu Sep 15 17:55:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 17:55:41.431847 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721a8eac-563d-49e5-a7d9-a51f0c32b8b1 None None] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:55:41.433834 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-721a8eac-563d-49e5-a7d9-a51f0c32b8b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 17:55:41.587822 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721a8eac-563d-49e5-a7d9-a51f0c32b8b1 None None] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:55:41.644228 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:55:41.708129 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2d07fa-7bd2-4009-aa3a-cda40ce91a7f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe2244818e4d4dca9c424cd078653e6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1213c0d1b584404ba3998e136f166e89', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:55:41.708646 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2d07fa-7bd2-4009-aa3a-cda40ce91a7f service nova] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:55:41.708923 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2d07fa-7bd2-4009-aa3a-cda40ce91a7f service nova] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:55:41.709193 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2d07fa-7bd2-4009-aa3a-cda40ce91a7f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:55:41.710829 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-8b2d07fa-7bd2-4009-aa3a-cda40ce91a7f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 17:55:41.801343 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b2d07fa-7bd2-4009-aa3a-cda40ce91a7f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:55:41.802966 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b2d07fa-7bd2-4009-aa3a-cda40ce91a7f service nova] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:55:41.821359 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 729/1437] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 15 17:55:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 390 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 17:55:42.890886 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa516c5-f04b-4eba-b3fb-89df461365d1 None None] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:55:42.891468 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa516c5-f04b-4eba-b3fb-89df461365d1 None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:55:42.891468 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa516c5-f04b-4eba-b3fb-89df461365d1 None None] PATH_INFO: `/` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:55:42.892781 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 709/1438] 127.0.0.1 () {54 vars in 901 bytes} [Thu Sep 15 17:55:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 17:55:42.899506 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b591029-7982-4401-b6c0-d5fdf30221de None None] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:55:42.900081 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b591029-7982-4401-b6c0-d5fdf30221de None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:55:42.900081 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b591029-7982-4401-b6c0-d5fdf30221de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:55:42.979402 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.auth.core [None req-2b591029-7982-4401-b6c0-d5fdf30221de None None] MFA Rules not processed for user `5cfa58ef86774ab7800bf91930bf6028`. Rule list: `[]` (Enabled: `True`). {{(pid=81593) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 17:55:42.981127 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-2b591029-7982-4401-b6c0-d5fdf30221de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 17:55:42.983304 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:55:43.081900 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 730/1439] 127.0.0.1 () {58 vars in 998 bytes} [Thu Sep 15 17:55:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 17:55:43.234092 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa516c5-f04b-4eba-b3fb-89df461365d1 None None] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:55:43.235616 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-baa516c5-f04b-4eba-b3fb-89df461365d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 17:55:43.387728 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa516c5-f04b-4eba-b3fb-89df461365d1 None None] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:55:43.418873 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:55:43.510510 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52786a5f-e622-4d71-8617-f754c277838a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe2244818e4d4dca9c424cd078653e6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1213c0d1b584404ba3998e136f166e89', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:55:43.511958 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52786a5f-e622-4d71-8617-f754c277838a service nova] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:55:43.512233 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52786a5f-e622-4d71-8617-f754c277838a service nova] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:55:43.512499 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52786a5f-e622-4d71-8617-f754c277838a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:55:43.514149 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-52786a5f-e622-4d71-8617-f754c277838a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 17:55:43.605440 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52786a5f-e622-4d71-8617-f754c277838a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:55:43.607042 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52786a5f-e622-4d71-8617-f754c277838a service nova] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:55:43.633667 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 710/1440] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 15 17:55:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 400 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 17:55:45.744850 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8fb1f7-0493-410c-b2f3-51221fa66c51 None None] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:55:45.745492 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8fb1f7-0493-410c-b2f3-51221fa66c51 None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:55:45.745492 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8fb1f7-0493-410c-b2f3-51221fa66c51 None None] PATH_INFO: `/` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:55:45.746873 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 731/1441] 127.0.0.1 () {54 vars in 917 bytes} [Thu Sep 15 17:55:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 17:55:45.752710 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed8a954-8163-45e2-8bde-057a8894339a None None] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:55:45.753192 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed8a954-8163-45e2-8bde-057a8894339a None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:55:45.753322 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed8a954-8163-45e2-8bde-057a8894339a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:55:45.796386 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:55:45.827586 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.auth.core [None req-3ed8a954-8163-45e2-8bde-057a8894339a None None] MFA Rules not processed for user `5cfa58ef86774ab7800bf91930bf6028`. Rule list: `[]` (Enabled: `True`). {{(pid=81592) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 17:55:45.828811 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-3ed8a954-8163-45e2-8bde-057a8894339a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 17:55:45.928847 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 711/1442] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Sep 15 17:55:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 17:55:46.213341 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8fb1f7-0493-410c-b2f3-51221fa66c51 None None] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:55:46.214939 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-ae8fb1f7-0493-410c-b2f3-51221fa66c51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 17:55:46.321652 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8fb1f7-0493-410c-b2f3-51221fa66c51 None None] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:55:46.356369 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:55:46.403328 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0928f0-3536-4065-97f7-7a9d41eaff27 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a32274b4781b40fea9f28da8a9bde5ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1213c0d1b584404ba3998e136f166e89', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:55:46.403942 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0928f0-3536-4065-97f7-7a9d41eaff27 service neutron] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:55:46.404216 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0928f0-3536-4065-97f7-7a9d41eaff27 service neutron] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:55:46.404497 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0928f0-3536-4065-97f7-7a9d41eaff27 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:55:46.406212 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-ff0928f0-3536-4065-97f7-7a9d41eaff27 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 17:55:46.537628 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff0928f0-3536-4065-97f7-7a9d41eaff27 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:55:46.539086 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff0928f0-3536-4065-97f7-7a9d41eaff27 service neutron] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:55:46.557986 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 732/1443] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 15 17:55:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 17:55:48.914961 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d28326e-694a-437f-9b93-7850bbfa7edd None None] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:55:48.915509 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d28326e-694a-437f-9b93-7850bbfa7edd None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:55:48.915509 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d28326e-694a-437f-9b93-7850bbfa7edd None None] PATH_INFO: `/` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:55:48.916876 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 712/1444] 127.0.0.1 () {54 vars in 917 bytes} [Thu Sep 15 17:55:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 17:55:48.923135 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8017684-cd31-466c-b5a8-f1134117abf5 None None] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:55:48.923605 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8017684-cd31-466c-b5a8-f1134117abf5 None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:55:48.923720 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8017684-cd31-466c-b5a8-f1134117abf5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:55:48.991281 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.auth.core [None req-e8017684-cd31-466c-b5a8-f1134117abf5 None None] MFA Rules not processed for user `5cfa58ef86774ab7800bf91930bf6028`. Rule list: `[]` (Enabled: `True`). {{(pid=81593) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 17:55:48.992493 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-e8017684-cd31-466c-b5a8-f1134117abf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 17:55:49.005585 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:55:49.092880 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 733/1445] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Sep 15 17:55:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 17:55:49.376416 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d28326e-694a-437f-9b93-7850bbfa7edd None None] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:55:49.377996 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-7d28326e-694a-437f-9b93-7850bbfa7edd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 17:55:49.484156 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d28326e-694a-437f-9b93-7850bbfa7edd None None] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:55:49.497999 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:55:49.560087 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916cea6f-7b35-44f2-a5ec-a0924f20c7d6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a32274b4781b40fea9f28da8a9bde5ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1213c0d1b584404ba3998e136f166e89', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:55:49.560697 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916cea6f-7b35-44f2-a5ec-a0924f20c7d6 service neutron] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:55:49.560976 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916cea6f-7b35-44f2-a5ec-a0924f20c7d6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:55:49.561250 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916cea6f-7b35-44f2-a5ec-a0924f20c7d6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:55:49.562895 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-916cea6f-7b35-44f2-a5ec-a0924f20c7d6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 17:55:49.676283 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-916cea6f-7b35-44f2-a5ec-a0924f20c7d6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:55:49.677673 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-916cea6f-7b35-44f2-a5ec-a0924f20c7d6 service neutron] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:55:49.696399 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 713/1446] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 15 17:55:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 17:55:52.286710 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd934fe-1db3-41f9-8ce2-bdfc2de1799b None None] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:55:52.287267 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd934fe-1db3-41f9-8ce2-bdfc2de1799b None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:55:52.287267 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd934fe-1db3-41f9-8ce2-bdfc2de1799b None None] PATH_INFO: `/` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:55:52.288587 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 734/1447] 127.0.0.1 () {54 vars in 917 bytes} [Thu Sep 15 17:55:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 17:55:52.294667 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126b281e-c6aa-41a8-b768-9bf0af0fa86b None None] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:55:52.295127 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126b281e-c6aa-41a8-b768-9bf0af0fa86b None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:55:52.295239 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126b281e-c6aa-41a8-b768-9bf0af0fa86b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:55:52.347776 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:55:52.367364 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.auth.core [None req-126b281e-c6aa-41a8-b768-9bf0af0fa86b None None] MFA Rules not processed for user `5cfa58ef86774ab7800bf91930bf6028`. Rule list: `[]` (Enabled: `True`). {{(pid=81592) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 17:55:52.368602 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-126b281e-c6aa-41a8-b768-9bf0af0fa86b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 17:55:52.470076 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 714/1448] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Sep 15 17:55:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 17:55:52.758823 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd934fe-1db3-41f9-8ce2-bdfc2de1799b None None] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:55:52.760360 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-5bd934fe-1db3-41f9-8ce2-bdfc2de1799b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 17:55:52.896718 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd934fe-1db3-41f9-8ce2-bdfc2de1799b None None] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:55:52.939209 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:55:52.976758 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f3ef32-0a17-46af-be19-0bca2b9b698b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a32274b4781b40fea9f28da8a9bde5ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1213c0d1b584404ba3998e136f166e89', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:55:52.977390 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f3ef32-0a17-46af-be19-0bca2b9b698b service neutron] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:55:52.977670 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f3ef32-0a17-46af-be19-0bca2b9b698b service neutron] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:55:52.977937 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f3ef32-0a17-46af-be19-0bca2b9b698b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:55:52.979616 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-23f3ef32-0a17-46af-be19-0bca2b9b698b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 17:55:53.094924 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f3ef32-0a17-46af-be19-0bca2b9b698b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:55:53.096333 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f3ef32-0a17-46af-be19-0bca2b9b698b service neutron] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:55:53.116061 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 735/1449] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 15 17:55:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 17:55:55.427366 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135f8fb1-5f1e-4491-af49-27834b0f530c None None] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:55:55.427971 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135f8fb1-5f1e-4491-af49-27834b0f530c None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:55:55.427971 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135f8fb1-5f1e-4491-af49-27834b0f530c None None] PATH_INFO: `/` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:55:55.429261 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 715/1450] 127.0.0.1 () {54 vars in 917 bytes} [Thu Sep 15 17:55:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 17:55:55.435396 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74701f2c-8596-456b-b60a-32b49b5e1c1c None None] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:55:55.435918 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74701f2c-8596-456b-b60a-32b49b5e1c1c None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:55:55.436034 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74701f2c-8596-456b-b60a-32b49b5e1c1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:55:55.505836 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.auth.core [None req-74701f2c-8596-456b-b60a-32b49b5e1c1c None None] MFA Rules not processed for user `5cfa58ef86774ab7800bf91930bf6028`. Rule list: `[]` (Enabled: `True`). {{(pid=81593) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 17:55:55.507073 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-74701f2c-8596-456b-b60a-32b49b5e1c1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 17:55:55.528730 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:55:55.608815 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 736/1451] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Sep 15 17:55:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 17:55:55.905666 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135f8fb1-5f1e-4491-af49-27834b0f530c None None] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:55:55.905666 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-135f8fb1-5f1e-4491-af49-27834b0f530c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 17:55:56.013419 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135f8fb1-5f1e-4491-af49-27834b0f530c None None] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:55:56.040469 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:55:56.094645 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04cbfa0a-1de9-4f97-b735-876463e27d9b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a32274b4781b40fea9f28da8a9bde5ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1213c0d1b584404ba3998e136f166e89', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:55:56.095258 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cbfa0a-1de9-4f97-b735-876463e27d9b service neutron] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:55:56.095538 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cbfa0a-1de9-4f97-b735-876463e27d9b service neutron] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:55:56.095811 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cbfa0a-1de9-4f97-b735-876463e27d9b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:55:56.097470 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-04cbfa0a-1de9-4f97-b735-876463e27d9b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 17:55:56.328714 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04cbfa0a-1de9-4f97-b735-876463e27d9b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:55:56.330096 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04cbfa0a-1de9-4f97-b735-876463e27d9b service neutron] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:55:56.349229 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 716/1452] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 15 17:55:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 446 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 17:55:58.590288 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1984ce-d086-4b2b-ae2d-3976a0c4afd5 None None] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:55:58.590903 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1984ce-d086-4b2b-ae2d-3976a0c4afd5 None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:55:58.590903 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1984ce-d086-4b2b-ae2d-3976a0c4afd5 None None] PATH_INFO: `/` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:55:58.592180 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 737/1453] 127.0.0.1 () {54 vars in 917 bytes} [Thu Sep 15 17:55:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 17:55:58.597809 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5573cbd-5f01-476d-97aa-550cc5984942 None None] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:55:58.598305 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5573cbd-5f01-476d-97aa-550cc5984942 None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:55:58.598398 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5573cbd-5f01-476d-97aa-550cc5984942 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:55:58.664800 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:55:58.668873 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.auth.core [None req-b5573cbd-5f01-476d-97aa-550cc5984942 None None] MFA Rules not processed for user `5cfa58ef86774ab7800bf91930bf6028`. Rule list: `[]` (Enabled: `True`). {{(pid=81592) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 17:55:58.670734 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-b5573cbd-5f01-476d-97aa-550cc5984942 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 17:55:58.771361 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 717/1454] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Sep 15 17:55:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 17:55:59.062719 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1984ce-d086-4b2b-ae2d-3976a0c4afd5 None None] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:55:59.064318 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-1e1984ce-d086-4b2b-ae2d-3976a0c4afd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 17:55:59.179288 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1984ce-d086-4b2b-ae2d-3976a0c4afd5 None None] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:55:59.232400 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:55:59.263434 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ad3052-155a-4c24-9884-7edea9daac89 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a32274b4781b40fea9f28da8a9bde5ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1213c0d1b584404ba3998e136f166e89', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:55:59.264044 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ad3052-155a-4c24-9884-7edea9daac89 service neutron] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:55:59.266689 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ad3052-155a-4c24-9884-7edea9daac89 service neutron] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:55:59.266968 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ad3052-155a-4c24-9884-7edea9daac89 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:55:59.268710 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-c3ad3052-155a-4c24-9884-7edea9daac89 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 17:55:59.398763 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ad3052-155a-4c24-9884-7edea9daac89 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:55:59.400227 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ad3052-155a-4c24-9884-7edea9daac89 service neutron] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:55:59.420842 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 738/1455] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 15 17:55:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 17:56:01.758707 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbd7575-ba96-4d34-9e34-cf611a66fb27 None None] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:56:01.759246 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbd7575-ba96-4d34-9e34-cf611a66fb27 None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:56:01.759246 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbd7575-ba96-4d34-9e34-cf611a66fb27 None None] PATH_INFO: `/` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:56:01.760650 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 718/1456] 127.0.0.1 () {54 vars in 917 bytes} [Thu Sep 15 17:56:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 17:56:01.766557 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55f3596-a310-4096-a732-de075613b70a None None] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:56:01.767052 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55f3596-a310-4096-a732-de075613b70a None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:56:01.767157 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55f3596-a310-4096-a732-de075613b70a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:56:01.834792 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.auth.core [None req-f55f3596-a310-4096-a732-de075613b70a None None] MFA Rules not processed for user `5cfa58ef86774ab7800bf91930bf6028`. Rule list: `[]` (Enabled: `True`). {{(pid=81593) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 17:56:01.836031 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-f55f3596-a310-4096-a732-de075613b70a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 17:56:01.866670 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:56:01.939508 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 739/1457] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Sep 15 17:56:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 17:56:02.220925 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bbd7575-ba96-4d34-9e34-cf611a66fb27 None None] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:56:02.222698 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-0bbd7575-ba96-4d34-9e34-cf611a66fb27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 17:56:02.331275 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bbd7575-ba96-4d34-9e34-cf611a66fb27 None None] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:56:02.362452 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:56:02.412532 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a957e5-aa9d-40f1-987b-00bde52afa08 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a32274b4781b40fea9f28da8a9bde5ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1213c0d1b584404ba3998e136f166e89', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:56:02.413141 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a957e5-aa9d-40f1-987b-00bde52afa08 service neutron] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:56:02.413471 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a957e5-aa9d-40f1-987b-00bde52afa08 service neutron] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:56:02.413726 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a957e5-aa9d-40f1-987b-00bde52afa08 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:56:02.415340 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-b1a957e5-aa9d-40f1-987b-00bde52afa08 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 17:56:02.535901 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a957e5-aa9d-40f1-987b-00bde52afa08 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:56:02.537361 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a957e5-aa9d-40f1-987b-00bde52afa08 service neutron] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:56:02.557395 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 719/1458] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 15 17:56:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 17:56:04.822524 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf62b26f-1bb7-44c3-8a9a-0b9c4532d9db None None] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:56:04.823711 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf62b26f-1bb7-44c3-8a9a-0b9c4532d9db None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:56:04.823711 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf62b26f-1bb7-44c3-8a9a-0b9c4532d9db None None] PATH_INFO: `/` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:56:04.825019 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 740/1459] 127.0.0.1 () {54 vars in 917 bytes} [Thu Sep 15 17:56:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 17:56:04.830742 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf6c320-cde8-4667-a5e2-3f0663dc1222 None None] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:56:04.831257 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf6c320-cde8-4667-a5e2-3f0663dc1222 None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:56:04.831366 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf6c320-cde8-4667-a5e2-3f0663dc1222 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:56:04.899608 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.auth.core [None req-6cf6c320-cde8-4667-a5e2-3f0663dc1222 None None] MFA Rules not processed for user `5cfa58ef86774ab7800bf91930bf6028`. Rule list: `[]` (Enabled: `True`). {{(pid=81592) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 17:56:04.900822 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-6cf6c320-cde8-4667-a5e2-3f0663dc1222 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 17:56:04.910017 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:56:05.000963 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 720/1460] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Sep 15 17:56:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 17:56:05.285170 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf62b26f-1bb7-44c3-8a9a-0b9c4532d9db None None] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:56:05.286776 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-bf62b26f-1bb7-44c3-8a9a-0b9c4532d9db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 17:56:05.395687 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf62b26f-1bb7-44c3-8a9a-0b9c4532d9db None None] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:56:05.452937 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:56:05.472458 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc4b550-9d60-44a2-bc0e-939fb33b1466 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a32274b4781b40fea9f28da8a9bde5ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1213c0d1b584404ba3998e136f166e89', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:56:05.473073 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc4b550-9d60-44a2-bc0e-939fb33b1466 service neutron] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:56:05.473375 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc4b550-9d60-44a2-bc0e-939fb33b1466 service neutron] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:56:05.473643 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc4b550-9d60-44a2-bc0e-939fb33b1466 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:56:05.475534 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-5dc4b550-9d60-44a2-bc0e-939fb33b1466 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 17:56:05.591361 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc4b550-9d60-44a2-bc0e-939fb33b1466 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:56:05.592734 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc4b550-9d60-44a2-bc0e-939fb33b1466 service neutron] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:56:05.611275 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 741/1461] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 15 17:56:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 17:56:07.851204 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57dbf021-2f10-495c-b341-a1435adc80c4 None None] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:56:07.851770 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57dbf021-2f10-495c-b341-a1435adc80c4 None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:56:07.851770 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57dbf021-2f10-495c-b341-a1435adc80c4 None None] PATH_INFO: `/` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:56:07.853136 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 721/1462] 127.0.0.1 () {54 vars in 917 bytes} [Thu Sep 15 17:56:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 17:56:07.860195 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46eb5822-c1aa-4695-bbb9-93ecf2b896d9 None None] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:56:07.860719 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46eb5822-c1aa-4695-bbb9-93ecf2b896d9 None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:56:07.860719 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46eb5822-c1aa-4695-bbb9-93ecf2b896d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:56:07.930769 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.auth.core [None req-46eb5822-c1aa-4695-bbb9-93ecf2b896d9 None None] MFA Rules not processed for user `5cfa58ef86774ab7800bf91930bf6028`. Rule list: `[]` (Enabled: `True`). {{(pid=81593) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 17:56:07.932012 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-46eb5822-c1aa-4695-bbb9-93ecf2b896d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 17:56:07.971948 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:56:08.034443 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 742/1463] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Sep 15 17:56:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 17:56:08.325853 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57dbf021-2f10-495c-b341-a1435adc80c4 None None] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:56:08.327387 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-57dbf021-2f10-495c-b341-a1435adc80c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 17:56:08.433122 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57dbf021-2f10-495c-b341-a1435adc80c4 None None] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:56:08.472430 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:56:08.510698 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9047cee0-b852-44ad-be99-6e00beb8e181 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a32274b4781b40fea9f28da8a9bde5ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1213c0d1b584404ba3998e136f166e89', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:56:08.511300 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9047cee0-b852-44ad-be99-6e00beb8e181 service neutron] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:56:08.511594 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9047cee0-b852-44ad-be99-6e00beb8e181 service neutron] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:56:08.511861 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9047cee0-b852-44ad-be99-6e00beb8e181 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:56:08.513555 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-9047cee0-b852-44ad-be99-6e00beb8e181 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 17:56:08.629927 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9047cee0-b852-44ad-be99-6e00beb8e181 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:56:08.631296 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9047cee0-b852-44ad-be99-6e00beb8e181 service neutron] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:56:08.649621 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 722/1464] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 15 17:56:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 17:56:10.851842 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39fac2c-7ec7-494c-808f-b39aeed63be3 None None] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:56:10.852434 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39fac2c-7ec7-494c-808f-b39aeed63be3 None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:56:10.852434 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39fac2c-7ec7-494c-808f-b39aeed63be3 None None] PATH_INFO: `/` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:56:10.853756 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 743/1465] 127.0.0.1 () {54 vars in 917 bytes} [Thu Sep 15 17:56:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 17:56:10.859258 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1bcee3-2783-4f99-b2ec-aa606e70042a None None] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:56:10.859776 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1bcee3-2783-4f99-b2ec-aa606e70042a None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:56:10.859884 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1bcee3-2783-4f99-b2ec-aa606e70042a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:56:10.929052 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.auth.core [None req-3e1bcee3-2783-4f99-b2ec-aa606e70042a None None] MFA Rules not processed for user `5cfa58ef86774ab7800bf91930bf6028`. Rule list: `[]` (Enabled: `True`). {{(pid=81592) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 17:56:10.930315 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-3e1bcee3-2783-4f99-b2ec-aa606e70042a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 17:56:10.949056 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:56:11.028748 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 723/1466] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Sep 15 17:56:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 17:56:11.310939 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39fac2c-7ec7-494c-808f-b39aeed63be3 None None] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:56:11.312501 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-c39fac2c-7ec7-494c-808f-b39aeed63be3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 17:56:11.420349 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39fac2c-7ec7-494c-808f-b39aeed63be3 None None] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:56:11.496553 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:56:11.504217 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2480f164-feb5-4925-adab-86838d8abdc5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a32274b4781b40fea9f28da8a9bde5ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1213c0d1b584404ba3998e136f166e89', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:56:11.504833 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2480f164-feb5-4925-adab-86838d8abdc5 service neutron] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:56:11.505115 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2480f164-feb5-4925-adab-86838d8abdc5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:56:11.505494 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2480f164-feb5-4925-adab-86838d8abdc5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:56:11.507151 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-2480f164-feb5-4925-adab-86838d8abdc5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 17:56:11.621155 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2480f164-feb5-4925-adab-86838d8abdc5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:56:11.622557 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2480f164-feb5-4925-adab-86838d8abdc5 service neutron] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:56:11.641936 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 744/1467] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 15 17:56:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 17:56:13.878842 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcf112b-45b7-4342-acd7-a5b408f23e31 None None] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:56:13.879379 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcf112b-45b7-4342-acd7-a5b408f23e31 None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:56:13.879379 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcf112b-45b7-4342-acd7-a5b408f23e31 None None] PATH_INFO: `/` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:56:13.880715 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 724/1468] 127.0.0.1 () {54 vars in 917 bytes} [Thu Sep 15 17:56:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 17:56:13.887184 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866140c6-e410-425a-8849-856a0dbdbd37 None None] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:56:13.887684 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866140c6-e410-425a-8849-856a0dbdbd37 None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:56:13.887792 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866140c6-e410-425a-8849-856a0dbdbd37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:56:13.956389 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.auth.core [None req-866140c6-e410-425a-8849-856a0dbdbd37 None None] MFA Rules not processed for user `5cfa58ef86774ab7800bf91930bf6028`. Rule list: `[]` (Enabled: `True`). {{(pid=81593) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 17:56:13.957642 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-866140c6-e410-425a-8849-856a0dbdbd37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 17:56:14.006720 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:56:14.058788 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 745/1469] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Sep 15 17:56:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 17:56:14.361234 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebcf112b-45b7-4342-acd7-a5b408f23e31 None None] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:56:14.362783 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-ebcf112b-45b7-4342-acd7-a5b408f23e31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 17:56:14.473702 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebcf112b-45b7-4342-acd7-a5b408f23e31 None None] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:56:14.528494 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:56:14.554553 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a4779c-65a0-4e84-bf20-01ba7aeb8b81 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a32274b4781b40fea9f28da8a9bde5ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1213c0d1b584404ba3998e136f166e89', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:56:14.555195 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a4779c-65a0-4e84-bf20-01ba7aeb8b81 service neutron] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:56:14.555473 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a4779c-65a0-4e84-bf20-01ba7aeb8b81 service neutron] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:56:14.555740 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a4779c-65a0-4e84-bf20-01ba7aeb8b81 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:56:14.557386 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-b5a4779c-65a0-4e84-bf20-01ba7aeb8b81 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 17:56:14.671724 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a4779c-65a0-4e84-bf20-01ba7aeb8b81 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:56:14.673096 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a4779c-65a0-4e84-bf20-01ba7aeb8b81 service neutron] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:56:14.696087 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 725/1470] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 15 17:56:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 17:56:24.057172 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=22 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:56:24.693635 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=66 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:56:34.937687 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82192e0f-cb75-417e-9b11-40125460268a None None] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:56:34.938245 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82192e0f-cb75-417e-9b11-40125460268a None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:56:34.938245 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82192e0f-cb75-417e-9b11-40125460268a None None] PATH_INFO: `/` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:56:34.939624 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 746/1471] 10.222.0.25 () {54 vars in 927 bytes} [Thu Sep 15 17:56:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 17:56:34.945015 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9958486-0c5e-45cb-875f-40958160cf7d None None] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:56:34.945497 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9958486-0c5e-45cb-875f-40958160cf7d None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:56:34.945595 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9958486-0c5e-45cb-875f-40958160cf7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:56:35.014503 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.auth.core [None req-c9958486-0c5e-45cb-875f-40958160cf7d None None] MFA Rules not processed for user `5cfa58ef86774ab7800bf91930bf6028`. Rule list: `[]` (Enabled: `True`). {{(pid=81592) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 17:56:35.015731 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-c9958486-0c5e-45cb-875f-40958160cf7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 17:56:35.112575 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 726/1472] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Sep 15 17:56:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 17:56:35.417742 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c44c88d-2a67-4c82-98aa-d682ca9a8c3b None None] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:56:35.418027 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c44c88d-2a67-4c82-98aa-d682ca9a8c3b None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:56:35.418330 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c44c88d-2a67-4c82-98aa-d682ca9a8c3b None None] PATH_INFO: `/` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:56:35.419688 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 747/1473] 10.222.0.25 () {54 vars in 962 bytes} [Thu Sep 15 17:56:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 17:56:35.424993 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1c56ef-1dad-4e8c-bbca-006da24cf524 None None] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:56:35.425277 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1c56ef-1dad-4e8c-bbca-006da24cf524 None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:56:35.425575 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1c56ef-1dad-4e8c-bbca-006da24cf524 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:56:35.502193 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.auth.core [None req-dc1c56ef-1dad-4e8c-bbca-006da24cf524 None None] MFA Rules not processed for user `c194f79928aa4a4d94619c417b4e39e9`. Rule list: `[]` (Enabled: `True`). {{(pid=81592) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 17:56:35.503393 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-dc1c56ef-1dad-4e8c-bbca-006da24cf524 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 17:56:35.525106 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:56:35.584194 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 727/1474] 10.222.0.25 () {58 vars in 1059 bytes} [Thu Sep 15 17:56:35 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 17:56:35.591938 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c44c88d-2a67-4c82-98aa-d682ca9a8c3b None None] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:56:35.593634 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-1c44c88d-2a67-4c82-98aa-d682ca9a8c3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 17:56:35.698025 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c44c88d-2a67-4c82-98aa-d682ca9a8c3b None None] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:56:35.772764 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7354fc6a-3b43-4e56-801a-62e6c227f5f5 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c194f79928aa4a4d94619c417b4e39e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1213c0d1b584404ba3998e136f166e89', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:56:35.773410 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7354fc6a-3b43-4e56-801a-62e6c227f5f5 service glance] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:56:35.773690 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7354fc6a-3b43-4e56-801a-62e6c227f5f5 service glance] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:56:35.773959 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7354fc6a-3b43-4e56-801a-62e6c227f5f5 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:56:35.775586 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-7354fc6a-3b43-4e56-801a-62e6c227f5f5 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 17:56:35.831609 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:56:35.889317 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7354fc6a-3b43-4e56-801a-62e6c227f5f5 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:56:35.890915 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7354fc6a-3b43-4e56-801a-62e6c227f5f5 service glance] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:56:35.909653 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 748/1475] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 15 17:56:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 17:56:38.183720 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bb0e9b-16f8-49fc-9748-07176ede5d35 None None] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:56:38.184262 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bb0e9b-16f8-49fc-9748-07176ede5d35 None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:56:38.184262 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bb0e9b-16f8-49fc-9748-07176ede5d35 None None] PATH_INFO: `/` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:56:38.185581 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 728/1476] 10.222.0.25 () {54 vars in 927 bytes} [Thu Sep 15 17:56:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 15 17:56:38.191144 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbed6de-4c99-493b-8b4b-e632adf88313 None None] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:56:38.191596 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbed6de-4c99-493b-8b4b-e632adf88313 None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:56:38.191702 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbed6de-4c99-493b-8b4b-e632adf88313 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:56:38.268345 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.auth.core [None req-ebbed6de-4c99-493b-8b4b-e632adf88313 None None] MFA Rules not processed for user `5cfa58ef86774ab7800bf91930bf6028`. Rule list: `[]` (Enabled: `True`). {{(pid=81593) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 17:56:38.269624 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-ebbed6de-4c99-493b-8b4b-e632adf88313 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 17:56:38.384263 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 749/1477] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Sep 15 17:56:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 17:56:38.661079 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53bb0e9b-16f8-49fc-9748-07176ede5d35 None None] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:56:38.662633 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-53bb0e9b-16f8-49fc-9748-07176ede5d35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 17:56:38.793574 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53bb0e9b-16f8-49fc-9748-07176ede5d35 None None] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:56:38.846765 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:56:38.894320 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72a5d82-39e6-438a-9f88-6b22773bc07b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:56:38.894930 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72a5d82-39e6-438a-9f88-6b22773bc07b admin admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:56:38.895332 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72a5d82-39e6-438a-9f88-6b22773bc07b admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:56:38.895607 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72a5d82-39e6-438a-9f88-6b22773bc07b admin admin] PATH_INFO: `/v3/projects` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:56:38.896255 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a72a5d82-39e6-438a-9f88-6b22773bc07b admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:56:38.898032 dv-cinder-835384-27-smb devstack@keystone.service[81592]: WARNING py.warnings [None req-a72a5d82-39e6-438a-9f88-6b22773bc07b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 15 17:56:38.898032 dv-cinder-835384-27-smb devstack@keystone.service[81592]: warnings.warn(msg) Sep 15 17:56:38.898032 dv-cinder-835384-27-smb devstack@keystone.service[81592]: Sep 15 17:56:38.899173 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a72a5d82-39e6-438a-9f88-6b22773bc07b admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:56:38.924586 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 729/1478] 10.222.0.25 () {56 vars in 1108 bytes} [Thu Sep 15 17:56:38 2022] GET /identity/v3/projects => generated 2553 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 17:56:41.156245 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd858fd0-a556-4cbf-9ea7-9cb7e9337659 None None] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:56:41.156833 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd858fd0-a556-4cbf-9ea7-9cb7e9337659 None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:56:41.156833 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd858fd0-a556-4cbf-9ea7-9cb7e9337659 None None] PATH_INFO: `/` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:56:41.158194 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 750/1479] 10.222.0.25 () {54 vars in 927 bytes} [Thu Sep 15 17:56:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 17:56:41.164068 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ae271d-2d90-4a39-9777-a826baa29bf0 None None] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:56:41.164582 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ae271d-2d90-4a39-9777-a826baa29bf0 None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:56:41.164706 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ae271d-2d90-4a39-9777-a826baa29bf0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:56:41.236708 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.auth.core [None req-52ae271d-2d90-4a39-9777-a826baa29bf0 None None] MFA Rules not processed for user `5cfa58ef86774ab7800bf91930bf6028`. Rule list: `[]` (Enabled: `True`). {{(pid=81592) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 17:56:41.238969 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-52ae271d-2d90-4a39-9777-a826baa29bf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 17:56:41.339185 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 730/1480] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Sep 15 17:56:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 17:56:41.637825 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd858fd0-a556-4cbf-9ea7-9cb7e9337659 None None] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:56:41.639453 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-dd858fd0-a556-4cbf-9ea7-9cb7e9337659 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 17:56:41.649406 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:56:41.802768 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd858fd0-a556-4cbf-9ea7-9cb7e9337659 None None] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:56:41.897171 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:56:41.934449 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7375981b-c877-4254-bb40-5d0046d8de37 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe2244818e4d4dca9c424cd078653e6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1213c0d1b584404ba3998e136f166e89', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:56:41.935425 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7375981b-c877-4254-bb40-5d0046d8de37 service nova] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:56:41.935893 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7375981b-c877-4254-bb40-5d0046d8de37 service nova] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:56:41.936339 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7375981b-c877-4254-bb40-5d0046d8de37 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:56:41.944994 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-7375981b-c877-4254-bb40-5d0046d8de37 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 17:56:42.043003 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7375981b-c877-4254-bb40-5d0046d8de37 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:56:42.044646 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7375981b-c877-4254-bb40-5d0046d8de37 service nova] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:56:42.063706 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 751/1481] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 15 17:56:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 426 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 17:56:44.483217 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f27d1e-ebdd-44d7-8175-4c55afe646f7 None None] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:56:44.483742 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f27d1e-ebdd-44d7-8175-4c55afe646f7 None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:56:44.483742 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f27d1e-ebdd-44d7-8175-4c55afe646f7 None None] PATH_INFO: `/` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:56:44.485015 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 731/1482] 10.222.0.25 () {54 vars in 927 bytes} [Thu Sep 15 17:56:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 17:56:44.491629 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4d587b-e4e5-4d79-926e-b62db8ce1817 None None] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:56:44.492145 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4d587b-e4e5-4d79-926e-b62db8ce1817 None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:56:44.492248 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4d587b-e4e5-4d79-926e-b62db8ce1817 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:56:44.562954 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.auth.core [None req-be4d587b-e4e5-4d79-926e-b62db8ce1817 None None] MFA Rules not processed for user `5cfa58ef86774ab7800bf91930bf6028`. Rule list: `[]` (Enabled: `True`). {{(pid=81593) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 17:56:44.564184 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-be4d587b-e4e5-4d79-926e-b62db8ce1817 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 17:56:44.612368 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:56:44.665447 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 752/1483] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Sep 15 17:56:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 17:56:44.958287 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f27d1e-ebdd-44d7-8175-4c55afe646f7 None None] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:56:44.959834 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-58f27d1e-ebdd-44d7-8175-4c55afe646f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 17:56:44.985479 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:56:45.077075 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f27d1e-ebdd-44d7-8175-4c55afe646f7 None None] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:56:45.156122 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1152771c-18c9-4efa-8887-7c3bca2afe26 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a32274b4781b40fea9f28da8a9bde5ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1213c0d1b584404ba3998e136f166e89', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:56:45.156741 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1152771c-18c9-4efa-8887-7c3bca2afe26 service neutron] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:56:45.157026 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1152771c-18c9-4efa-8887-7c3bca2afe26 service neutron] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:56:45.157321 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1152771c-18c9-4efa-8887-7c3bca2afe26 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:56:45.159058 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-1152771c-18c9-4efa-8887-7c3bca2afe26 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 17:56:45.238857 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:56:45.278190 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1152771c-18c9-4efa-8887-7c3bca2afe26 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:56:45.279646 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1152771c-18c9-4efa-8887-7c3bca2afe26 service neutron] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:56:45.298730 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 732/1484] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 15 17:56:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 17:56:47.558389 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5db0b86-43eb-4e90-8ca4-482c5e0fb17b None None] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:56:47.558923 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5db0b86-43eb-4e90-8ca4-482c5e0fb17b None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:56:47.558923 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5db0b86-43eb-4e90-8ca4-482c5e0fb17b None None] PATH_INFO: `/` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:56:47.560294 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 753/1485] 10.222.0.25 () {54 vars in 927 bytes} [Thu Sep 15 17:56:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 17:56:47.565626 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906ba402-58d4-4246-8957-d2de5f2fd8d0 None None] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:56:47.566082 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906ba402-58d4-4246-8957-d2de5f2fd8d0 None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:56:47.566201 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906ba402-58d4-4246-8957-d2de5f2fd8d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:56:47.636533 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.auth.core [None req-906ba402-58d4-4246-8957-d2de5f2fd8d0 None None] MFA Rules not processed for user `5cfa58ef86774ab7800bf91930bf6028`. Rule list: `[]` (Enabled: `True`). {{(pid=81592) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 17:56:47.637779 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-906ba402-58d4-4246-8957-d2de5f2fd8d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 17:56:47.733670 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 733/1486] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Sep 15 17:56:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 17:56:48.024452 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5db0b86-43eb-4e90-8ca4-482c5e0fb17b None None] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:56:48.026519 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-d5db0b86-43eb-4e90-8ca4-482c5e0fb17b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 17:56:48.159343 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5db0b86-43eb-4e90-8ca4-482c5e0fb17b None None] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:56:48.242417 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:56:48.245724 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae6fd29-c02f-42f9-b2e4-62da631e73a1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a32274b4781b40fea9f28da8a9bde5ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1213c0d1b584404ba3998e136f166e89', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:56:48.246832 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae6fd29-c02f-42f9-b2e4-62da631e73a1 service neutron] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:56:48.247661 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae6fd29-c02f-42f9-b2e4-62da631e73a1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:56:48.248196 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae6fd29-c02f-42f9-b2e4-62da631e73a1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:56:48.251259 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-6ae6fd29-c02f-42f9-b2e4-62da631e73a1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 17:56:48.376272 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae6fd29-c02f-42f9-b2e4-62da631e73a1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:56:48.382750 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae6fd29-c02f-42f9-b2e4-62da631e73a1 service neutron] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:56:48.513989 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 754/1487] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 15 17:56:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 490 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 17:56:50.934433 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd049a1-f786-4b4b-ac70-6daa0095df36 None None] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:56:50.934928 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd049a1-f786-4b4b-ac70-6daa0095df36 None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:56:50.935034 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd049a1-f786-4b4b-ac70-6daa0095df36 None None] PATH_INFO: `/` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:56:50.936348 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 734/1488] 10.222.0.25 () {54 vars in 927 bytes} [Thu Sep 15 17:56:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 17:56:50.942045 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64c877a-35a5-41fb-b006-5f4796adbdcb None None] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:56:50.942516 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64c877a-35a5-41fb-b006-5f4796adbdcb None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:56:50.942625 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64c877a-35a5-41fb-b006-5f4796adbdcb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:56:51.012305 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.auth.core [None req-c64c877a-35a5-41fb-b006-5f4796adbdcb None None] MFA Rules not processed for user `5cfa58ef86774ab7800bf91930bf6028`. Rule list: `[]` (Enabled: `True`). {{(pid=81593) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 17:56:51.013526 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-c64c877a-35a5-41fb-b006-5f4796adbdcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 17:56:51.065782 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:56:51.109650 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 755/1489] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Sep 15 17:56:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 17:56:51.404731 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd049a1-f786-4b4b-ac70-6daa0095df36 None None] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:56:51.406696 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-9cd049a1-f786-4b4b-ac70-6daa0095df36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 17:56:51.457139 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:56:51.529018 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd049a1-f786-4b4b-ac70-6daa0095df36 None None] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:56:51.605581 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56a189a-e49e-4af3-bd56-2f063422c904 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a32274b4781b40fea9f28da8a9bde5ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1213c0d1b584404ba3998e136f166e89', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:56:51.606193 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56a189a-e49e-4af3-bd56-2f063422c904 service neutron] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:56:51.606472 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56a189a-e49e-4af3-bd56-2f063422c904 service neutron] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:56:51.606745 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56a189a-e49e-4af3-bd56-2f063422c904 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:56:51.608365 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-c56a189a-e49e-4af3-bd56-2f063422c904 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 17:56:51.695313 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:56:51.725594 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c56a189a-e49e-4af3-bd56-2f063422c904 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:56:51.727034 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c56a189a-e49e-4af3-bd56-2f063422c904 service neutron] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:56:51.746037 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 735/1490] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 15 17:56:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 17:56:54.141157 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ca0dc2-e105-49c6-bd0b-0580c8092c08 None None] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:56:54.141744 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ca0dc2-e105-49c6-bd0b-0580c8092c08 None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:56:54.141744 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ca0dc2-e105-49c6-bd0b-0580c8092c08 None None] PATH_INFO: `/` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:56:54.143105 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 756/1491] 10.222.0.25 () {54 vars in 927 bytes} [Thu Sep 15 17:56:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 17:56:54.148554 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2826f3-44af-4292-9918-240a96595a0c None None] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:56:54.148986 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2826f3-44af-4292-9918-240a96595a0c None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:56:54.149100 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2826f3-44af-4292-9918-240a96595a0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:56:54.217744 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.auth.core [None req-da2826f3-44af-4292-9918-240a96595a0c None None] MFA Rules not processed for user `5cfa58ef86774ab7800bf91930bf6028`. Rule list: `[]` (Enabled: `True`). {{(pid=81592) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 17:56:54.218964 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-da2826f3-44af-4292-9918-240a96595a0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 17:56:54.317817 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 736/1492] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Sep 15 17:56:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 17:56:54.609422 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ca0dc2-e105-49c6-bd0b-0580c8092c08 None None] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:56:54.610999 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-68ca0dc2-e105-49c6-bd0b-0580c8092c08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 17:56:54.714613 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ca0dc2-e105-49c6-bd0b-0580c8092c08 None None] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:56:54.786541 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d0b8ac-164a-4ec3-87d7-835696c4f216 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a32274b4781b40fea9f28da8a9bde5ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1213c0d1b584404ba3998e136f166e89', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:56:54.787142 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d0b8ac-164a-4ec3-87d7-835696c4f216 service neutron] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:56:54.787420 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d0b8ac-164a-4ec3-87d7-835696c4f216 service neutron] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:56:54.787690 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d0b8ac-164a-4ec3-87d7-835696c4f216 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:56:54.789279 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-f9d0b8ac-164a-4ec3-87d7-835696c4f216 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 17:56:54.798965 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:56:54.900502 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d0b8ac-164a-4ec3-87d7-835696c4f216 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:56:54.902066 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d0b8ac-164a-4ec3-87d7-835696c4f216 service neutron] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:56:54.922687 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 757/1493] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 15 17:56:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 17:57:04.316308 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=82 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:57:04.919994 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=50 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:58:09.236486 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808ec51e-66a3-4539-a527-35477a2904cf None None] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:58:09.237077 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808ec51e-66a3-4539-a527-35477a2904cf None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:58:09.237077 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808ec51e-66a3-4539-a527-35477a2904cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:58:09.321003 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.auth.core [None req-808ec51e-66a3-4539-a527-35477a2904cf None None] MFA Rules not processed for user `5cfa58ef86774ab7800bf91930bf6028`. Rule list: `[]` (Enabled: `True`). {{(pid=81592) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 17:58:09.322359 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-808ec51e-66a3-4539-a527-35477a2904cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 17:58:09.429997 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 737/1494] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 15 17:58:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 17:58:09.438610 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd6595c-5cb1-4bfa-97e5-ec7a1050bc6f None None] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:58:09.439137 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd6595c-5cb1-4bfa-97e5-ec7a1050bc6f None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:58:09.439137 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd6595c-5cb1-4bfa-97e5-ec7a1050bc6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:58:09.518435 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.auth.core [None req-acd6595c-5cb1-4bfa-97e5-ec7a1050bc6f None None] MFA Rules not processed for user `5cfa58ef86774ab7800bf91930bf6028`. Rule list: `[]` (Enabled: `True`). {{(pid=81593) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 17:58:09.519928 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-acd6595c-5cb1-4bfa-97e5-ec7a1050bc6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 17:58:09.614037 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 758/1495] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 15 17:58:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 17:58:09.619692 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808ec51e-66a3-4539-a527-35477a2904cf None None] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:58:09.620940 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-808ec51e-66a3-4539-a527-35477a2904cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 17:58:09.632263 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808ec51e-66a3-4539-a527-35477a2904cf None None] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:58:09.705722 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:58:09.741780 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b50b30-76ce-4832-bace-9e93d59d966e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:58:09.742376 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b50b30-76ce-4832-bace-9e93d59d966e admin admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:58:09.742722 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b50b30-76ce-4832-bace-9e93d59d966e admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:58:09.743002 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b50b30-76ce-4832-bace-9e93d59d966e admin admin] PATH_INFO: `/v3/domains` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:58:09.743635 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b50b30-76ce-4832-bace-9e93d59d966e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81592) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 17:58:09.743930 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b50b30-76ce-4832-bace-9e93d59d966e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:58:09.744920 dv-cinder-835384-27-smb devstack@keystone.service[81592]: WARNING py.warnings [None req-c4b50b30-76ce-4832-bace-9e93d59d966e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 15 17:58:09.744920 dv-cinder-835384-27-smb devstack@keystone.service[81592]: warnings.warn(msg) Sep 15 17:58:09.744920 dv-cinder-835384-27-smb devstack@keystone.service[81592]: Sep 15 17:58:09.745816 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b50b30-76ce-4832-bace-9e93d59d966e admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:58:09.756744 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 738/1496] 10.222.0.25 () {58 vars in 1153 bytes} [Thu Sep 15 17:58:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 17:58:09.764973 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd6595c-5cb1-4bfa-97e5-ec7a1050bc6f None None] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:58:09.774621 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd6595c-5cb1-4bfa-97e5-ec7a1050bc6f None None] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:58:09.834861 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:58:09.869391 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ae98e1-7e9e-40a9-bd3f-78260ab6a299 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:58:09.869990 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ae98e1-7e9e-40a9-bd3f-78260ab6a299 admin admin] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:58:09.870267 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ae98e1-7e9e-40a9-bd3f-78260ab6a299 admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:58:09.870552 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ae98e1-7e9e-40a9-bd3f-78260ab6a299 admin admin] PATH_INFO: `/v3/projects` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:58:09.871184 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ae98e1-7e9e-40a9-bd3f-78260ab6a299 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:58:09.873068 dv-cinder-835384-27-smb devstack@keystone.service[81593]: WARNING py.warnings [None req-b4ae98e1-7e9e-40a9-bd3f-78260ab6a299 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 15 17:58:09.873068 dv-cinder-835384-27-smb devstack@keystone.service[81593]: warnings.warn(msg) Sep 15 17:58:09.873068 dv-cinder-835384-27-smb devstack@keystone.service[81593]: Sep 15 17:58:09.874330 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ae98e1-7e9e-40a9-bd3f-78260ab6a299 admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:58:09.931733 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 759/1497] 10.222.0.25 () {60 vars in 1153 bytes} [Thu Sep 15 17:58:09 2022] POST /identity/v3/projects => generated 379 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 17:58:09.935853 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b50b30-76ce-4832-bace-9e93d59d966e admin admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:58:09.937541 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-c4b50b30-76ce-4832-bace-9e93d59d966e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 17:58:09.976646 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b50b30-76ce-4832-bace-9e93d59d966e admin admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:58:10.080535 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c98672-f6c4-40d4-be56-868c20957d82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:58:10.081055 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c98672-f6c4-40d4-be56-868c20957d82 admin admin] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:58:10.081362 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c98672-f6c4-40d4-be56-868c20957d82 admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:58:10.081635 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c98672-f6c4-40d4-be56-868c20957d82 admin admin] PATH_INFO: `/v3/users` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:58:10.082270 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c98672-f6c4-40d4-be56-868c20957d82 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:58:10.083280 dv-cinder-835384-27-smb devstack@keystone.service[81592]: WARNING py.warnings [None req-63c98672-f6c4-40d4-be56-868c20957d82 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 15 17:58:10.083280 dv-cinder-835384-27-smb devstack@keystone.service[81592]: warnings.warn(msg) Sep 15 17:58:10.083280 dv-cinder-835384-27-smb devstack@keystone.service[81592]: Sep 15 17:58:10.084491 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c98672-f6c4-40d4-be56-868c20957d82 admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:58:10.137203 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 739/1498] 10.222.0.25 () {60 vars in 1144 bytes} [Thu Sep 15 17:58:09 2022] POST /identity/v3/users => generated 290 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 17:58:10.141525 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ae98e1-7e9e-40a9-bd3f-78260ab6a299 admin admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:58:10.143053 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-b4ae98e1-7e9e-40a9-bd3f-78260ab6a299 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 17:58:10.207739 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ae98e1-7e9e-40a9-bd3f-78260ab6a299 admin admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:58:10.292565 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:58:10.303836 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc023a0-8dd5-4698-9ca4-d502f72d9995 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:58:10.304443 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc023a0-8dd5-4698-9ca4-d502f72d9995 admin admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:58:10.304717 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc023a0-8dd5-4698-9ca4-d502f72d9995 admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:58:10.304987 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc023a0-8dd5-4698-9ca4-d502f72d9995 admin admin] PATH_INFO: `/v3/roles` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:58:10.306242 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc023a0-8dd5-4698-9ca4-d502f72d9995 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:58:10.307272 dv-cinder-835384-27-smb devstack@keystone.service[81593]: WARNING py.warnings [None req-dcc023a0-8dd5-4698-9ca4-d502f72d9995 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 15 17:58:10.307272 dv-cinder-835384-27-smb devstack@keystone.service[81593]: warnings.warn(msg) Sep 15 17:58:10.307272 dv-cinder-835384-27-smb devstack@keystone.service[81593]: Sep 15 17:58:10.308171 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc023a0-8dd5-4698-9ca4-d502f72d9995 admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:58:10.321484 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 760/1499] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Sep 15 17:58:10 2022] GET /identity/v3/roles => generated 1420 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 15 17:58:10.325679 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c98672-f6c4-40d4-be56-868c20957d82 admin admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:58:10.327293 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-63c98672-f6c4-40d4-be56-868c20957d82 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 17:58:10.339450 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c98672-f6c4-40d4-be56-868c20957d82 admin admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:58:10.365627 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:58:10.437551 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c249ae-5924-4e20-bb01-041c7d5b1a47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:58:10.438163 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c249ae-5924-4e20-bb01-041c7d5b1a47 admin admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:58:10.438437 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c249ae-5924-4e20-bb01-041c7d5b1a47 admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:58:10.438702 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c249ae-5924-4e20-bb01-041c7d5b1a47 admin admin] PATH_INFO: `/v3/roles` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:58:10.439375 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c249ae-5924-4e20-bb01-041c7d5b1a47 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:58:10.440380 dv-cinder-835384-27-smb devstack@keystone.service[81592]: WARNING py.warnings [None req-85c249ae-5924-4e20-bb01-041c7d5b1a47 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 15 17:58:10.440380 dv-cinder-835384-27-smb devstack@keystone.service[81592]: warnings.warn(msg) Sep 15 17:58:10.440380 dv-cinder-835384-27-smb devstack@keystone.service[81592]: Sep 15 17:58:10.441254 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c249ae-5924-4e20-bb01-041c7d5b1a47 admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:58:10.453884 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 740/1500] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Sep 15 17:58:10 2022] GET /identity/v3/roles => generated 1420 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 17:58:10.458528 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc023a0-8dd5-4698-9ca4-d502f72d9995 admin admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:58:10.460383 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-dcc023a0-8dd5-4698-9ca4-d502f72d9995 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 17:58:10.495850 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc023a0-8dd5-4698-9ca4-d502f72d9995 admin admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:58:10.587278 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21f5261-aafe-424e-9fa4-069503672095 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:58:10.587931 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21f5261-aafe-424e-9fa4-069503672095 admin admin] REQUEST_METHOD: `PUT` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:58:10.588204 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21f5261-aafe-424e-9fa4-069503672095 admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:58:10.588470 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21f5261-aafe-424e-9fa4-069503672095 admin admin] PATH_INFO: `/v3/projects/a54b5e05061744dea29b6a1ed0b609f0/users/af5f0e2e3bc24b0cb905500648108532/roles/343cc8b1bc7243eebabdf08147e8366d` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:58:10.611698 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b21f5261-aafe-424e-9fa4-069503672095 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a54b5e05061744dea29b6a1ed0b609f0, user_id=af5f0e2e3bc24b0cb905500648108532, role_id=343cc8b1bc7243eebabdf08147e8366d)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:58:10.612685 dv-cinder-835384-27-smb devstack@keystone.service[81593]: WARNING py.warnings [None req-b21f5261-aafe-424e-9fa4-069503672095 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 15 17:58:10.612685 dv-cinder-835384-27-smb devstack@keystone.service[81593]: warnings.warn(msg) Sep 15 17:58:10.612685 dv-cinder-835384-27-smb devstack@keystone.service[81593]: Sep 15 17:58:10.614673 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b21f5261-aafe-424e-9fa4-069503672095 admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:58:10.639193 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 761/1501] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Sep 15 17:58:10 2022] PUT /identity/v3/projects/a54b5e05061744dea29b6a1ed0b609f0/users/af5f0e2e3bc24b0cb905500648108532/roles/343cc8b1bc7243eebabdf08147e8366d => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 17:58:10.651949 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22a0d7e-d1f0-40b4-b38f-f9774699e98e None None] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:58:10.652238 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22a0d7e-d1f0-40b4-b38f-f9774699e98e None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:58:10.652515 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22a0d7e-d1f0-40b4-b38f-f9774699e98e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:58:10.709200 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.auth.core [None req-c22a0d7e-d1f0-40b4-b38f-f9774699e98e None None] MFA Rules not processed for user `af5f0e2e3bc24b0cb905500648108532`. Rule list: `[]` (Enabled: `True`). {{(pid=81592) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 17:58:10.710442 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-c22a0d7e-d1f0-40b4-b38f-f9774699e98e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 17:58:10.792747 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 741/1502] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 15 17:58:10 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 17:58:10.805920 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecdd76a-6c18-4a6c-80c5-e91b659095fe None None] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:58:10.806208 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecdd76a-6c18-4a6c-80c5-e91b659095fe None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:58:10.806481 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecdd76a-6c18-4a6c-80c5-e91b659095fe None None] PATH_INFO: `/` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:58:10.807848 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 762/1503] 10.222.0.25 () {54 vars in 964 bytes} [Thu Sep 15 17:58:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 17:58:10.812806 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c4bc6f-848d-43d5-8748-3b6538864c24 None None] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:58:10.813119 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c4bc6f-848d-43d5-8748-3b6538864c24 None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:58:10.813435 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c4bc6f-848d-43d5-8748-3b6538864c24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:58:10.846377 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:58:10.893578 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.auth.core [None req-e7c4bc6f-848d-43d5-8748-3b6538864c24 None None] MFA Rules not processed for user `1b232e7a841145ba93c6d8462ccb751a`. Rule list: `[]` (Enabled: `True`). {{(pid=81592) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 17:58:10.894700 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-e7c4bc6f-848d-43d5-8748-3b6538864c24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 17:58:10.971657 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 742/1504] 10.222.0.25 () {58 vars in 1061 bytes} [Thu Sep 15 17:58:10 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 17:58:10.979835 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cecdd76a-6c18-4a6c-80c5-e91b659095fe None None] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:58:10.981399 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-cecdd76a-6c18-4a6c-80c5-e91b659095fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 17:58:11.031649 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:58:11.085913 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cecdd76a-6c18-4a6c-80c5-e91b659095fe None None] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:58:11.159640 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29309c01-ab89-428c-85c0-9bb78951cdb6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b232e7a841145ba93c6d8462ccb751a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1213c0d1b584404ba3998e136f166e89', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:58:11.160163 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29309c01-ab89-428c-85c0-9bb78951cdb6 service cinder] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:58:11.160434 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29309c01-ab89-428c-85c0-9bb78951cdb6 service cinder] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:58:11.160703 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29309c01-ab89-428c-85c0-9bb78951cdb6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:58:11.162337 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-29309c01-ab89-428c-85c0-9bb78951cdb6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 17:58:11.263170 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29309c01-ab89-428c-85c0-9bb78951cdb6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:58:11.264627 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29309c01-ab89-428c-85c0-9bb78951cdb6 service cinder] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:58:11.268153 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:58:11.283294 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 763/1505] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 15 17:58:10 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 17:58:11.329850 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e68a6bc-c484-4b05-a309-2e7f848a0087 None None] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:58:11.330288 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e68a6bc-c484-4b05-a309-2e7f848a0087 None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:58:11.330393 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e68a6bc-c484-4b05-a309-2e7f848a0087 None None] PATH_INFO: `/` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:58:11.331678 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 743/1506] 10.222.0.25 () {52 vars in 830 bytes} [Thu Sep 15 17:58:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 17:58:11.335372 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29309c01-ab89-428c-85c0-9bb78951cdb6 service cinder] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:58:11.336612 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-29309c01-ab89-428c-85c0-9bb78951cdb6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 17:58:11.457845 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29309c01-ab89-428c-85c0-9bb78951cdb6 service cinder] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:58:11.554065 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e7097b-7842-4e5e-bf25-021cefc5892b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:58:11.554772 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e7097b-7842-4e5e-bf25-021cefc5892b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:58:11.554964 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e7097b-7842-4e5e-bf25-021cefc5892b admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:58:11.555267 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e7097b-7842-4e5e-bf25-021cefc5892b admin admin] PATH_INFO: `/v3/users/af5f0e2e3bc24b0cb905500648108532` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:58:11.568368 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e7097b-7842-4e5e-bf25-021cefc5892b admin admin] RBAC: Authorizing `identity:delete_user(user_id=af5f0e2e3bc24b0cb905500648108532)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:58:11.569435 dv-cinder-835384-27-smb devstack@keystone.service[81593]: WARNING py.warnings [None req-a2e7097b-7842-4e5e-bf25-021cefc5892b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 15 17:58:11.569435 dv-cinder-835384-27-smb devstack@keystone.service[81593]: warnings.warn(msg) Sep 15 17:58:11.569435 dv-cinder-835384-27-smb devstack@keystone.service[81593]: Sep 15 17:58:11.571133 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e7097b-7842-4e5e-bf25-021cefc5892b admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:58:11.581075 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:58:11.647016 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-a2e7097b-7842-4e5e-bf25-021cefc5892b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'af5f0e2e3bc24b0cb905500648108532'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 17:58:11.656973 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-a2e7097b-7842-4e5e-bf25-021cefc5892b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'af5f0e2e3bc24b0cb905500648108532'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 17:58:11.657435 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-a2e7097b-7842-4e5e-bf25-021cefc5892b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'af5f0e2e3bc24b0cb905500648108532'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 17:58:11.657946 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-a2e7097b-7842-4e5e-bf25-021cefc5892b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'af5f0e2e3bc24b0cb905500648108532'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 17:58:11.672267 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-a2e7097b-7842-4e5e-bf25-021cefc5892b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'af5f0e2e3bc24b0cb905500648108532'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 17:58:11.701627 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 764/1507] 10.222.0.25 () {58 vars in 1224 bytes} [Thu Sep 15 17:58:11 2022] DELETE /identity/v3/users/af5f0e2e3bc24b0cb905500648108532 => generated 0 bytes in 367 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 17:58:11.706092 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17aabed-1862-45b2-9158-b902199ac64b None None] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:58:11.706408 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17aabed-1862-45b2-9158-b902199ac64b None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:58:11.706683 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17aabed-1862-45b2-9158-b902199ac64b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:58:11.778742 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.auth.core [None req-c17aabed-1862-45b2-9158-b902199ac64b None None] MFA Rules not processed for user `5cfa58ef86774ab7800bf91930bf6028`. Rule list: `[]` (Enabled: `True`). {{(pid=81592) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 17:58:11.779959 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-c17aabed-1862-45b2-9158-b902199ac64b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 17:58:11.856722 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:58:11.869462 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 744/1508] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 15 17:58:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 17:58:11.879150 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e7097b-7842-4e5e-bf25-021cefc5892b admin admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:58:11.880391 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-a2e7097b-7842-4e5e-bf25-021cefc5892b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 17:58:11.984976 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e7097b-7842-4e5e-bf25-021cefc5892b admin admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:58:12.043576 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:58:12.065590 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ed5568-3226-4e97-942e-392f3387ecc3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a32274b4781b40fea9f28da8a9bde5ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1213c0d1b584404ba3998e136f166e89', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:58:12.066363 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ed5568-3226-4e97-942e-392f3387ecc3 service neutron] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:58:12.066737 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ed5568-3226-4e97-942e-392f3387ecc3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:58:12.067097 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ed5568-3226-4e97-942e-392f3387ecc3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:58:12.068850 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-24ed5568-3226-4e97-942e-392f3387ecc3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 17:58:12.177984 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ed5568-3226-4e97-942e-392f3387ecc3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:58:12.179434 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ed5568-3226-4e97-942e-392f3387ecc3 service neutron] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:58:12.197317 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 765/1509] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 15 17:58:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 17:58:12.538716 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17aabed-1862-45b2-9158-b902199ac64b None None] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:58:12.540041 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-c17aabed-1862-45b2-9158-b902199ac64b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 17:58:12.551912 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17aabed-1862-45b2-9158-b902199ac64b None None] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:58:12.655781 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e058fa4-e515-49eb-a605-1da29e7e9655 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:58:12.656426 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e058fa4-e515-49eb-a605-1da29e7e9655 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:58:12.656711 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e058fa4-e515-49eb-a605-1da29e7e9655 admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:58:12.656983 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e058fa4-e515-49eb-a605-1da29e7e9655 admin admin] PATH_INFO: `/v3/projects/a54b5e05061744dea29b6a1ed0b609f0` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:58:12.667469 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e058fa4-e515-49eb-a605-1da29e7e9655 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a54b5e05061744dea29b6a1ed0b609f0)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:58:12.668511 dv-cinder-835384-27-smb devstack@keystone.service[81592]: WARNING py.warnings [None req-5e058fa4-e515-49eb-a605-1da29e7e9655 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 15 17:58:12.668511 dv-cinder-835384-27-smb devstack@keystone.service[81592]: warnings.warn(msg) Sep 15 17:58:12.668511 dv-cinder-835384-27-smb devstack@keystone.service[81592]: Sep 15 17:58:12.669761 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e058fa4-e515-49eb-a605-1da29e7e9655 admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:58:12.743465 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-5e058fa4-e515-49eb-a605-1da29e7e9655 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a54b5e05061744dea29b6a1ed0b609f0', 'request_id': 'req-5e058fa4-e515-49eb-a605-1da29e7e9655'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 17:58:12.750061 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-5e058fa4-e515-49eb-a605-1da29e7e9655 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a54b5e05061744dea29b6a1ed0b609f0', 'request_id': 'req-5e058fa4-e515-49eb-a605-1da29e7e9655'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 17:58:12.760013 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-5e058fa4-e515-49eb-a605-1da29e7e9655 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a54b5e05061744dea29b6a1ed0b609f0', 'request_id': 'req-5e058fa4-e515-49eb-a605-1da29e7e9655'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 17:58:12.792628 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-5e058fa4-e515-49eb-a605-1da29e7e9655 admin admin] The token cache is being invalidate because project a54b5e05061744dea29b6a1ed0b609f0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81592) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 17:58:12.792916 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-5e058fa4-e515-49eb-a605-1da29e7e9655 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 17:58:12.793381 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-5e058fa4-e515-49eb-a605-1da29e7e9655 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 17:58:12.794822 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 745/1510] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Sep 15 17:58:12 2022] DELETE /identity/v3/projects/a54b5e05061744dea29b6a1ed0b609f0 => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 17:58:22.195093 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=62 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:58:22.790512 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=84,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:59:48.507564 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca807f85-ca11-4a0e-a81c-11f2d1fb42bc None None] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:59:48.508233 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca807f85-ca11-4a0e-a81c-11f2d1fb42bc None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:59:48.508233 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca807f85-ca11-4a0e-a81c-11f2d1fb42bc None None] PATH_INFO: `/` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:59:48.509516 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 766/1511] 127.0.0.1 () {54 vars in 901 bytes} [Thu Sep 15 17:59:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 17:59:48.514758 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223e485d-08a2-41e5-824d-92756b2ca21e None None] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:59:48.515270 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223e485d-08a2-41e5-824d-92756b2ca21e None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:59:48.515375 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223e485d-08a2-41e5-824d-92756b2ca21e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:59:48.598385 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.auth.core [None req-223e485d-08a2-41e5-824d-92756b2ca21e None None] MFA Rules not processed for user `5cfa58ef86774ab7800bf91930bf6028`. Rule list: `[]` (Enabled: `True`). {{(pid=81592) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 17:59:48.599614 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-223e485d-08a2-41e5-824d-92756b2ca21e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 17:59:48.708318 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 746/1512] 127.0.0.1 () {58 vars in 998 bytes} [Thu Sep 15 17:59:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 17:59:48.898223 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca807f85-ca11-4a0e-a81c-11f2d1fb42bc None None] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:59:48.900384 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-ca807f85-ca11-4a0e-a81c-11f2d1fb42bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 17:59:49.022876 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca807f85-ca11-4a0e-a81c-11f2d1fb42bc None None] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:59:49.028427 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6f06b0-05fd-4a69-8079-f0043654dd3c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe2244818e4d4dca9c424cd078653e6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1213c0d1b584404ba3998e136f166e89', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:59:49.029045 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6f06b0-05fd-4a69-8079-f0043654dd3c service nova] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:59:49.029353 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6f06b0-05fd-4a69-8079-f0043654dd3c service nova] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:59:49.029630 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6f06b0-05fd-4a69-8079-f0043654dd3c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:59:49.038175 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6f06b0-05fd-4a69-8079-f0043654dd3c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:59:49.039776 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6f06b0-05fd-4a69-8079-f0043654dd3c service nova] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:59:49.050068 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 767/1513] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 15 17:59:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 17:59:50.155058 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87be09c-759f-4967-bf34-305f216f6d4d None None] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:59:50.155623 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87be09c-759f-4967-bf34-305f216f6d4d None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:59:50.155623 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87be09c-759f-4967-bf34-305f216f6d4d None None] PATH_INFO: `/` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:59:50.156977 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 747/1514] 127.0.0.1 () {54 vars in 901 bytes} [Thu Sep 15 17:59:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 17:59:50.164179 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d4b181-0583-48ab-92a5-26d2445b10ed None None] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:59:50.164737 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d4b181-0583-48ab-92a5-26d2445b10ed None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:59:50.164737 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d4b181-0583-48ab-92a5-26d2445b10ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:59:50.180768 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83458dc7-b537-4600-bd0a-bf4019b78f00 None None] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:59:50.181208 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83458dc7-b537-4600-bd0a-bf4019b78f00 None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:59:50.181727 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83458dc7-b537-4600-bd0a-bf4019b78f00 None None] PATH_INFO: `/v3` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:59:50.183363 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 748/1515] 10.222.0.27 () {54 vars in 925 bytes} [Thu Sep 15 17:59:50 2022] GET /identity/v3 => generated 255 bytes in 4 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 17:59:50.189223 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.auth.core [None req-07d4b181-0583-48ab-92a5-26d2445b10ed None None] MFA Rules not processed for user `5cfa58ef86774ab7800bf91930bf6028`. Rule list: `[]` (Enabled: `True`). {{(pid=81593) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 17:59:50.190482 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-07d4b181-0583-48ab-92a5-26d2445b10ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 17:59:50.198648 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 768/1516] 127.0.0.1 () {58 vars in 998 bytes} [Thu Sep 15 17:59:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 17:59:50.204982 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc57eed-aecb-4d5e-bde0-4176dbaa0ed4 None None] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:59:50.204982 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc57eed-aecb-4d5e-bde0-4176dbaa0ed4 None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:59:50.205219 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc57eed-aecb-4d5e-bde0-4176dbaa0ed4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:59:50.269583 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.auth.core [None req-ddc57eed-aecb-4d5e-bde0-4176dbaa0ed4 None None] MFA Rules not processed for user `10af119bd39841ed8163993676230fca`. Rule list: `[]` (Enabled: `True`). {{(pid=81592) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 17:59:50.271334 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-ddc57eed-aecb-4d5e-bde0-4176dbaa0ed4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 17:59:50.302530 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 17:59:50.344858 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 749/1517] 10.222.0.27 () {58 vars in 1015 bytes} [Thu Sep 15 17:59:50 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 17:59:50.350790 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d4b181-0583-48ab-92a5-26d2445b10ed None None] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:59:50.363545 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d4b181-0583-48ab-92a5-26d2445b10ed None None] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:59:50.369452 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ef5c4f-4310-4688-a7cc-6dfea34101df service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe2244818e4d4dca9c424cd078653e6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1213c0d1b584404ba3998e136f166e89', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:59:50.370061 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ef5c4f-4310-4688-a7cc-6dfea34101df service nova] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:59:50.370340 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ef5c4f-4310-4688-a7cc-6dfea34101df service nova] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:59:50.370613 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ef5c4f-4310-4688-a7cc-6dfea34101df service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:59:50.379162 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ef5c4f-4310-4688-a7cc-6dfea34101df service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:59:50.381468 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ef5c4f-4310-4688-a7cc-6dfea34101df service nova] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:59:50.393130 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 769/1518] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 15 17:59:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 17:59:59.109852 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c80d4d8-4f45-4892-8fc3-f439bcfbea6c None None] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:59:59.110369 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c80d4d8-4f45-4892-8fc3-f439bcfbea6c None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:59:59.110474 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c80d4d8-4f45-4892-8fc3-f439bcfbea6c None None] PATH_INFO: `/` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:59:59.111754 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 750/1519] 10.222.0.25 () {54 vars in 961 bytes} [Thu Sep 15 17:59:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 17:59:59.116686 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788e8a95-0b19-44ca-8b67-abe8d6726f2a None None] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:59:59.117127 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788e8a95-0b19-44ca-8b67-abe8d6726f2a None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:59:59.117256 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788e8a95-0b19-44ca-8b67-abe8d6726f2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:59:59.138750 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.auth.core [None req-788e8a95-0b19-44ca-8b67-abe8d6726f2a None None] MFA Rules not processed for user `10af119bd39841ed8163993676230fca`. Rule list: `[]` (Enabled: `True`). {{(pid=81593) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 17:59:59.139946 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-788e8a95-0b19-44ca-8b67-abe8d6726f2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 17:59:59.149865 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 770/1520] 10.222.0.25 () {58 vars in 1058 bytes} [Thu Sep 15 17:59:59 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 17:59:59.157659 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c80d4d8-4f45-4892-8fc3-f439bcfbea6c None None] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 17:59:59.170682 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c80d4d8-4f45-4892-8fc3-f439bcfbea6c None None] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 17:59:59.175532 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dffacb1f-6112-4dbb-9f34-8e33d91ccafc service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10af119bd39841ed8163993676230fca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1213c0d1b584404ba3998e136f166e89', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 17:59:59.176125 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffacb1f-6112-4dbb-9f34-8e33d91ccafc service placement] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 17:59:59.176408 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffacb1f-6112-4dbb-9f34-8e33d91ccafc service placement] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 17:59:59.176680 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffacb1f-6112-4dbb-9f34-8e33d91ccafc service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 17:59:59.184653 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dffacb1f-6112-4dbb-9f34-8e33d91ccafc service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 17:59:59.186236 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dffacb1f-6112-4dbb-9f34-8e33d91ccafc service placement] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 17:59:59.196073 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 751/1521] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 15 17:59:59 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 18:00:01.892085 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90893ec8-c55b-4876-a40b-769c9290b9dc None None] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:00:01.892650 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90893ec8-c55b-4876-a40b-769c9290b9dc None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:00:01.892650 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90893ec8-c55b-4876-a40b-769c9290b9dc None None] PATH_INFO: `/` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:00:01.894029 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 771/1522] 127.0.0.1 () {54 vars in 901 bytes} [Thu Sep 15 18:00:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 18:00:01.904577 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8321abff-b40c-47e1-a181-4a6ddb646357 None None] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:00:01.905141 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8321abff-b40c-47e1-a181-4a6ddb646357 None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:00:01.905141 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8321abff-b40c-47e1-a181-4a6ddb646357 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:00:01.925510 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.auth.core [None req-8321abff-b40c-47e1-a181-4a6ddb646357 None None] MFA Rules not processed for user `5cfa58ef86774ab7800bf91930bf6028`. Rule list: `[]` (Enabled: `True`). {{(pid=81592) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 18:00:01.926822 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-8321abff-b40c-47e1-a181-4a6ddb646357 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:00:01.935389 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 752/1523] 127.0.0.1 () {58 vars in 998 bytes} [Thu Sep 15 18:00:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 18:00:02.088080 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90893ec8-c55b-4876-a40b-769c9290b9dc None None] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:00:02.103596 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90893ec8-c55b-4876-a40b-769c9290b9dc None None] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:00:02.108904 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ed5fa7-d6d7-4a7b-81ee-0161207b5dc1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe2244818e4d4dca9c424cd078653e6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1213c0d1b584404ba3998e136f166e89', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:00:02.109531 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ed5fa7-d6d7-4a7b-81ee-0161207b5dc1 service nova] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:00:02.109812 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ed5fa7-d6d7-4a7b-81ee-0161207b5dc1 service nova] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:00:02.110080 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ed5fa7-d6d7-4a7b-81ee-0161207b5dc1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:00:02.119270 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ed5fa7-d6d7-4a7b-81ee-0161207b5dc1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:00:02.120863 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ed5fa7-d6d7-4a7b-81ee-0161207b5dc1 service nova] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:00:02.130620 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 772/1524] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 15 18:00:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 18:00:03.223704 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337a0c24-d3e7-4ebf-8575-f9103b3f43b2 None None] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:00:03.224780 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337a0c24-d3e7-4ebf-8575-f9103b3f43b2 None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:00:03.224780 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337a0c24-d3e7-4ebf-8575-f9103b3f43b2 None None] PATH_INFO: `/` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:00:03.226422 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 753/1525] 127.0.0.1 () {54 vars in 901 bytes} [Thu Sep 15 18:00:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 18:00:03.233021 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601cf558-1c8a-4e65-acf1-75fdb249f151 None None] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:00:03.233598 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601cf558-1c8a-4e65-acf1-75fdb249f151 None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:00:03.233598 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601cf558-1c8a-4e65-acf1-75fdb249f151 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:00:03.256330 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.auth.core [None req-601cf558-1c8a-4e65-acf1-75fdb249f151 None None] MFA Rules not processed for user `5cfa58ef86774ab7800bf91930bf6028`. Rule list: `[]` (Enabled: `True`). {{(pid=81593) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 18:00:03.257579 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-601cf558-1c8a-4e65-acf1-75fdb249f151 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:00:03.268009 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 773/1526] 127.0.0.1 () {58 vars in 998 bytes} [Thu Sep 15 18:00:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 18:00:03.422256 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337a0c24-d3e7-4ebf-8575-f9103b3f43b2 None None] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:00:03.436673 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337a0c24-d3e7-4ebf-8575-f9103b3f43b2 None None] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:00:03.442198 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ccad2f-bf9a-4299-ac9f-38c1598a7d67 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe2244818e4d4dca9c424cd078653e6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1213c0d1b584404ba3998e136f166e89', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:00:03.443323 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ccad2f-bf9a-4299-ac9f-38c1598a7d67 service nova] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:00:03.443612 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ccad2f-bf9a-4299-ac9f-38c1598a7d67 service nova] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:00:03.443881 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ccad2f-bf9a-4299-ac9f-38c1598a7d67 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:00:03.452505 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ccad2f-bf9a-4299-ac9f-38c1598a7d67 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:00:03.454125 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ccad2f-bf9a-4299-ac9f-38c1598a7d67 service nova] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:00:03.464660 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 754/1527] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 15 18:00:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 18:00:07.790292 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0c6f55-5fe9-4f99-ad30-e0d37af41ad6 None None] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:00:07.790906 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0c6f55-5fe9-4f99-ad30-e0d37af41ad6 None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:00:07.790906 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0c6f55-5fe9-4f99-ad30-e0d37af41ad6 None None] PATH_INFO: `/` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:00:07.792174 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 774/1528] 127.0.0.1 () {54 vars in 917 bytes} [Thu Sep 15 18:00:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 18:00:07.797853 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc2ba9c-8c6f-4f09-90d0-1a6c76b0d65e None None] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:00:07.798353 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc2ba9c-8c6f-4f09-90d0-1a6c76b0d65e None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:00:07.798451 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc2ba9c-8c6f-4f09-90d0-1a6c76b0d65e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:00:07.818987 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.auth.core [None req-5fc2ba9c-8c6f-4f09-90d0-1a6c76b0d65e None None] MFA Rules not processed for user `5cfa58ef86774ab7800bf91930bf6028`. Rule list: `[]` (Enabled: `True`). {{(pid=81592) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 18:00:07.820202 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-5fc2ba9c-8c6f-4f09-90d0-1a6c76b0d65e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:00:07.828254 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 755/1529] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Sep 15 18:00:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 18:00:08.123577 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0c6f55-5fe9-4f99-ad30-e0d37af41ad6 None None] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:00:08.125442 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-5f0c6f55-5fe9-4f99-ad30-e0d37af41ad6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:00:08.194798 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 18:00:08.210427 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0c6f55-5fe9-4f99-ad30-e0d37af41ad6 None None] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:00:08.217181 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c35770-4aa2-47a8-aeb0-b94a1aef97ea service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a32274b4781b40fea9f28da8a9bde5ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1213c0d1b584404ba3998e136f166e89', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:00:08.217825 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c35770-4aa2-47a8-aeb0-b94a1aef97ea service neutron] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:00:08.218099 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c35770-4aa2-47a8-aeb0-b94a1aef97ea service neutron] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:00:08.218366 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c35770-4aa2-47a8-aeb0-b94a1aef97ea service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:00:08.230238 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c35770-4aa2-47a8-aeb0-b94a1aef97ea service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:00:08.232585 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c35770-4aa2-47a8-aeb0-b94a1aef97ea service neutron] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:00:08.244952 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 775/1530] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 15 18:00:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 18:00:10.448022 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f1ef21-49ca-4526-ba36-413f51e12d8a None None] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:00:10.448598 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f1ef21-49ca-4526-ba36-413f51e12d8a None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:00:10.448598 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f1ef21-49ca-4526-ba36-413f51e12d8a None None] PATH_INFO: `/` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:00:10.449947 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 756/1531] 127.0.0.1 () {54 vars in 917 bytes} [Thu Sep 15 18:00:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 18:00:10.455718 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81dff7c3-a66a-45df-b153-1c83727041cf None None] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:00:10.456216 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81dff7c3-a66a-45df-b153-1c83727041cf None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:00:10.456342 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81dff7c3-a66a-45df-b153-1c83727041cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:00:10.476724 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.auth.core [None req-81dff7c3-a66a-45df-b153-1c83727041cf None None] MFA Rules not processed for user `5cfa58ef86774ab7800bf91930bf6028`. Rule list: `[]` (Enabled: `True`). {{(pid=81593) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 18:00:10.478166 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-81dff7c3-a66a-45df-b153-1c83727041cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:00:10.486394 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 776/1532] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Sep 15 18:00:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 18:00:10.784670 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f1ef21-49ca-4526-ba36-413f51e12d8a None None] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:00:10.787093 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-09f1ef21-49ca-4526-ba36-413f51e12d8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:00:10.800239 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f1ef21-49ca-4526-ba36-413f51e12d8a None None] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:00:10.803856 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4652d2e2-91e1-4c85-9aaf-9cd41dc53462 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a32274b4781b40fea9f28da8a9bde5ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1213c0d1b584404ba3998e136f166e89', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:00:10.804455 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4652d2e2-91e1-4c85-9aaf-9cd41dc53462 service neutron] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:00:10.804732 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4652d2e2-91e1-4c85-9aaf-9cd41dc53462 service neutron] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:00:10.805000 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4652d2e2-91e1-4c85-9aaf-9cd41dc53462 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:00:10.814725 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4652d2e2-91e1-4c85-9aaf-9cd41dc53462 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:00:10.816152 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4652d2e2-91e1-4c85-9aaf-9cd41dc53462 service neutron] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:00:10.826118 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 757/1533] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 15 18:00:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 18:00:14.698106 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9697b91-eac1-4265-86bd-9a96ba5453f7 None None] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:00:14.698754 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9697b91-eac1-4265-86bd-9a96ba5453f7 None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:00:14.698754 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9697b91-eac1-4265-86bd-9a96ba5453f7 None None] PATH_INFO: `/` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:00:14.699891 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 777/1534] 127.0.0.1 () {54 vars in 917 bytes} [Thu Sep 15 18:00:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 18:00:14.705856 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43abfa28-a7a9-4fa1-ae85-d22a32ba014b None None] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:00:14.706400 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43abfa28-a7a9-4fa1-ae85-d22a32ba014b None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:00:14.706400 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43abfa28-a7a9-4fa1-ae85-d22a32ba014b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:00:14.727795 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.auth.core [None req-43abfa28-a7a9-4fa1-ae85-d22a32ba014b None None] MFA Rules not processed for user `5cfa58ef86774ab7800bf91930bf6028`. Rule list: `[]` (Enabled: `True`). {{(pid=81592) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 18:00:14.729016 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-43abfa28-a7a9-4fa1-ae85-d22a32ba014b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:00:14.736943 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 758/1535] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Sep 15 18:00:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 18:00:15.058056 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9697b91-eac1-4265-86bd-9a96ba5453f7 None None] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:00:15.059755 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-c9697b91-eac1-4265-86bd-9a96ba5453f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:00:15.136798 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9697b91-eac1-4265-86bd-9a96ba5453f7 None None] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:00:15.140278 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d533dbcd-c58e-447e-8172-7ea434a63739 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b232e7a841145ba93c6d8462ccb751a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1213c0d1b584404ba3998e136f166e89', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:00:15.140874 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d533dbcd-c58e-447e-8172-7ea434a63739 service cinder] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:00:15.141149 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d533dbcd-c58e-447e-8172-7ea434a63739 service cinder] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:00:15.141446 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d533dbcd-c58e-447e-8172-7ea434a63739 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:00:15.150922 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d533dbcd-c58e-447e-8172-7ea434a63739 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:00:15.152412 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d533dbcd-c58e-447e-8172-7ea434a63739 service cinder] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:00:15.162506 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 778/1536] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 15 18:00:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 18:00:17.333221 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2295f83e-22e9-49e2-bb4f-bec164ab8abd None None] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:00:17.334107 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2295f83e-22e9-49e2-bb4f-bec164ab8abd None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:00:17.334265 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2295f83e-22e9-49e2-bb4f-bec164ab8abd None None] PATH_INFO: `/` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:00:17.335716 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 759/1537] 127.0.0.1 () {54 vars in 917 bytes} [Thu Sep 15 18:00:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 18:00:17.341399 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c4240a-aacb-44f2-a111-ff35f4634ebd None None] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:00:17.341905 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c4240a-aacb-44f2-a111-ff35f4634ebd None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:00:17.342003 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c4240a-aacb-44f2-a111-ff35f4634ebd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:00:17.361592 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.auth.core [None req-19c4240a-aacb-44f2-a111-ff35f4634ebd None None] MFA Rules not processed for user `5cfa58ef86774ab7800bf91930bf6028`. Rule list: `[]` (Enabled: `True`). {{(pid=81593) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 18:00:17.362905 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-19c4240a-aacb-44f2-a111-ff35f4634ebd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:00:17.371808 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 779/1538] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Sep 15 18:00:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 18:00:17.670956 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2295f83e-22e9-49e2-bb4f-bec164ab8abd None None] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:00:17.672750 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-2295f83e-22e9-49e2-bb4f-bec164ab8abd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:00:17.686353 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2295f83e-22e9-49e2-bb4f-bec164ab8abd None None] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:00:17.689841 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c15d857-7b8d-4900-bb32-71031f7ce7d3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b232e7a841145ba93c6d8462ccb751a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1213c0d1b584404ba3998e136f166e89', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:00:17.690435 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c15d857-7b8d-4900-bb32-71031f7ce7d3 service cinder] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:00:17.690707 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c15d857-7b8d-4900-bb32-71031f7ce7d3 service cinder] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:00:17.690973 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c15d857-7b8d-4900-bb32-71031f7ce7d3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:00:17.699684 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c15d857-7b8d-4900-bb32-71031f7ce7d3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:00:17.701109 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c15d857-7b8d-4900-bb32-71031f7ce7d3 service cinder] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:00:17.710320 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 760/1539] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 15 18:00:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 18:00:27.356490 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=50 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 18:00:27.706281 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=50 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 18:01:45.422705 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facc0349-a1c6-4b8a-9871-52c2cc4dd60f None None] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:01:45.423418 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facc0349-a1c6-4b8a-9871-52c2cc4dd60f None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:01:45.423418 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facc0349-a1c6-4b8a-9871-52c2cc4dd60f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:01:45.452251 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.auth.core [None req-facc0349-a1c6-4b8a-9871-52c2cc4dd60f None None] MFA Rules not processed for user `5cfa58ef86774ab7800bf91930bf6028`. Rule list: `[]` (Enabled: `True`). {{(pid=81593) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 18:01:45.454186 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-facc0349-a1c6-4b8a-9871-52c2cc4dd60f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:01:45.473612 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 780/1540] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 15 18:01:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 18:01:45.482865 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69326dd5-bb20-4fd7-9675-d7eb27359fc0 None None] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:01:45.483571 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69326dd5-bb20-4fd7-9675-d7eb27359fc0 None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:01:45.483571 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69326dd5-bb20-4fd7-9675-d7eb27359fc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:01:45.522565 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.auth.core [None req-69326dd5-bb20-4fd7-9675-d7eb27359fc0 None None] MFA Rules not processed for user `5cfa58ef86774ab7800bf91930bf6028`. Rule list: `[]` (Enabled: `True`). {{(pid=81592) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 18:01:45.523846 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-69326dd5-bb20-4fd7-9675-d7eb27359fc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:01:45.533811 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 761/1541] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 15 18:01:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 18:01:45.538822 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-facc0349-a1c6-4b8a-9871-52c2cc4dd60f None None] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:01:45.549789 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-facc0349-a1c6-4b8a-9871-52c2cc4dd60f None None] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:01:45.558000 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c214b8-6d4f-4a3d-a8a3-6ca1c75d8958 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:01:45.558641 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c214b8-6d4f-4a3d-a8a3-6ca1c75d8958 admin admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:01:45.558921 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c214b8-6d4f-4a3d-a8a3-6ca1c75d8958 admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:01:45.559199 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c214b8-6d4f-4a3d-a8a3-6ca1c75d8958 admin admin] PATH_INFO: `/v3/domains` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:01:45.559874 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c214b8-6d4f-4a3d-a8a3-6ca1c75d8958 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81593) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 18:01:45.560177 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c214b8-6d4f-4a3d-a8a3-6ca1c75d8958 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:01:45.561231 dv-cinder-835384-27-smb devstack@keystone.service[81593]: WARNING py.warnings [None req-c7c214b8-6d4f-4a3d-a8a3-6ca1c75d8958 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 15 18:01:45.561231 dv-cinder-835384-27-smb devstack@keystone.service[81593]: warnings.warn(msg) Sep 15 18:01:45.561231 dv-cinder-835384-27-smb devstack@keystone.service[81593]: Sep 15 18:01:45.562177 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c214b8-6d4f-4a3d-a8a3-6ca1c75d8958 admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:01:45.582119 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 781/1542] 10.222.0.25 () {58 vars in 1153 bytes} [Thu Sep 15 18:01:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 18:01:45.590566 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69326dd5-bb20-4fd7-9675-d7eb27359fc0 None None] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:01:45.605443 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69326dd5-bb20-4fd7-9675-d7eb27359fc0 None None] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:01:45.610943 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b757fe-947b-4a8f-9b92-38a6cb04d3d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:01:45.611607 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b757fe-947b-4a8f-9b92-38a6cb04d3d5 admin admin] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:01:45.612038 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b757fe-947b-4a8f-9b92-38a6cb04d3d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:01:45.612319 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b757fe-947b-4a8f-9b92-38a6cb04d3d5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:01:45.612989 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b757fe-947b-4a8f-9b92-38a6cb04d3d5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:01:45.614324 dv-cinder-835384-27-smb devstack@keystone.service[81592]: WARNING py.warnings [None req-f1b757fe-947b-4a8f-9b92-38a6cb04d3d5 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 15 18:01:45.614324 dv-cinder-835384-27-smb devstack@keystone.service[81592]: warnings.warn(msg) Sep 15 18:01:45.614324 dv-cinder-835384-27-smb devstack@keystone.service[81592]: Sep 15 18:01:45.615654 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b757fe-947b-4a8f-9b92-38a6cb04d3d5 admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:01:45.680079 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 762/1543] 10.222.0.25 () {60 vars in 1153 bytes} [Thu Sep 15 18:01:45 2022] POST /identity/v3/projects => generated 379 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 18:01:45.684287 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c214b8-6d4f-4a3d-a8a3-6ca1c75d8958 admin admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:01:45.701395 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c214b8-6d4f-4a3d-a8a3-6ca1c75d8958 admin admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:01:45.748323 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66d06e7-19ee-4def-a427-d36b155f5866 None None] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:01:45.748699 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66d06e7-19ee-4def-a427-d36b155f5866 None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:01:45.748887 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66d06e7-19ee-4def-a427-d36b155f5866 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:01:45.782002 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7174fd4c-7139-4797-8564-1c3e064c42ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:01:45.782634 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7174fd4c-7139-4797-8564-1c3e064c42ea admin admin] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:01:45.782916 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7174fd4c-7139-4797-8564-1c3e064c42ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:01:45.783191 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7174fd4c-7139-4797-8564-1c3e064c42ea admin admin] PATH_INFO: `/v3/users` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:01:45.783868 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7174fd4c-7139-4797-8564-1c3e064c42ea admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:01:45.784891 dv-cinder-835384-27-smb devstack@keystone.service[81593]: WARNING py.warnings [None req-7174fd4c-7139-4797-8564-1c3e064c42ea admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 15 18:01:45.784891 dv-cinder-835384-27-smb devstack@keystone.service[81593]: warnings.warn(msg) Sep 15 18:01:45.784891 dv-cinder-835384-27-smb devstack@keystone.service[81593]: Sep 15 18:01:45.786137 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7174fd4c-7139-4797-8564-1c3e064c42ea admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:01:45.791534 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.auth.core [None req-f66d06e7-19ee-4def-a427-d36b155f5866 None None] MFA Rules not processed for user `5cfa58ef86774ab7800bf91930bf6028`. Rule list: `[]` (Enabled: `True`). {{(pid=81592) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 18:01:45.792818 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-f66d06e7-19ee-4def-a427-d36b155f5866 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:01:45.808679 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 763/1544] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 15 18:01:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (3 switches on core 0) Sep 15 18:01:45.819611 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297275b7-1d25-4f19-9c57-6b76af956b8d None None] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:01:45.819950 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297275b7-1d25-4f19-9c57-6b76af956b8d None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:01:45.820225 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297275b7-1d25-4f19-9c57-6b76af956b8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:01:45.824283 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 782/1545] 10.222.0.25 () {60 vars in 1144 bytes} [Thu Sep 15 18:01:45 2022] POST /identity/v3/users => generated 290 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 15 18:01:45.828273 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7174fd4c-7139-4797-8564-1c3e064c42ea admin admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:01:45.843238 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7174fd4c-7139-4797-8564-1c3e064c42ea admin admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:01:45.856060 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.auth.core [None req-297275b7-1d25-4f19-9c57-6b76af956b8d None None] MFA Rules not processed for user `5cfa58ef86774ab7800bf91930bf6028`. Rule list: `[]` (Enabled: `True`). {{(pid=81592) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 18:01:45.857466 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-297275b7-1d25-4f19-9c57-6b76af956b8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:01:45.862128 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef91faab-713f-457f-8edf-0643da8cd73c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:01:45.862712 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef91faab-713f-457f-8edf-0643da8cd73c admin admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:01:45.863000 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef91faab-713f-457f-8edf-0643da8cd73c admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:01:45.863266 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef91faab-713f-457f-8edf-0643da8cd73c admin admin] PATH_INFO: `/v3/roles` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:01:45.863925 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef91faab-713f-457f-8edf-0643da8cd73c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:01:45.865753 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef91faab-713f-457f-8edf-0643da8cd73c admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:01:45.870378 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 764/1546] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 15 18:01:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 18:01:45.871988 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581b08cb-7d74-4902-977e-0493e002400c None None] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:01:45.872488 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581b08cb-7d74-4902-977e-0493e002400c None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:01:45.872994 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581b08cb-7d74-4902-977e-0493e002400c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:01:45.877995 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 783/1547] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Sep 15 18:01:45 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 15 18:01:45.879962 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fd83b3-036b-4fc5-a753-2b0254aa9881 None None] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:01:45.880249 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fd83b3-036b-4fc5-a753-2b0254aa9881 None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:01:45.880515 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fd83b3-036b-4fc5-a753-2b0254aa9881 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:01:45.916721 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.auth.core [None req-581b08cb-7d74-4902-977e-0493e002400c None None] MFA Rules not processed for user `5cfa58ef86774ab7800bf91930bf6028`. Rule list: `[]` (Enabled: `True`). {{(pid=81592) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 18:01:45.918185 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-581b08cb-7d74-4902-977e-0493e002400c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:01:45.927393 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.auth.core [None req-f0fd83b3-036b-4fc5-a753-2b0254aa9881 None None] MFA Rules not processed for user `5cfa58ef86774ab7800bf91930bf6028`. Rule list: `[]` (Enabled: `True`). {{(pid=81593) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 18:01:45.930600 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-f0fd83b3-036b-4fc5-a753-2b0254aa9881 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:01:45.933994 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 765/1548] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 15 18:01:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 18:01:45.935908 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b7f65f-d67f-4b26-a570-d3d4d009f196 None None] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:01:45.936206 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b7f65f-d67f-4b26-a570-d3d4d009f196 None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:01:45.936488 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b7f65f-d67f-4b26-a570-d3d4d009f196 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:01:45.942247 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 784/1549] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 15 18:01:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 18:01:45.943579 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0fd83b3-036b-4fc5-a753-2b0254aa9881 None None] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:01:45.959571 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0fd83b3-036b-4fc5-a753-2b0254aa9881 None None] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:01:45.965061 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad18b513-887e-4c00-8142-371b71247db9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:01:45.965980 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad18b513-887e-4c00-8142-371b71247db9 admin admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:01:45.966480 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad18b513-887e-4c00-8142-371b71247db9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:01:45.966914 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad18b513-887e-4c00-8142-371b71247db9 admin admin] PATH_INFO: `/v3/domains` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:01:45.967847 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad18b513-887e-4c00-8142-371b71247db9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81593) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 18:01:45.968349 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad18b513-887e-4c00-8142-371b71247db9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:01:45.969939 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.auth.core [None req-01b7f65f-d67f-4b26-a570-d3d4d009f196 None None] MFA Rules not processed for user `5cfa58ef86774ab7800bf91930bf6028`. Rule list: `[]` (Enabled: `True`). {{(pid=81592) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 18:01:45.970464 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad18b513-887e-4c00-8142-371b71247db9 admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:01:45.971319 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-01b7f65f-d67f-4b26-a570-d3d4d009f196 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:01:45.980482 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 766/1550] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 15 18:01:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 18:01:45.981511 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b7f65f-d67f-4b26-a570-d3d4d009f196 None None] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:01:45.985043 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 785/1551] 10.222.0.25 () {58 vars in 1153 bytes} [Thu Sep 15 18:01:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 18:01:45.987082 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7da0df-277f-41ed-b06e-aa6f8548a298 None None] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:01:45.987553 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7da0df-277f-41ed-b06e-aa6f8548a298 None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:01:45.988064 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7da0df-277f-41ed-b06e-aa6f8548a298 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:01:45.992421 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b7f65f-d67f-4b26-a570-d3d4d009f196 None None] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:01:45.997218 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb523dd-e9fe-4b19-ba72-627d187cfc40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:01:45.997854 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb523dd-e9fe-4b19-ba72-627d187cfc40 admin admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:01:45.998135 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb523dd-e9fe-4b19-ba72-627d187cfc40 admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:01:45.998440 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb523dd-e9fe-4b19-ba72-627d187cfc40 admin admin] PATH_INFO: `/v3/roles` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:01:45.999123 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb523dd-e9fe-4b19-ba72-627d187cfc40 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:01:46.000721 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb523dd-e9fe-4b19-ba72-627d187cfc40 admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:01:46.011828 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 767/1552] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Sep 15 18:01:45 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 18:01:46.012023 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.auth.core [None req-5f7da0df-277f-41ed-b06e-aa6f8548a298 None None] MFA Rules not processed for user `5cfa58ef86774ab7800bf91930bf6028`. Rule list: `[]` (Enabled: `True`). {{(pid=81593) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 18:01:46.013156 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00aafb45-9753-4fa3-9ddc-37f13bf713b2 None None] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:01:46.013472 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00aafb45-9753-4fa3-9ddc-37f13bf713b2 None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:01:46.013662 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-5f7da0df-277f-41ed-b06e-aa6f8548a298 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:01:46.013772 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00aafb45-9753-4fa3-9ddc-37f13bf713b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:01:46.022217 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 786/1553] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 15 18:01:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 18:01:46.023530 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57956746-90a8-40f0-a7e8-9b8a46a3bede None None] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:01:46.023857 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57956746-90a8-40f0-a7e8-9b8a46a3bede None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:01:46.024129 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57956746-90a8-40f0-a7e8-9b8a46a3bede None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:01:46.033996 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.auth.core [None req-00aafb45-9753-4fa3-9ddc-37f13bf713b2 None None] MFA Rules not processed for user `5cfa58ef86774ab7800bf91930bf6028`. Rule list: `[]` (Enabled: `True`). {{(pid=81592) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 18:01:46.035240 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-00aafb45-9753-4fa3-9ddc-37f13bf713b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:01:46.043223 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 768/1554] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 15 18:01:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 18:01:46.044573 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a602c86d-1c6c-40a7-b94b-507e09b358f8 None None] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:01:46.044867 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a602c86d-1c6c-40a7-b94b-507e09b358f8 None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:01:46.045144 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a602c86d-1c6c-40a7-b94b-507e09b358f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:01:46.047517 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.auth.core [None req-57956746-90a8-40f0-a7e8-9b8a46a3bede None None] MFA Rules not processed for user `5cfa58ef86774ab7800bf91930bf6028`. Rule list: `[]` (Enabled: `True`). {{(pid=81593) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 18:01:46.049470 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-57956746-90a8-40f0-a7e8-9b8a46a3bede None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:01:46.058558 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 787/1555] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 15 18:01:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 18:01:46.059964 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ccc5b3-0579-42e3-96f1-621ec2db2639 None None] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:01:46.060284 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ccc5b3-0579-42e3-96f1-621ec2db2639 None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:01:46.060565 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ccc5b3-0579-42e3-96f1-621ec2db2639 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:01:46.069836 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.auth.core [None req-a602c86d-1c6c-40a7-b94b-507e09b358f8 None None] MFA Rules not processed for user `5cfa58ef86774ab7800bf91930bf6028`. Rule list: `[]` (Enabled: `True`). {{(pid=81592) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 18:01:46.071050 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-a602c86d-1c6c-40a7-b94b-507e09b358f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:01:46.079256 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 769/1556] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 15 18:01:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 18:01:46.080619 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bce2c94-d07e-4702-9d4c-6bc7ce0242c4 None None] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:01:46.080908 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bce2c94-d07e-4702-9d4c-6bc7ce0242c4 None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:01:46.081205 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bce2c94-d07e-4702-9d4c-6bc7ce0242c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:01:46.082707 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.auth.core [None req-02ccc5b3-0579-42e3-96f1-621ec2db2639 None None] MFA Rules not processed for user `5cfa58ef86774ab7800bf91930bf6028`. Rule list: `[]` (Enabled: `True`). {{(pid=81593) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 18:01:46.084083 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-02ccc5b3-0579-42e3-96f1-621ec2db2639 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:01:46.093230 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 788/1557] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 15 18:01:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 18:01:46.094237 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ccc5b3-0579-42e3-96f1-621ec2db2639 None None] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:01:46.105531 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ccc5b3-0579-42e3-96f1-621ec2db2639 None None] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:01:46.105767 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.auth.core [None req-3bce2c94-d07e-4702-9d4c-6bc7ce0242c4 None None] MFA Rules not processed for user `5cfa58ef86774ab7800bf91930bf6028`. Rule list: `[]` (Enabled: `True`). {{(pid=81592) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 18:01:46.106817 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-3bce2c94-d07e-4702-9d4c-6bc7ce0242c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:01:46.110952 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946f0776-6b74-4d06-8aac-f11f38c26956 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:01:46.112148 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946f0776-6b74-4d06-8aac-f11f38c26956 admin admin] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:01:46.112442 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946f0776-6b74-4d06-8aac-f11f38c26956 admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:01:46.112717 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946f0776-6b74-4d06-8aac-f11f38c26956 admin admin] PATH_INFO: `/v3/projects` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:01:46.113388 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946f0776-6b74-4d06-8aac-f11f38c26956 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:01:46.115338 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946f0776-6b74-4d06-8aac-f11f38c26956 admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:01:46.115847 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 770/1558] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 15 18:01:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 18:01:46.116588 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bce2c94-d07e-4702-9d4c-6bc7ce0242c4 None None] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:01:46.126380 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bce2c94-d07e-4702-9d4c-6bc7ce0242c4 None None] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:01:46.131164 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b874860-abdf-4b6b-8381-823f89541bf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:01:46.131823 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b874860-abdf-4b6b-8381-823f89541bf8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:01:46.132706 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b874860-abdf-4b6b-8381-823f89541bf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:01:46.132706 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b874860-abdf-4b6b-8381-823f89541bf8 admin admin] PATH_INFO: `/v3/projects/c099c78661284aa6940b6f842b0c9af3/users/5b0a236a877446d59821a8860636adef/roles/343cc8b1bc7243eebabdf08147e8366d` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:01:46.145366 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 789/1559] 10.222.0.25 () {60 vars in 1153 bytes} [Thu Sep 15 18:01:46 2022] POST /identity/v3/projects => generated 365 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 18:01:46.146393 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6d17c1-2b65-44d7-a84b-3a799d88d05a None None] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:01:46.146686 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6d17c1-2b65-44d7-a84b-3a799d88d05a None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:01:46.147112 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6d17c1-2b65-44d7-a84b-3a799d88d05a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:01:46.150988 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b874860-abdf-4b6b-8381-823f89541bf8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c099c78661284aa6940b6f842b0c9af3, user_id=5b0a236a877446d59821a8860636adef, role_id=343cc8b1bc7243eebabdf08147e8366d)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:01:46.152536 dv-cinder-835384-27-smb devstack@keystone.service[81592]: WARNING py.warnings [None req-5b874860-abdf-4b6b-8381-823f89541bf8 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 15 18:01:46.152536 dv-cinder-835384-27-smb devstack@keystone.service[81592]: warnings.warn(msg) Sep 15 18:01:46.152536 dv-cinder-835384-27-smb devstack@keystone.service[81592]: Sep 15 18:01:46.156385 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b874860-abdf-4b6b-8381-823f89541bf8 admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:01:46.167996 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.auth.core [None req-9d6d17c1-2b65-44d7-a84b-3a799d88d05a None None] MFA Rules not processed for user `5cfa58ef86774ab7800bf91930bf6028`. Rule list: `[]` (Enabled: `True`). {{(pid=81593) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 18:01:46.169209 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-9d6d17c1-2b65-44d7-a84b-3a799d88d05a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:01:46.170619 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 771/1560] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Sep 15 18:01:46 2022] PUT /identity/v3/projects/c099c78661284aa6940b6f842b0c9af3/users/5b0a236a877446d59821a8860636adef/roles/343cc8b1bc7243eebabdf08147e8366d => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 18:01:46.175351 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b874860-abdf-4b6b-8381-823f89541bf8 admin admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:01:46.227628 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 18:01:46.239700 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 790/1561] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 15 18:01:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 18:01:46.240655 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6d17c1-2b65-44d7-a84b-3a799d88d05a None None] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:01:46.248998 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b874860-abdf-4b6b-8381-823f89541bf8 admin admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:01:46.250207 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6d17c1-2b65-44d7-a84b-3a799d88d05a None None] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:01:46.253748 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e2f953-8684-4b54-b5fb-2460ac8b3922 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:01:46.254365 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e2f953-8684-4b54-b5fb-2460ac8b3922 admin admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:01:46.254676 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e2f953-8684-4b54-b5fb-2460ac8b3922 admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:01:46.254949 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e2f953-8684-4b54-b5fb-2460ac8b3922 admin admin] PATH_INFO: `/v3/domains` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:01:46.255216 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9827c80a-1440-484c-b2ac-44282c65581f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:01:46.255598 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e2f953-8684-4b54-b5fb-2460ac8b3922 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81592) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 18:01:46.255816 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9827c80a-1440-484c-b2ac-44282c65581f admin admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:01:46.255936 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e2f953-8684-4b54-b5fb-2460ac8b3922 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:01:46.256098 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9827c80a-1440-484c-b2ac-44282c65581f admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:01:46.256371 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9827c80a-1440-484c-b2ac-44282c65581f admin admin] PATH_INFO: `/v3/domains` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:01:46.257020 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9827c80a-1440-484c-b2ac-44282c65581f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81593) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 18:01:46.257350 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9827c80a-1440-484c-b2ac-44282c65581f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:01:46.257496 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e2f953-8684-4b54-b5fb-2460ac8b3922 admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:01:46.258954 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9827c80a-1440-484c-b2ac-44282c65581f admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:01:46.270049 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 772/1562] 10.222.0.25 () {58 vars in 1153 bytes} [Thu Sep 15 18:01:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 18:01:46.277370 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 791/1563] 10.222.0.25 () {58 vars in 1153 bytes} [Thu Sep 15 18:01:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 18:01:46.277579 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4250567-2f99-4191-91aa-e073662e15be None None] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:01:46.277697 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c9cd36-84dd-4f81-8657-96e847d0bda3 None None] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:01:46.277797 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4250567-2f99-4191-91aa-e073662e15be None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:01:46.277882 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c9cd36-84dd-4f81-8657-96e847d0bda3 None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:01:46.277986 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4250567-2f99-4191-91aa-e073662e15be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:01:46.278076 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c9cd36-84dd-4f81-8657-96e847d0bda3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:01:46.294786 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.auth.core [None req-d4250567-2f99-4191-91aa-e073662e15be None None] MFA Rules not processed for user `5cfa58ef86774ab7800bf91930bf6028`. Rule list: `[]` (Enabled: `True`). {{(pid=81592) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 18:01:46.296101 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.auth.core [None req-29c9cd36-84dd-4f81-8657-96e847d0bda3 None None] MFA Rules not processed for user `5cfa58ef86774ab7800bf91930bf6028`. Rule list: `[]` (Enabled: `True`). {{(pid=81593) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 18:01:46.296329 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-d4250567-2f99-4191-91aa-e073662e15be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:01:46.297288 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-29c9cd36-84dd-4f81-8657-96e847d0bda3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:01:46.305207 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 773/1564] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 15 18:01:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 18:01:46.306258 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 792/1565] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 15 18:01:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 18:01:46.306398 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4250567-2f99-4191-91aa-e073662e15be None None] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:01:46.306879 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c9cd36-84dd-4f81-8657-96e847d0bda3 None None] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:01:46.317321 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c9cd36-84dd-4f81-8657-96e847d0bda3 None None] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:01:46.319589 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4250567-2f99-4191-91aa-e073662e15be None None] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:01:46.324206 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5260397-7b1a-46d4-a469-ddc6794ee1fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:01:46.324498 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa1a1ae-e82f-46c2-9e6d-ae30637bcb73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:01:46.324817 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5260397-7b1a-46d4-a469-ddc6794ee1fa admin admin] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:01:46.325099 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5260397-7b1a-46d4-a469-ddc6794ee1fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:01:46.325244 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa1a1ae-e82f-46c2-9e6d-ae30637bcb73 admin admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:01:46.325458 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5260397-7b1a-46d4-a469-ddc6794ee1fa admin admin] PATH_INFO: `/v3/users` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:01:46.325554 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa1a1ae-e82f-46c2-9e6d-ae30637bcb73 admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:01:46.325651 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa1a1ae-e82f-46c2-9e6d-ae30637bcb73 admin admin] PATH_INFO: `/v3/domains` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:01:46.326311 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa1a1ae-e82f-46c2-9e6d-ae30637bcb73 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81592) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 18:01:46.326611 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa1a1ae-e82f-46c2-9e6d-ae30637bcb73 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:01:46.328208 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa1a1ae-e82f-46c2-9e6d-ae30637bcb73 admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:01:46.328373 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5260397-7b1a-46d4-a469-ddc6794ee1fa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:01:46.331270 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5260397-7b1a-46d4-a469-ddc6794ee1fa admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:01:46.340744 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 774/1566] 10.222.0.25 () {58 vars in 1153 bytes} [Thu Sep 15 18:01:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 18:01:46.342140 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44b28cd-7f50-418c-86f6-05676a062c1b None None] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:01:46.342422 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44b28cd-7f50-418c-86f6-05676a062c1b None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:01:46.342693 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44b28cd-7f50-418c-86f6-05676a062c1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:01:46.358228 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 793/1567] 10.222.0.25 () {60 vars in 1144 bytes} [Thu Sep 15 18:01:46 2022] POST /identity/v3/users => generated 283 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 18:01:46.359138 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5260397-7b1a-46d4-a469-ddc6794ee1fa admin admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:01:46.367250 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.auth.core [None req-a44b28cd-7f50-418c-86f6-05676a062c1b None None] MFA Rules not processed for user `5cfa58ef86774ab7800bf91930bf6028`. Rule list: `[]` (Enabled: `True`). {{(pid=81592) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 18:01:46.368447 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-a44b28cd-7f50-418c-86f6-05676a062c1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:01:46.371520 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5260397-7b1a-46d4-a469-ddc6794ee1fa admin admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:01:46.376298 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 775/1568] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 15 18:01:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 18:01:46.376482 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b853cebd-557d-49b5-a22d-8d9f7c52f81c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:01:46.376880 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b853cebd-557d-49b5-a22d-8d9f7c52f81c admin admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:01:46.377085 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44b28cd-7f50-418c-86f6-05676a062c1b None None] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:01:46.377197 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b853cebd-557d-49b5-a22d-8d9f7c52f81c admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:01:46.377515 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b853cebd-557d-49b5-a22d-8d9f7c52f81c admin admin] PATH_INFO: `/v3/domains` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:01:46.378291 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b853cebd-557d-49b5-a22d-8d9f7c52f81c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81593) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 18:01:46.378672 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b853cebd-557d-49b5-a22d-8d9f7c52f81c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:01:46.380288 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b853cebd-557d-49b5-a22d-8d9f7c52f81c admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:01:46.387690 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44b28cd-7f50-418c-86f6-05676a062c1b None None] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:01:46.393499 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec6ba3f-1687-4bd2-8af3-13afb9ca5797 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:01:46.400769 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 794/1569] 10.222.0.25 () {58 vars in 1153 bytes} [Thu Sep 15 18:01:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 18:01:46.400983 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec6ba3f-1687-4bd2-8af3-13afb9ca5797 admin admin] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:01:46.400983 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec6ba3f-1687-4bd2-8af3-13afb9ca5797 admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:01:46.400983 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec6ba3f-1687-4bd2-8af3-13afb9ca5797 admin admin] PATH_INFO: `/v3/projects` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:01:46.401274 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b853cebd-557d-49b5-a22d-8d9f7c52f81c admin admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:01:46.401428 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec6ba3f-1687-4bd2-8af3-13afb9ca5797 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:01:46.401428 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec6ba3f-1687-4bd2-8af3-13afb9ca5797 admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:01:46.403595 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 18:01:46.407063 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b853cebd-557d-49b5-a22d-8d9f7c52f81c admin admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:01:46.412841 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2909e7-5a1c-4f99-a5ce-7fa20761cab2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:01:46.413540 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2909e7-5a1c-4f99-a5ce-7fa20761cab2 admin admin] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:01:46.413821 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2909e7-5a1c-4f99-a5ce-7fa20761cab2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:01:46.414135 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2909e7-5a1c-4f99-a5ce-7fa20761cab2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:01:46.414794 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d2909e7-5a1c-4f99-a5ce-7fa20761cab2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:01:46.417061 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d2909e7-5a1c-4f99-a5ce-7fa20761cab2 admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:01:46.430405 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 776/1570] 10.222.0.25 () {60 vars in 1153 bytes} [Thu Sep 15 18:01:46 2022] POST /identity/v3/projects => generated 393 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 18:01:46.431483 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec6ba3f-1687-4bd2-8af3-13afb9ca5797 admin admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:01:46.460731 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 795/1571] 10.222.0.25 () {60 vars in 1153 bytes} [Thu Sep 15 18:01:46 2022] POST /identity/v3/projects => generated 377 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 18:01:46.462205 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2909e7-5a1c-4f99-a5ce-7fa20761cab2 admin admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:01:46.507003 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec6ba3f-1687-4bd2-8af3-13afb9ca5797 admin admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:01:46.534095 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2909e7-5a1c-4f99-a5ce-7fa20761cab2 admin admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:01:46.539569 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97900caa-ab6e-42e8-8418-a78979ce16a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:01:46.540211 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97900caa-ab6e-42e8-8418-a78979ce16a6 admin admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:01:46.540492 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97900caa-ab6e-42e8-8418-a78979ce16a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:01:46.540765 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97900caa-ab6e-42e8-8418-a78979ce16a6 admin admin] PATH_INFO: `/v3/domains` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:01:46.541468 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97900caa-ab6e-42e8-8418-a78979ce16a6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81593) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 18:01:46.541772 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97900caa-ab6e-42e8-8418-a78979ce16a6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:01:46.543444 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97900caa-ab6e-42e8-8418-a78979ce16a6 admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:01:46.555974 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 796/1572] 10.222.0.25 () {58 vars in 1153 bytes} [Thu Sep 15 18:01:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 18:01:46.556916 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97900caa-ab6e-42e8-8418-a78979ce16a6 admin admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:01:46.567478 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97900caa-ab6e-42e8-8418-a78979ce16a6 admin admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:01:46.572204 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2745ab-53e5-4189-8d06-455d8244cb23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:01:46.572847 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2745ab-53e5-4189-8d06-455d8244cb23 admin admin] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:01:46.573132 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2745ab-53e5-4189-8d06-455d8244cb23 admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:01:46.573441 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2745ab-53e5-4189-8d06-455d8244cb23 admin admin] PATH_INFO: `/v3/projects` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:01:46.574048 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28af526c-b388-4674-a833-563781aeb16c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:01:46.574198 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc2745ab-53e5-4189-8d06-455d8244cb23 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:01:46.574658 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28af526c-b388-4674-a833-563781aeb16c admin admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:01:46.574934 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28af526c-b388-4674-a833-563781aeb16c admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:01:46.575203 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28af526c-b388-4674-a833-563781aeb16c admin admin] PATH_INFO: `/v3/domains` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:01:46.575939 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28af526c-b388-4674-a833-563781aeb16c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81592) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 18:01:46.576058 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc2745ab-53e5-4189-8d06-455d8244cb23 admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:01:46.576235 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28af526c-b388-4674-a833-563781aeb16c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:01:46.577969 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28af526c-b388-4674-a833-563781aeb16c admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:01:46.590394 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 777/1573] 10.222.0.25 () {58 vars in 1153 bytes} [Thu Sep 15 18:01:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 18:01:46.591251 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28af526c-b388-4674-a833-563781aeb16c admin admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:01:46.603140 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28af526c-b388-4674-a833-563781aeb16c admin admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:01:46.605727 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 797/1574] 10.222.0.25 () {60 vars in 1153 bytes} [Thu Sep 15 18:01:46 2022] POST /identity/v3/projects => generated 371 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 18:01:46.606891 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2745ab-53e5-4189-8d06-455d8244cb23 admin admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:01:46.612215 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70f1642-8627-40d1-bae2-f4f04aa8f0fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:01:46.613043 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70f1642-8627-40d1-bae2-f4f04aa8f0fe admin admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:01:46.613337 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70f1642-8627-40d1-bae2-f4f04aa8f0fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:01:46.613615 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70f1642-8627-40d1-bae2-f4f04aa8f0fe admin admin] PATH_INFO: `/v3/roles` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:01:46.614263 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70f1642-8627-40d1-bae2-f4f04aa8f0fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:01:46.615850 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70f1642-8627-40d1-bae2-f4f04aa8f0fe admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:01:46.627186 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 778/1575] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Sep 15 18:01:46 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 18:01:46.628166 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70f1642-8627-40d1-bae2-f4f04aa8f0fe admin admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:01:46.638440 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70f1642-8627-40d1-bae2-f4f04aa8f0fe admin admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:01:46.669481 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2745ab-53e5-4189-8d06-455d8244cb23 admin admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:01:46.673800 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89db33b8-8700-4d97-b0f6-a470cbeb1eb2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a32274b4781b40fea9f28da8a9bde5ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1213c0d1b584404ba3998e136f166e89', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:01:46.674518 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89db33b8-8700-4d97-b0f6-a470cbeb1eb2 service neutron] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:01:46.674960 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89db33b8-8700-4d97-b0f6-a470cbeb1eb2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:01:46.675165 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89db33b8-8700-4d97-b0f6-a470cbeb1eb2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:01:46.688309 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 18:01:46.738627 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47a6b35-2f00-4587-bf01-9a7df24559db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:01:46.739275 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47a6b35-2f00-4587-bf01-9a7df24559db admin admin] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:01:46.739557 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47a6b35-2f00-4587-bf01-9a7df24559db admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:01:46.739850 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47a6b35-2f00-4587-bf01-9a7df24559db admin admin] PATH_INFO: `/v3/projects` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:01:46.740509 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47a6b35-2f00-4587-bf01-9a7df24559db admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:01:46.742548 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47a6b35-2f00-4587-bf01-9a7df24559db admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:01:46.753813 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89db33b8-8700-4d97-b0f6-a470cbeb1eb2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:01:46.755677 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89db33b8-8700-4d97-b0f6-a470cbeb1eb2 service neutron] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:01:46.766676 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 798/1576] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 15 18:01:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 18:01:46.767432 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89db33b8-8700-4d97-b0f6-a470cbeb1eb2 service neutron] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:01:46.774724 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 779/1577] 10.222.0.25 () {60 vars in 1153 bytes} [Thu Sep 15 18:01:46 2022] POST /identity/v3/projects => generated 357 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 18:01:46.774724 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47a6b35-2f00-4587-bf01-9a7df24559db admin admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:01:46.779381 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 18:01:46.780226 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89db33b8-8700-4d97-b0f6-a470cbeb1eb2 service neutron] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:01:46.857553 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63675893-7526-4cf0-a550-826308e1f663 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:01:46.858622 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63675893-7526-4cf0-a550-826308e1f663 admin admin] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:01:46.859151 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63675893-7526-4cf0-a550-826308e1f663 admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:01:46.859724 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63675893-7526-4cf0-a550-826308e1f663 admin admin] PATH_INFO: `/v3/users` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:01:46.860788 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47a6b35-2f00-4587-bf01-9a7df24559db admin admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:01:46.861212 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63675893-7526-4cf0-a550-826308e1f663 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:01:46.864343 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63675893-7526-4cf0-a550-826308e1f663 admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:01:46.867795 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2c0c1e-91a2-485b-942d-763cca78a2e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:01:46.868724 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2c0c1e-91a2-485b-942d-763cca78a2e6 admin admin] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:01:46.869009 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2c0c1e-91a2-485b-942d-763cca78a2e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:01:46.869420 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2c0c1e-91a2-485b-942d-763cca78a2e6 admin admin] PATH_INFO: `/v3/users` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:01:46.870156 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a2c0c1e-91a2-485b-942d-763cca78a2e6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:01:46.872476 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a2c0c1e-91a2-485b-942d-763cca78a2e6 admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:01:46.895356 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 799/1578] 10.222.0.25 () {60 vars in 1144 bytes} [Thu Sep 15 18:01:46 2022] POST /identity/v3/users => generated 297 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 18:01:46.896572 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63675893-7526-4cf0-a550-826308e1f663 admin admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:01:46.907668 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 780/1579] 10.222.0.25 () {60 vars in 1144 bytes} [Thu Sep 15 18:01:46 2022] POST /identity/v3/users => generated 289 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 18:01:46.908929 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2c0c1e-91a2-485b-942d-763cca78a2e6 admin admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:01:46.911268 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63675893-7526-4cf0-a550-826308e1f663 admin admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:01:46.916888 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d79a14-2279-48b8-aa2c-c191d50512d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:01:46.917813 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d79a14-2279-48b8-aa2c-c191d50512d9 admin admin] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:01:46.918589 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d79a14-2279-48b8-aa2c-c191d50512d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:01:46.919070 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d79a14-2279-48b8-aa2c-c191d50512d9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:01:46.920095 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d79a14-2279-48b8-aa2c-c191d50512d9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:01:46.926169 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d79a14-2279-48b8-aa2c-c191d50512d9 admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:01:46.937574 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2c0c1e-91a2-485b-942d-763cca78a2e6 admin admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:01:46.947012 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de215aa-115d-468c-8eb6-8a9f9d9278d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:01:46.947772 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de215aa-115d-468c-8eb6-8a9f9d9278d1 admin admin] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:01:46.948058 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de215aa-115d-468c-8eb6-8a9f9d9278d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:01:46.948601 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de215aa-115d-468c-8eb6-8a9f9d9278d1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:01:46.949711 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de215aa-115d-468c-8eb6-8a9f9d9278d1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:01:46.951765 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de215aa-115d-468c-8eb6-8a9f9d9278d1 admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:01:46.987912 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 800/1580] 10.222.0.25 () {60 vars in 1153 bytes} [Thu Sep 15 18:01:46 2022] POST /identity/v3/projects => generated 385 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 18:01:46.987912 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d79a14-2279-48b8-aa2c-c191d50512d9 admin admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:01:46.994352 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 781/1581] 10.222.0.25 () {60 vars in 1153 bytes} [Thu Sep 15 18:01:46 2022] POST /identity/v3/projects => generated 367 bytes in 86 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 18:01:46.999028 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de215aa-115d-468c-8eb6-8a9f9d9278d1 admin admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:01:47.073750 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d79a14-2279-48b8-aa2c-c191d50512d9 admin admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:01:47.102062 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 18:01:47.130497 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de215aa-115d-468c-8eb6-8a9f9d9278d1 admin admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:01:47.135445 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc917c8-4f56-46da-8ba6-b44e72a35754 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:01:47.136074 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc917c8-4f56-46da-8ba6-b44e72a35754 admin admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:01:47.136441 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc917c8-4f56-46da-8ba6-b44e72a35754 admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:01:47.136721 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc917c8-4f56-46da-8ba6-b44e72a35754 admin admin] PATH_INFO: `/v3/roles` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:01:47.145235 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc917c8-4f56-46da-8ba6-b44e72a35754 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:01:47.147462 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc917c8-4f56-46da-8ba6-b44e72a35754 admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:01:47.166071 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 782/1582] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Sep 15 18:01:46 2022] GET /identity/v3/roles => generated 1420 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 18:01:47.166071 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc917c8-4f56-46da-8ba6-b44e72a35754 admin admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:01:47.170449 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44796c2-6ab7-4ecf-87b8-5bd152cf9c25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:01:47.172016 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44796c2-6ab7-4ecf-87b8-5bd152cf9c25 admin admin] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:01:47.172477 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44796c2-6ab7-4ecf-87b8-5bd152cf9c25 admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:01:47.172902 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44796c2-6ab7-4ecf-87b8-5bd152cf9c25 admin admin] PATH_INFO: `/v3/users` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:01:47.173636 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d44796c2-6ab7-4ecf-87b8-5bd152cf9c25 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:01:47.175692 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc917c8-4f56-46da-8ba6-b44e72a35754 admin admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:01:47.176114 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d44796c2-6ab7-4ecf-87b8-5bd152cf9c25 admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:01:47.191817 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f538a1-0777-4071-9b9a-498a2187ea33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:01:47.193268 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f538a1-0777-4071-9b9a-498a2187ea33 admin admin] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:01:47.193956 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f538a1-0777-4071-9b9a-498a2187ea33 admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:01:47.193956 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f538a1-0777-4071-9b9a-498a2187ea33 admin admin] PATH_INFO: `/v3/users` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:01:47.194789 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f538a1-0777-4071-9b9a-498a2187ea33 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:01:47.197196 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f538a1-0777-4071-9b9a-498a2187ea33 admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:01:47.206417 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 801/1583] 10.222.0.25 () {60 vars in 1144 bytes} [Thu Sep 15 18:01:46 2022] POST /identity/v3/users => generated 286 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 18:01:47.208344 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44796c2-6ab7-4ecf-87b8-5bd152cf9c25 admin admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:01:47.224424 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 783/1584] 10.222.0.25 () {60 vars in 1144 bytes} [Thu Sep 15 18:01:47 2022] POST /identity/v3/users => generated 279 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 18:01:47.224808 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44796c2-6ab7-4ecf-87b8-5bd152cf9c25 admin admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:01:47.226124 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f538a1-0777-4071-9b9a-498a2187ea33 admin admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:01:47.238248 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ddf6c3-d63a-44f5-a1aa-6b9010915b50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:01:47.241952 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f538a1-0777-4071-9b9a-498a2187ea33 admin admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:01:47.242703 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ddf6c3-d63a-44f5-a1aa-6b9010915b50 admin admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:01:47.243274 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ddf6c3-d63a-44f5-a1aa-6b9010915b50 admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:01:47.243525 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ddf6c3-d63a-44f5-a1aa-6b9010915b50 admin admin] PATH_INFO: `/v3/roles` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:01:47.244467 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ddf6c3-d63a-44f5-a1aa-6b9010915b50 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:01:47.246336 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ddf6c3-d63a-44f5-a1aa-6b9010915b50 admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:01:47.250883 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807d377c-296f-4bb3-b99b-7f3f3bc6b929 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:01:47.252586 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807d377c-296f-4bb3-b99b-7f3f3bc6b929 admin admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:01:47.253094 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807d377c-296f-4bb3-b99b-7f3f3bc6b929 admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:01:47.253664 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807d377c-296f-4bb3-b99b-7f3f3bc6b929 admin admin] PATH_INFO: `/v3/roles` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:01:47.254559 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807d377c-296f-4bb3-b99b-7f3f3bc6b929 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:01:47.256624 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807d377c-296f-4bb3-b99b-7f3f3bc6b929 admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:01:47.270784 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 784/1585] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Sep 15 18:01:47 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 18:01:47.272119 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807d377c-296f-4bb3-b99b-7f3f3bc6b929 admin admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:01:47.278929 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 802/1586] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Sep 15 18:01:47 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 18:01:47.279807 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ddf6c3-d63a-44f5-a1aa-6b9010915b50 admin admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:01:47.286060 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807d377c-296f-4bb3-b99b-7f3f3bc6b929 admin admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:01:47.292616 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e87615-3d97-482f-ad41-2e71bde2b7ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:01:47.293693 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e87615-3d97-482f-ad41-2e71bde2b7ac admin admin] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:01:47.294340 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e87615-3d97-482f-ad41-2e71bde2b7ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:01:47.295168 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e87615-3d97-482f-ad41-2e71bde2b7ac admin admin] PATH_INFO: `/v3/users` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:01:47.296193 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e87615-3d97-482f-ad41-2e71bde2b7ac admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:01:47.300120 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e87615-3d97-482f-ad41-2e71bde2b7ac admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:01:47.315452 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ddf6c3-d63a-44f5-a1aa-6b9010915b50 admin admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:01:47.323422 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2876f53e-f24a-4c59-a46e-e9bb29fcc69c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:01:47.324084 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2876f53e-f24a-4c59-a46e-e9bb29fcc69c admin admin] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:01:47.324378 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2876f53e-f24a-4c59-a46e-e9bb29fcc69c admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:01:47.324641 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2876f53e-f24a-4c59-a46e-e9bb29fcc69c admin admin] PATH_INFO: `/v3/users` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:01:47.325614 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2876f53e-f24a-4c59-a46e-e9bb29fcc69c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:01:47.327696 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2876f53e-f24a-4c59-a46e-e9bb29fcc69c admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:01:47.336130 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 785/1587] 10.222.0.25 () {60 vars in 1144 bytes} [Thu Sep 15 18:01:47 2022] POST /identity/v3/users => generated 293 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 18:01:47.337147 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e87615-3d97-482f-ad41-2e71bde2b7ac admin admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:01:47.356692 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e87615-3d97-482f-ad41-2e71bde2b7ac admin admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:01:47.363072 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 803/1588] 10.222.0.25 () {60 vars in 1144 bytes} [Thu Sep 15 18:01:47 2022] POST /identity/v3/users => generated 284 bytes in 81 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 18:01:47.363072 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2876f53e-f24a-4c59-a46e-e9bb29fcc69c admin admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:01:47.363595 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959fd4ea-737a-45b0-a157-a6985937981d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:01:47.364290 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959fd4ea-737a-45b0-a157-a6985937981d admin admin] REQUEST_METHOD: `PUT` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:01:47.364573 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959fd4ea-737a-45b0-a157-a6985937981d admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:01:47.364848 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959fd4ea-737a-45b0-a157-a6985937981d admin admin] PATH_INFO: `/v3/projects/362f5c0382754bddb4f875b7e04b7b7e/users/802b5320e2a4488eb6c9123625ee6e87/roles/343cc8b1bc7243eebabdf08147e8366d` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:01:47.373387 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2876f53e-f24a-4c59-a46e-e9bb29fcc69c admin admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:01:47.379849 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf2c5a8-ef48-4ae1-b587-80a6b6c1d790 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:01:47.380228 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf2c5a8-ef48-4ae1-b587-80a6b6c1d790 admin admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:01:47.381624 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf2c5a8-ef48-4ae1-b587-80a6b6c1d790 admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:01:47.381624 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf2c5a8-ef48-4ae1-b587-80a6b6c1d790 admin admin] PATH_INFO: `/v3/roles` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:01:47.381624 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf2c5a8-ef48-4ae1-b587-80a6b6c1d790 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:01:47.383372 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf2c5a8-ef48-4ae1-b587-80a6b6c1d790 admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:01:47.391452 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-959fd4ea-737a-45b0-a157-a6985937981d admin admin] RBAC: Authorizing `identity:create_grant(project_id=362f5c0382754bddb4f875b7e04b7b7e, user_id=802b5320e2a4488eb6c9123625ee6e87, role_id=343cc8b1bc7243eebabdf08147e8366d)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:01:47.396698 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 804/1589] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Sep 15 18:01:47 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 18:01:47.396993 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-959fd4ea-737a-45b0-a157-a6985937981d admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:01:47.400278 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf2c5a8-ef48-4ae1-b587-80a6b6c1d790 admin admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:01:47.401243 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=89,keystone:INSERT=11 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 18:01:47.412785 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf2c5a8-ef48-4ae1-b587-80a6b6c1d790 admin admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:01:47.415995 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 786/1590] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Sep 15 18:01:47 2022] PUT /identity/v3/projects/362f5c0382754bddb4f875b7e04b7b7e/users/802b5320e2a4488eb6c9123625ee6e87/roles/343cc8b1bc7243eebabdf08147e8366d => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 18:01:47.417390 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959fd4ea-737a-45b0-a157-a6985937981d admin admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:01:47.482474 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546a8c96-6b7f-4464-bf5d-56b75e08dfda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:01:47.483149 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546a8c96-6b7f-4464-bf5d-56b75e08dfda admin admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:01:47.483621 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546a8c96-6b7f-4464-bf5d-56b75e08dfda admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:01:47.483969 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546a8c96-6b7f-4464-bf5d-56b75e08dfda admin admin] PATH_INFO: `/v3/roles` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:01:47.484687 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-546a8c96-6b7f-4464-bf5d-56b75e08dfda admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:01:47.487058 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-546a8c96-6b7f-4464-bf5d-56b75e08dfda admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:01:47.498815 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 805/1591] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Sep 15 18:01:47 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 18:01:47.500394 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546a8c96-6b7f-4464-bf5d-56b75e08dfda admin admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:01:47.521697 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546a8c96-6b7f-4464-bf5d-56b75e08dfda admin admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:01:47.526196 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959fd4ea-737a-45b0-a157-a6985937981d admin admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:01:47.526939 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d082d9c-7736-4346-b481-75f3ef68ebac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:01:47.527593 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d082d9c-7736-4346-b481-75f3ef68ebac admin admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:01:47.527876 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d082d9c-7736-4346-b481-75f3ef68ebac admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:01:47.528150 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d082d9c-7736-4346-b481-75f3ef68ebac admin admin] PATH_INFO: `/v3/roles` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:01:47.528858 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d082d9c-7736-4346-b481-75f3ef68ebac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:01:47.530510 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d082d9c-7736-4346-b481-75f3ef68ebac admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:01:47.532452 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9aafd63-4232-4c7a-97b4-f796c96af636 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:01:47.533214 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9aafd63-4232-4c7a-97b4-f796c96af636 admin admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:01:47.534184 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9aafd63-4232-4c7a-97b4-f796c96af636 admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:01:47.534580 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9aafd63-4232-4c7a-97b4-f796c96af636 admin admin] PATH_INFO: `/v3/roles` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:01:47.535384 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9aafd63-4232-4c7a-97b4-f796c96af636 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:01:47.537241 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9aafd63-4232-4c7a-97b4-f796c96af636 admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:01:47.542185 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 806/1592] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Sep 15 18:01:47 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 18:01:47.546093 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d082d9c-7736-4346-b481-75f3ef68ebac admin admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:01:47.553332 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 787/1593] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Sep 15 18:01:47 2022] GET /identity/v3/roles => generated 1420 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 18:01:47.553332 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9aafd63-4232-4c7a-97b4-f796c96af636 admin admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:01:47.557992 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d082d9c-7736-4346-b481-75f3ef68ebac admin admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:01:47.563428 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe59cfa-73e9-4174-b968-669b1e48fbcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:01:47.564129 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9aafd63-4232-4c7a-97b4-f796c96af636 admin admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:01:47.565039 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe59cfa-73e9-4174-b968-669b1e48fbcc admin admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:01:47.565405 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe59cfa-73e9-4174-b968-669b1e48fbcc admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:01:47.565743 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe59cfa-73e9-4174-b968-669b1e48fbcc admin admin] PATH_INFO: `/v3/roles` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:01:47.566528 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe59cfa-73e9-4174-b968-669b1e48fbcc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:01:47.568636 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe59cfa-73e9-4174-b968-669b1e48fbcc admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:01:47.570692 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015a1fc9-5fa6-457a-8fd5-682f1a9045c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:01:47.571487 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015a1fc9-5fa6-457a-8fd5-682f1a9045c9 admin admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:01:47.571780 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015a1fc9-5fa6-457a-8fd5-682f1a9045c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:01:47.572463 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015a1fc9-5fa6-457a-8fd5-682f1a9045c9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:01:47.573243 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-015a1fc9-5fa6-457a-8fd5-682f1a9045c9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:01:47.574911 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-015a1fc9-5fa6-457a-8fd5-682f1a9045c9 admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:01:47.587667 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 807/1594] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Sep 15 18:01:47 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 18:01:47.589038 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe59cfa-73e9-4174-b968-669b1e48fbcc admin admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:01:47.593673 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 788/1595] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Sep 15 18:01:47 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 18:01:47.595139 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f3cad5-f120-4b9a-aa8c-316b8f0d2b3b None None] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:01:47.595435 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f3cad5-f120-4b9a-aa8c-316b8f0d2b3b None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:01:47.595880 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f3cad5-f120-4b9a-aa8c-316b8f0d2b3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:01:47.604700 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe59cfa-73e9-4174-b968-669b1e48fbcc admin admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:01:47.611646 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dea6311-77fb-49b7-ad5c-892c04f8e021 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:01:47.612279 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dea6311-77fb-49b7-ad5c-892c04f8e021 admin admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:01:47.612562 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dea6311-77fb-49b7-ad5c-892c04f8e021 admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:01:47.612832 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dea6311-77fb-49b7-ad5c-892c04f8e021 admin admin] PATH_INFO: `/v3/roles` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:01:47.613518 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dea6311-77fb-49b7-ad5c-892c04f8e021 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:01:47.615143 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dea6311-77fb-49b7-ad5c-892c04f8e021 admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:01:47.626829 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 808/1596] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Sep 15 18:01:47 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 18:01:47.628352 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dea6311-77fb-49b7-ad5c-892c04f8e021 admin admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:01:47.646839 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dea6311-77fb-49b7-ad5c-892c04f8e021 admin admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:01:47.647897 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.auth.core [None req-b7f3cad5-f120-4b9a-aa8c-316b8f0d2b3b None None] MFA Rules not processed for user `802b5320e2a4488eb6c9123625ee6e87`. Rule list: `[]` (Enabled: `True`). {{(pid=81592) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 18:01:47.649326 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-b7f3cad5-f120-4b9a-aa8c-316b8f0d2b3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:01:47.655139 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415f676b-b7d5-4359-be67-10e8be0e3fb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:01:47.656210 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415f676b-b7d5-4359-be67-10e8be0e3fb3 admin admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:01:47.656494 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415f676b-b7d5-4359-be67-10e8be0e3fb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:01:47.657166 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415f676b-b7d5-4359-be67-10e8be0e3fb3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:01:47.659008 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415f676b-b7d5-4359-be67-10e8be0e3fb3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:01:47.662124 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415f676b-b7d5-4359-be67-10e8be0e3fb3 admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:01:47.678112 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 809/1597] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Sep 15 18:01:47 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 18:01:47.678112 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415f676b-b7d5-4359-be67-10e8be0e3fb3 admin admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:01:47.688055 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415f676b-b7d5-4359-be67-10e8be0e3fb3 admin admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:01:47.696955 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a766991-4a33-45f8-ad58-1925a8795c23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:01:47.698794 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a766991-4a33-45f8-ad58-1925a8795c23 admin admin] REQUEST_METHOD: `PUT` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:01:47.699129 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a766991-4a33-45f8-ad58-1925a8795c23 admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:01:47.701510 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a766991-4a33-45f8-ad58-1925a8795c23 admin admin] PATH_INFO: `/v3/projects/646252485a394aff93dd855c977cc609/users/db4da97ae9284046b5d1667bee32f821/roles/343cc8b1bc7243eebabdf08147e8366d` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:01:47.726497 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a766991-4a33-45f8-ad58-1925a8795c23 admin admin] RBAC: Authorizing `identity:create_grant(project_id=646252485a394aff93dd855c977cc609, user_id=db4da97ae9284046b5d1667bee32f821, role_id=343cc8b1bc7243eebabdf08147e8366d)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:01:47.730398 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a766991-4a33-45f8-ad58-1925a8795c23 admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:01:47.743091 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 18:01:47.750682 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 810/1598] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Sep 15 18:01:47 2022] PUT /identity/v3/projects/646252485a394aff93dd855c977cc609/users/db4da97ae9284046b5d1667bee32f821/roles/343cc8b1bc7243eebabdf08147e8366d => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 18:01:47.751864 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a766991-4a33-45f8-ad58-1925a8795c23 admin admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:01:47.753021 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 789/1599] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 15 18:01:47 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 18:01:47.754169 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f3cad5-f120-4b9a-aa8c-316b8f0d2b3b None None] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:01:47.770352 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f3cad5-f120-4b9a-aa8c-316b8f0d2b3b None None] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:01:47.845320 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a766991-4a33-45f8-ad58-1925a8795c23 admin admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:01:47.853139 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842e3f41-b4c2-45eb-8088-dd1c936a3d68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:01:47.853139 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842e3f41-b4c2-45eb-8088-dd1c936a3d68 admin admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:01:47.853508 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842e3f41-b4c2-45eb-8088-dd1c936a3d68 admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:01:47.853679 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842e3f41-b4c2-45eb-8088-dd1c936a3d68 admin admin] PATH_INFO: `/v3/roles` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:01:47.853951 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecbb593b-1eb8-4c51-8906-6693667da0b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:01:47.854520 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842e3f41-b4c2-45eb-8088-dd1c936a3d68 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:01:47.855014 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbb593b-1eb8-4c51-8906-6693667da0b5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:01:47.855461 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbb593b-1eb8-4c51-8906-6693667da0b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:01:47.855898 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbb593b-1eb8-4c51-8906-6693667da0b5 admin admin] PATH_INFO: `/v3/projects/d0c00ad55eda4d7f8a0370359478f2df/users/49761e1a87dc495eae27fe1b8f509ae7/roles/343cc8b1bc7243eebabdf08147e8366d` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:01:47.856905 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842e3f41-b4c2-45eb-8088-dd1c936a3d68 admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:01:47.876470 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 790/1600] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Sep 15 18:01:47 2022] GET /identity/v3/roles => generated 1420 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 18:01:47.882422 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842e3f41-b4c2-45eb-8088-dd1c936a3d68 admin admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:01:47.884316 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecbb593b-1eb8-4c51-8906-6693667da0b5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d0c00ad55eda4d7f8a0370359478f2df, user_id=49761e1a87dc495eae27fe1b8f509ae7, role_id=343cc8b1bc7243eebabdf08147e8366d)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:01:47.887229 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecbb593b-1eb8-4c51-8906-6693667da0b5 admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:01:47.894977 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842e3f41-b4c2-45eb-8088-dd1c936a3d68 admin admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:01:47.900576 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 18:01:47.904397 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 811/1601] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Sep 15 18:01:47 2022] PUT /identity/v3/projects/d0c00ad55eda4d7f8a0370359478f2df/users/49761e1a87dc495eae27fe1b8f509ae7/roles/343cc8b1bc7243eebabdf08147e8366d => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 18:01:47.905521 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecbb593b-1eb8-4c51-8906-6693667da0b5 admin admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:01:47.997830 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecbb593b-1eb8-4c51-8906-6693667da0b5 admin admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:01:48.005969 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607dffcb-271f-4abf-8f2a-2b6df11afe73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:01:48.006733 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607dffcb-271f-4abf-8f2a-2b6df11afe73 admin admin] REQUEST_METHOD: `PUT` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:01:48.007107 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607dffcb-271f-4abf-8f2a-2b6df11afe73 admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:01:48.007450 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607dffcb-271f-4abf-8f2a-2b6df11afe73 admin admin] PATH_INFO: `/v3/projects/07d73521c60e482fa76e4ad3d3d63d96/users/1f439cf5a965484790f8a47e618c2505/roles/343cc8b1bc7243eebabdf08147e8366d` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:01:48.021841 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73775da-d4cd-46d8-8a23-d835330a9648 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:01:48.022986 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73775da-d4cd-46d8-8a23-d835330a9648 admin admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:01:48.022986 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73775da-d4cd-46d8-8a23-d835330a9648 admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:01:48.023191 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73775da-d4cd-46d8-8a23-d835330a9648 admin admin] PATH_INFO: `/v3/roles` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:01:48.023822 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73775da-d4cd-46d8-8a23-d835330a9648 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:01:48.025477 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73775da-d4cd-46d8-8a23-d835330a9648 admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:01:48.029571 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607dffcb-271f-4abf-8f2a-2b6df11afe73 admin admin] RBAC: Authorizing `identity:create_grant(project_id=07d73521c60e482fa76e4ad3d3d63d96, user_id=1f439cf5a965484790f8a47e618c2505, role_id=343cc8b1bc7243eebabdf08147e8366d)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:01:48.037211 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607dffcb-271f-4abf-8f2a-2b6df11afe73 admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:01:48.039436 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 791/1602] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Sep 15 18:01:47 2022] GET /identity/v3/roles => generated 1420 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 18:01:48.040496 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73775da-d4cd-46d8-8a23-d835330a9648 admin admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:01:48.052239 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73775da-d4cd-46d8-8a23-d835330a9648 admin admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:01:48.060742 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb91541-98ed-46b2-b51d-056ef65e4ef7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:01:48.062791 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb91541-98ed-46b2-b51d-056ef65e4ef7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:01:48.063408 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb91541-98ed-46b2-b51d-056ef65e4ef7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:01:48.063408 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb91541-98ed-46b2-b51d-056ef65e4ef7 admin admin] PATH_INFO: `/v3/projects/badb7fd631594e8da127358e916d5a69/users/62b8d4beaf4446e8814c9fedee7078f2/roles/343cc8b1bc7243eebabdf08147e8366d` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:01:48.077991 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 812/1603] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Sep 15 18:01:47 2022] PUT /identity/v3/projects/07d73521c60e482fa76e4ad3d3d63d96/users/1f439cf5a965484790f8a47e618c2505/roles/343cc8b1bc7243eebabdf08147e8366d => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 18:01:48.079805 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f538db6-71e5-42c6-8107-f11dabee8996 None None] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:01:48.080682 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f538db6-71e5-42c6-8107-f11dabee8996 None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:01:48.081232 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f538db6-71e5-42c6-8107-f11dabee8996 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:01:48.103121 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb91541-98ed-46b2-b51d-056ef65e4ef7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=badb7fd631594e8da127358e916d5a69, user_id=62b8d4beaf4446e8814c9fedee7078f2, role_id=343cc8b1bc7243eebabdf08147e8366d)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:01:48.105181 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.auth.core [None req-1f538db6-71e5-42c6-8107-f11dabee8996 None None] MFA Rules not processed for user `5cfa58ef86774ab7800bf91930bf6028`. Rule list: `[]` (Enabled: `True`). {{(pid=81593) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 18:01:48.106769 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-1f538db6-71e5-42c6-8107-f11dabee8996 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:01:48.107415 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb91541-98ed-46b2-b51d-056ef65e4ef7 admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:01:48.141306 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 792/1604] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Sep 15 18:01:48 2022] PUT /identity/v3/projects/badb7fd631594e8da127358e916d5a69/users/62b8d4beaf4446e8814c9fedee7078f2/roles/343cc8b1bc7243eebabdf08147e8366d => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 18:01:48.141306 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb91541-98ed-46b2-b51d-056ef65e4ef7 admin admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:01:48.227204 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb91541-98ed-46b2-b51d-056ef65e4ef7 admin admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:01:48.233551 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 813/1605] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 15 18:01:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 18:01:48.233751 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60abdd6c-29cb-4191-b3a7-c961838c888a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b232e7a841145ba93c6d8462ccb751a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1213c0d1b584404ba3998e136f166e89', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:01:48.233859 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f538db6-71e5-42c6-8107-f11dabee8996 None None] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:01:48.233962 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60abdd6c-29cb-4191-b3a7-c961838c888a service cinder] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:01:48.233962 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60abdd6c-29cb-4191-b3a7-c961838c888a service cinder] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:01:48.233962 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60abdd6c-29cb-4191-b3a7-c961838c888a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:01:48.247128 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f538db6-71e5-42c6-8107-f11dabee8996 None None] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:01:48.255278 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 18:01:48.339351 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60abdd6c-29cb-4191-b3a7-c961838c888a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:01:48.342326 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60abdd6c-29cb-4191-b3a7-c961838c888a service cinder] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:01:48.349734 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e24964-e5b0-4962-a61b-16fe36cb9aff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:01:48.351387 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e24964-e5b0-4962-a61b-16fe36cb9aff admin admin] REQUEST_METHOD: `PUT` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:01:48.351730 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e24964-e5b0-4962-a61b-16fe36cb9aff admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:01:48.352089 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e24964-e5b0-4962-a61b-16fe36cb9aff admin admin] PATH_INFO: `/v3/projects/a41994d63b3a4e01a3c7c8eda6c09dff/users/36c20c2b373e4794a7f0c04e41f9af5f/roles/343cc8b1bc7243eebabdf08147e8366d` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:01:48.358063 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 793/1606] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 15 18:01:48 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 227 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 18:01:48.359150 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e55d3c-25ac-4ad5-8360-a2f3354e8ac6 None None] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:01:48.359438 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e55d3c-25ac-4ad5-8360-a2f3354e8ac6 None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:01:48.359805 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e55d3c-25ac-4ad5-8360-a2f3354e8ac6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:01:48.372600 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e24964-e5b0-4962-a61b-16fe36cb9aff admin admin] RBAC: Authorizing `identity:create_grant(project_id=a41994d63b3a4e01a3c7c8eda6c09dff, user_id=36c20c2b373e4794a7f0c04e41f9af5f, role_id=343cc8b1bc7243eebabdf08147e8366d)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:01:48.375492 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e24964-e5b0-4962-a61b-16fe36cb9aff admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:01:48.392757 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 814/1607] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Sep 15 18:01:48 2022] PUT /identity/v3/projects/a41994d63b3a4e01a3c7c8eda6c09dff/users/36c20c2b373e4794a7f0c04e41f9af5f/roles/343cc8b1bc7243eebabdf08147e8366d => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 18:01:48.393876 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e24964-e5b0-4962-a61b-16fe36cb9aff admin admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:01:48.398799 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.auth.core [None req-e2e55d3c-25ac-4ad5-8360-a2f3354e8ac6 None None] MFA Rules not processed for user `5cfa58ef86774ab7800bf91930bf6028`. Rule list: `[]` (Enabled: `True`). {{(pid=81592) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 18:01:48.406537 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-e2e55d3c-25ac-4ad5-8360-a2f3354e8ac6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:01:48.471442 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 18:01:48.478305 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e24964-e5b0-4962-a61b-16fe36cb9aff admin admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:01:48.487822 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f5783a-18e0-4493-8336-48f2cf4e64e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:01:48.488858 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f5783a-18e0-4493-8336-48f2cf4e64e0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:01:48.489948 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f5783a-18e0-4493-8336-48f2cf4e64e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:01:48.490239 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f5783a-18e0-4493-8336-48f2cf4e64e0 admin admin] PATH_INFO: `/v3/projects/1f11e37ca4354281ad1e04db5b80c9b3/users/840768ae948643d6a0002f7da88cf2db/roles/343cc8b1bc7243eebabdf08147e8366d` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:01:48.522022 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f5783a-18e0-4493-8336-48f2cf4e64e0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1f11e37ca4354281ad1e04db5b80c9b3, user_id=840768ae948643d6a0002f7da88cf2db, role_id=343cc8b1bc7243eebabdf08147e8366d)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:01:48.525776 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f5783a-18e0-4493-8336-48f2cf4e64e0 admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:01:48.545145 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 794/1608] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 15 18:01:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 18:01:48.546552 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512abf84-8467-4073-a63f-cfd4822932c7 None None] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:01:48.546841 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512abf84-8467-4073-a63f-cfd4822932c7 None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:01:48.547172 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512abf84-8467-4073-a63f-cfd4822932c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:01:48.557496 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 815/1609] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Sep 15 18:01:48 2022] PUT /identity/v3/projects/1f11e37ca4354281ad1e04db5b80c9b3/users/840768ae948643d6a0002f7da88cf2db/roles/343cc8b1bc7243eebabdf08147e8366d => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 18:01:48.561612 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4605099-bed9-4cb3-a75c-f9c133d576de None None] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:01:48.561895 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4605099-bed9-4cb3-a75c-f9c133d576de None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:01:48.562166 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4605099-bed9-4cb3-a75c-f9c133d576de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:01:48.617690 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.auth.core [None req-b4605099-bed9-4cb3-a75c-f9c133d576de None None] MFA Rules not processed for user `62b8d4beaf4446e8814c9fedee7078f2`. Rule list: `[]` (Enabled: `True`). {{(pid=81593) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 18:01:48.619068 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-b4605099-bed9-4cb3-a75c-f9c133d576de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:01:48.621634 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.auth.core [None req-512abf84-8467-4073-a63f-cfd4822932c7 None None] MFA Rules not processed for user `1f439cf5a965484790f8a47e618c2505`. Rule list: `[]` (Enabled: `True`). {{(pid=81592) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 18:01:48.625731 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-512abf84-8467-4073-a63f-cfd4822932c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:01:48.721339 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 816/1610] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 15 18:01:48 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 18:01:48.722372 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4605099-bed9-4cb3-a75c-f9c133d576de None None] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:01:48.728002 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 18:01:48.739062 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 795/1611] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 15 18:01:48 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 18:01:48.741516 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83298d63-dfd3-49a2-a9aa-1f62a3f615a7 None None] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:01:48.741909 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83298d63-dfd3-49a2-a9aa-1f62a3f615a7 None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:01:48.742469 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83298d63-dfd3-49a2-a9aa-1f62a3f615a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:01:48.815241 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.auth.core [None req-83298d63-dfd3-49a2-a9aa-1f62a3f615a7 None None] MFA Rules not processed for user `36c20c2b373e4794a7f0c04e41f9af5f`. Rule list: `[]` (Enabled: `True`). {{(pid=81592) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 18:01:48.817047 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-83298d63-dfd3-49a2-a9aa-1f62a3f615a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:01:48.901973 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4605099-bed9-4cb3-a75c-f9c133d576de None None] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:01:48.901973 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec5b5ff-875f-4b84-9a8b-7ebea488edc4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a32274b4781b40fea9f28da8a9bde5ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1213c0d1b584404ba3998e136f166e89', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:01:48.901973 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec5b5ff-875f-4b84-9a8b-7ebea488edc4 service neutron] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:01:48.901973 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec5b5ff-875f-4b84-9a8b-7ebea488edc4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:01:48.902519 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec5b5ff-875f-4b84-9a8b-7ebea488edc4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:01:48.989070 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 796/1612] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 15 18:01:48 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 244 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 18:01:48.989070 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83298d63-dfd3-49a2-a9aa-1f62a3f615a7 None None] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:01:49.003634 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83298d63-dfd3-49a2-a9aa-1f62a3f615a7 None None] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:01:49.007753 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1701785-810c-4ae0-b174-72e07222a45f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a32274b4781b40fea9f28da8a9bde5ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1213c0d1b584404ba3998e136f166e89', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:01:49.008370 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1701785-810c-4ae0-b174-72e07222a45f service neutron] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:01:49.009675 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1701785-810c-4ae0-b174-72e07222a45f service neutron] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:01:49.009821 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1701785-810c-4ae0-b174-72e07222a45f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:01:49.042432 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec5b5ff-875f-4b84-9a8b-7ebea488edc4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:01:49.051892 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec5b5ff-875f-4b84-9a8b-7ebea488edc4 service neutron] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:01:49.066602 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 817/1613] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 15 18:01:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 18:01:49.068219 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11fd24a-42d2-4fa5-8cb2-1704a4e06ad0 None None] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:01:49.068661 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11fd24a-42d2-4fa5-8cb2-1704a4e06ad0 None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:01:49.069089 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11fd24a-42d2-4fa5-8cb2-1704a4e06ad0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:01:49.074878 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 18:01:49.092290 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1701785-810c-4ae0-b174-72e07222a45f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:01:49.094410 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1701785-810c-4ae0-b174-72e07222a45f service neutron] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:01:49.103811 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.auth.core [None req-e11fd24a-42d2-4fa5-8cb2-1704a4e06ad0 None None] MFA Rules not processed for user `840768ae948643d6a0002f7da88cf2db`. Rule list: `[]` (Enabled: `True`). {{(pid=81593) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 18:01:49.105410 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-e11fd24a-42d2-4fa5-8cb2-1704a4e06ad0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:01:49.114492 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 797/1614] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 15 18:01:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 18:01:49.115778 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1701785-810c-4ae0-b174-72e07222a45f service neutron] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:01:49.130507 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1701785-810c-4ae0-b174-72e07222a45f service neutron] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:01:49.138992 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1d557e-6bf8-4f79-b2fd-f94b1745f574 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:01:49.139630 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1d557e-6bf8-4f79-b2fd-f94b1745f574 admin admin] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:01:49.139909 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1d557e-6bf8-4f79-b2fd-f94b1745f574 admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:01:49.140348 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1d557e-6bf8-4f79-b2fd-f94b1745f574 admin admin] PATH_INFO: `/v3/projects` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:01:49.141155 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1d557e-6bf8-4f79-b2fd-f94b1745f574 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:01:49.143663 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1d557e-6bf8-4f79-b2fd-f94b1745f574 admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:01:49.187183 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 798/1615] 10.222.0.25 () {60 vars in 1153 bytes} [Thu Sep 15 18:01:49 2022] POST /identity/v3/projects => generated 357 bytes in 71 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 18:01:49.189987 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e62858-9472-4b9b-994d-08dc7ed4f997 None None] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:01:49.190819 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e62858-9472-4b9b-994d-08dc7ed4f997 None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:01:49.190819 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e62858-9472-4b9b-994d-08dc7ed4f997 None None] PATH_INFO: `/` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:01:49.193943 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 799/1616] 10.222.0.25 () {54 vars in 962 bytes} [Thu Sep 15 18:01:49 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 18:01:49.196221 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93037348-ae37-468e-b146-d6447df7bd19 None None] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:01:49.196730 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93037348-ae37-468e-b146-d6447df7bd19 None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:01:49.197008 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93037348-ae37-468e-b146-d6447df7bd19 None None] PATH_INFO: `/` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:01:49.199574 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 800/1617] 10.222.0.25 () {54 vars in 962 bytes} [Thu Sep 15 18:01:49 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 18:01:49.200513 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93037348-ae37-468e-b146-d6447df7bd19 None None] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:01:49.263298 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 818/1618] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 15 18:01:49 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 18:01:49.265740 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f4c680-d96c-45fc-99cd-6a9daebcc103 None None] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:01:49.266211 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f4c680-d96c-45fc-99cd-6a9daebcc103 None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:01:49.267985 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f4c680-d96c-45fc-99cd-6a9daebcc103 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:01:49.315151 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93037348-ae37-468e-b146-d6447df7bd19 None None] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:01:49.321610 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d861c252-d2f4-43db-a586-f0a5ba090415 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:01:49.322332 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d861c252-d2f4-43db-a586-f0a5ba090415 admin admin] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:01:49.322819 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d861c252-d2f4-43db-a586-f0a5ba090415 admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:01:49.324009 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d861c252-d2f4-43db-a586-f0a5ba090415 admin admin] PATH_INFO: `/v3/users` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:01:49.324813 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d861c252-d2f4-43db-a586-f0a5ba090415 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:01:49.327611 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d861c252-d2f4-43db-a586-f0a5ba090415 admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:01:49.333824 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.auth.core [None req-98f4c680-d96c-45fc-99cd-6a9daebcc103 None None] MFA Rules not processed for user `fe2244818e4d4dca9c424cd078653e6a`. Rule list: `[]` (Enabled: `True`). {{(pid=81593) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 18:01:49.335420 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-98f4c680-d96c-45fc-99cd-6a9daebcc103 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:01:49.371227 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 801/1619] 10.222.0.25 () {60 vars in 1144 bytes} [Thu Sep 15 18:01:49 2022] POST /identity/v3/users => generated 285 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 18:01:49.371227 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ee784a-2a48-4a91-9998-fe63fdd4753b None None] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:01:49.371227 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ee784a-2a48-4a91-9998-fe63fdd4753b None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:01:49.371524 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ee784a-2a48-4a91-9998-fe63fdd4753b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:01:49.416980 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.auth.core [None req-a8ee784a-2a48-4a91-9998-fe63fdd4753b None None] MFA Rules not processed for user `fe2244818e4d4dca9c424cd078653e6a`. Rule list: `[]` (Enabled: `True`). {{(pid=81592) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 18:01:49.418845 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-a8ee784a-2a48-4a91-9998-fe63fdd4753b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:01:49.440309 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 18:01:49.529690 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 802/1620] 10.222.0.25 () {58 vars in 1059 bytes} [Thu Sep 15 18:01:49 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 18:01:49.530674 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ee784a-2a48-4a91-9998-fe63fdd4753b None None] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:01:49.544802 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ee784a-2a48-4a91-9998-fe63fdd4753b None None] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:01:49.551310 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 819/1621] 10.222.0.25 () {58 vars in 1059 bytes} [Thu Sep 15 18:01:49 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 287 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 18:01:49.552336 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f4c680-d96c-45fc-99cd-6a9daebcc103 None None] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:01:49.552609 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35884a0a-3e3c-4c5e-adb7-20242f36e064 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:01:49.554360 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35884a0a-3e3c-4c5e-adb7-20242f36e064 admin admin] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:01:49.554831 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35884a0a-3e3c-4c5e-adb7-20242f36e064 admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:01:49.555307 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35884a0a-3e3c-4c5e-adb7-20242f36e064 admin admin] PATH_INFO: `/v3/projects` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:01:49.556258 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35884a0a-3e3c-4c5e-adb7-20242f36e064 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:01:49.559669 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35884a0a-3e3c-4c5e-adb7-20242f36e064 admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:01:49.603292 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f4c680-d96c-45fc-99cd-6a9daebcc103 None None] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:01:49.612513 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75055de9-1e31-4706-a8b1-ae5a2d0f374c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:01:49.615111 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75055de9-1e31-4706-a8b1-ae5a2d0f374c admin admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:01:49.615400 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75055de9-1e31-4706-a8b1-ae5a2d0f374c admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:01:49.615754 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75055de9-1e31-4706-a8b1-ae5a2d0f374c admin admin] PATH_INFO: `/v3/roles` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:01:49.616478 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75055de9-1e31-4706-a8b1-ae5a2d0f374c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:01:49.620680 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75055de9-1e31-4706-a8b1-ae5a2d0f374c admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:01:49.634862 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 803/1622] 10.222.0.25 () {60 vars in 1153 bytes} [Thu Sep 15 18:01:49 2022] POST /identity/v3/projects => generated 367 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 18:01:49.638886 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35884a0a-3e3c-4c5e-adb7-20242f36e064 admin admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:01:49.654074 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 820/1623] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Sep 15 18:01:49 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 18:01:49.664834 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75055de9-1e31-4706-a8b1-ae5a2d0f374c admin admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:01:49.705964 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75055de9-1e31-4706-a8b1-ae5a2d0f374c admin admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:01:49.706991 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 18:01:49.822561 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e413b42-dc56-4d01-ba7e-5c0b204a45aa service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe2244818e4d4dca9c424cd078653e6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1213c0d1b584404ba3998e136f166e89', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:01:49.823263 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e413b42-dc56-4d01-ba7e-5c0b204a45aa service nova] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:01:49.823600 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e413b42-dc56-4d01-ba7e-5c0b204a45aa service nova] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:01:49.824018 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e413b42-dc56-4d01-ba7e-5c0b204a45aa service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:01:49.825991 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35884a0a-3e3c-4c5e-adb7-20242f36e064 admin admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:01:49.837591 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ea7f78-c933-4078-8583-f757b05f1da1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe2244818e4d4dca9c424cd078653e6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1213c0d1b584404ba3998e136f166e89', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:01:49.838293 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ea7f78-c933-4078-8583-f757b05f1da1 service nova] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:01:49.838572 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ea7f78-c933-4078-8583-f757b05f1da1 service nova] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:01:49.838910 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ea7f78-c933-4078-8583-f757b05f1da1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:01:49.969020 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ea7f78-c933-4078-8583-f757b05f1da1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:01:49.970015 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e413b42-dc56-4d01-ba7e-5c0b204a45aa service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:01:49.976537 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e413b42-dc56-4d01-ba7e-5c0b204a45aa service nova] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:01:49.987718 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ea7f78-c933-4078-8583-f757b05f1da1 service nova] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:01:49.989466 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 821/1624] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 15 18:01:49 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 18:01:49.990579 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e413b42-dc56-4d01-ba7e-5c0b204a45aa service nova] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:01:50.033968 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 804/1625] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 15 18:01:49 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 398 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 18:01:50.035588 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ea7f78-c933-4078-8583-f757b05f1da1 service nova] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:01:50.089526 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 18:01:50.111466 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e413b42-dc56-4d01-ba7e-5c0b204a45aa service nova] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:01:50.118716 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3cc64fd-7cd0-40e8-a91f-c85464fd81e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:01:50.119927 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cc64fd-7cd0-40e8-a91f-c85464fd81e9 admin admin] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:01:50.120367 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cc64fd-7cd0-40e8-a91f-c85464fd81e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:01:50.120793 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cc64fd-7cd0-40e8-a91f-c85464fd81e9 admin admin] PATH_INFO: `/v3/users` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:01:50.122340 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3cc64fd-7cd0-40e8-a91f-c85464fd81e9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:01:50.125049 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3cc64fd-7cd0-40e8-a91f-c85464fd81e9 admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:01:50.157805 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 822/1626] 10.222.0.25 () {60 vars in 1144 bytes} [Thu Sep 15 18:01:49 2022] POST /identity/v3/users => generated 290 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 18:01:50.162445 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3cc64fd-7cd0-40e8-a91f-c85464fd81e9 admin admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:01:50.191514 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3cc64fd-7cd0-40e8-a91f-c85464fd81e9 admin admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:01:50.198763 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ea7f78-c933-4078-8583-f757b05f1da1 service nova] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:01:50.200699 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b96832-874b-4437-9a4e-1ff5d55c20a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:01:50.202654 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b96832-874b-4437-9a4e-1ff5d55c20a1 admin admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:01:50.203111 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b96832-874b-4437-9a4e-1ff5d55c20a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:01:50.203732 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b96832-874b-4437-9a4e-1ff5d55c20a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:01:50.205055 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b96832-874b-4437-9a4e-1ff5d55c20a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:01:50.206957 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b96832-874b-4437-9a4e-1ff5d55c20a1 admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:01:50.207749 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b9a41a-dba9-4788-bd24-baf602bb250f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:01:50.208562 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b9a41a-dba9-4788-bd24-baf602bb250f admin admin] REQUEST_METHOD: `PUT` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:01:50.208942 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b9a41a-dba9-4788-bd24-baf602bb250f admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:01:50.209346 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b9a41a-dba9-4788-bd24-baf602bb250f admin admin] PATH_INFO: `/v3/projects/6a63022d94a34796bf21e189c7a44f6f/users/8a65cf96c0284afdb896a1dc1136a747/roles/a9e42be86923434f8af52d3fc07fb4f7` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:01:50.223479 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 823/1627] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Sep 15 18:01:50 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 18:01:50.230512 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b96832-874b-4437-9a4e-1ff5d55c20a1 admin admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:01:50.244832 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b96832-874b-4437-9a4e-1ff5d55c20a1 admin admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:01:50.246765 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b9a41a-dba9-4788-bd24-baf602bb250f admin admin] RBAC: Authorizing `identity:create_grant(project_id=6a63022d94a34796bf21e189c7a44f6f, user_id=8a65cf96c0284afdb896a1dc1136a747, role_id=a9e42be86923434f8af52d3fc07fb4f7)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:01:50.249645 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b9a41a-dba9-4788-bd24-baf602bb250f admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:01:50.249883 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26ddb6b-cc9b-4902-acde-d2a49ad2ef5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:01:50.250558 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26ddb6b-cc9b-4902-acde-d2a49ad2ef5d admin admin] REQUEST_METHOD: `PUT` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:01:50.250843 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26ddb6b-cc9b-4902-acde-d2a49ad2ef5d admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:01:50.251120 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26ddb6b-cc9b-4902-acde-d2a49ad2ef5d admin admin] PATH_INFO: `/v3/projects/c860dae0716844a3aaaaeb8e73616c76/users/a407a4b2754c43b2a56143cdd28697c0/roles/a9e42be86923434f8af52d3fc07fb4f7` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:01:50.272739 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26ddb6b-cc9b-4902-acde-d2a49ad2ef5d admin admin] RBAC: Authorizing `identity:create_grant(project_id=c860dae0716844a3aaaaeb8e73616c76, user_id=a407a4b2754c43b2a56143cdd28697c0, role_id=a9e42be86923434f8af52d3fc07fb4f7)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:01:50.277104 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26ddb6b-cc9b-4902-acde-d2a49ad2ef5d admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:01:50.280500 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 805/1628] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Sep 15 18:01:50 2022] PUT /identity/v3/projects/6a63022d94a34796bf21e189c7a44f6f/users/8a65cf96c0284afdb896a1dc1136a747/roles/a9e42be86923434f8af52d3fc07fb4f7 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 18:01:50.281939 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b9a41a-dba9-4788-bd24-baf602bb250f admin admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:01:50.302411 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 824/1629] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Sep 15 18:01:50 2022] PUT /identity/v3/projects/c860dae0716844a3aaaaeb8e73616c76/users/a407a4b2754c43b2a56143cdd28697c0/roles/a9e42be86923434f8af52d3fc07fb4f7 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 18:01:50.304308 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26ddb6b-cc9b-4902-acde-d2a49ad2ef5d admin admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:01:50.381025 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 18:01:50.415277 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26ddb6b-cc9b-4902-acde-d2a49ad2ef5d admin admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:01:50.418809 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b9a41a-dba9-4788-bd24-baf602bb250f admin admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:01:50.422849 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c91c75-4bcb-4e7e-83e7-bd55e7a8f0c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:01:50.424433 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c91c75-4bcb-4e7e-83e7-bd55e7a8f0c3 admin admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:01:50.425041 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c91c75-4bcb-4e7e-83e7-bd55e7a8f0c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:01:50.425656 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c91c75-4bcb-4e7e-83e7-bd55e7a8f0c3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:01:50.426669 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c91c75-4bcb-4e7e-83e7-bd55e7a8f0c3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:01:50.429170 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c91c75-4bcb-4e7e-83e7-bd55e7a8f0c3 admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:01:50.431198 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4dce3d-34c7-41de-a2af-8c915fd81c9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:01:50.431866 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4dce3d-34c7-41de-a2af-8c915fd81c9b admin admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:01:50.432118 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4dce3d-34c7-41de-a2af-8c915fd81c9b admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:01:50.432405 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4dce3d-34c7-41de-a2af-8c915fd81c9b admin admin] PATH_INFO: `/v3/roles` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:01:50.433141 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed4dce3d-34c7-41de-a2af-8c915fd81c9b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:01:50.434781 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed4dce3d-34c7-41de-a2af-8c915fd81c9b admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:01:50.448318 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 825/1630] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Sep 15 18:01:50 2022] GET /identity/v3/roles => generated 1420 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 18:01:50.450183 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c91c75-4bcb-4e7e-83e7-bd55e7a8f0c3 admin admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:01:50.454791 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 806/1631] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Sep 15 18:01:50 2022] GET /identity/v3/roles => generated 1420 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 18:01:50.462303 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4dce3d-34c7-41de-a2af-8c915fd81c9b admin admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:01:50.465944 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c91c75-4bcb-4e7e-83e7-bd55e7a8f0c3 admin admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:01:50.474713 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9254cac-f057-4254-9335-ec09d36c1e70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:01:50.475796 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9254cac-f057-4254-9335-ec09d36c1e70 admin admin] REQUEST_METHOD: `PUT` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:01:50.476171 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9254cac-f057-4254-9335-ec09d36c1e70 admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:01:50.476965 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9254cac-f057-4254-9335-ec09d36c1e70 admin admin] PATH_INFO: `/v3/projects/c860dae0716844a3aaaaeb8e73616c76/users/a407a4b2754c43b2a56143cdd28697c0/roles/a9e42be86923434f8af52d3fc07fb4f7` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:01:50.479683 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9254cac-f057-4254-9335-ec09d36c1e70 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c860dae0716844a3aaaaeb8e73616c76, user_id=a407a4b2754c43b2a56143cdd28697c0, role_id=a9e42be86923434f8af52d3fc07fb4f7)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:01:50.481017 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4dce3d-34c7-41de-a2af-8c915fd81c9b admin admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:01:50.484226 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9254cac-f057-4254-9335-ec09d36c1e70 admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:01:50.488989 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7441ca-6a5b-482b-8841-615e18a55be2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:01:50.489607 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7441ca-6a5b-482b-8841-615e18a55be2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:01:50.489885 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7441ca-6a5b-482b-8841-615e18a55be2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:01:50.490208 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7441ca-6a5b-482b-8841-615e18a55be2 admin admin] PATH_INFO: `/v3/projects/6a63022d94a34796bf21e189c7a44f6f/users/8a65cf96c0284afdb896a1dc1136a747/roles/a9e42be86923434f8af52d3fc07fb4f7` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:01:50.497870 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e7441ca-6a5b-482b-8841-615e18a55be2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6a63022d94a34796bf21e189c7a44f6f, user_id=8a65cf96c0284afdb896a1dc1136a747, role_id=a9e42be86923434f8af52d3fc07fb4f7)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:01:50.501262 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e7441ca-6a5b-482b-8841-615e18a55be2 admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:01:50.517356 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 826/1632] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Sep 15 18:01:50 2022] PUT /identity/v3/projects/c860dae0716844a3aaaaeb8e73616c76/users/a407a4b2754c43b2a56143cdd28697c0/roles/a9e42be86923434f8af52d3fc07fb4f7 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 18:01:50.519107 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27548344-dc0b-41c9-8f67-05bc0a256510 None None] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:01:50.519412 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27548344-dc0b-41c9-8f67-05bc0a256510 None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:01:50.519694 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27548344-dc0b-41c9-8f67-05bc0a256510 None None] PATH_INFO: `/` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:01:50.522309 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 827/1633] 10.222.0.25 () {54 vars in 912 bytes} [Thu Sep 15 18:01:50 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 18:01:50.524021 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5877a3-35f4-4fcd-bd25-f357d97c3eb3 None None] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:01:50.524304 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5877a3-35f4-4fcd-bd25-f357d97c3eb3 None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:01:50.524575 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5877a3-35f4-4fcd-bd25-f357d97c3eb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:01:50.538098 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 807/1634] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Sep 15 18:01:50 2022] PUT /identity/v3/projects/6a63022d94a34796bf21e189c7a44f6f/users/8a65cf96c0284afdb896a1dc1136a747/roles/a9e42be86923434f8af52d3fc07fb4f7 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 18:01:50.538098 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52735e67-4e6b-4e76-aa10-6857d9e49233 None None] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:01:50.538098 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52735e67-4e6b-4e76-aa10-6857d9e49233 None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:01:50.538098 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52735e67-4e6b-4e76-aa10-6857d9e49233 None None] PATH_INFO: `/` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:01:50.538098 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 808/1635] 10.222.0.25 () {54 vars in 912 bytes} [Thu Sep 15 18:01:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 18:01:50.538098 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bfc652-e13e-49e3-beea-d5bedc399c8c None None] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:01:50.538745 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bfc652-e13e-49e3-beea-d5bedc399c8c None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:01:50.538745 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bfc652-e13e-49e3-beea-d5bedc399c8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:01:50.562388 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.auth.core [None req-b2bfc652-e13e-49e3-beea-d5bedc399c8c None None] MFA Rules not processed for user `fe2244818e4d4dca9c424cd078653e6a`. Rule list: `[]` (Enabled: `True`). {{(pid=81592) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 18:01:50.563936 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-b2bfc652-e13e-49e3-beea-d5bedc399c8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:01:50.568695 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.auth.core [None req-4f5877a3-35f4-4fcd-bd25-f357d97c3eb3 None None] MFA Rules not processed for user `a407a4b2754c43b2a56143cdd28697c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81593) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 18:01:50.570115 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-4f5877a3-35f4-4fcd-bd25-f357d97c3eb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:01:50.696273 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 828/1636] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 15 18:01:50 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 18:01:50.700725 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5ea57f-3e9a-4b2f-ad24-b4c0aea0838b None None] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:01:50.701385 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5ea57f-3e9a-4b2f-ad24-b4c0aea0838b None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:01:50.702665 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5ea57f-3e9a-4b2f-ad24-b4c0aea0838b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:01:50.705666 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 809/1637] 10.222.0.25 () {58 vars in 1009 bytes} [Thu Sep 15 18:01:50 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 18:01:50.709197 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b5385e-dc70-452c-ade2-e542b5a564e8 None None] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:01:50.709618 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b5385e-dc70-452c-ade2-e542b5a564e8 None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:01:50.709903 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b5385e-dc70-452c-ade2-e542b5a564e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:01:50.764040 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.auth.core [None req-1a5ea57f-3e9a-4b2f-ad24-b4c0aea0838b None None] MFA Rules not processed for user `fe2244818e4d4dca9c424cd078653e6a`. Rule list: `[]` (Enabled: `True`). {{(pid=81593) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 18:01:50.767304 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-1a5ea57f-3e9a-4b2f-ad24-b4c0aea0838b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:01:50.782749 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.auth.core [None req-49b5385e-dc70-452c-ade2-e542b5a564e8 None None] MFA Rules not processed for user `8a65cf96c0284afdb896a1dc1136a747`. Rule list: `[]` (Enabled: `True`). {{(pid=81592) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 18:01:50.791363 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-49b5385e-dc70-452c-ade2-e542b5a564e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:01:50.810308 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 829/1638] 10.222.0.25 () {58 vars in 1009 bytes} [Thu Sep 15 18:01:50 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 18:01:50.811843 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5ea57f-3e9a-4b2f-ad24-b4c0aea0838b None None] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:01:50.818573 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 18:01:50.916959 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 810/1639] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 15 18:01:50 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 18:01:50.918048 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b5385e-dc70-452c-ade2-e542b5a564e8 None None] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:01:50.933152 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b5385e-dc70-452c-ade2-e542b5a564e8 None None] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:01:50.938490 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8df6e8e-b2af-4fe6-a945-cf6758400960 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b232e7a841145ba93c6d8462ccb751a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1213c0d1b584404ba3998e136f166e89', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:01:50.939802 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8df6e8e-b2af-4fe6-a945-cf6758400960 service cinder] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:01:50.941249 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8df6e8e-b2af-4fe6-a945-cf6758400960 service cinder] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:01:50.941249 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8df6e8e-b2af-4fe6-a945-cf6758400960 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:01:50.944555 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5ea57f-3e9a-4b2f-ad24-b4c0aea0838b None None] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:01:50.958148 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907f0e42-3f1e-45a9-a678-8839a9d99e22 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b232e7a841145ba93c6d8462ccb751a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1213c0d1b584404ba3998e136f166e89', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:01:50.958375 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8df6e8e-b2af-4fe6-a945-cf6758400960 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:01:50.958938 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907f0e42-3f1e-45a9-a678-8839a9d99e22 service cinder] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:01:50.959311 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907f0e42-3f1e-45a9-a678-8839a9d99e22 service cinder] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:01:50.959636 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907f0e42-3f1e-45a9-a678-8839a9d99e22 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:01:50.960124 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8df6e8e-b2af-4fe6-a945-cf6758400960 service cinder] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:01:50.982079 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907f0e42-3f1e-45a9-a678-8839a9d99e22 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:01:50.986838 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907f0e42-3f1e-45a9-a678-8839a9d99e22 service cinder] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:01:50.988540 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 811/1640] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 15 18:01:50 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 70 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 18:01:51.006345 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 830/1641] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 15 18:01:50 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 195 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 18:01:51.078601 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8df6e8e-b2af-4fe6-a945-cf6758400960 service cinder] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:01:51.088824 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8df6e8e-b2af-4fe6-a945-cf6758400960 service cinder] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:01:51.097083 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49460542-cd22-446a-a46b-409373aec152 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b232e7a841145ba93c6d8462ccb751a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1213c0d1b584404ba3998e136f166e89', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:01:51.097868 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49460542-cd22-446a-a46b-409373aec152 service cinder] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:01:51.098605 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49460542-cd22-446a-a46b-409373aec152 service cinder] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:01:51.098605 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49460542-cd22-446a-a46b-409373aec152 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:01:51.117343 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49460542-cd22-446a-a46b-409373aec152 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:01:51.128465 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49460542-cd22-446a-a46b-409373aec152 service cinder] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:01:51.144278 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 812/1642] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 15 18:01:51 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 18:01:51.383707 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907f0e42-3f1e-45a9-a678-8839a9d99e22 service cinder] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:01:51.402445 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907f0e42-3f1e-45a9-a678-8839a9d99e22 service cinder] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:01:51.411337 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e117650-6f7b-4d98-b6b3-cfa21e8dd860 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b232e7a841145ba93c6d8462ccb751a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1213c0d1b584404ba3998e136f166e89', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:01:51.412415 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e117650-6f7b-4d98-b6b3-cfa21e8dd860 service cinder] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:01:51.412835 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e117650-6f7b-4d98-b6b3-cfa21e8dd860 service cinder] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:01:51.413138 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e117650-6f7b-4d98-b6b3-cfa21e8dd860 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:01:51.427234 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e117650-6f7b-4d98-b6b3-cfa21e8dd860 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:01:51.430060 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e117650-6f7b-4d98-b6b3-cfa21e8dd860 service cinder] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:01:51.457441 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 831/1643] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 15 18:01:51 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 74 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 18:01:51.534047 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49460542-cd22-446a-a46b-409373aec152 service cinder] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:01:51.543790 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49460542-cd22-446a-a46b-409373aec152 service cinder] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:01:51.556854 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e89dc00-04e3-4f7d-9343-7084083bb91d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b232e7a841145ba93c6d8462ccb751a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1213c0d1b584404ba3998e136f166e89', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:01:51.557562 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e89dc00-04e3-4f7d-9343-7084083bb91d service cinder] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:01:51.557902 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e89dc00-04e3-4f7d-9343-7084083bb91d service cinder] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:01:51.558182 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e89dc00-04e3-4f7d-9343-7084083bb91d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:01:51.590086 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 18:01:51.707750 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e89dc00-04e3-4f7d-9343-7084083bb91d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:01:51.711514 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e89dc00-04e3-4f7d-9343-7084083bb91d service cinder] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:01:51.733078 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 813/1644] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 15 18:01:51 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 200 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 18:01:52.419726 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e117650-6f7b-4d98-b6b3-cfa21e8dd860 service cinder] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:01:52.428953 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e117650-6f7b-4d98-b6b3-cfa21e8dd860 service cinder] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:01:52.441076 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3525861d-9937-49c6-b33c-2446fcc415f2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b232e7a841145ba93c6d8462ccb751a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1213c0d1b584404ba3998e136f166e89', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:01:52.441746 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3525861d-9937-49c6-b33c-2446fcc415f2 service cinder] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:01:52.442029 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3525861d-9937-49c6-b33c-2446fcc415f2 service cinder] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:01:52.442322 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3525861d-9937-49c6-b33c-2446fcc415f2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:01:52.719988 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3525861d-9937-49c6-b33c-2446fcc415f2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:01:52.734040 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3525861d-9937-49c6-b33c-2446fcc415f2 service cinder] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:01:52.787671 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 832/1645] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 15 18:01:52 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 18:01:55.185000 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e89dc00-04e3-4f7d-9343-7084083bb91d service cinder] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:01:55.370655 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e89dc00-04e3-4f7d-9343-7084083bb91d service cinder] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:01:55.382689 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad16396c-03e3-4ac8-98fd-16d2e162d81d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:01:55.383729 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad16396c-03e3-4ac8-98fd-16d2e162d81d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:01:55.384015 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad16396c-03e3-4ac8-98fd-16d2e162d81d admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:01:55.384293 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad16396c-03e3-4ac8-98fd-16d2e162d81d admin admin] PATH_INFO: `/v3/users/1f439cf5a965484790f8a47e618c2505` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:01:55.385979 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad16396c-03e3-4ac8-98fd-16d2e162d81d admin admin] RBAC: Authorizing `identity:delete_user(user_id=1f439cf5a965484790f8a47e618c2505)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:01:55.387168 dv-cinder-835384-27-smb devstack@keystone.service[81592]: WARNING py.warnings [None req-ad16396c-03e3-4ac8-98fd-16d2e162d81d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 15 18:01:55.387168 dv-cinder-835384-27-smb devstack@keystone.service[81592]: warnings.warn(msg) Sep 15 18:01:55.387168 dv-cinder-835384-27-smb devstack@keystone.service[81592]: Sep 15 18:01:55.390440 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad16396c-03e3-4ac8-98fd-16d2e162d81d admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:01:55.582726 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-ad16396c-03e3-4ac8-98fd-16d2e162d81d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1f439cf5a965484790f8a47e618c2505'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:01:55.607116 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-ad16396c-03e3-4ac8-98fd-16d2e162d81d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1f439cf5a965484790f8a47e618c2505'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:01:55.611822 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-ad16396c-03e3-4ac8-98fd-16d2e162d81d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1f439cf5a965484790f8a47e618c2505'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:01:55.615982 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-ad16396c-03e3-4ac8-98fd-16d2e162d81d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1f439cf5a965484790f8a47e618c2505'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:01:55.638531 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-ad16396c-03e3-4ac8-98fd-16d2e162d81d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1f439cf5a965484790f8a47e618c2505'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:01:55.724377 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee7e5bb-3283-470b-92af-13ff0e46b868 None None] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:01:55.725136 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee7e5bb-3283-470b-92af-13ff0e46b868 None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:01:55.725228 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee7e5bb-3283-470b-92af-13ff0e46b868 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:01:55.729033 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 814/1646] 10.222.0.25 () {58 vars in 1224 bytes} [Thu Sep 15 18:01:55 2022] DELETE /identity/v3/users/1f439cf5a965484790f8a47e618c2505 => generated 0 bytes in 535 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 18:01:55.762368 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.auth.core [None req-8ee7e5bb-3283-470b-92af-13ff0e46b868 None None] MFA Rules not processed for user `5cfa58ef86774ab7800bf91930bf6028`. Rule list: `[]` (Enabled: `True`). {{(pid=81593) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 18:01:55.763682 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-8ee7e5bb-3283-470b-92af-13ff0e46b868 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:01:55.980992 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 833/1647] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 15 18:01:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 257 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 18:01:56.073949 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad16396c-03e3-4ac8-98fd-16d2e162d81d admin admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:01:56.075633 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-ad16396c-03e3-4ac8-98fd-16d2e162d81d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:01:56.255185 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 18:01:56.301791 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad16396c-03e3-4ac8-98fd-16d2e162d81d admin admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:01:56.306015 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4546144d-6914-4241-b87f-c4337b53ed17 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a32274b4781b40fea9f28da8a9bde5ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1213c0d1b584404ba3998e136f166e89', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:01:56.307085 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4546144d-6914-4241-b87f-c4337b53ed17 service neutron] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:01:56.307565 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4546144d-6914-4241-b87f-c4337b53ed17 service neutron] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:01:56.308033 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4546144d-6914-4241-b87f-c4337b53ed17 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:01:56.319708 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4546144d-6914-4241-b87f-c4337b53ed17 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:01:56.321916 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4546144d-6914-4241-b87f-c4337b53ed17 service neutron] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:01:56.336820 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 815/1648] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 15 18:01:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 263 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 18:01:57.285163 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9948bd60-07c2-481c-88a4-0cf192a28eb5 None None] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:01:57.286129 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9948bd60-07c2-481c-88a4-0cf192a28eb5 None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:01:57.286635 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9948bd60-07c2-481c-88a4-0cf192a28eb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:01:57.374398 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.auth.core [None req-9948bd60-07c2-481c-88a4-0cf192a28eb5 None None] MFA Rules not processed for user `5b0a236a877446d59821a8860636adef`. Rule list: `[]` (Enabled: `True`). {{(pid=81593) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 18:01:57.375681 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-9948bd60-07c2-481c-88a4-0cf192a28eb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:01:57.425048 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 18:01:57.568793 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 834/1649] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 15 18:01:57 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 284 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 18:01:57.588768 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fbb009-c946-4ae5-a31c-e144d4541d0f None None] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:01:57.594875 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fbb009-c946-4ae5-a31c-e144d4541d0f None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:01:57.598936 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fbb009-c946-4ae5-a31c-e144d4541d0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:01:57.650990 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.auth.core [None req-60fbb009-c946-4ae5-a31c-e144d4541d0f None None] MFA Rules not processed for user `5b0a236a877446d59821a8860636adef`. Rule list: `[]` (Enabled: `True`). {{(pid=81592) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 18:01:57.653071 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-60fbb009-c946-4ae5-a31c-e144d4541d0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:01:57.673889 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 816/1650] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 15 18:01:57 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 18:01:57.687517 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9948bd60-07c2-481c-88a4-0cf192a28eb5 None None] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:01:57.689620 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-9948bd60-07c2-481c-88a4-0cf192a28eb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:01:57.960732 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9948bd60-07c2-481c-88a4-0cf192a28eb5 None None] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:01:57.976147 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308c05d4-12c7-4fcc-85d9-99f9ead09d6f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe2244818e4d4dca9c424cd078653e6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1213c0d1b584404ba3998e136f166e89', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:01:57.976956 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308c05d4-12c7-4fcc-85d9-99f9ead09d6f service nova] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:01:57.977423 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308c05d4-12c7-4fcc-85d9-99f9ead09d6f service nova] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:01:57.977828 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308c05d4-12c7-4fcc-85d9-99f9ead09d6f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:01:57.991753 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60fbb009-c946-4ae5-a31c-e144d4541d0f None None] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:01:57.993515 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-60fbb009-c946-4ae5-a31c-e144d4541d0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:01:58.004804 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308c05d4-12c7-4fcc-85d9-99f9ead09d6f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:01:58.007927 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308c05d4-12c7-4fcc-85d9-99f9ead09d6f service nova] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:01:58.034661 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 835/1651] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 15 18:01:57 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 18:01:58.036165 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308c05d4-12c7-4fcc-85d9-99f9ead09d6f service nova] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:01:58.041497 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-308c05d4-12c7-4fcc-85d9-99f9ead09d6f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:01:58.072297 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60fbb009-c946-4ae5-a31c-e144d4541d0f None None] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:01:58.098073 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047e7ba8-bca1-4b2d-8681-661a66c2431a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:01:58.099130 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047e7ba8-bca1-4b2d-8681-661a66c2431a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:01:58.099974 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047e7ba8-bca1-4b2d-8681-661a66c2431a admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:01:58.100663 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047e7ba8-bca1-4b2d-8681-661a66c2431a admin admin] PATH_INFO: `/v3/users/840768ae948643d6a0002f7da88cf2db` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:01:58.104826 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308c05d4-12c7-4fcc-85d9-99f9ead09d6f service nova] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:01:58.107430 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047e7ba8-bca1-4b2d-8681-661a66c2431a admin admin] RBAC: Authorizing `identity:delete_user(user_id=840768ae948643d6a0002f7da88cf2db)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:01:58.111035 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047e7ba8-bca1-4b2d-8681-661a66c2431a admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:01:58.120663 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40a4ca6-601e-4caf-ae18-71cdf103c16f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:01:58.121655 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40a4ca6-601e-4caf-ae18-71cdf103c16f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:01:58.121932 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40a4ca6-601e-4caf-ae18-71cdf103c16f admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:01:58.122209 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40a4ca6-601e-4caf-ae18-71cdf103c16f admin admin] PATH_INFO: `/v3/projects/07d73521c60e482fa76e4ad3d3d63d96` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:01:58.124745 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b40a4ca6-601e-4caf-ae18-71cdf103c16f admin admin] RBAC: Authorizing `identity:delete_project(project_id=07d73521c60e482fa76e4ad3d3d63d96)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:01:58.130109 dv-cinder-835384-27-smb devstack@keystone.service[81593]: WARNING py.warnings [None req-b40a4ca6-601e-4caf-ae18-71cdf103c16f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 15 18:01:58.130109 dv-cinder-835384-27-smb devstack@keystone.service[81593]: warnings.warn(msg) Sep 15 18:01:58.130109 dv-cinder-835384-27-smb devstack@keystone.service[81593]: Sep 15 18:01:58.135652 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b40a4ca6-601e-4caf-ae18-71cdf103c16f admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:01:58.220706 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-047e7ba8-bca1-4b2d-8681-661a66c2431a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '840768ae948643d6a0002f7da88cf2db'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:01:58.248774 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-047e7ba8-bca1-4b2d-8681-661a66c2431a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '840768ae948643d6a0002f7da88cf2db'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:01:58.249887 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-047e7ba8-bca1-4b2d-8681-661a66c2431a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '840768ae948643d6a0002f7da88cf2db'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:01:58.250791 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-047e7ba8-bca1-4b2d-8681-661a66c2431a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '840768ae948643d6a0002f7da88cf2db'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:01:58.307083 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-047e7ba8-bca1-4b2d-8681-661a66c2431a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '840768ae948643d6a0002f7da88cf2db'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:01:58.346031 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-b40a4ca6-601e-4caf-ae18-71cdf103c16f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '07d73521c60e482fa76e4ad3d3d63d96', 'request_id': 'req-b40a4ca6-601e-4caf-ae18-71cdf103c16f'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:01:58.386414 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-b40a4ca6-601e-4caf-ae18-71cdf103c16f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '07d73521c60e482fa76e4ad3d3d63d96', 'request_id': 'req-b40a4ca6-601e-4caf-ae18-71cdf103c16f'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:01:58.403751 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 817/1652] 10.222.0.25 () {58 vars in 1224 bytes} [Thu Sep 15 18:01:57 2022] DELETE /identity/v3/users/840768ae948643d6a0002f7da88cf2db => generated 0 bytes in 412 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 18:01:58.410207 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-b40a4ca6-601e-4caf-ae18-71cdf103c16f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '07d73521c60e482fa76e4ad3d3d63d96', 'request_id': 'req-b40a4ca6-601e-4caf-ae18-71cdf103c16f'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:01:58.413927 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d60ed6-99f7-4d1a-932e-59069230cef1 None None] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:01:58.414489 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d60ed6-99f7-4d1a-932e-59069230cef1 None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:01:58.415153 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d60ed6-99f7-4d1a-932e-59069230cef1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:01:58.455477 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.auth.core [None req-46d60ed6-99f7-4d1a-932e-59069230cef1 None None] MFA Rules not processed for user `5cfa58ef86774ab7800bf91930bf6028`. Rule list: `[]` (Enabled: `True`). {{(pid=81592) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 18:01:58.456818 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-46d60ed6-99f7-4d1a-932e-59069230cef1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:01:58.456985 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-b40a4ca6-601e-4caf-ae18-71cdf103c16f admin admin] The token cache is being invalidate because project 07d73521c60e482fa76e4ad3d3d63d96 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81593) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 18:01:58.457324 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-b40a4ca6-601e-4caf-ae18-71cdf103c16f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:01:58.458421 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-b40a4ca6-601e-4caf-ae18-71cdf103c16f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:01:58.468094 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 836/1653] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Sep 15 18:01:58 2022] DELETE /identity/v3/projects/07d73521c60e482fa76e4ad3d3d63d96 => generated 0 bytes in 429 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 18:01:58.469968 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ec85c4-725b-4c20-b0fe-67da0c2ece68 None None] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:01:58.474509 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ec85c4-725b-4c20-b0fe-67da0c2ece68 None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:01:58.475404 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ec85c4-725b-4c20-b0fe-67da0c2ece68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:01:58.528230 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.auth.core [None req-78ec85c4-725b-4c20-b0fe-67da0c2ece68 None None] MFA Rules not processed for user `5cfa58ef86774ab7800bf91930bf6028`. Rule list: `[]` (Enabled: `True`). {{(pid=81593) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 18:01:58.529754 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-78ec85c4-725b-4c20-b0fe-67da0c2ece68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:01:58.609188 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 818/1654] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 15 18:01:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 18:01:58.645620 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d60ed6-99f7-4d1a-932e-59069230cef1 None None] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:01:58.647530 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-46d60ed6-99f7-4d1a-932e-59069230cef1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:01:58.681660 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 18:01:58.768957 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 18:01:58.785202 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d60ed6-99f7-4d1a-932e-59069230cef1 None None] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:01:58.808470 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 837/1655] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 15 18:01:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 339 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 18:01:58.811668 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc63d4a-834e-4edd-bcc1-2dd34be87cbd None None] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:01:58.812274 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc63d4a-834e-4edd-bcc1-2dd34be87cbd None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:01:58.812831 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc63d4a-834e-4edd-bcc1-2dd34be87cbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:01:58.814423 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a802997c-16ae-4ff3-9b3a-ff2d55589997 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a32274b4781b40fea9f28da8a9bde5ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1213c0d1b584404ba3998e136f166e89', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:01:58.815428 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a802997c-16ae-4ff3-9b3a-ff2d55589997 service neutron] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:01:58.815951 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a802997c-16ae-4ff3-9b3a-ff2d55589997 service neutron] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:01:58.816568 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a802997c-16ae-4ff3-9b3a-ff2d55589997 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:01:58.839967 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a802997c-16ae-4ff3-9b3a-ff2d55589997 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:01:58.846014 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a802997c-16ae-4ff3-9b3a-ff2d55589997 service neutron] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:01:58.866088 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.auth.core [None req-1bc63d4a-834e-4edd-bcc1-2dd34be87cbd None None] MFA Rules not processed for user `5cfa58ef86774ab7800bf91930bf6028`. Rule list: `[]` (Enabled: `True`). {{(pid=81593) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 18:01:58.869836 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 819/1656] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 15 18:01:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 225 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 18:01:58.875005 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-1bc63d4a-834e-4edd-bcc1-2dd34be87cbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:01:58.899082 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 838/1657] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 15 18:01:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 18:01:58.903654 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a802997c-16ae-4ff3-9b3a-ff2d55589997 service neutron] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:01:58.919060 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a802997c-16ae-4ff3-9b3a-ff2d55589997 service neutron] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:01:58.926317 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a39f276-4952-4f49-ab86-fa180c2f66a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:01:58.927087 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a39f276-4952-4f49-ab86-fa180c2f66a8 admin admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:01:58.927464 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a39f276-4952-4f49-ab86-fa180c2f66a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:01:58.927833 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a39f276-4952-4f49-ab86-fa180c2f66a8 admin admin] PATH_INFO: `/v3/domains` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:01:58.929020 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a39f276-4952-4f49-ab86-fa180c2f66a8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81592) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 18:01:58.929638 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a39f276-4952-4f49-ab86-fa180c2f66a8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:01:58.931691 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a39f276-4952-4f49-ab86-fa180c2f66a8 admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:01:58.955116 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 820/1658] 10.222.0.25 () {58 vars in 1153 bytes} [Thu Sep 15 18:01:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 18:01:58.959578 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc63d4a-834e-4edd-bcc1-2dd34be87cbd None None] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:01:58.971428 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc63d4a-834e-4edd-bcc1-2dd34be87cbd None None] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:01:58.985578 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8882d14c-5a72-4c9b-914a-b0a9e235557c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:01:58.986278 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8882d14c-5a72-4c9b-914a-b0a9e235557c admin admin] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:01:58.986630 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8882d14c-5a72-4c9b-914a-b0a9e235557c admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:01:58.986972 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8882d14c-5a72-4c9b-914a-b0a9e235557c admin admin] PATH_INFO: `/v3/projects` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:01:58.987636 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8882d14c-5a72-4c9b-914a-b0a9e235557c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:01:58.990154 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8882d14c-5a72-4c9b-914a-b0a9e235557c admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:01:59.067205 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a39f276-4952-4f49-ab86-fa180c2f66a8 admin admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:01:59.081392 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 839/1659] 10.222.0.25 () {60 vars in 1153 bytes} [Thu Sep 15 18:01:58 2022] POST /identity/v3/projects => generated 405 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 15 18:01:59.087976 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a39f276-4952-4f49-ab86-fa180c2f66a8 admin admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:01:59.212829 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8882d14c-5a72-4c9b-914a-b0a9e235557c admin admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:01:59.214940 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-8882d14c-5a72-4c9b-914a-b0a9e235557c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:01:59.322688 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e252c777-5e57-4537-91ab-47a327dd1d09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:01:59.323352 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e252c777-5e57-4537-91ab-47a327dd1d09 admin admin] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:01:59.323634 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e252c777-5e57-4537-91ab-47a327dd1d09 admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:01:59.323964 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e252c777-5e57-4537-91ab-47a327dd1d09 admin admin] PATH_INFO: `/v3/users` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:01:59.324650 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e252c777-5e57-4537-91ab-47a327dd1d09 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:01:59.345114 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e252c777-5e57-4537-91ab-47a327dd1d09 admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:01:59.393898 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8882d14c-5a72-4c9b-914a-b0a9e235557c admin admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:01:59.405622 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb3acac-110d-4d72-83f3-406a3fe40b51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:01:59.406201 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb3acac-110d-4d72-83f3-406a3fe40b51 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:01:59.406487 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb3acac-110d-4d72-83f3-406a3fe40b51 admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:01:59.406762 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb3acac-110d-4d72-83f3-406a3fe40b51 admin admin] PATH_INFO: `/v3/users/36c20c2b373e4794a7f0c04e41f9af5f` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:01:59.411991 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb3acac-110d-4d72-83f3-406a3fe40b51 admin admin] RBAC: Authorizing `identity:delete_user(user_id=36c20c2b373e4794a7f0c04e41f9af5f)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:01:59.414606 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb3acac-110d-4d72-83f3-406a3fe40b51 admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:01:59.445675 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 821/1660] 10.222.0.25 () {60 vars in 1144 bytes} [Thu Sep 15 18:01:59 2022] POST /identity/v3/users => generated 303 bytes in 383 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 18:01:59.452227 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e252c777-5e57-4537-91ab-47a327dd1d09 admin admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:01:59.494799 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e252c777-5e57-4537-91ab-47a327dd1d09 admin admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:01:59.508060 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c091bb1-0057-46e4-9979-10c268950a8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:01:59.508692 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c091bb1-0057-46e4-9979-10c268950a8e admin admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:01:59.508977 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c091bb1-0057-46e4-9979-10c268950a8e admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:01:59.509256 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c091bb1-0057-46e4-9979-10c268950a8e admin admin] PATH_INFO: `/v3/roles` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:01:59.510078 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c091bb1-0057-46e4-9979-10c268950a8e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:01:59.511726 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c091bb1-0057-46e4-9979-10c268950a8e admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:01:59.539368 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 822/1661] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Sep 15 18:01:59 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 18:01:59.540803 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45fd819-23c9-4a34-a693-5847d2119fdb None None] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:01:59.541099 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45fd819-23c9-4a34-a693-5847d2119fdb None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:01:59.542617 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45fd819-23c9-4a34-a693-5847d2119fdb None None] PATH_INFO: `/` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:01:59.550243 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 823/1662] 10.222.0.25 () {54 vars in 912 bytes} [Thu Sep 15 18:01:59 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 18:01:59.551139 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45fd819-23c9-4a34-a693-5847d2119fdb None None] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:01:59.587062 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45fd819-23c9-4a34-a693-5847d2119fdb None None] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:01:59.597124 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ebe69c8-efb5-4eda-bef6-10b9d440c802 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:01:59.597792 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebe69c8-efb5-4eda-bef6-10b9d440c802 admin admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:01:59.598228 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebe69c8-efb5-4eda-bef6-10b9d440c802 admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:01:59.598511 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebe69c8-efb5-4eda-bef6-10b9d440c802 admin admin] PATH_INFO: `/v3/roles` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:01:59.599173 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ebe69c8-efb5-4eda-bef6-10b9d440c802 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:01:59.601049 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ebe69c8-efb5-4eda-bef6-10b9d440c802 admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:01:59.618745 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-cbb3acac-110d-4d72-83f3-406a3fe40b51 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '36c20c2b373e4794a7f0c04e41f9af5f'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:01:59.630476 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 824/1663] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Sep 15 18:01:59 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 18:01:59.638882 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc6aa02-d1e4-44aa-b957-0dd4847aa501 None None] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:01:59.639533 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc6aa02-d1e4-44aa-b957-0dd4847aa501 None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:01:59.640009 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc6aa02-d1e4-44aa-b957-0dd4847aa501 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:01:59.660379 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-cbb3acac-110d-4d72-83f3-406a3fe40b51 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '36c20c2b373e4794a7f0c04e41f9af5f'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:01:59.664576 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-cbb3acac-110d-4d72-83f3-406a3fe40b51 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '36c20c2b373e4794a7f0c04e41f9af5f'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:01:59.665925 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-cbb3acac-110d-4d72-83f3-406a3fe40b51 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '36c20c2b373e4794a7f0c04e41f9af5f'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:01:59.707966 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-cbb3acac-110d-4d72-83f3-406a3fe40b51 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '36c20c2b373e4794a7f0c04e41f9af5f'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:01:59.778450 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 840/1664] 10.222.0.25 () {58 vars in 1224 bytes} [Thu Sep 15 18:01:59 2022] DELETE /identity/v3/users/36c20c2b373e4794a7f0c04e41f9af5f => generated 0 bytes in 566 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 15 18:01:59.779634 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb3acac-110d-4d72-83f3-406a3fe40b51 admin admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:01:59.786462 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-cbb3acac-110d-4d72-83f3-406a3fe40b51 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:01:59.796927 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.auth.core [None req-2dc6aa02-d1e4-44aa-b957-0dd4847aa501 None None] MFA Rules not processed for user `a32274b4781b40fea9f28da8a9bde5ca`. Rule list: `[]` (Enabled: `True`). {{(pid=81592) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 18:01:59.799853 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-2dc6aa02-d1e4-44aa-b957-0dd4847aa501 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:01:59.861027 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 18:02:00.036693 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb3acac-110d-4d72-83f3-406a3fe40b51 admin admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:02:00.051730 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 825/1665] 10.222.0.25 () {58 vars in 1009 bytes} [Thu Sep 15 18:01:59 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 423 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 18:02:00.056139 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c0b7eb-b668-4031-9989-be22a8102c73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:02:00.056848 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c0b7eb-b668-4031-9989-be22a8102c73 admin admin] REQUEST_METHOD: `PUT` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:02:00.057131 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c0b7eb-b668-4031-9989-be22a8102c73 admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:02:00.057436 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c0b7eb-b668-4031-9989-be22a8102c73 admin admin] PATH_INFO: `/v3/projects/17319698db9a4fa29c452c6a779c43b3/users/2882c77c885f42bbba07e244ed076f0d/roles/343cc8b1bc7243eebabdf08147e8366d` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:02:00.063790 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1552f8-bb80-43b1-9aa3-cc7f2ab2aba0 None None] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:02:00.065762 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1552f8-bb80-43b1-9aa3-cc7f2ab2aba0 None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:02:00.072455 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1552f8-bb80-43b1-9aa3-cc7f2ab2aba0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:02:00.111359 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c0b7eb-b668-4031-9989-be22a8102c73 admin admin] RBAC: Authorizing `identity:create_grant(project_id=17319698db9a4fa29c452c6a779c43b3, user_id=2882c77c885f42bbba07e244ed076f0d, role_id=343cc8b1bc7243eebabdf08147e8366d)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:02:00.120152 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c0b7eb-b668-4031-9989-be22a8102c73 admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:02:00.152486 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 841/1666] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Sep 15 18:01:59 2022] PUT /identity/v3/projects/17319698db9a4fa29c452c6a779c43b3/users/2882c77c885f42bbba07e244ed076f0d/roles/343cc8b1bc7243eebabdf08147e8366d => generated 0 bytes in 373 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 18:02:00.159667 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82f220b-9fbf-49ba-871e-ae33423d0497 None None] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:02:00.162619 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.auth.core [None req-ed1552f8-bb80-43b1-9aa3-cc7f2ab2aba0 None None] MFA Rules not processed for user `5cfa58ef86774ab7800bf91930bf6028`. Rule list: `[]` (Enabled: `True`). {{(pid=81592) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 18:02:00.163987 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-ed1552f8-bb80-43b1-9aa3-cc7f2ab2aba0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:02:00.175123 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82f220b-9fbf-49ba-871e-ae33423d0497 None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:02:00.175521 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82f220b-9fbf-49ba-871e-ae33423d0497 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:02:00.234179 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.auth.core [None req-e82f220b-9fbf-49ba-871e-ae33423d0497 None None] MFA Rules not processed for user `5cfa58ef86774ab7800bf91930bf6028`. Rule list: `[]` (Enabled: `True`). {{(pid=81593) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 18:02:00.235445 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-e82f220b-9fbf-49ba-871e-ae33423d0497 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:02:00.279335 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 18:02:00.362325 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 826/1667] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 15 18:02:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 300 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 18:02:00.366598 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1552f8-bb80-43b1-9aa3-cc7f2ab2aba0 None None] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:02:00.370641 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-ed1552f8-bb80-43b1-9aa3-cc7f2ab2aba0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:02:00.429036 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 842/1668] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 15 18:02:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 272 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 18:02:00.430814 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82f220b-9fbf-49ba-871e-ae33423d0497 None None] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:02:00.435209 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-e82f220b-9fbf-49ba-871e-ae33423d0497 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:02:00.539194 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1552f8-bb80-43b1-9aa3-cc7f2ab2aba0 None None] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:02:00.546035 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d91ff00-5c12-45db-b27c-e404079d0517 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a32274b4781b40fea9f28da8a9bde5ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1213c0d1b584404ba3998e136f166e89', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:02:00.546705 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d91ff00-5c12-45db-b27c-e404079d0517 service neutron] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:02:00.546989 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d91ff00-5c12-45db-b27c-e404079d0517 service neutron] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:02:00.547264 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d91ff00-5c12-45db-b27c-e404079d0517 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:02:00.567333 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82f220b-9fbf-49ba-871e-ae33423d0497 None None] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:02:00.568315 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d91ff00-5c12-45db-b27c-e404079d0517 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:02:00.569866 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d91ff00-5c12-45db-b27c-e404079d0517 service neutron] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:02:00.572003 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10991ee-a303-4bf5-a3c3-f55d3e41ac7a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a32274b4781b40fea9f28da8a9bde5ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1213c0d1b584404ba3998e136f166e89', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:02:00.572863 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10991ee-a303-4bf5-a3c3-f55d3e41ac7a service neutron] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:02:00.573280 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10991ee-a303-4bf5-a3c3-f55d3e41ac7a service neutron] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:02:00.573726 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10991ee-a303-4bf5-a3c3-f55d3e41ac7a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:02:00.584313 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 827/1669] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 15 18:02:00 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 221 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 18:02:00.585149 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d91ff00-5c12-45db-b27c-e404079d0517 service neutron] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:02:00.592898 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f10991ee-a303-4bf5-a3c3-f55d3e41ac7a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:02:00.594554 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f10991ee-a303-4bf5-a3c3-f55d3e41ac7a service neutron] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:02:00.608031 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 843/1670] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 15 18:02:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 18:02:00.609513 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb82cf2-b561-4b12-a09f-e7e1b58d640a None None] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:02:00.610487 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb82cf2-b561-4b12-a09f-e7e1b58d640a None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:02:00.610973 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb82cf2-b561-4b12-a09f-e7e1b58d640a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:02:00.613477 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d91ff00-5c12-45db-b27c-e404079d0517 service neutron] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:02:00.620875 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be31c8b5-fa26-466c-a44f-758f44d38a8e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a32274b4781b40fea9f28da8a9bde5ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1213c0d1b584404ba3998e136f166e89', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:02:00.621571 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be31c8b5-fa26-466c-a44f-758f44d38a8e service neutron] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:02:00.621856 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be31c8b5-fa26-466c-a44f-758f44d38a8e service neutron] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:02:00.622130 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be31c8b5-fa26-466c-a44f-758f44d38a8e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:02:00.641532 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be31c8b5-fa26-466c-a44f-758f44d38a8e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:02:00.643067 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be31c8b5-fa26-466c-a44f-758f44d38a8e service neutron] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:02:00.651610 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.auth.core [None req-ebb82cf2-b561-4b12-a09f-e7e1b58d640a None None] MFA Rules not processed for user `49761e1a87dc495eae27fe1b8f509ae7`. Rule list: `[]` (Enabled: `True`). {{(pid=81593) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 18:02:00.654634 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-ebb82cf2-b561-4b12-a09f-e7e1b58d640a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:02:00.666244 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 828/1671] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 15 18:02:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 18:02:00.721867 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 18:02:00.804390 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 844/1672] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 15 18:02:00 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 18:02:00.831425 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be31c8b5-fa26-466c-a44f-758f44d38a8e service neutron] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:02:00.833285 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-be31c8b5-fa26-466c-a44f-758f44d38a8e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:02:00.893684 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb82cf2-b561-4b12-a09f-e7e1b58d640a None None] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:02:00.899314 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-ebb82cf2-b561-4b12-a09f-e7e1b58d640a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:02:00.992220 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb82cf2-b561-4b12-a09f-e7e1b58d640a None None] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:02:01.030617 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6ae8ca-f55d-4932-8900-f5974b42a21c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:02:01.034433 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6ae8ca-f55d-4932-8900-f5974b42a21c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:02:01.034833 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6ae8ca-f55d-4932-8900-f5974b42a21c admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:02:01.038365 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6ae8ca-f55d-4932-8900-f5974b42a21c admin admin] PATH_INFO: `/v3/projects/1f11e37ca4354281ad1e04db5b80c9b3` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:02:01.043797 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa6ae8ca-f55d-4932-8900-f5974b42a21c admin admin] RBAC: Authorizing `identity:delete_project(project_id=1f11e37ca4354281ad1e04db5b80c9b3)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:02:01.059613 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa6ae8ca-f55d-4932-8900-f5974b42a21c admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:02:01.254518 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-aa6ae8ca-f55d-4932-8900-f5974b42a21c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1f11e37ca4354281ad1e04db5b80c9b3', 'request_id': 'req-aa6ae8ca-f55d-4932-8900-f5974b42a21c'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:02:01.268641 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be31c8b5-fa26-466c-a44f-758f44d38a8e service neutron] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:02:01.271399 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-aa6ae8ca-f55d-4932-8900-f5974b42a21c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1f11e37ca4354281ad1e04db5b80c9b3', 'request_id': 'req-aa6ae8ca-f55d-4932-8900-f5974b42a21c'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:02:01.291480 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-aa6ae8ca-f55d-4932-8900-f5974b42a21c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1f11e37ca4354281ad1e04db5b80c9b3', 'request_id': 'req-aa6ae8ca-f55d-4932-8900-f5974b42a21c'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:02:01.327496 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-aa6ae8ca-f55d-4932-8900-f5974b42a21c admin admin] The token cache is being invalidate because project 1f11e37ca4354281ad1e04db5b80c9b3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81593) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 18:02:01.327802 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-aa6ae8ca-f55d-4932-8900-f5974b42a21c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:02:01.333212 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-aa6ae8ca-f55d-4932-8900-f5974b42a21c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:02:01.341593 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 845/1673] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Sep 15 18:02:00 2022] DELETE /identity/v3/projects/1f11e37ca4354281ad1e04db5b80c9b3 => generated 0 bytes in 447 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 18:02:01.345732 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6ae8ca-f55d-4932-8900-f5974b42a21c admin admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:02:01.347753 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-aa6ae8ca-f55d-4932-8900-f5974b42a21c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:02:01.487763 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 18:02:01.524780 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e195401-7403-40d7-aec1-30062784e360 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe2244818e4d4dca9c424cd078653e6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1213c0d1b584404ba3998e136f166e89', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:02:01.525546 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e195401-7403-40d7-aec1-30062784e360 service nova] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:02:01.525941 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e195401-7403-40d7-aec1-30062784e360 service nova] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:02:01.526376 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e195401-7403-40d7-aec1-30062784e360 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:02:01.529796 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-7e195401-7403-40d7-aec1-30062784e360 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:02:01.537050 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6ae8ca-f55d-4932-8900-f5974b42a21c admin admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:02:01.549249 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb0f989-8fc1-4802-99b3-a8e9b12235d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:02:01.550371 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb0f989-8fc1-4802-99b3-a8e9b12235d3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:02:01.551003 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb0f989-8fc1-4802-99b3-a8e9b12235d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:02:01.551492 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb0f989-8fc1-4802-99b3-a8e9b12235d3 admin admin] PATH_INFO: `/v3/users/a407a4b2754c43b2a56143cdd28697c0` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:02:01.555164 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb0f989-8fc1-4802-99b3-a8e9b12235d3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a407a4b2754c43b2a56143cdd28697c0)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:02:01.558613 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb0f989-8fc1-4802-99b3-a8e9b12235d3 admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:02:01.717231 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-feb0f989-8fc1-4802-99b3-a8e9b12235d3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a407a4b2754c43b2a56143cdd28697c0'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:02:01.740097 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-feb0f989-8fc1-4802-99b3-a8e9b12235d3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a407a4b2754c43b2a56143cdd28697c0'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:02:01.741061 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-feb0f989-8fc1-4802-99b3-a8e9b12235d3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a407a4b2754c43b2a56143cdd28697c0'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:02:01.742198 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-feb0f989-8fc1-4802-99b3-a8e9b12235d3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a407a4b2754c43b2a56143cdd28697c0'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:02:01.760057 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 18:02:01.767646 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-feb0f989-8fc1-4802-99b3-a8e9b12235d3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a407a4b2754c43b2a56143cdd28697c0'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:02:01.783583 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e195401-7403-40d7-aec1-30062784e360 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:02:01.785214 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e195401-7403-40d7-aec1-30062784e360 service nova] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:02:01.809929 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 829/1674] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 15 18:02:00 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 979 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 18:02:01.812500 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e195401-7403-40d7-aec1-30062784e360 service nova] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:02:01.820242 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 846/1675] 10.222.0.25 () {58 vars in 1224 bytes} [Thu Sep 15 18:02:01 2022] DELETE /identity/v3/users/a407a4b2754c43b2a56143cdd28697c0 => generated 0 bytes in 476 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 18:02:01.830355 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-7e195401-7403-40d7-aec1-30062784e360 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:02:01.944132 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e195401-7403-40d7-aec1-30062784e360 service nova] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:02:02.180017 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f65c549-6608-400a-a059-7e69e377ee49 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10af119bd39841ed8163993676230fca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1213c0d1b584404ba3998e136f166e89', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:02:02.180663 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f65c549-6608-400a-a059-7e69e377ee49 service placement] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:02:02.181870 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f65c549-6608-400a-a059-7e69e377ee49 service placement] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:02:02.182176 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f65c549-6608-400a-a059-7e69e377ee49 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:02:02.187565 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-0f65c549-6608-400a-a059-7e69e377ee49 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:02:02.222393 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f65c549-6608-400a-a059-7e69e377ee49 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:02:02.224291 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f65c549-6608-400a-a059-7e69e377ee49 service placement] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:02:02.242263 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 830/1676] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 15 18:02:01 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 432 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 18:02:02.621373 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb0f989-8fc1-4802-99b3-a8e9b12235d3 admin admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:02:02.623877 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-feb0f989-8fc1-4802-99b3-a8e9b12235d3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:02:02.730398 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f65c549-6608-400a-a059-7e69e377ee49 service placement] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:02:02.732850 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-0f65c549-6608-400a-a059-7e69e377ee49 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:02:02.804145 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb0f989-8fc1-4802-99b3-a8e9b12235d3 admin admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:02:02.822091 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e11058-4bf0-4a81-bdaa-2b92c1270f46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:02:02.822764 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e11058-4bf0-4a81-bdaa-2b92c1270f46 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:02:02.823049 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e11058-4bf0-4a81-bdaa-2b92c1270f46 admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:02:02.823328 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e11058-4bf0-4a81-bdaa-2b92c1270f46 admin admin] PATH_INFO: `/v3/projects/a41994d63b3a4e01a3c7c8eda6c09dff` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:02:02.829688 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e11058-4bf0-4a81-bdaa-2b92c1270f46 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a41994d63b3a4e01a3c7c8eda6c09dff)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:02:02.834149 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e11058-4bf0-4a81-bdaa-2b92c1270f46 admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:02:02.987471 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 18:02:03.030559 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-82e11058-4bf0-4a81-bdaa-2b92c1270f46 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a41994d63b3a4e01a3c7c8eda6c09dff', 'request_id': 'req-82e11058-4bf0-4a81-bdaa-2b92c1270f46'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:02:03.052861 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-82e11058-4bf0-4a81-bdaa-2b92c1270f46 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a41994d63b3a4e01a3c7c8eda6c09dff', 'request_id': 'req-82e11058-4bf0-4a81-bdaa-2b92c1270f46'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:02:03.082276 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-82e11058-4bf0-4a81-bdaa-2b92c1270f46 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a41994d63b3a4e01a3c7c8eda6c09dff', 'request_id': 'req-82e11058-4bf0-4a81-bdaa-2b92c1270f46'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:02:03.119819 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f65c549-6608-400a-a059-7e69e377ee49 service placement] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:02:03.136718 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-82e11058-4bf0-4a81-bdaa-2b92c1270f46 admin admin] The token cache is being invalidate because project a41994d63b3a4e01a3c7c8eda6c09dff was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81593) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 18:02:03.136718 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-82e11058-4bf0-4a81-bdaa-2b92c1270f46 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:02:03.139369 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-82e11058-4bf0-4a81-bdaa-2b92c1270f46 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:02:03.143791 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 847/1677] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Sep 15 18:02:02 2022] DELETE /identity/v3/projects/a41994d63b3a4e01a3c7c8eda6c09dff => generated 0 bytes in 528 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 15 18:02:03.154593 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4591d3d-0946-4984-8279-68b09e9a40c0 None None] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:02:03.157079 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4591d3d-0946-4984-8279-68b09e9a40c0 None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:02:03.158416 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4591d3d-0946-4984-8279-68b09e9a40c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:02:03.257943 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b96741f-010a-4f36-9bdc-cbce381fca7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:02:03.258605 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b96741f-010a-4f36-9bdc-cbce381fca7c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:02:03.258892 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b96741f-010a-4f36-9bdc-cbce381fca7c admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:02:03.259168 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b96741f-010a-4f36-9bdc-cbce381fca7c admin admin] PATH_INFO: `/v3/projects/c860dae0716844a3aaaaeb8e73616c76` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:02:03.260387 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b96741f-010a-4f36-9bdc-cbce381fca7c admin admin] RBAC: Authorizing `identity:delete_project(project_id=c860dae0716844a3aaaaeb8e73616c76)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:02:03.262893 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b96741f-010a-4f36-9bdc-cbce381fca7c admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:02:03.284033 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.auth.core [None req-c4591d3d-0946-4984-8279-68b09e9a40c0 None None] MFA Rules not processed for user `5cfa58ef86774ab7800bf91930bf6028`. Rule list: `[]` (Enabled: `True`). {{(pid=81593) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 18:02:03.285508 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-c4591d3d-0946-4984-8279-68b09e9a40c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:02:03.318558 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 848/1678] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 15 18:02:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 18:02:03.332740 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed76f68-ff59-4459-b0a9-0c1275f009a3 None None] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:02:03.333047 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed76f68-ff59-4459-b0a9-0c1275f009a3 None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:02:03.335758 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed76f68-ff59-4459-b0a9-0c1275f009a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:02:03.399913 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-5b96741f-010a-4f36-9bdc-cbce381fca7c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c860dae0716844a3aaaaeb8e73616c76', 'request_id': 'req-5b96741f-010a-4f36-9bdc-cbce381fca7c'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:02:03.418089 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.auth.core [None req-4ed76f68-ff59-4459-b0a9-0c1275f009a3 None None] MFA Rules not processed for user `5cfa58ef86774ab7800bf91930bf6028`. Rule list: `[]` (Enabled: `True`). {{(pid=81593) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 18:02:03.418921 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-5b96741f-010a-4f36-9bdc-cbce381fca7c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c860dae0716844a3aaaaeb8e73616c76', 'request_id': 'req-5b96741f-010a-4f36-9bdc-cbce381fca7c'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:02:03.420069 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-4ed76f68-ff59-4459-b0a9-0c1275f009a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:02:03.461962 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-5b96741f-010a-4f36-9bdc-cbce381fca7c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c860dae0716844a3aaaaeb8e73616c76', 'request_id': 'req-5b96741f-010a-4f36-9bdc-cbce381fca7c'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:02:03.498112 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-5b96741f-010a-4f36-9bdc-cbce381fca7c admin admin] The token cache is being invalidate because project c860dae0716844a3aaaaeb8e73616c76 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81592) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 18:02:03.498456 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-5b96741f-010a-4f36-9bdc-cbce381fca7c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:02:03.499440 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-5b96741f-010a-4f36-9bdc-cbce381fca7c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:02:03.508513 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 831/1679] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Sep 15 18:02:02 2022] DELETE /identity/v3/projects/c860dae0716844a3aaaaeb8e73616c76 => generated 0 bytes in 779 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 15 18:02:03.514243 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f9964f-8bfd-41cc-959c-42b048915b5e None None] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:02:03.514725 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f9964f-8bfd-41cc-959c-42b048915b5e None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:02:03.515141 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f9964f-8bfd-41cc-959c-42b048915b5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:02:03.575173 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.auth.core [None req-18f9964f-8bfd-41cc-959c-42b048915b5e None None] MFA Rules not processed for user `5cfa58ef86774ab7800bf91930bf6028`. Rule list: `[]` (Enabled: `True`). {{(pid=81592) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 18:02:03.577197 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-18f9964f-8bfd-41cc-959c-42b048915b5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:02:03.587681 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 849/1680] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 15 18:02:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 260 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 18:02:03.589093 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed1921d-8f15-4b5c-8c96-88003446a710 None None] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:02:03.589437 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed1921d-8f15-4b5c-8c96-88003446a710 None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:02:03.589689 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed1921d-8f15-4b5c-8c96-88003446a710 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:02:03.599609 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 18:02:03.606749 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 832/1681] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 15 18:02:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 18:02:03.614683 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f9964f-8bfd-41cc-959c-42b048915b5e None None] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:02:03.650377 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f9964f-8bfd-41cc-959c-42b048915b5e None None] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:02:03.655346 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.auth.core [None req-3ed1921d-8f15-4b5c-8c96-88003446a710 None None] MFA Rules not processed for user `2882c77c885f42bbba07e244ed076f0d`. Rule list: `[]` (Enabled: `True`). {{(pid=81593) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 18:02:03.656730 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-3ed1921d-8f15-4b5c-8c96-88003446a710 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:02:03.663625 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f929f4-bd64-47bd-9e75-cd129a5717da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:02:03.664261 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f929f4-bd64-47bd-9e75-cd129a5717da admin admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:02:03.664548 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f929f4-bd64-47bd-9e75-cd129a5717da admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:02:03.665470 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f929f4-bd64-47bd-9e75-cd129a5717da admin admin] PATH_INFO: `/v3/domains` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:02:03.667828 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f929f4-bd64-47bd-9e75-cd129a5717da admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81592) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 18:02:03.668139 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f929f4-bd64-47bd-9e75-cd129a5717da admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:02:03.670846 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f929f4-bd64-47bd-9e75-cd129a5717da admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:02:03.711502 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 833/1682] 10.222.0.25 () {58 vars in 1153 bytes} [Thu Sep 15 18:02:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 18:02:03.714966 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053872e6-bc0f-419a-b6d4-5650667f3bcf None None] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:02:03.715779 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053872e6-bc0f-419a-b6d4-5650667f3bcf None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:02:03.715779 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053872e6-bc0f-419a-b6d4-5650667f3bcf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:02:03.754715 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.auth.core [None req-053872e6-bc0f-419a-b6d4-5650667f3bcf None None] MFA Rules not processed for user `5cfa58ef86774ab7800bf91930bf6028`. Rule list: `[]` (Enabled: `True`). {{(pid=81592) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 18:02:03.755979 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-053872e6-bc0f-419a-b6d4-5650667f3bcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:02:03.791425 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 834/1683] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 15 18:02:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 18:02:03.791425 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053872e6-bc0f-419a-b6d4-5650667f3bcf None None] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:02:03.827446 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053872e6-bc0f-419a-b6d4-5650667f3bcf None None] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:02:03.843745 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a785f7-42af-4761-a428-982df6ce6be3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:02:03.844408 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a785f7-42af-4761-a428-982df6ce6be3 admin admin] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:02:03.844657 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a785f7-42af-4761-a428-982df6ce6be3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:02:03.845093 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a785f7-42af-4761-a428-982df6ce6be3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:02:03.845820 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a785f7-42af-4761-a428-982df6ce6be3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:02:03.851717 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a785f7-42af-4761-a428-982df6ce6be3 admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:02:03.862167 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 850/1684] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 15 18:02:03 2022] POST /identity/v3/auth/tokens => generated 3282 bytes in 274 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 18:02:03.864696 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed1921d-8f15-4b5c-8c96-88003446a710 None None] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:02:03.908611 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 835/1685] 10.222.0.25 () {60 vars in 1153 bytes} [Thu Sep 15 18:02:03 2022] POST /identity/v3/projects => generated 405 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 18:02:03.909609 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a785f7-42af-4761-a428-982df6ce6be3 admin admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:02:03.914023 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed1921d-8f15-4b5c-8c96-88003446a710 None None] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:02:03.920788 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-55a785f7-42af-4761-a428-982df6ce6be3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:02:04.000557 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 18:02:04.122296 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a785f7-42af-4761-a428-982df6ce6be3 admin admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:02:04.136420 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a52b48-4255-4699-b545-f165561bddfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:02:04.138202 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a52b48-4255-4699-b545-f165561bddfe admin admin] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:02:04.139176 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a52b48-4255-4699-b545-f165561bddfe admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:02:04.140043 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a52b48-4255-4699-b545-f165561bddfe admin admin] PATH_INFO: `/v3/projects` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:02:04.141828 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a52b48-4255-4699-b545-f165561bddfe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:02:04.150603 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3987e2b7-4ff6-4db2-88ec-802e985a1033 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:02:04.151233 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a52b48-4255-4699-b545-f165561bddfe admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:02:04.152877 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3987e2b7-4ff6-4db2-88ec-802e985a1033 admin admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:02:04.156722 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3987e2b7-4ff6-4db2-88ec-802e985a1033 admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:02:04.158132 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3987e2b7-4ff6-4db2-88ec-802e985a1033 admin admin] PATH_INFO: `/v3/domains` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:02:04.161804 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3987e2b7-4ff6-4db2-88ec-802e985a1033 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81593) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 18:02:04.163648 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3987e2b7-4ff6-4db2-88ec-802e985a1033 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:02:04.169655 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3987e2b7-4ff6-4db2-88ec-802e985a1033 admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:02:04.221800 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 851/1686] 10.222.0.25 () {58 vars in 1153 bytes} [Thu Sep 15 18:02:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 355 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 18:02:04.222639 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3987e2b7-4ff6-4db2-88ec-802e985a1033 admin admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:02:04.259405 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3987e2b7-4ff6-4db2-88ec-802e985a1033 admin admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:02:04.260122 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 836/1687] 10.222.0.25 () {60 vars in 1153 bytes} [Thu Sep 15 18:02:03 2022] POST /identity/v3/projects => generated 405 bytes in 348 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 18:02:04.261441 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a52b48-4255-4699-b545-f165561bddfe admin admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:02:04.267922 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-43a52b48-4255-4699-b545-f165561bddfe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:02:04.450115 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118c7848-5f91-4625-95c5-b5e86b5d6916 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:02:04.450799 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118c7848-5f91-4625-95c5-b5e86b5d6916 admin admin] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:02:04.451254 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118c7848-5f91-4625-95c5-b5e86b5d6916 admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:02:04.451650 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118c7848-5f91-4625-95c5-b5e86b5d6916 admin admin] PATH_INFO: `/v3/users` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:02:04.452366 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-118c7848-5f91-4625-95c5-b5e86b5d6916 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:02:04.457069 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-118c7848-5f91-4625-95c5-b5e86b5d6916 admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:02:04.485113 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a52b48-4255-4699-b545-f165561bddfe admin admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:02:04.494124 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57959532-13e1-482a-8604-ee97d2c020a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:02:04.496613 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57959532-13e1-482a-8604-ee97d2c020a9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:02:04.496984 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57959532-13e1-482a-8604-ee97d2c020a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:02:04.497273 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57959532-13e1-482a-8604-ee97d2c020a9 admin admin] PATH_INFO: `/v3/users/802b5320e2a4488eb6c9123625ee6e87` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:02:04.500914 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57959532-13e1-482a-8604-ee97d2c020a9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=802b5320e2a4488eb6c9123625ee6e87)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:02:04.506862 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 852/1688] 10.222.0.25 () {60 vars in 1144 bytes} [Thu Sep 15 18:02:04 2022] POST /identity/v3/users => generated 303 bytes in 285 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 18:02:04.508847 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57959532-13e1-482a-8604-ee97d2c020a9 admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:02:04.509107 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118c7848-5f91-4625-95c5-b5e86b5d6916 admin admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:02:04.525316 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118c7848-5f91-4625-95c5-b5e86b5d6916 admin admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:02:04.539297 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0571d8de-5ce6-469f-b85c-e751cd7c307e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:02:04.542157 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0571d8de-5ce6-469f-b85c-e751cd7c307e admin admin] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:02:04.542432 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0571d8de-5ce6-469f-b85c-e751cd7c307e admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:02:04.542742 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0571d8de-5ce6-469f-b85c-e751cd7c307e admin admin] PATH_INFO: `/v3/projects` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:02:04.543442 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0571d8de-5ce6-469f-b85c-e751cd7c307e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:02:04.553737 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0571d8de-5ce6-469f-b85c-e751cd7c307e admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:02:04.624868 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 18:02:04.628224 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-57959532-13e1-482a-8604-ee97d2c020a9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '802b5320e2a4488eb6c9123625ee6e87'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:02:04.645239 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-57959532-13e1-482a-8604-ee97d2c020a9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '802b5320e2a4488eb6c9123625ee6e87'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:02:04.646267 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-57959532-13e1-482a-8604-ee97d2c020a9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '802b5320e2a4488eb6c9123625ee6e87'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:02:04.647192 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-57959532-13e1-482a-8604-ee97d2c020a9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '802b5320e2a4488eb6c9123625ee6e87'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:02:04.661550 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-57959532-13e1-482a-8604-ee97d2c020a9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '802b5320e2a4488eb6c9123625ee6e87'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:02:04.663242 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 853/1689] 10.222.0.25 () {60 vars in 1153 bytes} [Thu Sep 15 18:02:04 2022] POST /identity/v3/projects => generated 379 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 18:02:04.664942 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0571d8de-5ce6-469f-b85c-e751cd7c307e admin admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:02:04.668314 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-0571d8de-5ce6-469f-b85c-e751cd7c307e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:02:04.694903 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 837/1690] 10.222.0.25 () {58 vars in 1224 bytes} [Thu Sep 15 18:02:04 2022] DELETE /identity/v3/users/802b5320e2a4488eb6c9123625ee6e87 => generated 0 bytes in 431 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 18:02:04.694903 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57959532-13e1-482a-8604-ee97d2c020a9 admin admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:02:04.697646 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-57959532-13e1-482a-8604-ee97d2c020a9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:02:04.788612 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 18:02:04.866096 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0571d8de-5ce6-469f-b85c-e751cd7c307e admin admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:02:04.872615 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57959532-13e1-482a-8604-ee97d2c020a9 admin admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:02:04.882414 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc64f726-87b8-4c86-95ab-51a7d6119cca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:02:04.883648 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc64f726-87b8-4c86-95ab-51a7d6119cca admin admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:02:04.884094 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc64f726-87b8-4c86-95ab-51a7d6119cca admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:02:04.884614 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc64f726-87b8-4c86-95ab-51a7d6119cca admin admin] PATH_INFO: `/v3/roles` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:02:04.885630 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc64f726-87b8-4c86-95ab-51a7d6119cca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:02:04.887960 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc64f726-87b8-4c86-95ab-51a7d6119cca admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:02:04.888819 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8a7948-a731-4cc0-941e-1d777184ecbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:02:04.894147 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8a7948-a731-4cc0-941e-1d777184ecbc admin admin] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:02:04.894593 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8a7948-a731-4cc0-941e-1d777184ecbc admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:02:04.895264 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8a7948-a731-4cc0-941e-1d777184ecbc admin admin] PATH_INFO: `/v3/users` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:02:04.896982 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce8a7948-a731-4cc0-941e-1d777184ecbc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:02:04.902074 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce8a7948-a731-4cc0-941e-1d777184ecbc admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:02:04.911401 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 838/1691] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Sep 15 18:02:04 2022] GET /identity/v3/roles => generated 1420 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 18:02:04.912933 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc64f726-87b8-4c86-95ab-51a7d6119cca admin admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:02:04.916490 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-dc64f726-87b8-4c86-95ab-51a7d6119cca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:02:04.934546 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc64f726-87b8-4c86-95ab-51a7d6119cca admin admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:02:04.957342 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d082db-4a3b-4b10-9cc9-00a0f6f91c6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:02:04.959579 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d082db-4a3b-4b10-9cc9-00a0f6f91c6d admin admin] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:02:04.959852 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d082db-4a3b-4b10-9cc9-00a0f6f91c6d admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:02:04.960828 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d082db-4a3b-4b10-9cc9-00a0f6f91c6d admin admin] PATH_INFO: `/v3/users` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:02:04.963161 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d082db-4a3b-4b10-9cc9-00a0f6f91c6d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:02:04.969344 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d082db-4a3b-4b10-9cc9-00a0f6f91c6d admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:02:04.975252 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 854/1692] 10.222.0.25 () {60 vars in 1144 bytes} [Thu Sep 15 18:02:04 2022] POST /identity/v3/users => generated 309 bytes in 308 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 18:02:04.975252 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13341832-fb52-47bb-9bca-f937b572a503 None None] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:02:04.975252 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13341832-fb52-47bb-9bca-f937b572a503 None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:02:04.975252 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13341832-fb52-47bb-9bca-f937b572a503 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:02:05.002297 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.auth.core [None req-13341832-fb52-47bb-9bca-f937b572a503 None None] MFA Rules not processed for user `5cfa58ef86774ab7800bf91930bf6028`. Rule list: `[]` (Enabled: `True`). {{(pid=81593) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 18:02:05.004334 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-13341832-fb52-47bb-9bca-f937b572a503 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:02:05.015967 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 855/1693] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 15 18:02:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 18:02:05.017330 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13341832-fb52-47bb-9bca-f937b572a503 None None] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:02:05.029108 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 839/1694] 10.222.0.25 () {60 vars in 1144 bytes} [Thu Sep 15 18:02:04 2022] POST /identity/v3/users => generated 290 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 18:02:05.031737 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13341832-fb52-47bb-9bca-f937b572a503 None None] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:02:05.036785 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d082db-4a3b-4b10-9cc9-00a0f6f91c6d admin admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:02:05.038395 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d01636-174d-4e9f-b7af-4d3e2641c245 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:02:05.039131 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d01636-174d-4e9f-b7af-4d3e2641c245 admin admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:02:05.039509 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d01636-174d-4e9f-b7af-4d3e2641c245 admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:02:05.039932 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d01636-174d-4e9f-b7af-4d3e2641c245 admin admin] PATH_INFO: `/v3/roles` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:02:05.041223 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d01636-174d-4e9f-b7af-4d3e2641c245 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:02:05.043486 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d01636-174d-4e9f-b7af-4d3e2641c245 admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:02:05.061598 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d082db-4a3b-4b10-9cc9-00a0f6f91c6d admin admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:02:05.065327 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 856/1695] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Sep 15 18:02:05 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 18:02:05.066579 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d01636-174d-4e9f-b7af-4d3e2641c245 admin admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:02:05.072793 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a956322a-08a4-4a74-9c7f-7f081458893a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:02:05.073468 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a956322a-08a4-4a74-9c7f-7f081458893a admin admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:02:05.073755 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a956322a-08a4-4a74-9c7f-7f081458893a admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:02:05.074032 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a956322a-08a4-4a74-9c7f-7f081458893a admin admin] PATH_INFO: `/v3/roles` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:02:05.076223 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a956322a-08a4-4a74-9c7f-7f081458893a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:02:05.077942 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a956322a-08a4-4a74-9c7f-7f081458893a admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:02:05.094402 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d01636-174d-4e9f-b7af-4d3e2641c245 admin admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:02:05.094590 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 840/1696] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Sep 15 18:02:05 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 18:02:05.094590 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a956322a-08a4-4a74-9c7f-7f081458893a admin admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:02:05.098854 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-a956322a-08a4-4a74-9c7f-7f081458893a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:02:05.107679 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40de7fbc-35d9-43db-b6b6-fb439fd8f4c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:02:05.108617 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40de7fbc-35d9-43db-b6b6-fb439fd8f4c7 admin admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:02:05.109075 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40de7fbc-35d9-43db-b6b6-fb439fd8f4c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:02:05.109502 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40de7fbc-35d9-43db-b6b6-fb439fd8f4c7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:02:05.110459 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40de7fbc-35d9-43db-b6b6-fb439fd8f4c7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:02:05.117008 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40de7fbc-35d9-43db-b6b6-fb439fd8f4c7 admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:02:05.154707 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 857/1697] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Sep 15 18:02:05 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 18:02:05.154707 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40de7fbc-35d9-43db-b6b6-fb439fd8f4c7 admin admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:02:05.185595 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40de7fbc-35d9-43db-b6b6-fb439fd8f4c7 admin admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:02:05.206185 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e62f2b0-a9cd-41cf-87af-ded802f1ca7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:02:05.206185 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e62f2b0-a9cd-41cf-87af-ded802f1ca7a admin admin] REQUEST_METHOD: `PUT` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:02:05.206185 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e62f2b0-a9cd-41cf-87af-ded802f1ca7a admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:02:05.206512 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e62f2b0-a9cd-41cf-87af-ded802f1ca7a admin admin] PATH_INFO: `/v3/projects/d662741309974eeb99a8507fe6d19889/users/cf8aa375c4bd421e91f325f193b5a164/roles/343cc8b1bc7243eebabdf08147e8366d` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:02:05.241568 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a956322a-08a4-4a74-9c7f-7f081458893a admin admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:02:05.256559 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1af472-c936-4c89-804f-ce837b40fce0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a32274b4781b40fea9f28da8a9bde5ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1213c0d1b584404ba3998e136f166e89', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:02:05.256559 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1af472-c936-4c89-804f-ce837b40fce0 service neutron] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:02:05.256559 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1af472-c936-4c89-804f-ce837b40fce0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:02:05.256559 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1af472-c936-4c89-804f-ce837b40fce0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:02:05.257231 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e62f2b0-a9cd-41cf-87af-ded802f1ca7a admin admin] RBAC: Authorizing `identity:create_grant(project_id=d662741309974eeb99a8507fe6d19889, user_id=cf8aa375c4bd421e91f325f193b5a164, role_id=343cc8b1bc7243eebabdf08147e8366d)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:02:05.261886 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e62f2b0-a9cd-41cf-87af-ded802f1ca7a admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:02:05.278426 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1af472-c936-4c89-804f-ce837b40fce0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:02:05.281936 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1af472-c936-4c89-804f-ce837b40fce0 service neutron] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:02:05.307971 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 858/1698] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Sep 15 18:02:05 2022] PUT /identity/v3/projects/d662741309974eeb99a8507fe6d19889/users/cf8aa375c4bd421e91f325f193b5a164/roles/343cc8b1bc7243eebabdf08147e8366d => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 18:02:05.308986 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e62f2b0-a9cd-41cf-87af-ded802f1ca7a admin admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:02:05.311196 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 841/1699] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 15 18:02:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 219 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 18:02:05.317909 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1af472-c936-4c89-804f-ce837b40fce0 service neutron] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:02:05.345119 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1af472-c936-4c89-804f-ce837b40fce0 service neutron] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:02:05.500847 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff56852-c351-4a29-99f6-b2404bec2fae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:02:05.501647 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff56852-c351-4a29-99f6-b2404bec2fae admin admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:02:05.502003 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff56852-c351-4a29-99f6-b2404bec2fae admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:02:05.502363 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff56852-c351-4a29-99f6-b2404bec2fae admin admin] PATH_INFO: `/v3/roles` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:02:05.503080 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff56852-c351-4a29-99f6-b2404bec2fae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:02:05.506034 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff56852-c351-4a29-99f6-b2404bec2fae admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:02:05.511882 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e62f2b0-a9cd-41cf-87af-ded802f1ca7a admin admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:02:05.529246 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 842/1700] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Sep 15 18:02:05 2022] GET /identity/v3/roles => generated 1420 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 18:02:05.529246 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83dffcc9-676e-4b17-a5fb-4d74c16bb33e None None] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:02:05.529246 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83dffcc9-676e-4b17-a5fb-4d74c16bb33e None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:02:05.529246 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83dffcc9-676e-4b17-a5fb-4d74c16bb33e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:02:05.547598 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e116d8-2238-427b-8c19-6f648edf149e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:02:05.548668 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e116d8-2238-427b-8c19-6f648edf149e admin admin] REQUEST_METHOD: `PUT` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:02:05.549109 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e116d8-2238-427b-8c19-6f648edf149e admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:02:05.549574 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e116d8-2238-427b-8c19-6f648edf149e admin admin] PATH_INFO: `/v3/projects/7adf9adc48c84a568e8203d220fc1068/users/6bdf6f7544264b0e840e7c95070c4153/roles/a9e42be86923434f8af52d3fc07fb4f7` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:02:05.581382 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.auth.core [None req-83dffcc9-676e-4b17-a5fb-4d74c16bb33e None None] MFA Rules not processed for user `cf8aa375c4bd421e91f325f193b5a164`. Rule list: `[]` (Enabled: `True`). {{(pid=81592) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 18:02:05.583584 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-83dffcc9-676e-4b17-a5fb-4d74c16bb33e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:02:05.597637 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e116d8-2238-427b-8c19-6f648edf149e admin admin] RBAC: Authorizing `identity:create_grant(project_id=7adf9adc48c84a568e8203d220fc1068, user_id=6bdf6f7544264b0e840e7c95070c4153, role_id=a9e42be86923434f8af52d3fc07fb4f7)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:02:05.602704 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e116d8-2238-427b-8c19-6f648edf149e admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:02:05.673716 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 859/1701] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Sep 15 18:02:05 2022] PUT /identity/v3/projects/7adf9adc48c84a568e8203d220fc1068/users/6bdf6f7544264b0e840e7c95070c4153/roles/a9e42be86923434f8af52d3fc07fb4f7 => generated 0 bytes in 365 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 18:02:05.675297 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e116d8-2238-427b-8c19-6f648edf149e admin admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:02:05.679791 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 18:02:05.718932 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:INSERT=6,keystone:SELECT=94 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 18:02:05.822154 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 843/1702] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 15 18:02:05 2022] POST /identity/v3/auth/tokens => generated 3282 bytes in 298 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 18:02:05.826699 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83dffcc9-676e-4b17-a5fb-4d74c16bb33e None None] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:02:05.854770 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83dffcc9-676e-4b17-a5fb-4d74c16bb33e None None] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:02:05.878927 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb45d45e-f83a-4538-b4a9-96ae6393e910 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:02:05.879954 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb45d45e-f83a-4538-b4a9-96ae6393e910 admin admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:02:05.883832 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb45d45e-f83a-4538-b4a9-96ae6393e910 admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:02:05.884111 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb45d45e-f83a-4538-b4a9-96ae6393e910 admin admin] PATH_INFO: `/v3/roles` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:02:05.885931 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb45d45e-f83a-4538-b4a9-96ae6393e910 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:02:05.892292 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb45d45e-f83a-4538-b4a9-96ae6393e910 admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:02:05.897835 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e116d8-2238-427b-8c19-6f648edf149e admin admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:02:05.913693 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1da0f26-2560-490a-8b9d-1e2fbc3bdf9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:02:05.915158 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1da0f26-2560-490a-8b9d-1e2fbc3bdf9e admin admin] REQUEST_METHOD: `PUT` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:02:05.916820 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1da0f26-2560-490a-8b9d-1e2fbc3bdf9e admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:02:05.916820 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1da0f26-2560-490a-8b9d-1e2fbc3bdf9e admin admin] PATH_INFO: `/v3/projects/f836f23bd3064c58ba6fcaf9921b1a61/users/43d1caf1a47640878ce91c41cc566d4f/roles/343cc8b1bc7243eebabdf08147e8366d` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:02:05.945313 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 844/1703] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Sep 15 18:02:05 2022] GET /identity/v3/roles => generated 1420 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 18:02:05.948037 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb45d45e-f83a-4538-b4a9-96ae6393e910 admin admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:02:05.964018 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1da0f26-2560-490a-8b9d-1e2fbc3bdf9e admin admin] RBAC: Authorizing `identity:create_grant(project_id=f836f23bd3064c58ba6fcaf9921b1a61, user_id=43d1caf1a47640878ce91c41cc566d4f, role_id=343cc8b1bc7243eebabdf08147e8366d)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:02:05.970568 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1da0f26-2560-490a-8b9d-1e2fbc3bdf9e admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:02:05.992949 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb45d45e-f83a-4538-b4a9-96ae6393e910 admin admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:02:06.006720 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 860/1704] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Sep 15 18:02:05 2022] PUT /identity/v3/projects/f836f23bd3064c58ba6fcaf9921b1a61/users/43d1caf1a47640878ce91c41cc566d4f/roles/343cc8b1bc7243eebabdf08147e8366d => generated 0 bytes in 332 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 18:02:06.007660 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1da0f26-2560-490a-8b9d-1e2fbc3bdf9e admin admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:02:06.188454 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f443121b-8f84-4ec6-b239-19bb230aa346 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:02:06.189263 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f443121b-8f84-4ec6-b239-19bb230aa346 admin admin] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:02:06.191067 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f443121b-8f84-4ec6-b239-19bb230aa346 admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:02:06.191370 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f443121b-8f84-4ec6-b239-19bb230aa346 admin admin] PATH_INFO: `/v3/projects` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:02:06.194288 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f443121b-8f84-4ec6-b239-19bb230aa346 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:02:06.199815 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f443121b-8f84-4ec6-b239-19bb230aa346 admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:02:06.228123 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1da0f26-2560-490a-8b9d-1e2fbc3bdf9e admin admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:02:06.246459 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b5fece-3fa1-4d1f-b21b-2a99accf89e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:02:06.247307 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b5fece-3fa1-4d1f-b21b-2a99accf89e1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:02:06.248020 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b5fece-3fa1-4d1f-b21b-2a99accf89e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:02:06.248463 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b5fece-3fa1-4d1f-b21b-2a99accf89e1 admin admin] PATH_INFO: `/v3/projects/7adf9adc48c84a568e8203d220fc1068/users/6bdf6f7544264b0e840e7c95070c4153/roles/a9e42be86923434f8af52d3fc07fb4f7` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:02:06.250788 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b5fece-3fa1-4d1f-b21b-2a99accf89e1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7adf9adc48c84a568e8203d220fc1068, user_id=6bdf6f7544264b0e840e7c95070c4153, role_id=a9e42be86923434f8af52d3fc07fb4f7)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:02:06.256062 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b5fece-3fa1-4d1f-b21b-2a99accf89e1 admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:02:06.271064 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 845/1705] 10.222.0.25 () {60 vars in 1153 bytes} [Thu Sep 15 18:02:05 2022] POST /identity/v3/projects => generated 403 bytes in 325 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 18:02:06.272870 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c61a21-0532-476a-b1f3-6ab72882fc7b None None] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:02:06.273161 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c61a21-0532-476a-b1f3-6ab72882fc7b None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:02:06.273508 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c61a21-0532-476a-b1f3-6ab72882fc7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:02:06.290574 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 861/1706] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Sep 15 18:02:06 2022] PUT /identity/v3/projects/7adf9adc48c84a568e8203d220fc1068/users/6bdf6f7544264b0e840e7c95070c4153/roles/a9e42be86923434f8af52d3fc07fb4f7 => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 18:02:06.298407 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b5fece-3fa1-4d1f-b21b-2a99accf89e1 admin admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:02:06.336481 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.auth.core [None req-c4c61a21-0532-476a-b1f3-6ab72882fc7b None None] MFA Rules not processed for user `43d1caf1a47640878ce91c41cc566d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81592) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 18:02:06.337996 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-c4c61a21-0532-476a-b1f3-6ab72882fc7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:02:06.488664 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b5fece-3fa1-4d1f-b21b-2a99accf89e1 admin admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:02:06.501814 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec972fd6-0120-4543-bedd-833f1ce6f529 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:02:06.504359 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec972fd6-0120-4543-bedd-833f1ce6f529 admin admin] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:02:06.504759 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec972fd6-0120-4543-bedd-833f1ce6f529 admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:02:06.507283 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec972fd6-0120-4543-bedd-833f1ce6f529 admin admin] PATH_INFO: `/v3/users` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:02:06.508140 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec972fd6-0120-4543-bedd-833f1ce6f529 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:02:06.510286 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec972fd6-0120-4543-bedd-833f1ce6f529 admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:02:06.529399 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 846/1707] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 15 18:02:06 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 254 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 18:02:06.530927 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c61a21-0532-476a-b1f3-6ab72882fc7b None None] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:02:06.559927 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 862/1708] 10.222.0.25 () {60 vars in 1144 bytes} [Thu Sep 15 18:02:06 2022] POST /identity/v3/users => generated 308 bytes in 269 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 18:02:06.567072 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec972fd6-0120-4543-bedd-833f1ce6f529 admin admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:02:06.574396 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c61a21-0532-476a-b1f3-6ab72882fc7b None None] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:02:06.587174 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da77f2d-3843-41b1-9ac4-557b5342efd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:02:06.587711 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da77f2d-3843-41b1-9ac4-557b5342efd3 admin admin] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:02:06.587996 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da77f2d-3843-41b1-9ac4-557b5342efd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:02:06.588272 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da77f2d-3843-41b1-9ac4-557b5342efd3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:02:06.591449 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da77f2d-3843-41b1-9ac4-557b5342efd3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:02:06.593467 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec972fd6-0120-4543-bedd-833f1ce6f529 admin admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:02:06.597487 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da77f2d-3843-41b1-9ac4-557b5342efd3 admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:02:06.608755 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb89b10c-8d47-4b16-a6a1-d7fdc135d277 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:02:06.609530 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb89b10c-8d47-4b16-a6a1-d7fdc135d277 admin admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:02:06.609815 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb89b10c-8d47-4b16-a6a1-d7fdc135d277 admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:02:06.610180 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb89b10c-8d47-4b16-a6a1-d7fdc135d277 admin admin] PATH_INFO: `/v3/roles` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:02:06.613025 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb89b10c-8d47-4b16-a6a1-d7fdc135d277 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:02:06.615902 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb89b10c-8d47-4b16-a6a1-d7fdc135d277 admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:02:06.643822 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 863/1709] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Sep 15 18:02:06 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 18:02:06.646604 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb89b10c-8d47-4b16-a6a1-d7fdc135d277 admin admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:02:06.674065 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 847/1710] 10.222.0.25 () {60 vars in 1153 bytes} [Thu Sep 15 18:02:06 2022] POST /identity/v3/projects => generated 379 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 18:02:06.676140 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb89b10c-8d47-4b16-a6a1-d7fdc135d277 admin admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:02:06.679466 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da77f2d-3843-41b1-9ac4-557b5342efd3 admin admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:02:06.687908 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 18:02:06.708846 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 18:02:06.820409 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086a82cc-d892-4d0b-a9a9-74f3a16fdd58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:02:06.822271 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086a82cc-d892-4d0b-a9a9-74f3a16fdd58 admin admin] REQUEST_METHOD: `PUT` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:02:06.822555 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086a82cc-d892-4d0b-a9a9-74f3a16fdd58 admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:02:06.822829 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086a82cc-d892-4d0b-a9a9-74f3a16fdd58 admin admin] PATH_INFO: `/v3/projects/f2e424016f6a4db8aa09e95f7998209a/users/1c9a8e60df594b6abb22e5bd30c598b3/roles/a9e42be86923434f8af52d3fc07fb4f7` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:02:06.861154 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da77f2d-3843-41b1-9ac4-557b5342efd3 admin admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:02:06.866224 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-086a82cc-d892-4d0b-a9a9-74f3a16fdd58 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f2e424016f6a4db8aa09e95f7998209a, user_id=1c9a8e60df594b6abb22e5bd30c598b3, role_id=a9e42be86923434f8af52d3fc07fb4f7)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:02:06.872923 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-086a82cc-d892-4d0b-a9a9-74f3a16fdd58 admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:02:06.873199 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b686e10-45a0-4b18-89ee-9a7c7cac0809 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:02:06.878296 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b686e10-45a0-4b18-89ee-9a7c7cac0809 admin admin] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:02:06.878296 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b686e10-45a0-4b18-89ee-9a7c7cac0809 admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:02:06.878296 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b686e10-45a0-4b18-89ee-9a7c7cac0809 admin admin] PATH_INFO: `/v3/users` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:02:06.880952 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b686e10-45a0-4b18-89ee-9a7c7cac0809 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:02:06.883386 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b686e10-45a0-4b18-89ee-9a7c7cac0809 admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:02:06.909657 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 864/1711] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Sep 15 18:02:06 2022] PUT /identity/v3/projects/f2e424016f6a4db8aa09e95f7998209a/users/1c9a8e60df594b6abb22e5bd30c598b3/roles/a9e42be86923434f8af52d3fc07fb4f7 => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 18:02:06.913791 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086a82cc-d892-4d0b-a9a9-74f3a16fdd58 admin admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:02:06.940110 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 848/1712] 10.222.0.25 () {60 vars in 1144 bytes} [Thu Sep 15 18:02:06 2022] POST /identity/v3/users => generated 296 bytes in 262 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 18:02:06.941019 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b686e10-45a0-4b18-89ee-9a7c7cac0809 admin admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:02:06.967631 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b686e10-45a0-4b18-89ee-9a7c7cac0809 admin admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:02:07.142933 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffac1601-3e37-4568-b142-48d086e5df66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:02:07.143579 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffac1601-3e37-4568-b142-48d086e5df66 admin admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:02:07.143867 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffac1601-3e37-4568-b142-48d086e5df66 admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:02:07.150497 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086a82cc-d892-4d0b-a9a9-74f3a16fdd58 admin admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:02:07.152099 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffac1601-3e37-4568-b142-48d086e5df66 admin admin] PATH_INFO: `/v3/roles` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:02:07.153987 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffac1601-3e37-4568-b142-48d086e5df66 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:02:07.158967 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffac1601-3e37-4568-b142-48d086e5df66 admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:02:07.163820 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14e187b-8918-4fc9-bc69-6f5b239351fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:02:07.165065 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14e187b-8918-4fc9-bc69-6f5b239351fa admin admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:02:07.165745 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14e187b-8918-4fc9-bc69-6f5b239351fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:02:07.166713 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14e187b-8918-4fc9-bc69-6f5b239351fa admin admin] PATH_INFO: `/v3/roles` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:02:07.169002 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14e187b-8918-4fc9-bc69-6f5b239351fa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:02:07.173085 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14e187b-8918-4fc9-bc69-6f5b239351fa admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:02:07.191029 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 865/1713] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Sep 15 18:02:06 2022] GET /identity/v3/roles => generated 1420 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 15 18:02:07.192487 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edc0311-8198-4536-af81-952f7068b4f4 None None] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:02:07.194549 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edc0311-8198-4536-af81-952f7068b4f4 None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:02:07.194981 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edc0311-8198-4536-af81-952f7068b4f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:02:07.210444 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 849/1714] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Sep 15 18:02:06 2022] GET /identity/v3/roles => generated 1420 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 18:02:07.211434 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffac1601-3e37-4568-b142-48d086e5df66 admin admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:02:07.241891 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffac1601-3e37-4568-b142-48d086e5df66 admin admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:02:07.278834 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30013862-8d39-4154-873c-7bf008786c6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:02:07.279673 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30013862-8d39-4154-873c-7bf008786c6f admin admin] REQUEST_METHOD: `PUT` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:02:07.280061 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30013862-8d39-4154-873c-7bf008786c6f admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:02:07.287980 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30013862-8d39-4154-873c-7bf008786c6f admin admin] PATH_INFO: `/v3/projects/f2e424016f6a4db8aa09e95f7998209a/users/1c9a8e60df594b6abb22e5bd30c598b3/roles/a9e42be86923434f8af52d3fc07fb4f7` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:02:07.302857 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30013862-8d39-4154-873c-7bf008786c6f admin admin] RBAC: Authorizing `identity:create_grant(project_id=f2e424016f6a4db8aa09e95f7998209a, user_id=1c9a8e60df594b6abb22e5bd30c598b3, role_id=a9e42be86923434f8af52d3fc07fb4f7)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:02:07.307221 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30013862-8d39-4154-873c-7bf008786c6f admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:02:07.338058 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.auth.core [None req-4edc0311-8198-4536-af81-952f7068b4f4 None None] MFA Rules not processed for user `d899ec4fcbeb4de382c7f0a779ca8ed5`. Rule list: `[]` (Enabled: `True`). {{(pid=81593) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 18:02:07.342666 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-4edc0311-8198-4536-af81-952f7068b4f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:02:07.354898 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 850/1715] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Sep 15 18:02:07 2022] PUT /identity/v3/projects/f2e424016f6a4db8aa09e95f7998209a/users/1c9a8e60df594b6abb22e5bd30c598b3/roles/a9e42be86923434f8af52d3fc07fb4f7 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 18:02:07.357312 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30013862-8d39-4154-873c-7bf008786c6f admin admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:02:07.636397 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 18:02:07.646383 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 866/1716] 10.222.0.25 () {58 vars in 1009 bytes} [Thu Sep 15 18:02:07 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 454 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 18:02:07.661511 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df94cec-3ef2-4fb0-8bd8-60d2346a6020 None None] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:02:07.663681 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df94cec-3ef2-4fb0-8bd8-60d2346a6020 None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:02:07.666366 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30013862-8d39-4154-873c-7bf008786c6f admin admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:02:07.667712 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df94cec-3ef2-4fb0-8bd8-60d2346a6020 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:02:07.716244 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a21c20e-e38f-49de-ac8c-1ada0aa7a887 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:02:07.722807 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a21c20e-e38f-49de-ac8c-1ada0aa7a887 admin admin] REQUEST_METHOD: `PUT` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:02:07.728454 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a21c20e-e38f-49de-ac8c-1ada0aa7a887 admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:02:07.729233 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a21c20e-e38f-49de-ac8c-1ada0aa7a887 admin admin] PATH_INFO: `/v3/projects/37cf2ad05d8e4f3994c14f1477fe5e17/users/ea5f9d7267044ec8851ea0f3a7db280c/roles/a9e42be86923434f8af52d3fc07fb4f7` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:02:07.746094 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.auth.core [None req-0df94cec-3ef2-4fb0-8bd8-60d2346a6020 None None] MFA Rules not processed for user `db4da97ae9284046b5d1667bee32f821`. Rule list: `[]` (Enabled: `True`). {{(pid=81593) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 18:02:07.747581 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-0df94cec-3ef2-4fb0-8bd8-60d2346a6020 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:02:07.763518 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a21c20e-e38f-49de-ac8c-1ada0aa7a887 admin admin] RBAC: Authorizing `identity:create_grant(project_id=37cf2ad05d8e4f3994c14f1477fe5e17, user_id=ea5f9d7267044ec8851ea0f3a7db280c, role_id=a9e42be86923434f8af52d3fc07fb4f7)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:02:07.769727 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a21c20e-e38f-49de-ac8c-1ada0aa7a887 admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:02:07.816555 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 851/1717] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Sep 15 18:02:07 2022] PUT /identity/v3/projects/37cf2ad05d8e4f3994c14f1477fe5e17/users/ea5f9d7267044ec8851ea0f3a7db280c/roles/a9e42be86923434f8af52d3fc07fb4f7 => generated 0 bytes in 461 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 18:02:07.825110 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fbe277-8ee5-4893-9085-40f78c1748e7 None None] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:02:07.825744 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fbe277-8ee5-4893-9085-40f78c1748e7 None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:02:07.826261 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fbe277-8ee5-4893-9085-40f78c1748e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:02:07.857132 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 18:02:07.972274 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.auth.core [None req-c8fbe277-8ee5-4893-9085-40f78c1748e7 None None] MFA Rules not processed for user `1c9a8e60df594b6abb22e5bd30c598b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81592) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 18:02:07.973893 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 867/1718] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 15 18:02:07 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 322 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 18:02:07.974847 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df94cec-3ef2-4fb0-8bd8-60d2346a6020 None None] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:02:07.975233 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-c8fbe277-8ee5-4893-9085-40f78c1748e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:02:07.985143 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-0df94cec-3ef2-4fb0-8bd8-60d2346a6020 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:02:08.020945 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df94cec-3ef2-4fb0-8bd8-60d2346a6020 None None] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:02:08.185721 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 852/1719] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 15 18:02:07 2022] POST /identity/v3/auth/tokens => generated 3347 bytes in 368 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 18:02:08.187068 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8fbe277-8ee5-4893-9085-40f78c1748e7 None None] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:02:08.220071 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0757bc-6cf6-48e6-8fb8-be8545d32c0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:02:08.221062 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0757bc-6cf6-48e6-8fb8-be8545d32c0a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:02:08.221540 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0757bc-6cf6-48e6-8fb8-be8545d32c0a admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:02:08.231461 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0757bc-6cf6-48e6-8fb8-be8545d32c0a admin admin] PATH_INFO: `/v3/projects/362f5c0382754bddb4f875b7e04b7b7e` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:02:08.232834 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b0757bc-6cf6-48e6-8fb8-be8545d32c0a admin admin] RBAC: Authorizing `identity:delete_project(project_id=362f5c0382754bddb4f875b7e04b7b7e)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:02:08.234839 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b0757bc-6cf6-48e6-8fb8-be8545d32c0a admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:02:08.303576 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8fbe277-8ee5-4893-9085-40f78c1748e7 None None] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:02:08.353969 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-5b0757bc-6cf6-48e6-8fb8-be8545d32c0a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '362f5c0382754bddb4f875b7e04b7b7e', 'request_id': 'req-5b0757bc-6cf6-48e6-8fb8-be8545d32c0a'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:02:08.378948 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-5b0757bc-6cf6-48e6-8fb8-be8545d32c0a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '362f5c0382754bddb4f875b7e04b7b7e', 'request_id': 'req-5b0757bc-6cf6-48e6-8fb8-be8545d32c0a'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:02:08.394019 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-5b0757bc-6cf6-48e6-8fb8-be8545d32c0a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '362f5c0382754bddb4f875b7e04b7b7e', 'request_id': 'req-5b0757bc-6cf6-48e6-8fb8-be8545d32c0a'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:02:08.404034 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf37bee-24d5-4fc4-88d8-0ca0d9431b8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:02:08.407864 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf37bee-24d5-4fc4-88d8-0ca0d9431b8d admin admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:02:08.408611 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf37bee-24d5-4fc4-88d8-0ca0d9431b8d admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:02:08.410074 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf37bee-24d5-4fc4-88d8-0ca0d9431b8d admin admin] PATH_INFO: `/v3/roles` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:02:08.411491 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf37bee-24d5-4fc4-88d8-0ca0d9431b8d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:02:08.415835 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-5b0757bc-6cf6-48e6-8fb8-be8545d32c0a admin admin] The token cache is being invalidate because project 362f5c0382754bddb4f875b7e04b7b7e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81593) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 18:02:08.416159 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-5b0757bc-6cf6-48e6-8fb8-be8545d32c0a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:02:08.416846 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-5b0757bc-6cf6-48e6-8fb8-be8545d32c0a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:02:08.418936 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf37bee-24d5-4fc4-88d8-0ca0d9431b8d admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:02:08.419056 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 868/1720] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Sep 15 18:02:07 2022] DELETE /identity/v3/projects/362f5c0382754bddb4f875b7e04b7b7e => generated 0 bytes in 445 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 18:02:08.419808 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0757bc-6cf6-48e6-8fb8-be8545d32c0a admin admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:02:08.424903 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-5b0757bc-6cf6-48e6-8fb8-be8545d32c0a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:02:08.492088 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 18:02:08.497514 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 853/1721] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Sep 15 18:02:08 2022] GET /identity/v3/roles => generated 1420 bytes in 308 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 18:02:08.497514 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5696481e-d30f-4b8a-81c5-9789f6dc461d None None] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:02:08.497514 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5696481e-d30f-4b8a-81c5-9789f6dc461d None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:02:08.497514 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5696481e-d30f-4b8a-81c5-9789f6dc461d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:02:08.596418 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.auth.core [None req-5696481e-d30f-4b8a-81c5-9789f6dc461d None None] MFA Rules not processed for user `db4da97ae9284046b5d1667bee32f821`. Rule list: `[]` (Enabled: `True`). {{(pid=81592) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 18:02:08.607848 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-5696481e-d30f-4b8a-81c5-9789f6dc461d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:02:08.685135 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 18:02:08.689749 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0757bc-6cf6-48e6-8fb8-be8545d32c0a admin admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:02:08.705032 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b039a5-101b-4da6-ad26-4cef50628f90 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '685f7ad4c6fe4c878d542dddd6d81593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1213c0d1b584404ba3998e136f166e89', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:02:08.705703 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b039a5-101b-4da6-ad26-4cef50628f90 service swift] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:02:08.706248 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b039a5-101b-4da6-ad26-4cef50628f90 service swift] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:02:08.707116 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b039a5-101b-4da6-ad26-4cef50628f90 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:02:08.714503 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-f5b039a5-101b-4da6-ad26-4cef50628f90 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:02:08.756648 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 854/1722] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 15 18:02:08 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 262 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 18:02:08.758079 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3660dad1-e382-4ef6-8e3d-779717992a17 None None] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:02:08.761482 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3660dad1-e382-4ef6-8e3d-779717992a17 None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:02:08.761890 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3660dad1-e382-4ef6-8e3d-779717992a17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:02:08.815323 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.auth.core [None req-3660dad1-e382-4ef6-8e3d-779717992a17 None None] MFA Rules not processed for user `49761e1a87dc495eae27fe1b8f509ae7`. Rule list: `[]` (Enabled: `True`). {{(pid=81592) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 18:02:08.816742 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-3660dad1-e382-4ef6-8e3d-779717992a17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:02:08.856514 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b039a5-101b-4da6-ad26-4cef50628f90 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:02:08.858556 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b039a5-101b-4da6-ad26-4cef50628f90 service swift] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:02:08.887181 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 869/1723] 10.222.0.25 () {60 vars in 1384 bytes} [Thu Sep 15 18:02:08 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 468 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 15 18:02:08.888070 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b039a5-101b-4da6-ad26-4cef50628f90 service swift] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:02:08.895455 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-f5b039a5-101b-4da6-ad26-4cef50628f90 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:02:08.970670 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 855/1724] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 15 18:02:08 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 18:02:08.973020 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42a3cb8-6d2d-4b54-b837-f5143fdc81d5 None None] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:02:08.973181 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42a3cb8-6d2d-4b54-b837-f5143fdc81d5 None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:02:08.973510 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42a3cb8-6d2d-4b54-b837-f5143fdc81d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:02:09.033109 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.auth.core [None req-f42a3cb8-6d2d-4b54-b837-f5143fdc81d5 None None] MFA Rules not processed for user `5cfa58ef86774ab7800bf91930bf6028`. Rule list: `[]` (Enabled: `True`). {{(pid=81592) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 18:02:09.034997 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-f42a3cb8-6d2d-4b54-b837-f5143fdc81d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:02:09.071875 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 856/1725] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 15 18:02:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 18:02:09.084410 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42a3cb8-6d2d-4b54-b837-f5143fdc81d5 None None] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:02:09.091034 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-f42a3cb8-6d2d-4b54-b837-f5143fdc81d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:02:09.126453 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42a3cb8-6d2d-4b54-b837-f5143fdc81d5 None None] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:02:09.138319 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58997bb3-fbb3-468e-8ca9-637df9cbcdcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:02:09.139374 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58997bb3-fbb3-468e-8ca9-637df9cbcdcc admin admin] REQUEST_METHOD: `PUT` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:02:09.139869 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58997bb3-fbb3-468e-8ca9-637df9cbcdcc admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:02:09.140406 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58997bb3-fbb3-468e-8ca9-637df9cbcdcc admin admin] PATH_INFO: `/v3/projects/37cf2ad05d8e4f3994c14f1477fe5e17/users/ea5f9d7267044ec8851ea0f3a7db280c/roles/a9e42be86923434f8af52d3fc07fb4f7` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:02:09.149014 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58997bb3-fbb3-468e-8ca9-637df9cbcdcc admin admin] RBAC: Authorizing `identity:create_grant(project_id=37cf2ad05d8e4f3994c14f1477fe5e17, user_id=ea5f9d7267044ec8851ea0f3a7db280c, role_id=a9e42be86923434f8af52d3fc07fb4f7)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:02:09.165779 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58997bb3-fbb3-468e-8ca9-637df9cbcdcc admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:02:09.201310 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 857/1726] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Sep 15 18:02:09 2022] PUT /identity/v3/projects/37cf2ad05d8e4f3994c14f1477fe5e17/users/ea5f9d7267044ec8851ea0f3a7db280c/roles/a9e42be86923434f8af52d3fc07fb4f7 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 18:02:09.207696 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0e84af-3b19-4510-9e54-049ed4da8b59 None None] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:02:09.208405 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0e84af-3b19-4510-9e54-049ed4da8b59 None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:02:09.213602 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0e84af-3b19-4510-9e54-049ed4da8b59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:02:09.214407 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b039a5-101b-4da6-ad26-4cef50628f90 service swift] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:02:09.318000 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.auth.core [None req-4b0e84af-3b19-4510-9e54-049ed4da8b59 None None] MFA Rules not processed for user `6bdf6f7544264b0e840e7c95070c4153`. Rule list: `[]` (Enabled: `True`). {{(pid=81592) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 18:02:09.319407 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-4b0e84af-3b19-4510-9e54-049ed4da8b59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:02:09.531517 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 858/1727] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 15 18:02:09 2022] POST /identity/v3/auth/tokens => generated 3349 bytes in 329 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 18:02:09.532712 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0e84af-3b19-4510-9e54-049ed4da8b59 None None] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:02:09.554914 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-4b0e84af-3b19-4510-9e54-049ed4da8b59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:02:09.576367 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9211af70-0232-455a-8ee2-91974e40533e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b232e7a841145ba93c6d8462ccb751a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1213c0d1b584404ba3998e136f166e89', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:02:09.577730 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9211af70-0232-455a-8ee2-91974e40533e service cinder] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:02:09.578163 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9211af70-0232-455a-8ee2-91974e40533e service cinder] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:02:09.578585 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9211af70-0232-455a-8ee2-91974e40533e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:02:09.587095 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-9211af70-0232-455a-8ee2-91974e40533e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:02:09.612576 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 18:02:09.774504 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9211af70-0232-455a-8ee2-91974e40533e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:02:09.776889 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9211af70-0232-455a-8ee2-91974e40533e service cinder] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:02:09.806457 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 870/1728] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 15 18:02:08 2022] GET /identity/v3/auth/tokens => generated 3347 bytes in 919 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 18:02:09.810196 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf6ab53-e974-45bf-93b0-5450536d4f54 None None] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:02:09.817891 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf6ab53-e974-45bf-93b0-5450536d4f54 None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:02:09.817891 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf6ab53-e974-45bf-93b0-5450536d4f54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:02:09.867233 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 18:02:09.900473 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.auth.core [None req-8cf6ab53-e974-45bf-93b0-5450536d4f54 None None] MFA Rules not processed for user `5cfa58ef86774ab7800bf91930bf6028`. Rule list: `[]` (Enabled: `True`). {{(pid=81593) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 18:02:09.904085 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-8cf6ab53-e974-45bf-93b0-5450536d4f54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:02:10.062431 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0e84af-3b19-4510-9e54-049ed4da8b59 None None] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:02:10.088755 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48de0b40-af12-463e-b9b7-e7592df1fc05 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe2244818e4d4dca9c424cd078653e6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1213c0d1b584404ba3998e136f166e89', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:02:10.089745 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48de0b40-af12-463e-b9b7-e7592df1fc05 service nova] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:02:10.100090 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 871/1729] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 15 18:02:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 293 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 18:02:10.101879 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d12cba5-b7d2-4549-94b9-cd01bf3a12f3 None None] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:02:10.108019 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d12cba5-b7d2-4549-94b9-cd01bf3a12f3 None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:02:10.108934 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48de0b40-af12-463e-b9b7-e7592df1fc05 service nova] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:02:10.109447 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48de0b40-af12-463e-b9b7-e7592df1fc05 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:02:10.110725 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d12cba5-b7d2-4549-94b9-cd01bf3a12f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:02:10.123540 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-48de0b40-af12-463e-b9b7-e7592df1fc05 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:02:10.197791 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.auth.core [None req-8d12cba5-b7d2-4549-94b9-cd01bf3a12f3 None None] MFA Rules not processed for user `a32274b4781b40fea9f28da8a9bde5ca`. Rule list: `[]` (Enabled: `True`). {{(pid=81593) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 18:02:10.199162 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-8d12cba5-b7d2-4549-94b9-cd01bf3a12f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:02:10.363773 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 872/1730] 10.222.0.27 () {58 vars in 1015 bytes} [Thu Sep 15 18:02:10 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 263 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 18:02:10.365402 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d03cab-c03c-41d9-88ab-3b557fc029c8 None None] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:02:10.365724 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d03cab-c03c-41d9-88ab-3b557fc029c8 None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:02:10.368625 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d03cab-c03c-41d9-88ab-3b557fc029c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:02:10.431496 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48de0b40-af12-463e-b9b7-e7592df1fc05 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:02:10.436310 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48de0b40-af12-463e-b9b7-e7592df1fc05 service nova] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:02:10.461148 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.auth.core [None req-b7d03cab-c03c-41d9-88ab-3b557fc029c8 None None] MFA Rules not processed for user `ea5f9d7267044ec8851ea0f3a7db280c`. Rule list: `[]` (Enabled: `True`). {{(pid=81593) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 18:02:10.464728 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-b7d03cab-c03c-41d9-88ab-3b557fc029c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:02:10.472146 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 859/1731] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 15 18:02:09 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 940 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 18:02:10.474254 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48de0b40-af12-463e-b9b7-e7592df1fc05 service nova] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:02:10.505477 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48de0b40-af12-463e-b9b7-e7592df1fc05 service nova] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:02:10.524489 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a568d31-a483-40ec-aa09-a70091bdde8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:02:10.525131 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a568d31-a483-40ec-aa09-a70091bdde8a admin admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:02:10.525451 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a568d31-a483-40ec-aa09-a70091bdde8a admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:02:10.525744 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a568d31-a483-40ec-aa09-a70091bdde8a admin admin] PATH_INFO: `/v3/domains` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:02:10.530141 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a568d31-a483-40ec-aa09-a70091bdde8a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81592) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 18:02:10.530509 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a568d31-a483-40ec-aa09-a70091bdde8a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:02:10.535888 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a568d31-a483-40ec-aa09-a70091bdde8a admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:02:10.575172 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 860/1732] 10.222.0.25 () {58 vars in 1153 bytes} [Thu Sep 15 18:02:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 18:02:10.577058 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2b6356-4f1c-45dc-9747-0000c353c8fe None None] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:02:10.577624 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2b6356-4f1c-45dc-9747-0000c353c8fe None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:02:10.578139 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2b6356-4f1c-45dc-9747-0000c353c8fe None None] PATH_INFO: `/` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:02:10.581978 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 861/1733] 10.222.0.25 () {54 vars in 912 bytes} [Thu Sep 15 18:02:10 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 18:02:10.583222 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2b6356-4f1c-45dc-9747-0000c353c8fe None None] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:02:10.585695 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-6a2b6356-4f1c-45dc-9747-0000c353c8fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:02:10.590542 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 18:02:10.621106 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2b6356-4f1c-45dc-9747-0000c353c8fe None None] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:02:10.638528 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f623be-0c89-47b9-9afa-f5473a6228fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:02:10.639424 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f623be-0c89-47b9-9afa-f5473a6228fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:02:10.642369 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f623be-0c89-47b9-9afa-f5473a6228fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:02:10.642675 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f623be-0c89-47b9-9afa-f5473a6228fe admin admin] PATH_INFO: `/v3/users/cf8aa375c4bd421e91f325f193b5a164` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:02:10.645944 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f623be-0c89-47b9-9afa-f5473a6228fe admin admin] RBAC: Authorizing `identity:delete_user(user_id=cf8aa375c4bd421e91f325f193b5a164)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:02:10.662587 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f623be-0c89-47b9-9afa-f5473a6228fe admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:02:10.668039 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 873/1734] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 15 18:02:10 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 300 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 18:02:10.668039 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d03cab-c03c-41d9-88ab-3b557fc029c8 None None] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:02:10.675131 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-b7d03cab-c03c-41d9-88ab-3b557fc029c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:02:10.706968 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d03cab-c03c-41d9-88ab-3b557fc029c8 None None] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:02:10.724288 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f279063-41ab-4064-98da-cdab4d443694 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a32274b4781b40fea9f28da8a9bde5ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1213c0d1b584404ba3998e136f166e89', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:02:10.725806 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f279063-41ab-4064-98da-cdab4d443694 service neutron] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:02:10.725806 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f279063-41ab-4064-98da-cdab4d443694 service neutron] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:02:10.725806 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f279063-41ab-4064-98da-cdab4d443694 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:02:10.748523 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f279063-41ab-4064-98da-cdab4d443694 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:02:10.750382 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f279063-41ab-4064-98da-cdab4d443694 service neutron] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:02:10.798041 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 874/1735] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 15 18:02:10 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 18:02:10.804882 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f279063-41ab-4064-98da-cdab4d443694 service neutron] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:02:10.870986 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f279063-41ab-4064-98da-cdab4d443694 service neutron] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:02:10.872095 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-b2f623be-0c89-47b9-9afa-f5473a6228fe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cf8aa375c4bd421e91f325f193b5a164'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:02:10.894020 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2df4e3-944e-471d-9b94-b349487040af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:02:10.900867 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2df4e3-944e-471d-9b94-b349487040af admin admin] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:02:10.902695 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2df4e3-944e-471d-9b94-b349487040af admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:02:10.903210 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-b2f623be-0c89-47b9-9afa-f5473a6228fe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cf8aa375c4bd421e91f325f193b5a164'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:02:10.905202 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-b2f623be-0c89-47b9-9afa-f5473a6228fe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cf8aa375c4bd421e91f325f193b5a164'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:02:10.905922 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2df4e3-944e-471d-9b94-b349487040af admin admin] PATH_INFO: `/v3/projects` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:02:10.909700 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2df4e3-944e-471d-9b94-b349487040af admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:02:10.913342 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2df4e3-944e-471d-9b94-b349487040af admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:02:10.913501 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-b2f623be-0c89-47b9-9afa-f5473a6228fe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cf8aa375c4bd421e91f325f193b5a164'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:02:10.964240 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-b2f623be-0c89-47b9-9afa-f5473a6228fe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cf8aa375c4bd421e91f325f193b5a164'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:02:11.065578 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 862/1736] 10.222.0.25 () {58 vars in 1224 bytes} [Thu Sep 15 18:02:10 2022] DELETE /identity/v3/users/cf8aa375c4bd421e91f325f193b5a164 => generated 0 bytes in 483 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 18:02:11.073835 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c517ce-f4ae-4a4c-a558-6d2130b2813f None None] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:02:11.074219 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c517ce-f4ae-4a4c-a558-6d2130b2813f None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:02:11.074439 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c517ce-f4ae-4a4c-a558-6d2130b2813f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:02:11.093422 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 875/1737] 10.222.0.25 () {60 vars in 1153 bytes} [Thu Sep 15 18:02:10 2022] POST /identity/v3/projects => generated 371 bytes in 295 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 18:02:11.103796 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2df4e3-944e-471d-9b94-b349487040af admin admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:02:11.117906 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-4a2df4e3-944e-471d-9b94-b349487040af admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:02:11.189135 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.auth.core [None req-74c517ce-f4ae-4a4c-a558-6d2130b2813f None None] MFA Rules not processed for user `a32274b4781b40fea9f28da8a9bde5ca`. Rule list: `[]` (Enabled: `True`). {{(pid=81592) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 18:02:11.198423 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-74c517ce-f4ae-4a4c-a558-6d2130b2813f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:02:11.307425 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2df4e3-944e-471d-9b94-b349487040af admin admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:02:11.322769 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641ca863-5c73-4ecf-b529-a4ca5badaf6a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b232e7a841145ba93c6d8462ccb751a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1213c0d1b584404ba3998e136f166e89', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:02:11.323792 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641ca863-5c73-4ecf-b529-a4ca5badaf6a service cinder] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:02:11.324072 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641ca863-5c73-4ecf-b529-a4ca5badaf6a service cinder] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:02:11.324348 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641ca863-5c73-4ecf-b529-a4ca5badaf6a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:02:11.331066 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-641ca863-5c73-4ecf-b529-a4ca5badaf6a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:02:11.357215 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 18:02:11.438307 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 863/1738] 10.222.0.25 () {58 vars in 1009 bytes} [Thu Sep 15 18:02:11 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 372 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 18:02:11.439370 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25215ad4-e017-42ba-86e3-60fac239fbaf None None] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:02:11.439763 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25215ad4-e017-42ba-86e3-60fac239fbaf None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:02:11.440226 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25215ad4-e017-42ba-86e3-60fac239fbaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:02:11.525524 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.auth.core [None req-25215ad4-e017-42ba-86e3-60fac239fbaf None None] MFA Rules not processed for user `5cfa58ef86774ab7800bf91930bf6028`. Rule list: `[]` (Enabled: `True`). {{(pid=81592) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 18:02:11.543699 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-25215ad4-e017-42ba-86e3-60fac239fbaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:02:11.549485 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641ca863-5c73-4ecf-b529-a4ca5badaf6a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:02:11.551043 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641ca863-5c73-4ecf-b529-a4ca5badaf6a service cinder] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:02:11.578006 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 876/1739] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 15 18:02:11 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 483 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 18:02:11.579515 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641ca863-5c73-4ecf-b529-a4ca5badaf6a service cinder] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:02:11.581602 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-641ca863-5c73-4ecf-b529-a4ca5badaf6a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:02:11.772092 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641ca863-5c73-4ecf-b529-a4ca5badaf6a service cinder] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:02:11.795885 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f87fc43-7348-4dff-b0ca-4eb1fdaaa774 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:02:11.796540 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f87fc43-7348-4dff-b0ca-4eb1fdaaa774 admin admin] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:02:11.796803 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f87fc43-7348-4dff-b0ca-4eb1fdaaa774 admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:02:11.797078 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f87fc43-7348-4dff-b0ca-4eb1fdaaa774 admin admin] PATH_INFO: `/v3/users` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:02:11.797820 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f87fc43-7348-4dff-b0ca-4eb1fdaaa774 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:02:11.799804 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f87fc43-7348-4dff-b0ca-4eb1fdaaa774 admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:02:11.815451 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 864/1740] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 15 18:02:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 377 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 18:02:11.822219 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25215ad4-e017-42ba-86e3-60fac239fbaf None None] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:02:11.833192 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-25215ad4-e017-42ba-86e3-60fac239fbaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:02:11.862331 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 18:02:11.899905 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25215ad4-e017-42ba-86e3-60fac239fbaf None None] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:02:11.930749 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 877/1741] 10.222.0.25 () {60 vars in 1144 bytes} [Thu Sep 15 18:02:11 2022] POST /identity/v3/users => generated 286 bytes in 352 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 18:02:11.931478 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1c478e-547d-4305-bdc4-cfaff50fd06b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a32274b4781b40fea9f28da8a9bde5ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1213c0d1b584404ba3998e136f166e89', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:02:11.938642 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1c478e-547d-4305-bdc4-cfaff50fd06b service neutron] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:02:11.939037 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1c478e-547d-4305-bdc4-cfaff50fd06b service neutron] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:02:11.939327 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1c478e-547d-4305-bdc4-cfaff50fd06b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:02:11.942447 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f87fc43-7348-4dff-b0ca-4eb1fdaaa774 admin admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:02:11.992003 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1c478e-547d-4305-bdc4-cfaff50fd06b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:02:11.994672 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f87fc43-7348-4dff-b0ca-4eb1fdaaa774 admin admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:02:12.000741 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1c478e-547d-4305-bdc4-cfaff50fd06b service neutron] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:02:12.022594 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f5e951-20bd-4306-b622-01c07d1633da service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a32274b4781b40fea9f28da8a9bde5ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1213c0d1b584404ba3998e136f166e89', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:02:12.023269 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f5e951-20bd-4306-b622-01c07d1633da service neutron] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:02:12.023635 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f5e951-20bd-4306-b622-01c07d1633da service neutron] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:02:12.023914 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f5e951-20bd-4306-b622-01c07d1633da service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:02:12.044980 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 865/1742] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 15 18:02:11 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 229 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 18:02:12.045999 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1c478e-547d-4305-bdc4-cfaff50fd06b service neutron] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:02:12.086668 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f5e951-20bd-4306-b622-01c07d1633da service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:02:12.094262 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f5e951-20bd-4306-b622-01c07d1633da service neutron] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:02:12.112879 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1c478e-547d-4305-bdc4-cfaff50fd06b service neutron] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:02:12.135258 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23b7f31-a674-47a0-a3f6-a8eeee52d835 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:02:12.135952 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23b7f31-a674-47a0-a3f6-a8eeee52d835 admin admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:02:12.136245 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23b7f31-a674-47a0-a3f6-a8eeee52d835 admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:02:12.136525 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23b7f31-a674-47a0-a3f6-a8eeee52d835 admin admin] PATH_INFO: `/v3/roles` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:02:12.137260 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23b7f31-a674-47a0-a3f6-a8eeee52d835 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:02:12.137761 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 878/1743] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 15 18:02:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 205 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 18:02:12.139448 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23b7f31-a674-47a0-a3f6-a8eeee52d835 admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:02:12.181633 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 866/1744] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Sep 15 18:02:12 2022] GET /identity/v3/roles => generated 1420 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 18:02:12.186080 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f5e951-20bd-4306-b622-01c07d1633da service neutron] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:02:12.201785 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f5e951-20bd-4306-b622-01c07d1633da service neutron] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:02:12.215936 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1535ddde-999a-49c9-9f2e-1a2e92c9e636 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:02:12.217213 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1535ddde-999a-49c9-9f2e-1a2e92c9e636 admin admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:02:12.217571 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1535ddde-999a-49c9-9f2e-1a2e92c9e636 admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:02:12.217859 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1535ddde-999a-49c9-9f2e-1a2e92c9e636 admin admin] PATH_INFO: `/v3/roles` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:02:12.225915 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1535ddde-999a-49c9-9f2e-1a2e92c9e636 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:02:12.247903 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1535ddde-999a-49c9-9f2e-1a2e92c9e636 admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:02:12.293435 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 879/1745] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Sep 15 18:02:12 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 18:02:12.294537 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23b7f31-a674-47a0-a3f6-a8eeee52d835 admin admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:02:12.307653 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23b7f31-a674-47a0-a3f6-a8eeee52d835 admin admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:02:12.355317 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da67b77-5841-4446-94e2-59277aa1882d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:02:12.356049 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da67b77-5841-4446-94e2-59277aa1882d admin admin] REQUEST_METHOD: `PUT` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:02:12.356389 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da67b77-5841-4446-94e2-59277aa1882d admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:02:12.356673 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da67b77-5841-4446-94e2-59277aa1882d admin admin] PATH_INFO: `/v3/projects/d0423231070d408c8ad82c32fd9cf4bd/users/d069ed5a66e64b4c91b2f55ed0c6681f/roles/343cc8b1bc7243eebabdf08147e8366d` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:02:12.461490 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da67b77-5841-4446-94e2-59277aa1882d admin admin] RBAC: Authorizing `identity:create_grant(project_id=d0423231070d408c8ad82c32fd9cf4bd, user_id=d069ed5a66e64b4c91b2f55ed0c6681f, role_id=343cc8b1bc7243eebabdf08147e8366d)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:02:12.464252 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da67b77-5841-4446-94e2-59277aa1882d admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:02:12.548295 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 867/1746] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Sep 15 18:02:12 2022] PUT /identity/v3/projects/d0423231070d408c8ad82c32fd9cf4bd/users/d069ed5a66e64b4c91b2f55ed0c6681f/roles/343cc8b1bc7243eebabdf08147e8366d => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 18:02:12.561599 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafcaf12-4759-4e59-9e13-9ea4186cd456 None None] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:02:12.562074 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafcaf12-4759-4e59-9e13-9ea4186cd456 None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:02:12.562493 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafcaf12-4759-4e59-9e13-9ea4186cd456 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:02:12.690998 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.auth.core [None req-eafcaf12-4759-4e59-9e13-9ea4186cd456 None None] MFA Rules not processed for user `d069ed5a66e64b4c91b2f55ed0c6681f`. Rule list: `[]` (Enabled: `True`). {{(pid=81593) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 18:02:12.692314 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-eafcaf12-4759-4e59-9e13-9ea4186cd456 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:02:12.906190 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84001e38-3736-49bb-aa97-506f9d91568c None None] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:02:12.907420 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84001e38-3736-49bb-aa97-506f9d91568c None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:02:12.907984 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84001e38-3736-49bb-aa97-506f9d91568c None None] PATH_INFO: `/` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:02:12.910818 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 868/1747] 10.222.0.25 () {54 vars in 921 bytes} [Thu Sep 15 18:02:12 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 18:02:13.042897 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 880/1748] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 15 18:02:12 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 482 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 18:02:13.047176 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84001e38-3736-49bb-aa97-506f9d91568c None None] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:02:13.109572 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9877bb97-b6d8-45c5-a30c-f93e3e1160ab None None] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:02:13.109857 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9877bb97-b6d8-45c5-a30c-f93e3e1160ab None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:02:13.110204 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9877bb97-b6d8-45c5-a30c-f93e3e1160ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:02:13.161155 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.auth.core [None req-9877bb97-b6d8-45c5-a30c-f93e3e1160ab None None] MFA Rules not processed for user `10af119bd39841ed8163993676230fca`. Rule list: `[]` (Enabled: `True`). {{(pid=81593) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 18:02:13.162031 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-9877bb97-b6d8-45c5-a30c-f93e3e1160ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:02:13.256787 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84001e38-3736-49bb-aa97-506f9d91568c None None] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:02:13.274170 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7583b27-0253-445e-a099-ecef8aa15f06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:02:13.275130 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7583b27-0253-445e-a099-ecef8aa15f06 admin admin] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:02:13.275593 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7583b27-0253-445e-a099-ecef8aa15f06 admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:02:13.276056 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7583b27-0253-445e-a099-ecef8aa15f06 admin admin] PATH_INFO: `/v3/projects` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:02:13.276850 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7583b27-0253-445e-a099-ecef8aa15f06 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:02:13.279133 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7583b27-0253-445e-a099-ecef8aa15f06 admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:02:13.375331 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 869/1749] 10.222.0.25 () {60 vars in 1153 bytes} [Thu Sep 15 18:02:13 2022] POST /identity/v3/projects => generated 373 bytes in 326 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 18:02:13.376571 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7583b27-0253-445e-a099-ecef8aa15f06 admin admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:02:13.475804 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 881/1750] 10.222.0.25 () {58 vars in 1018 bytes} [Thu Sep 15 18:02:13 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 367 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 18:02:13.489559 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 18:02:13.530455 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9877bb97-b6d8-45c5-a30c-f93e3e1160ab None None] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:02:13.533706 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-9877bb97-b6d8-45c5-a30c-f93e3e1160ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:02:13.569201 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9877bb97-b6d8-45c5-a30c-f93e3e1160ab None None] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:02:13.664978 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7583b27-0253-445e-a099-ecef8aa15f06 admin admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:02:13.716004 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2bc00a-746e-471f-bcb5-42c45171c83b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:02:13.717133 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2bc00a-746e-471f-bcb5-42c45171c83b admin admin] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:02:13.717605 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2bc00a-746e-471f-bcb5-42c45171c83b admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:02:13.718458 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2bc00a-746e-471f-bcb5-42c45171c83b admin admin] PATH_INFO: `/v3/users` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:02:13.719383 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b2bc00a-746e-471f-bcb5-42c45171c83b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:02:13.723253 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b2bc00a-746e-471f-bcb5-42c45171c83b admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:02:13.874737 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 870/1751] 10.222.0.25 () {60 vars in 1144 bytes} [Thu Sep 15 18:02:13 2022] POST /identity/v3/users => generated 293 bytes in 498 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 18:02:13.881122 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2bc00a-746e-471f-bcb5-42c45171c83b admin admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:02:13.894309 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 18:02:13.992088 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3444a7-e5b2-4e20-8228-9dea0b665818 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10af119bd39841ed8163993676230fca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1213c0d1b584404ba3998e136f166e89', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:02:13.994100 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3444a7-e5b2-4e20-8228-9dea0b665818 service placement] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:02:13.996676 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3444a7-e5b2-4e20-8228-9dea0b665818 service placement] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:02:13.998096 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3444a7-e5b2-4e20-8228-9dea0b665818 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:02:14.034721 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e3444a7-e5b2-4e20-8228-9dea0b665818 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:02:14.041362 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e3444a7-e5b2-4e20-8228-9dea0b665818 service placement] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:02:14.078134 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 882/1752] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 15 18:02:13 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 548 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 18:02:14.091978 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3444a7-e5b2-4e20-8228-9dea0b665818 service placement] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:02:14.180828 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3444a7-e5b2-4e20-8228-9dea0b665818 service placement] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:02:14.202894 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1b0a8d-784a-42d3-8d42-4226ad8f851f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:02:14.204319 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1b0a8d-784a-42d3-8d42-4226ad8f851f admin admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:02:14.213546 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1b0a8d-784a-42d3-8d42-4226ad8f851f admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:02:14.214021 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1b0a8d-784a-42d3-8d42-4226ad8f851f admin admin] PATH_INFO: `/v3/roles` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:02:14.215284 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1b0a8d-784a-42d3-8d42-4226ad8f851f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:02:14.220588 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2bc00a-746e-471f-bcb5-42c45171c83b admin admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:02:14.246142 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8f036e-3caf-450e-a65a-0861959c410b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b232e7a841145ba93c6d8462ccb751a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1213c0d1b584404ba3998e136f166e89', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:02:14.247437 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8f036e-3caf-450e-a65a-0861959c410b service cinder] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:02:14.247995 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8f036e-3caf-450e-a65a-0861959c410b service cinder] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:02:14.250390 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8f036e-3caf-450e-a65a-0861959c410b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:02:14.255192 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1b0a8d-784a-42d3-8d42-4226ad8f851f admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:02:14.259179 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-5a8f036e-3caf-450e-a65a-0861959c410b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:02:14.353425 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 883/1753] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Sep 15 18:02:14 2022] GET /identity/v3/roles => generated 1420 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 18:02:14.356989 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1b0a8d-784a-42d3-8d42-4226ad8f851f admin admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:02:14.404354 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1b0a8d-784a-42d3-8d42-4226ad8f851f admin admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:02:14.438544 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd16473a-b8c8-48d1-a654-162496bd5262 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:02:14.439662 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd16473a-b8c8-48d1-a654-162496bd5262 admin admin] REQUEST_METHOD: `PUT` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:02:14.440479 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd16473a-b8c8-48d1-a654-162496bd5262 admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:02:14.440629 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd16473a-b8c8-48d1-a654-162496bd5262 admin admin] PATH_INFO: `/v3/projects/bc1c7178f75f4767b66fd4a5b10641f1/users/123f9f62011a46b7ac725461d084d833/roles/a9e42be86923434f8af52d3fc07fb4f7` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:02:14.543150 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd16473a-b8c8-48d1-a654-162496bd5262 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bc1c7178f75f4767b66fd4a5b10641f1, user_id=123f9f62011a46b7ac725461d084d833, role_id=a9e42be86923434f8af52d3fc07fb4f7)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:02:14.548994 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd16473a-b8c8-48d1-a654-162496bd5262 admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:02:14.674946 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a8f036e-3caf-450e-a65a-0861959c410b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:02:14.676350 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 884/1754] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Sep 15 18:02:14 2022] PUT /identity/v3/projects/bc1c7178f75f4767b66fd4a5b10641f1/users/123f9f62011a46b7ac725461d084d833/roles/a9e42be86923434f8af52d3fc07fb4f7 => generated 0 bytes in 322 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 18:02:14.680844 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd16473a-b8c8-48d1-a654-162496bd5262 admin admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:02:14.687570 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a8f036e-3caf-450e-a65a-0861959c410b service cinder] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:02:14.759569 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 871/1755] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 15 18:02:13 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 881 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 18:02:14.977571 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd16473a-b8c8-48d1-a654-162496bd5262 admin admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:02:15.006266 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3e80fb-864a-4567-a12f-4b7049c88a71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:02:15.007457 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3e80fb-864a-4567-a12f-4b7049c88a71 admin admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:02:15.007967 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3e80fb-864a-4567-a12f-4b7049c88a71 admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:02:15.008416 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3e80fb-864a-4567-a12f-4b7049c88a71 admin admin] PATH_INFO: `/v3/roles` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:02:15.009332 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3e80fb-864a-4567-a12f-4b7049c88a71 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:02:15.017852 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3e80fb-864a-4567-a12f-4b7049c88a71 admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:02:15.053230 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 885/1756] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Sep 15 18:02:14 2022] GET /identity/v3/roles => generated 1420 bytes in 373 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 18:02:15.058695 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8f036e-3caf-450e-a65a-0861959c410b service cinder] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:02:15.107556 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8f036e-3caf-450e-a65a-0861959c410b service cinder] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:02:15.162415 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46b8251-b40b-4c01-b485-a268e2d25e01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:02:15.168418 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46b8251-b40b-4c01-b485-a268e2d25e01 admin admin] REQUEST_METHOD: `PUT` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:02:15.171902 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46b8251-b40b-4c01-b485-a268e2d25e01 admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:02:15.175062 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46b8251-b40b-4c01-b485-a268e2d25e01 admin admin] PATH_INFO: `/v3/projects/bc1c7178f75f4767b66fd4a5b10641f1/users/123f9f62011a46b7ac725461d084d833/roles/a9e42be86923434f8af52d3fc07fb4f7` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:02:15.191614 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d46b8251-b40b-4c01-b485-a268e2d25e01 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bc1c7178f75f4767b66fd4a5b10641f1, user_id=123f9f62011a46b7ac725461d084d833, role_id=a9e42be86923434f8af52d3fc07fb4f7)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:02:15.216768 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d46b8251-b40b-4c01-b485-a268e2d25e01 admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:02:15.310441 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3e80fb-864a-4567-a12f-4b7049c88a71 admin admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:02:15.312419 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-5e3e80fb-864a-4567-a12f-4b7049c88a71 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:02:15.321685 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 872/1757] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Sep 15 18:02:15 2022] PUT /identity/v3/projects/bc1c7178f75f4767b66fd4a5b10641f1/users/123f9f62011a46b7ac725461d084d833/roles/a9e42be86923434f8af52d3fc07fb4f7 => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 18:02:15.336632 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2809aec-bf75-44aa-b58f-b6512f4c37ae None None] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:02:15.337534 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2809aec-bf75-44aa-b58f-b6512f4c37ae None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:02:15.338315 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2809aec-bf75-44aa-b58f-b6512f4c37ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:02:15.339541 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3e80fb-864a-4567-a12f-4b7049c88a71 admin admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:02:15.474061 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa7b999-1bc7-4bbd-b8f1-2eaf9e26620e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:02:15.475249 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa7b999-1bc7-4bbd-b8f1-2eaf9e26620e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:02:15.475684 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa7b999-1bc7-4bbd-b8f1-2eaf9e26620e admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:02:15.476108 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa7b999-1bc7-4bbd-b8f1-2eaf9e26620e admin admin] PATH_INFO: `/v3/users/62b8d4beaf4446e8814c9fedee7078f2` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:02:15.481961 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa7b999-1bc7-4bbd-b8f1-2eaf9e26620e admin admin] RBAC: Authorizing `identity:delete_user(user_id=62b8d4beaf4446e8814c9fedee7078f2)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:02:15.484378 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa7b999-1bc7-4bbd-b8f1-2eaf9e26620e admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:02:15.524547 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.auth.core [None req-b2809aec-bf75-44aa-b58f-b6512f4c37ae None None] MFA Rules not processed for user `123f9f62011a46b7ac725461d084d833`. Rule list: `[]` (Enabled: `True`). {{(pid=81592) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 18:02:15.529214 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-b2809aec-bf75-44aa-b58f-b6512f4c37ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:02:15.617099 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-2aa7b999-1bc7-4bbd-b8f1-2eaf9e26620e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '62b8d4beaf4446e8814c9fedee7078f2'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:02:15.638292 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=92,keystone:INSERT=1,keystone:DELETE=7 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 18:02:15.639835 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-2aa7b999-1bc7-4bbd-b8f1-2eaf9e26620e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '62b8d4beaf4446e8814c9fedee7078f2'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:02:15.640673 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-2aa7b999-1bc7-4bbd-b8f1-2eaf9e26620e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '62b8d4beaf4446e8814c9fedee7078f2'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:02:15.641995 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-2aa7b999-1bc7-4bbd-b8f1-2eaf9e26620e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '62b8d4beaf4446e8814c9fedee7078f2'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:02:15.676742 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-2aa7b999-1bc7-4bbd-b8f1-2eaf9e26620e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '62b8d4beaf4446e8814c9fedee7078f2'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:02:15.730055 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 886/1758] 10.222.0.25 () {58 vars in 1224 bytes} [Thu Sep 15 18:02:15 2022] DELETE /identity/v3/users/62b8d4beaf4446e8814c9fedee7078f2 => generated 0 bytes in 417 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 15 18:02:15.731823 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ba2a71-446e-4b92-8377-7a23d2a9fa72 None None] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:02:15.741837 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ba2a71-446e-4b92-8377-7a23d2a9fa72 None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:02:15.742476 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ba2a71-446e-4b92-8377-7a23d2a9fa72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:02:15.792029 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.auth.core [None req-a9ba2a71-446e-4b92-8377-7a23d2a9fa72 None None] MFA Rules not processed for user `5cfa58ef86774ab7800bf91930bf6028`. Rule list: `[]` (Enabled: `True`). {{(pid=81593) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 18:02:15.793722 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-a9ba2a71-446e-4b92-8377-7a23d2a9fa72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:02:15.802583 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 18:02:15.929916 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 873/1759] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 15 18:02:15 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 590 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 18:02:15.934209 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2809aec-bf75-44aa-b58f-b6512f4c37ae None None] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:02:15.936333 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-b2809aec-bf75-44aa-b58f-b6512f4c37ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:02:15.937380 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 887/1760] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 15 18:02:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 18:02:15.938783 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ba2a71-446e-4b92-8377-7a23d2a9fa72 None None] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:02:15.939927 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-a9ba2a71-446e-4b92-8377-7a23d2a9fa72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:02:16.043837 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2809aec-bf75-44aa-b58f-b6512f4c37ae None None] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:02:16.072592 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ba2a71-446e-4b92-8377-7a23d2a9fa72 None None] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:02:16.073588 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02822c60-66bb-4d68-9c49-9bc7feb14c47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:02:16.076488 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02822c60-66bb-4d68-9c49-9bc7feb14c47 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:02:16.076780 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02822c60-66bb-4d68-9c49-9bc7feb14c47 admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:02:16.077063 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02822c60-66bb-4d68-9c49-9bc7feb14c47 admin admin] PATH_INFO: `/v3/users/2882c77c885f42bbba07e244ed076f0d` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:02:16.079948 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f3bbfc-4373-4023-b105-abc913bb19d8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b232e7a841145ba93c6d8462ccb751a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1213c0d1b584404ba3998e136f166e89', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:02:16.080588 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f3bbfc-4373-4023-b105-abc913bb19d8 service cinder] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:02:16.081005 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f3bbfc-4373-4023-b105-abc913bb19d8 service cinder] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:02:16.081328 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f3bbfc-4373-4023-b105-abc913bb19d8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:02:16.083647 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02822c60-66bb-4d68-9c49-9bc7feb14c47 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2882c77c885f42bbba07e244ed076f0d)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:02:16.103955 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02822c60-66bb-4d68-9c49-9bc7feb14c47 admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:02:16.326684 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-02822c60-66bb-4d68-9c49-9bc7feb14c47 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2882c77c885f42bbba07e244ed076f0d'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:02:16.334030 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f3bbfc-4373-4023-b105-abc913bb19d8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:02:16.336439 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f3bbfc-4373-4023-b105-abc913bb19d8 service cinder] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:02:16.342938 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-02822c60-66bb-4d68-9c49-9bc7feb14c47 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2882c77c885f42bbba07e244ed076f0d'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:02:16.344772 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-02822c60-66bb-4d68-9c49-9bc7feb14c47 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2882c77c885f42bbba07e244ed076f0d'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:02:16.345779 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-02822c60-66bb-4d68-9c49-9bc7feb14c47 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2882c77c885f42bbba07e244ed076f0d'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:02:16.360538 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 888/1761] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 15 18:02:15 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 423 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 18:02:16.362687 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f3bbfc-4373-4023-b105-abc913bb19d8 service cinder] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:02:16.367492 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-42f3bbfc-4373-4023-b105-abc913bb19d8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:02:16.367980 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-02822c60-66bb-4d68-9c49-9bc7feb14c47 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2882c77c885f42bbba07e244ed076f0d'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:02:16.412688 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 18:02:16.478157 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 874/1762] 10.222.0.25 () {58 vars in 1224 bytes} [Thu Sep 15 18:02:15 2022] DELETE /identity/v3/users/2882c77c885f42bbba07e244ed076f0d => generated 0 bytes in 552 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 18:02:16.564842 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02822c60-66bb-4d68-9c49-9bc7feb14c47 admin admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:02:16.566777 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f3bbfc-4373-4023-b105-abc913bb19d8 service cinder] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:02:16.566946 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-02822c60-66bb-4d68-9c49-9bc7feb14c47 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:02:16.745121 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1637dd8-7c4f-4dcc-a63a-dd3ea45a4f68 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a32274b4781b40fea9f28da8a9bde5ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1213c0d1b584404ba3998e136f166e89', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:02:16.751727 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1637dd8-7c4f-4dcc-a63a-dd3ea45a4f68 service neutron] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:02:16.751727 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1637dd8-7c4f-4dcc-a63a-dd3ea45a4f68 service neutron] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:02:16.753696 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1637dd8-7c4f-4dcc-a63a-dd3ea45a4f68 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:02:16.768291 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-d1637dd8-7c4f-4dcc-a63a-dd3ea45a4f68 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:02:16.917691 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02822c60-66bb-4d68-9c49-9bc7feb14c47 admin admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:02:16.936175 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878a2bf0-00f2-4ce5-99e0-fbcdebf4ec26 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b232e7a841145ba93c6d8462ccb751a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1213c0d1b584404ba3998e136f166e89', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:02:16.936564 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878a2bf0-00f2-4ce5-99e0-fbcdebf4ec26 service cinder] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:02:16.936852 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878a2bf0-00f2-4ce5-99e0-fbcdebf4ec26 service cinder] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:02:16.937132 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878a2bf0-00f2-4ce5-99e0-fbcdebf4ec26 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:02:16.964344 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-878a2bf0-00f2-4ce5-99e0-fbcdebf4ec26 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:02:16.973350 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1637dd8-7c4f-4dcc-a63a-dd3ea45a4f68 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:02:16.975150 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1637dd8-7c4f-4dcc-a63a-dd3ea45a4f68 service neutron] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:02:17.004101 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 889/1763] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 15 18:02:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 643 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 18:02:17.007106 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7cee24-7c0a-4c4f-a058-1657c9d42bcb None None] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:02:17.008861 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7cee24-7c0a-4c4f-a058-1657c9d42bcb None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:02:17.009229 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7cee24-7c0a-4c4f-a058-1657c9d42bcb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:02:17.057428 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.auth.core [None req-eb7cee24-7c0a-4c4f-a058-1657c9d42bcb None None] MFA Rules not processed for user `db4da97ae9284046b5d1667bee32f821`. Rule list: `[]` (Enabled: `True`). {{(pid=81593) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 18:02:17.061225 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-eb7cee24-7c0a-4c4f-a058-1657c9d42bcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:02:17.186359 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878a2bf0-00f2-4ce5-99e0-fbcdebf4ec26 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:02:17.196380 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878a2bf0-00f2-4ce5-99e0-fbcdebf4ec26 service cinder] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:02:17.241522 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 875/1764] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 15 18:02:16 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 678 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 18:02:17.321749 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 890/1765] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 15 18:02:17 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 317 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 18:02:17.550875 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878a2bf0-00f2-4ce5-99e0-fbcdebf4ec26 service cinder] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:02:17.554573 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-878a2bf0-00f2-4ce5-99e0-fbcdebf4ec26 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:02:17.587713 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878a2bf0-00f2-4ce5-99e0-fbcdebf4ec26 service cinder] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:02:17.629776 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9758c758-ff76-4ece-8e1a-3827253bcf8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:02:17.631642 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9758c758-ff76-4ece-8e1a-3827253bcf8d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:02:17.631931 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9758c758-ff76-4ece-8e1a-3827253bcf8d admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:02:17.632896 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9758c758-ff76-4ece-8e1a-3827253bcf8d admin admin] PATH_INFO: `/v3/projects/17319698db9a4fa29c452c6a779c43b3` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:02:17.636538 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9758c758-ff76-4ece-8e1a-3827253bcf8d admin admin] RBAC: Authorizing `identity:delete_project(project_id=17319698db9a4fa29c452c6a779c43b3)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:02:17.641970 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9758c758-ff76-4ece-8e1a-3827253bcf8d admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:02:17.646911 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 18:02:17.815162 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-9758c758-ff76-4ece-8e1a-3827253bcf8d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '17319698db9a4fa29c452c6a779c43b3', 'request_id': 'req-9758c758-ff76-4ece-8e1a-3827253bcf8d'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:02:17.827708 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-9758c758-ff76-4ece-8e1a-3827253bcf8d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '17319698db9a4fa29c452c6a779c43b3', 'request_id': 'req-9758c758-ff76-4ece-8e1a-3827253bcf8d'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:02:17.848349 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-9758c758-ff76-4ece-8e1a-3827253bcf8d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '17319698db9a4fa29c452c6a779c43b3', 'request_id': 'req-9758c758-ff76-4ece-8e1a-3827253bcf8d'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:02:17.870376 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-9758c758-ff76-4ece-8e1a-3827253bcf8d admin admin] The token cache is being invalidate because project 17319698db9a4fa29c452c6a779c43b3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81592) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 18:02:17.870693 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-9758c758-ff76-4ece-8e1a-3827253bcf8d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:02:17.872163 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-9758c758-ff76-4ece-8e1a-3827253bcf8d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:02:17.879080 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 876/1766] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Sep 15 18:02:17 2022] DELETE /identity/v3/projects/17319698db9a4fa29c452c6a779c43b3 => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 18:02:17.880711 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7cee24-7c0a-4c4f-a058-1657c9d42bcb None None] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:02:17.925414 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7cee24-7c0a-4c4f-a058-1657c9d42bcb None None] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:02:18.054323 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 18:02:18.176000 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a38c6d9-4ba8-409f-80e6-e8787d7034eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:02:18.179217 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a38c6d9-4ba8-409f-80e6-e8787d7034eb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:02:18.179501 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a38c6d9-4ba8-409f-80e6-e8787d7034eb admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:02:18.179784 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a38c6d9-4ba8-409f-80e6-e8787d7034eb admin admin] PATH_INFO: `/v3/users/6bdf6f7544264b0e840e7c95070c4153` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:02:18.188911 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a38c6d9-4ba8-409f-80e6-e8787d7034eb admin admin] RBAC: Authorizing `identity:delete_user(user_id=6bdf6f7544264b0e840e7c95070c4153)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:02:18.202819 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a38c6d9-4ba8-409f-80e6-e8787d7034eb admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:02:18.254460 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9758c758-ff76-4ece-8e1a-3827253bcf8d admin admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:02:18.256122 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-9758c758-ff76-4ece-8e1a-3827253bcf8d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:02:18.318455 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9758c758-ff76-4ece-8e1a-3827253bcf8d admin admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:02:18.344869 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a06c75-37ef-441d-8a33-ae1f62a4da6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:02:18.346383 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a06c75-37ef-441d-8a33-ae1f62a4da6a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:02:18.346667 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a06c75-37ef-441d-8a33-ae1f62a4da6a admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:02:18.346950 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a06c75-37ef-441d-8a33-ae1f62a4da6a admin admin] PATH_INFO: `/v3/projects/d662741309974eeb99a8507fe6d19889` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:02:18.363787 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a06c75-37ef-441d-8a33-ae1f62a4da6a admin admin] RBAC: Authorizing `identity:delete_project(project_id=d662741309974eeb99a8507fe6d19889)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:02:18.371363 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a06c75-37ef-441d-8a33-ae1f62a4da6a admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:02:18.400566 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-1a38c6d9-4ba8-409f-80e6-e8787d7034eb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6bdf6f7544264b0e840e7c95070c4153'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:02:18.426279 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-1a38c6d9-4ba8-409f-80e6-e8787d7034eb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6bdf6f7544264b0e840e7c95070c4153'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:02:18.427999 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-1a38c6d9-4ba8-409f-80e6-e8787d7034eb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6bdf6f7544264b0e840e7c95070c4153'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:02:18.429792 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-1a38c6d9-4ba8-409f-80e6-e8787d7034eb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6bdf6f7544264b0e840e7c95070c4153'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:02:18.440287 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-1a38c6d9-4ba8-409f-80e6-e8787d7034eb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6bdf6f7544264b0e840e7c95070c4153'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:02:18.479436 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 891/1767] 10.222.0.25 () {58 vars in 1224 bytes} [Thu Sep 15 18:02:17 2022] DELETE /identity/v3/users/6bdf6f7544264b0e840e7c95070c4153 => generated 0 bytes in 596 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 18:02:18.558152 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-d4a06c75-37ef-441d-8a33-ae1f62a4da6a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd662741309974eeb99a8507fe6d19889', 'request_id': 'req-d4a06c75-37ef-441d-8a33-ae1f62a4da6a'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:02:18.560999 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a38c6d9-4ba8-409f-80e6-e8787d7034eb admin admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:02:18.564307 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-1a38c6d9-4ba8-409f-80e6-e8787d7034eb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:02:18.574407 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-d4a06c75-37ef-441d-8a33-ae1f62a4da6a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd662741309974eeb99a8507fe6d19889', 'request_id': 'req-d4a06c75-37ef-441d-8a33-ae1f62a4da6a'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:02:18.592772 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-d4a06c75-37ef-441d-8a33-ae1f62a4da6a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd662741309974eeb99a8507fe6d19889', 'request_id': 'req-d4a06c75-37ef-441d-8a33-ae1f62a4da6a'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:02:18.644207 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-d4a06c75-37ef-441d-8a33-ae1f62a4da6a admin admin] The token cache is being invalidate because project d662741309974eeb99a8507fe6d19889 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81592) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 18:02:18.644921 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-d4a06c75-37ef-441d-8a33-ae1f62a4da6a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:02:18.646907 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-d4a06c75-37ef-441d-8a33-ae1f62a4da6a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:02:18.649683 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 877/1768] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Sep 15 18:02:18 2022] DELETE /identity/v3/projects/d662741309974eeb99a8507fe6d19889 => generated 0 bytes in 396 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 15 18:02:18.656834 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a06c75-37ef-441d-8a33-ae1f62a4da6a admin admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:02:18.659374 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-d4a06c75-37ef-441d-8a33-ae1f62a4da6a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:02:18.882102 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a06c75-37ef-441d-8a33-ae1f62a4da6a admin admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:02:18.891070 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5a5cb2-49bf-49c1-98af-4244932c55ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:02:18.891836 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5a5cb2-49bf-49c1-98af-4244932c55ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:02:18.892338 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5a5cb2-49bf-49c1-98af-4244932c55ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:02:18.892603 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a38c6d9-4ba8-409f-80e6-e8787d7034eb admin admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:02:18.893093 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5a5cb2-49bf-49c1-98af-4244932c55ce admin admin] PATH_INFO: `/v3/users/1c9a8e60df594b6abb22e5bd30c598b3` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:02:18.894799 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b5a5cb2-49bf-49c1-98af-4244932c55ce admin admin] RBAC: Authorizing `identity:delete_user(user_id=1c9a8e60df594b6abb22e5bd30c598b3)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:02:18.897309 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b5a5cb2-49bf-49c1-98af-4244932c55ce admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:02:18.914548 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e419d978-4fed-49e1-98ad-c5bf3d838227 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:02:18.915213 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e419d978-4fed-49e1-98ad-c5bf3d838227 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:02:18.915492 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e419d978-4fed-49e1-98ad-c5bf3d838227 admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:02:18.915761 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e419d978-4fed-49e1-98ad-c5bf3d838227 admin admin] PATH_INFO: `/v3/projects/badb7fd631594e8da127358e916d5a69` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:02:18.926793 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e419d978-4fed-49e1-98ad-c5bf3d838227 admin admin] RBAC: Authorizing `identity:delete_project(project_id=badb7fd631594e8da127358e916d5a69)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:02:18.933653 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e419d978-4fed-49e1-98ad-c5bf3d838227 admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:02:18.939817 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 18:02:19.057502 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-1b5a5cb2-49bf-49c1-98af-4244932c55ce admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1c9a8e60df594b6abb22e5bd30c598b3'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:02:19.071335 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-1b5a5cb2-49bf-49c1-98af-4244932c55ce admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1c9a8e60df594b6abb22e5bd30c598b3'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:02:19.072633 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-1b5a5cb2-49bf-49c1-98af-4244932c55ce admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1c9a8e60df594b6abb22e5bd30c598b3'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:02:19.074249 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-1b5a5cb2-49bf-49c1-98af-4244932c55ce admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1c9a8e60df594b6abb22e5bd30c598b3'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:02:19.098295 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-1b5a5cb2-49bf-49c1-98af-4244932c55ce admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1c9a8e60df594b6abb22e5bd30c598b3'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:02:19.125019 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 18:02:19.133542 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-e419d978-4fed-49e1-98ad-c5bf3d838227 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'badb7fd631594e8da127358e916d5a69', 'request_id': 'req-e419d978-4fed-49e1-98ad-c5bf3d838227'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:02:19.159684 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-e419d978-4fed-49e1-98ad-c5bf3d838227 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'badb7fd631594e8da127358e916d5a69', 'request_id': 'req-e419d978-4fed-49e1-98ad-c5bf3d838227'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:02:19.184542 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-e419d978-4fed-49e1-98ad-c5bf3d838227 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'badb7fd631594e8da127358e916d5a69', 'request_id': 'req-e419d978-4fed-49e1-98ad-c5bf3d838227'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:02:19.220266 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 878/1769] 10.222.0.25 () {58 vars in 1224 bytes} [Thu Sep 15 18:02:18 2022] DELETE /identity/v3/users/1c9a8e60df594b6abb22e5bd30c598b3 => generated 0 bytes in 564 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 18:02:19.222283 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5a5cb2-49bf-49c1-98af-4244932c55ce admin admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:02:19.230373 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-e419d978-4fed-49e1-98ad-c5bf3d838227 admin admin] The token cache is being invalidate because project badb7fd631594e8da127358e916d5a69 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81593) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 18:02:19.230690 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-e419d978-4fed-49e1-98ad-c5bf3d838227 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:02:19.232185 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-1b5a5cb2-49bf-49c1-98af-4244932c55ce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:02:19.233974 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-e419d978-4fed-49e1-98ad-c5bf3d838227 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:02:19.242901 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 892/1770] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Sep 15 18:02:18 2022] DELETE /identity/v3/projects/badb7fd631594e8da127358e916d5a69 => generated 0 bytes in 683 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 15 18:02:19.245097 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a1077d-2e20-43d2-8305-f1e29a85846b None None] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:02:19.249348 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a1077d-2e20-43d2-8305-f1e29a85846b None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:02:19.250884 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a1077d-2e20-43d2-8305-f1e29a85846b None None] PATH_INFO: `/` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:02:19.259193 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 893/1771] 10.222.0.25 () {54 vars in 921 bytes} [Thu Sep 15 18:02:19 2022] GET /identity => generated 270 bytes in 16 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 18:02:19.261283 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a1077d-2e20-43d2-8305-f1e29a85846b None None] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:02:19.269518 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-77a1077d-2e20-43d2-8305-f1e29a85846b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:02:19.575863 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5a5cb2-49bf-49c1-98af-4244932c55ce admin admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:02:19.589810 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888480d4-dd95-4b71-a8af-2cd09a75bc77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:02:19.592213 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888480d4-dd95-4b71-a8af-2cd09a75bc77 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:02:19.592900 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888480d4-dd95-4b71-a8af-2cd09a75bc77 admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:02:19.594084 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888480d4-dd95-4b71-a8af-2cd09a75bc77 admin admin] PATH_INFO: `/v3/projects/7adf9adc48c84a568e8203d220fc1068` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:02:19.597959 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-888480d4-dd95-4b71-a8af-2cd09a75bc77 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7adf9adc48c84a568e8203d220fc1068)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:02:19.603887 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-888480d4-dd95-4b71-a8af-2cd09a75bc77 admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:02:19.618842 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a1077d-2e20-43d2-8305-f1e29a85846b None None] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:02:19.638206 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adea3d01-4b87-43f0-96c7-821f0def0618 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:02:19.639282 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adea3d01-4b87-43f0-96c7-821f0def0618 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:02:19.639739 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adea3d01-4b87-43f0-96c7-821f0def0618 admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:02:19.640191 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adea3d01-4b87-43f0-96c7-821f0def0618 admin admin] PATH_INFO: `/v3/users/8a65cf96c0284afdb896a1dc1136a747` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:02:19.642349 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adea3d01-4b87-43f0-96c7-821f0def0618 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8a65cf96c0284afdb896a1dc1136a747)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:02:19.648413 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adea3d01-4b87-43f0-96c7-821f0def0618 admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:02:19.719754 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-888480d4-dd95-4b71-a8af-2cd09a75bc77 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7adf9adc48c84a568e8203d220fc1068', 'request_id': 'req-888480d4-dd95-4b71-a8af-2cd09a75bc77'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:02:19.738043 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-888480d4-dd95-4b71-a8af-2cd09a75bc77 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7adf9adc48c84a568e8203d220fc1068', 'request_id': 'req-888480d4-dd95-4b71-a8af-2cd09a75bc77'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:02:19.759095 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-888480d4-dd95-4b71-a8af-2cd09a75bc77 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7adf9adc48c84a568e8203d220fc1068', 'request_id': 'req-888480d4-dd95-4b71-a8af-2cd09a75bc77'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:02:19.828795 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-888480d4-dd95-4b71-a8af-2cd09a75bc77 admin admin] The token cache is being invalidate because project 7adf9adc48c84a568e8203d220fc1068 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81592) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 18:02:19.834014 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-888480d4-dd95-4b71-a8af-2cd09a75bc77 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:02:19.847378 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-888480d4-dd95-4b71-a8af-2cd09a75bc77 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:02:19.852108 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 879/1772] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Sep 15 18:02:19 2022] DELETE /identity/v3/projects/7adf9adc48c84a568e8203d220fc1068 => generated 0 bytes in 631 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 18:02:19.865243 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224388b0-9c8d-4759-b378-6d9d73f8bbb1 None None] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:02:19.865689 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224388b0-9c8d-4759-b378-6d9d73f8bbb1 None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:02:19.865847 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224388b0-9c8d-4759-b378-6d9d73f8bbb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:02:19.877528 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-adea3d01-4b87-43f0-96c7-821f0def0618 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8a65cf96c0284afdb896a1dc1136a747'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:02:19.902496 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-adea3d01-4b87-43f0-96c7-821f0def0618 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8a65cf96c0284afdb896a1dc1136a747'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:02:19.904481 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-adea3d01-4b87-43f0-96c7-821f0def0618 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8a65cf96c0284afdb896a1dc1136a747'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:02:19.906994 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-adea3d01-4b87-43f0-96c7-821f0def0618 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8a65cf96c0284afdb896a1dc1136a747'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:02:19.939492 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-adea3d01-4b87-43f0-96c7-821f0def0618 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8a65cf96c0284afdb896a1dc1136a747'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:02:20.008627 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.auth.core [None req-224388b0-9c8d-4759-b378-6d9d73f8bbb1 None None] MFA Rules not processed for user `fe2244818e4d4dca9c424cd078653e6a`. Rule list: `[]` (Enabled: `True`). {{(pid=81592) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 18:02:20.010159 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-224388b0-9c8d-4759-b378-6d9d73f8bbb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:02:20.037599 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 894/1773] 10.222.0.25 () {58 vars in 1224 bytes} [Thu Sep 15 18:02:19 2022] DELETE /identity/v3/users/8a65cf96c0284afdb896a1dc1136a747 => generated 0 bytes in 777 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 18:02:20.040619 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf0b20b-fc5e-4c2a-9b94-1525725a7c6f None None] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:02:20.040950 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf0b20b-fc5e-4c2a-9b94-1525725a7c6f None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:02:20.041240 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf0b20b-fc5e-4c2a-9b94-1525725a7c6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:02:20.071047 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 18:02:20.155716 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.auth.core [None req-1cf0b20b-fc5e-4c2a-9b94-1525725a7c6f None None] MFA Rules not processed for user `5cfa58ef86774ab7800bf91930bf6028`. Rule list: `[]` (Enabled: `True`). {{(pid=81593) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 18:02:20.162184 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-1cf0b20b-fc5e-4c2a-9b94-1525725a7c6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:02:20.216188 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 880/1774] 10.222.0.25 () {58 vars in 1018 bytes} [Thu Sep 15 18:02:19 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 363 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 18:02:20.217611 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224388b0-9c8d-4759-b378-6d9d73f8bbb1 None None] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:02:20.219237 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-224388b0-9c8d-4759-b378-6d9d73f8bbb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:02:20.353536 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:DELETE=14,keystone:SELECT=84,keystone:INSERT=2 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 18:02:20.377748 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 895/1775] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 15 18:02:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 339 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 18:02:20.406086 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e15da03-02f3-4abb-bbb3-0d5330913cb8 None None] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:02:20.407663 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e15da03-02f3-4abb-bbb3-0d5330913cb8 None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:02:20.408179 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e15da03-02f3-4abb-bbb3-0d5330913cb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:02:20.476193 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224388b0-9c8d-4759-b378-6d9d73f8bbb1 None None] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:02:20.488044 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.auth.core [None req-0e15da03-02f3-4abb-bbb3-0d5330913cb8 None None] MFA Rules not processed for user `5cfa58ef86774ab7800bf91930bf6028`. Rule list: `[]` (Enabled: `True`). {{(pid=81593) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 18:02:20.489416 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-0e15da03-02f3-4abb-bbb3-0d5330913cb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:02:20.493948 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544b58a0-b68a-4444-aff2-36acab8bba32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:02:20.494837 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544b58a0-b68a-4444-aff2-36acab8bba32 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:02:20.495218 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544b58a0-b68a-4444-aff2-36acab8bba32 admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:02:20.495653 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544b58a0-b68a-4444-aff2-36acab8bba32 admin admin] PATH_INFO: `/v3/users/43d1caf1a47640878ce91c41cc566d4f` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:02:20.498376 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-544b58a0-b68a-4444-aff2-36acab8bba32 admin admin] RBAC: Authorizing `identity:delete_user(user_id=43d1caf1a47640878ce91c41cc566d4f)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:02:20.500478 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-544b58a0-b68a-4444-aff2-36acab8bba32 admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:02:20.517551 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 896/1776] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 15 18:02:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 18:02:20.522463 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e15da03-02f3-4abb-bbb3-0d5330913cb8 None None] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:02:20.565501 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e15da03-02f3-4abb-bbb3-0d5330913cb8 None None] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:02:20.592225 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7e816b-735c-47e5-b605-d3918c0b2637 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:02:20.593685 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7e816b-735c-47e5-b605-d3918c0b2637 admin admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:02:20.594828 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7e816b-735c-47e5-b605-d3918c0b2637 admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:02:20.595239 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7e816b-735c-47e5-b605-d3918c0b2637 admin admin] PATH_INFO: `/v3/domains` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:02:20.596196 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b7e816b-735c-47e5-b605-d3918c0b2637 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81593) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 18:02:20.597633 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b7e816b-735c-47e5-b605-d3918c0b2637 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:02:20.600797 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b7e816b-735c-47e5-b605-d3918c0b2637 admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:02:20.643408 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 897/1777] 10.222.0.25 () {58 vars in 1153 bytes} [Thu Sep 15 18:02:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 18:02:20.645015 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-544b58a0-b68a-4444-aff2-36acab8bba32 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '43d1caf1a47640878ce91c41cc566d4f'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:02:20.648228 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7e816b-735c-47e5-b605-d3918c0b2637 admin admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:02:20.677021 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-544b58a0-b68a-4444-aff2-36acab8bba32 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '43d1caf1a47640878ce91c41cc566d4f'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:02:20.678362 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-544b58a0-b68a-4444-aff2-36acab8bba32 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '43d1caf1a47640878ce91c41cc566d4f'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:02:20.679335 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-544b58a0-b68a-4444-aff2-36acab8bba32 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '43d1caf1a47640878ce91c41cc566d4f'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:02:20.691920 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7e816b-735c-47e5-b605-d3918c0b2637 admin admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:02:20.700832 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-544b58a0-b68a-4444-aff2-36acab8bba32 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '43d1caf1a47640878ce91c41cc566d4f'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:02:20.706228 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9135504-c842-4eb7-b4f0-912456e70c81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:02:20.706859 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9135504-c842-4eb7-b4f0-912456e70c81 admin admin] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:02:20.707135 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9135504-c842-4eb7-b4f0-912456e70c81 admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:02:20.707404 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9135504-c842-4eb7-b4f0-912456e70c81 admin admin] PATH_INFO: `/v3/projects` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:02:20.709012 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9135504-c842-4eb7-b4f0-912456e70c81 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:02:20.716491 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9135504-c842-4eb7-b4f0-912456e70c81 admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:02:20.767417 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 881/1778] 10.222.0.25 () {58 vars in 1224 bytes} [Thu Sep 15 18:02:20 2022] DELETE /identity/v3/users/43d1caf1a47640878ce91c41cc566d4f => generated 0 bytes in 550 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 18:02:20.772959 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb086c4-fba8-4e28-b174-16b6b2ffc10e None None] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:02:20.772959 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb086c4-fba8-4e28-b174-16b6b2ffc10e None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:02:20.773560 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb086c4-fba8-4e28-b174-16b6b2ffc10e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:02:20.818151 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 898/1779] 10.222.0.25 () {60 vars in 1153 bytes} [Thu Sep 15 18:02:20 2022] POST /identity/v3/projects => generated 381 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 18:02:20.822772 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9135504-c842-4eb7-b4f0-912456e70c81 admin admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:02:20.827976 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.auth.core [None req-abb086c4-fba8-4e28-b174-16b6b2ffc10e None None] MFA Rules not processed for user `5cfa58ef86774ab7800bf91930bf6028`. Rule list: `[]` (Enabled: `True`). {{(pid=81592) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 18:02:20.828653 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-f9135504-c842-4eb7-b4f0-912456e70c81 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:02:20.829957 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-abb086c4-fba8-4e28-b174-16b6b2ffc10e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:02:20.940406 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 18:02:20.991050 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9135504-c842-4eb7-b4f0-912456e70c81 admin admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:02:20.997551 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640dffd4-51c6-4c67-a277-b7b1e0fdfdec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:02:20.998527 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640dffd4-51c6-4c67-a277-b7b1e0fdfdec admin admin] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:02:20.999009 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640dffd4-51c6-4c67-a277-b7b1e0fdfdec admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:02:20.999476 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640dffd4-51c6-4c67-a277-b7b1e0fdfdec admin admin] PATH_INFO: `/v3/users` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:02:21.000554 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-640dffd4-51c6-4c67-a277-b7b1e0fdfdec admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:02:21.010116 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-640dffd4-51c6-4c67-a277-b7b1e0fdfdec admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:02:21.127969 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 899/1780] 10.222.0.25 () {60 vars in 1144 bytes} [Thu Sep 15 18:02:20 2022] POST /identity/v3/users => generated 291 bytes in 308 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 18:02:21.130170 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640dffd4-51c6-4c67-a277-b7b1e0fdfdec admin admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:02:21.168114 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640dffd4-51c6-4c67-a277-b7b1e0fdfdec admin admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:02:21.180333 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 882/1781] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 15 18:02:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 409 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 18:02:21.182328 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57b902b-8ca4-419b-84de-c30e6fb514d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:02:21.183400 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57b902b-8ca4-419b-84de-c30e6fb514d4 admin admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:02:21.183889 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57b902b-8ca4-419b-84de-c30e6fb514d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:02:21.185946 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57b902b-8ca4-419b-84de-c30e6fb514d4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:02:21.200817 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b57b902b-8ca4-419b-84de-c30e6fb514d4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:02:21.211618 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b57b902b-8ca4-419b-84de-c30e6fb514d4 admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:02:21.223942 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb086c4-fba8-4e28-b174-16b6b2ffc10e None None] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:02:21.227193 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-abb086c4-fba8-4e28-b174-16b6b2ffc10e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:02:21.290294 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 900/1782] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Sep 15 18:02:21 2022] GET /identity/v3/roles => generated 1420 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 18:02:21.302374 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57b902b-8ca4-419b-84de-c30e6fb514d4 admin admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:02:21.303515 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-b57b902b-8ca4-419b-84de-c30e6fb514d4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:02:21.462453 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57b902b-8ca4-419b-84de-c30e6fb514d4 admin admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:02:21.489950 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e95c23-f31b-4b0b-996e-447106cda0d6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a32274b4781b40fea9f28da8a9bde5ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1213c0d1b584404ba3998e136f166e89', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:02:21.490750 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e95c23-f31b-4b0b-996e-447106cda0d6 service neutron] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:02:21.491026 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e95c23-f31b-4b0b-996e-447106cda0d6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:02:21.491301 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e95c23-f31b-4b0b-996e-447106cda0d6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:02:21.508292 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb086c4-fba8-4e28-b174-16b6b2ffc10e None None] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:02:21.533414 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e95c23-f31b-4b0b-996e-447106cda0d6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:02:21.535949 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e95c23-f31b-4b0b-996e-447106cda0d6 service neutron] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:02:21.570308 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 901/1783] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 15 18:02:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 279 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 18:02:21.571468 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e95c23-f31b-4b0b-996e-447106cda0d6 service neutron] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:02:21.572255 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b55731-9232-42d4-aa11-0239c2e93a12 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe2244818e4d4dca9c424cd078653e6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1213c0d1b584404ba3998e136f166e89', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:02:21.573078 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b55731-9232-42d4-aa11-0239c2e93a12 service nova] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:02:21.575030 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b55731-9232-42d4-aa11-0239c2e93a12 service nova] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:02:21.575335 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b55731-9232-42d4-aa11-0239c2e93a12 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:02:21.587526 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-00b55731-9232-42d4-aa11-0239c2e93a12 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:02:21.612751 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e95c23-f31b-4b0b-996e-447106cda0d6 service neutron] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:02:21.634116 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c212bc-cddb-4468-a7e5-ff31048de61d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:02:21.635139 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c212bc-cddb-4468-a7e5-ff31048de61d admin admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:02:21.635626 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c212bc-cddb-4468-a7e5-ff31048de61d admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:02:21.640572 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c212bc-cddb-4468-a7e5-ff31048de61d admin admin] PATH_INFO: `/v3/roles` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:02:21.642405 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c212bc-cddb-4468-a7e5-ff31048de61d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:02:21.644365 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c212bc-cddb-4468-a7e5-ff31048de61d admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:02:21.646182 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b55731-9232-42d4-aa11-0239c2e93a12 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:02:21.647828 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b55731-9232-42d4-aa11-0239c2e93a12 service nova] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:02:21.673664 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 902/1784] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Sep 15 18:02:21 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 18:02:21.675147 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c212bc-cddb-4468-a7e5-ff31048de61d admin admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:02:21.677634 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 883/1785] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 15 18:02:21 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 454 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 18:02:21.678506 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b55731-9232-42d4-aa11-0239c2e93a12 service nova] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:02:21.681943 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-c1c212bc-cddb-4468-a7e5-ff31048de61d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:02:21.756593 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c212bc-cddb-4468-a7e5-ff31048de61d admin admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:02:21.810052 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d063651-a756-457a-b467-9de1aaca961e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:02:21.810299 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b55731-9232-42d4-aa11-0239c2e93a12 service nova] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:02:21.813828 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d063651-a756-457a-b467-9de1aaca961e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:02:21.818993 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d063651-a756-457a-b467-9de1aaca961e admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:02:21.821212 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d063651-a756-457a-b467-9de1aaca961e admin admin] PATH_INFO: `/v3/projects/f2e424016f6a4db8aa09e95f7998209a` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:02:21.823175 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d063651-a756-457a-b467-9de1aaca961e admin admin] RBAC: Authorizing `identity:delete_project(project_id=f2e424016f6a4db8aa09e95f7998209a)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:02:21.841685 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d063651-a756-457a-b467-9de1aaca961e admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:02:21.851491 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81db30a-2d4d-4db2-887e-16e766ec0a5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:02:21.852215 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81db30a-2d4d-4db2-887e-16e766ec0a5f admin admin] REQUEST_METHOD: `PUT` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:02:21.852506 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81db30a-2d4d-4db2-887e-16e766ec0a5f admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:02:21.852769 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81db30a-2d4d-4db2-887e-16e766ec0a5f admin admin] PATH_INFO: `/v3/projects/867153f4779043beac4d86cd0a3f564a/users/0772d3e8a49f403bafaf858bb33dd204/roles/343cc8b1bc7243eebabdf08147e8366d` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:02:21.929040 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 18:02:21.935898 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a81db30a-2d4d-4db2-887e-16e766ec0a5f admin admin] RBAC: Authorizing `identity:create_grant(project_id=867153f4779043beac4d86cd0a3f564a, user_id=0772d3e8a49f403bafaf858bb33dd204, role_id=343cc8b1bc7243eebabdf08147e8366d)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:02:21.947739 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a81db30a-2d4d-4db2-887e-16e766ec0a5f admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:02:22.010996 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 884/1786] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Sep 15 18:02:21 2022] PUT /identity/v3/projects/867153f4779043beac4d86cd0a3f564a/users/0772d3e8a49f403bafaf858bb33dd204/roles/343cc8b1bc7243eebabdf08147e8366d => generated 0 bytes in 331 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 18:02:22.031168 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81db30a-2d4d-4db2-887e-16e766ec0a5f admin admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:02:22.042202 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-a81db30a-2d4d-4db2-887e-16e766ec0a5f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:02:22.079170 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-9d063651-a756-457a-b467-9de1aaca961e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f2e424016f6a4db8aa09e95f7998209a', 'request_id': 'req-9d063651-a756-457a-b467-9de1aaca961e'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:02:22.101697 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-9d063651-a756-457a-b467-9de1aaca961e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f2e424016f6a4db8aa09e95f7998209a', 'request_id': 'req-9d063651-a756-457a-b467-9de1aaca961e'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:02:22.128473 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-9d063651-a756-457a-b467-9de1aaca961e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f2e424016f6a4db8aa09e95f7998209a', 'request_id': 'req-9d063651-a756-457a-b467-9de1aaca961e'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:02:22.202420 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-9d063651-a756-457a-b467-9de1aaca961e admin admin] The token cache is being invalidate because project f2e424016f6a4db8aa09e95f7998209a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81593) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 18:02:22.203062 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-9d063651-a756-457a-b467-9de1aaca961e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:02:22.205110 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-9d063651-a756-457a-b467-9de1aaca961e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:02:22.208972 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 903/1787] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Sep 15 18:02:21 2022] DELETE /identity/v3/projects/f2e424016f6a4db8aa09e95f7998209a => generated 0 bytes in 534 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 18:02:22.211242 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74f68c7-dc68-438c-b49c-3b3e8283bcad None None] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:02:22.213702 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74f68c7-dc68-438c-b49c-3b3e8283bcad None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:02:22.214833 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74f68c7-dc68-438c-b49c-3b3e8283bcad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:02:22.301526 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81db30a-2d4d-4db2-887e-16e766ec0a5f admin admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:02:22.318910 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.auth.core [None req-f74f68c7-dc68-438c-b49c-3b3e8283bcad None None] MFA Rules not processed for user `0772d3e8a49f403bafaf858bb33dd204`. Rule list: `[]` (Enabled: `True`). {{(pid=81593) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 18:02:22.329696 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-f74f68c7-dc68-438c-b49c-3b3e8283bcad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:02:22.535624 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 18:02:22.572491 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac20e20f-b9c5-45a7-9752-4286aaf0be95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:02:22.573694 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac20e20f-b9c5-45a7-9752-4286aaf0be95 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:02:22.574313 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac20e20f-b9c5-45a7-9752-4286aaf0be95 admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:02:22.574749 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac20e20f-b9c5-45a7-9752-4286aaf0be95 admin admin] PATH_INFO: `/v3/projects/6a63022d94a34796bf21e189c7a44f6f` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:02:22.589309 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac20e20f-b9c5-45a7-9752-4286aaf0be95 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6a63022d94a34796bf21e189c7a44f6f)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:02:22.601174 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 904/1788] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 15 18:02:22 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 391 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 18:02:22.603453 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6ed03d-db18-45dc-9cbd-613dbd383c41 None None] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:02:22.603741 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6ed03d-db18-45dc-9cbd-613dbd383c41 None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:02:22.604027 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6ed03d-db18-45dc-9cbd-613dbd383c41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:02:22.606537 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac20e20f-b9c5-45a7-9752-4286aaf0be95 admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:02:22.735417 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-ac20e20f-b9c5-45a7-9752-4286aaf0be95 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6a63022d94a34796bf21e189c7a44f6f', 'request_id': 'req-ac20e20f-b9c5-45a7-9752-4286aaf0be95'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:02:22.736555 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.auth.core [None req-7e6ed03d-db18-45dc-9cbd-613dbd383c41 None None] MFA Rules not processed for user `5cfa58ef86774ab7800bf91930bf6028`. Rule list: `[]` (Enabled: `True`). {{(pid=81593) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 18:02:22.744358 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-7e6ed03d-db18-45dc-9cbd-613dbd383c41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:02:22.744935 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-ac20e20f-b9c5-45a7-9752-4286aaf0be95 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6a63022d94a34796bf21e189c7a44f6f', 'request_id': 'req-ac20e20f-b9c5-45a7-9752-4286aaf0be95'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:02:22.763300 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-ac20e20f-b9c5-45a7-9752-4286aaf0be95 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6a63022d94a34796bf21e189c7a44f6f', 'request_id': 'req-ac20e20f-b9c5-45a7-9752-4286aaf0be95'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:02:22.795315 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-ac20e20f-b9c5-45a7-9752-4286aaf0be95 admin admin] The token cache is being invalidate because project 6a63022d94a34796bf21e189c7a44f6f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81592) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 18:02:22.800419 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-ac20e20f-b9c5-45a7-9752-4286aaf0be95 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:02:22.804230 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-ac20e20f-b9c5-45a7-9752-4286aaf0be95 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:02:22.810535 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 885/1789] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Sep 15 18:02:22 2022] DELETE /identity/v3/projects/6a63022d94a34796bf21e189c7a44f6f => generated 0 bytes in 785 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 18:02:22.818856 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac20e20f-b9c5-45a7-9752-4286aaf0be95 admin admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:02:22.824959 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-ac20e20f-b9c5-45a7-9752-4286aaf0be95 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:02:22.960077 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 905/1790] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 15 18:02:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 358 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 18:02:22.963985 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f2ac8e-ef15-4de1-8d02-ac40b4094a7a None None] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:02:22.964429 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f2ac8e-ef15-4de1-8d02-ac40b4094a7a None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:02:22.965226 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f2ac8e-ef15-4de1-8d02-ac40b4094a7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:02:23.040523 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.auth.core [None req-d8f2ac8e-ef15-4de1-8d02-ac40b4094a7a None None] MFA Rules not processed for user `5cfa58ef86774ab7800bf91930bf6028`. Rule list: `[]` (Enabled: `True`). {{(pid=81593) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 18:02:23.043501 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-d8f2ac8e-ef15-4de1-8d02-ac40b4094a7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:02:23.067199 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 906/1791] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 15 18:02:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 18:02:23.078552 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cae9596-dc21-4bb9-afe0-89f184e37b86 None None] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:02:23.080436 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cae9596-dc21-4bb9-afe0-89f184e37b86 None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:02:23.081002 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cae9596-dc21-4bb9-afe0-89f184e37b86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:02:23.106151 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac20e20f-b9c5-45a7-9752-4286aaf0be95 admin admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:02:23.117978 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a01e130-a195-45eb-8334-719aa679b194 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:02:23.118623 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a01e130-a195-45eb-8334-719aa679b194 admin admin] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:02:23.118906 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a01e130-a195-45eb-8334-719aa679b194 admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:02:23.127590 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a01e130-a195-45eb-8334-719aa679b194 admin admin] PATH_INFO: `/v3/projects` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:02:23.127590 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a01e130-a195-45eb-8334-719aa679b194 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:02:23.146714 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.auth.core [None req-2cae9596-dc21-4bb9-afe0-89f184e37b86 None None] MFA Rules not processed for user `5cfa58ef86774ab7800bf91930bf6028`. Rule list: `[]` (Enabled: `True`). {{(pid=81593) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 18:02:23.150066 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-2cae9596-dc21-4bb9-afe0-89f184e37b86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:02:23.161070 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a01e130-a195-45eb-8334-719aa679b194 admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:02:23.167262 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 907/1792] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 15 18:02:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 18:02:23.169048 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9243ea-6127-4a28-b267-d2d01ecffdbd None None] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:02:23.170241 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9243ea-6127-4a28-b267-d2d01ecffdbd None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:02:23.170912 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9243ea-6127-4a28-b267-d2d01ecffdbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:02:23.235564 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.auth.core [None req-9e9243ea-6127-4a28-b267-d2d01ecffdbd None None] MFA Rules not processed for user `5cfa58ef86774ab7800bf91930bf6028`. Rule list: `[]` (Enabled: `True`). {{(pid=81593) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 18:02:23.239309 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-9e9243ea-6127-4a28-b267-d2d01ecffdbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:02:23.261426 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 886/1793] 10.222.0.25 () {60 vars in 1153 bytes} [Thu Sep 15 18:02:22 2022] POST /identity/v3/projects => generated 381 bytes in 449 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 18:02:23.263177 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a01e130-a195-45eb-8334-719aa679b194 admin admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:02:23.277663 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 908/1794] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 15 18:02:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 18:02:23.282800 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9243ea-6127-4a28-b267-d2d01ecffdbd None None] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:02:23.309034 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9243ea-6127-4a28-b267-d2d01ecffdbd None None] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:02:23.343365 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 18:02:23.467623 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 18:02:23.480218 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a01e130-a195-45eb-8334-719aa679b194 admin admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:02:23.500420 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747b3de7-8095-460c-9d90-5eecdd0bae1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:02:23.501136 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747b3de7-8095-460c-9d90-5eecdd0bae1c admin admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:02:23.503191 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747b3de7-8095-460c-9d90-5eecdd0bae1c admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:02:23.503656 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747b3de7-8095-460c-9d90-5eecdd0bae1c admin admin] PATH_INFO: `/v3/domains` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:02:23.505526 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-747b3de7-8095-460c-9d90-5eecdd0bae1c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81592) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 18:02:23.507054 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-747b3de7-8095-460c-9d90-5eecdd0bae1c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:02:23.513264 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-747b3de7-8095-460c-9d90-5eecdd0bae1c admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:02:23.520430 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4eeef4-bfce-4522-815b-cdbffe91d66c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:02:23.521455 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4eeef4-bfce-4522-815b-cdbffe91d66c admin admin] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:02:23.521982 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4eeef4-bfce-4522-815b-cdbffe91d66c admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:02:23.522400 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4eeef4-bfce-4522-815b-cdbffe91d66c admin admin] PATH_INFO: `/v3/users` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:02:23.529689 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df4eeef4-bfce-4522-815b-cdbffe91d66c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:02:23.539503 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 887/1795] 10.222.0.25 () {58 vars in 1153 bytes} [Thu Sep 15 18:02:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 18:02:23.540532 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747b3de7-8095-460c-9d90-5eecdd0bae1c admin admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:02:23.545310 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df4eeef4-bfce-4522-815b-cdbffe91d66c admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:02:23.556932 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747b3de7-8095-460c-9d90-5eecdd0bae1c admin admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:02:23.593236 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833ab2f3-bd27-4aea-aa0b-d656964000c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:02:23.599211 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833ab2f3-bd27-4aea-aa0b-d656964000c7 admin admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:02:23.603261 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833ab2f3-bd27-4aea-aa0b-d656964000c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:02:23.605145 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833ab2f3-bd27-4aea-aa0b-d656964000c7 admin admin] PATH_INFO: `/v3/domains` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:02:23.606345 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-833ab2f3-bd27-4aea-aa0b-d656964000c7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81592) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 18:02:23.608022 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-833ab2f3-bd27-4aea-aa0b-d656964000c7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:02:23.613810 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-833ab2f3-bd27-4aea-aa0b-d656964000c7 admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:02:23.626723 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 909/1796] 10.222.0.25 () {60 vars in 1144 bytes} [Thu Sep 15 18:02:23 2022] POST /identity/v3/users => generated 297 bytes in 346 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 18:02:23.631928 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4eeef4-bfce-4522-815b-cdbffe91d66c admin admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:02:23.653441 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 888/1797] 10.222.0.25 () {58 vars in 1153 bytes} [Thu Sep 15 18:02:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 18:02:23.654904 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833ab2f3-bd27-4aea-aa0b-d656964000c7 admin admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:02:23.678450 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4eeef4-bfce-4522-815b-cdbffe91d66c admin admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:02:23.692898 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833ab2f3-bd27-4aea-aa0b-d656964000c7 admin admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:02:23.700830 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78c0ad8-fbe4-4cc9-9082-c2153db26fda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:02:23.705255 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78c0ad8-fbe4-4cc9-9082-c2153db26fda admin admin] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:02:23.705255 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78c0ad8-fbe4-4cc9-9082-c2153db26fda admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:02:23.705255 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78c0ad8-fbe4-4cc9-9082-c2153db26fda admin admin] PATH_INFO: `/v3/projects` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:02:23.705577 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcbd9a9e-e9ab-42ee-b72c-01a3e0853452 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:02:23.705664 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a78c0ad8-fbe4-4cc9-9082-c2153db26fda admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:02:23.707188 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbd9a9e-e9ab-42ee-b72c-01a3e0853452 admin admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:02:23.708310 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbd9a9e-e9ab-42ee-b72c-01a3e0853452 admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:02:23.710244 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbd9a9e-e9ab-42ee-b72c-01a3e0853452 admin admin] PATH_INFO: `/v3/roles` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:02:23.713465 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcbd9a9e-e9ab-42ee-b72c-01a3e0853452 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:02:23.715187 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcbd9a9e-e9ab-42ee-b72c-01a3e0853452 admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:02:23.716620 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a78c0ad8-fbe4-4cc9-9082-c2153db26fda admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:02:23.782672 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 889/1798] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Sep 15 18:02:23 2022] GET /identity/v3/roles => generated 1420 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 18:02:23.784102 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcbd9a9e-e9ab-42ee-b72c-01a3e0853452 admin admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:02:23.842831 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcbd9a9e-e9ab-42ee-b72c-01a3e0853452 admin admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:02:23.852307 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 910/1799] 10.222.0.25 () {60 vars in 1153 bytes} [Thu Sep 15 18:02:23 2022] POST /identity/v3/projects => generated 363 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 18:02:23.854069 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78c0ad8-fbe4-4cc9-9082-c2153db26fda admin admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:02:23.955361 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33cf6541-a454-43d4-a1d1-bda373ad5bd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:02:23.955888 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cf6541-a454-43d4-a1d1-bda373ad5bd6 admin admin] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:02:23.956346 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cf6541-a454-43d4-a1d1-bda373ad5bd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:02:23.956601 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cf6541-a454-43d4-a1d1-bda373ad5bd6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:02:23.957270 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33cf6541-a454-43d4-a1d1-bda373ad5bd6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:02:23.959524 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33cf6541-a454-43d4-a1d1-bda373ad5bd6 admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:02:24.030497 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 890/1800] 10.222.0.25 () {60 vars in 1153 bytes} [Thu Sep 15 18:02:23 2022] POST /identity/v3/projects => generated 365 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 18:02:24.031509 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33cf6541-a454-43d4-a1d1-bda373ad5bd6 admin admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:02:24.147985 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78c0ad8-fbe4-4cc9-9082-c2153db26fda admin admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:02:24.232698 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33cf6541-a454-43d4-a1d1-bda373ad5bd6 admin admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:02:24.258736 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2080e2d1-f6fc-4858-8098-c57c5d5cde72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:02:24.259880 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2080e2d1-f6fc-4858-8098-c57c5d5cde72 admin admin] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:02:24.260347 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2080e2d1-f6fc-4858-8098-c57c5d5cde72 admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:02:24.260769 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2080e2d1-f6fc-4858-8098-c57c5d5cde72 admin admin] PATH_INFO: `/v3/users` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:02:24.269482 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2080e2d1-f6fc-4858-8098-c57c5d5cde72 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:02:24.282995 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2080e2d1-f6fc-4858-8098-c57c5d5cde72 admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:02:24.310138 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be0853a-24ef-45cb-b406-9aeac723e70f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:02:24.310820 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be0853a-24ef-45cb-b406-9aeac723e70f admin admin] REQUEST_METHOD: `PUT` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:02:24.311109 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be0853a-24ef-45cb-b406-9aeac723e70f admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:02:24.311384 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be0853a-24ef-45cb-b406-9aeac723e70f admin admin] PATH_INFO: `/v3/projects/debd1ecf8a2243428f1057f8e42e0e78/users/c7628f32df5549d89c75e7bdf1239952/roles/a9e42be86923434f8af52d3fc07fb4f7` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:02:24.360848 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be0853a-24ef-45cb-b406-9aeac723e70f admin admin] RBAC: Authorizing `identity:create_grant(project_id=debd1ecf8a2243428f1057f8e42e0e78, user_id=c7628f32df5549d89c75e7bdf1239952, role_id=a9e42be86923434f8af52d3fc07fb4f7)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:02:24.399100 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be0853a-24ef-45cb-b406-9aeac723e70f admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:02:24.422850 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 891/1801] 10.222.0.25 () {60 vars in 1144 bytes} [Thu Sep 15 18:02:24 2022] POST /identity/v3/users => generated 282 bytes in 392 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 18:02:24.434047 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2080e2d1-f6fc-4858-8098-c57c5d5cde72 admin admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:02:24.451765 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 911/1802] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Sep 15 18:02:23 2022] PUT /identity/v3/projects/debd1ecf8a2243428f1057f8e42e0e78/users/c7628f32df5549d89c75e7bdf1239952/roles/a9e42be86923434f8af52d3fc07fb4f7 => generated 0 bytes in 599 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 18:02:24.453274 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be0853a-24ef-45cb-b406-9aeac723e70f admin admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:02:24.462175 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2080e2d1-f6fc-4858-8098-c57c5d5cde72 admin admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:02:24.490901 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 18:02:24.580652 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 18:02:24.612548 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be0853a-24ef-45cb-b406-9aeac723e70f admin admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:02:24.620987 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0b42f3-7b9e-4527-b5bf-b4798114ca8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:02:24.622312 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0b42f3-7b9e-4527-b5bf-b4798114ca8d admin admin] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:02:24.623268 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0b42f3-7b9e-4527-b5bf-b4798114ca8d admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:02:24.625199 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0b42f3-7b9e-4527-b5bf-b4798114ca8d admin admin] PATH_INFO: `/v3/users` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:02:24.626508 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae0b42f3-7b9e-4527-b5bf-b4798114ca8d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:02:24.626761 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d22d1d2-77be-46c3-971f-4478f2661c82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:02:24.627666 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d22d1d2-77be-46c3-971f-4478f2661c82 admin admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:02:24.629359 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d22d1d2-77be-46c3-971f-4478f2661c82 admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:02:24.629713 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d22d1d2-77be-46c3-971f-4478f2661c82 admin admin] PATH_INFO: `/v3/roles` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:02:24.630448 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d22d1d2-77be-46c3-971f-4478f2661c82 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:02:24.632828 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d22d1d2-77be-46c3-971f-4478f2661c82 admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:02:24.633139 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae0b42f3-7b9e-4527-b5bf-b4798114ca8d admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:02:24.660395 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 912/1803] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Sep 15 18:02:24 2022] GET /identity/v3/roles => generated 1420 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 18:02:24.661646 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d22d1d2-77be-46c3-971f-4478f2661c82 admin admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:02:24.681115 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 892/1804] 10.222.0.25 () {60 vars in 1144 bytes} [Thu Sep 15 18:02:24 2022] POST /identity/v3/users => generated 283 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 18:02:24.681115 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0b42f3-7b9e-4527-b5bf-b4798114ca8d admin admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:02:24.686922 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d22d1d2-77be-46c3-971f-4478f2661c82 admin admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:02:24.698624 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0b42f3-7b9e-4527-b5bf-b4798114ca8d admin admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:02:24.700343 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21899632-e0cf-40cf-a8fa-77fa03914756 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:02:24.702124 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21899632-e0cf-40cf-a8fa-77fa03914756 admin admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:02:24.702252 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21899632-e0cf-40cf-a8fa-77fa03914756 admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:02:24.702660 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21899632-e0cf-40cf-a8fa-77fa03914756 admin admin] PATH_INFO: `/v3/roles` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:02:24.704039 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21899632-e0cf-40cf-a8fa-77fa03914756 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:02:24.706659 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21899632-e0cf-40cf-a8fa-77fa03914756 admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:02:24.718089 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2dd8dfb-58c9-4a8c-a698-cdafd27248fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:02:24.719559 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2dd8dfb-58c9-4a8c-a698-cdafd27248fe admin admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:02:24.719941 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2dd8dfb-58c9-4a8c-a698-cdafd27248fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:02:24.720318 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2dd8dfb-58c9-4a8c-a698-cdafd27248fe admin admin] PATH_INFO: `/v3/roles` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:02:24.721075 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2dd8dfb-58c9-4a8c-a698-cdafd27248fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:02:24.722867 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2dd8dfb-58c9-4a8c-a698-cdafd27248fe admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:02:24.737074 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 913/1805] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Sep 15 18:02:24 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 18:02:24.738263 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21899632-e0cf-40cf-a8fa-77fa03914756 admin admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:02:24.751813 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 893/1806] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Sep 15 18:02:24 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 18:02:24.753857 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2dd8dfb-58c9-4a8c-a698-cdafd27248fe admin admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:02:24.756948 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21899632-e0cf-40cf-a8fa-77fa03914756 admin admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:02:24.769972 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71899fa5-1460-41e7-9c17-09fe1f127012 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:02:24.771630 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71899fa5-1460-41e7-9c17-09fe1f127012 admin admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:02:24.772031 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71899fa5-1460-41e7-9c17-09fe1f127012 admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:02:24.773502 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71899fa5-1460-41e7-9c17-09fe1f127012 admin admin] PATH_INFO: `/v3/roles` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:02:24.774282 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71899fa5-1460-41e7-9c17-09fe1f127012 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:02:24.777316 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71899fa5-1460-41e7-9c17-09fe1f127012 admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:02:24.780502 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2dd8dfb-58c9-4a8c-a698-cdafd27248fe admin admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:02:24.792522 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31bff83f-5b00-4eac-b886-bc9a214dcbc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:02:24.793361 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bff83f-5b00-4eac-b886-bc9a214dcbc0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:02:24.793742 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bff83f-5b00-4eac-b886-bc9a214dcbc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:02:24.794132 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bff83f-5b00-4eac-b886-bc9a214dcbc0 admin admin] PATH_INFO: `/v3/projects/debd1ecf8a2243428f1057f8e42e0e78/users/c7628f32df5549d89c75e7bdf1239952/roles/a9e42be86923434f8af52d3fc07fb4f7` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:02:24.797385 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31bff83f-5b00-4eac-b886-bc9a214dcbc0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=debd1ecf8a2243428f1057f8e42e0e78, user_id=c7628f32df5549d89c75e7bdf1239952, role_id=a9e42be86923434f8af52d3fc07fb4f7)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:02:24.801549 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 914/1807] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Sep 15 18:02:24 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 18:02:24.802549 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31bff83f-5b00-4eac-b886-bc9a214dcbc0 admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:02:24.802668 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71899fa5-1460-41e7-9c17-09fe1f127012 admin admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:02:24.814813 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71899fa5-1460-41e7-9c17-09fe1f127012 admin admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:02:24.821566 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 894/1808] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Sep 15 18:02:24 2022] PUT /identity/v3/projects/debd1ecf8a2243428f1057f8e42e0e78/users/c7628f32df5549d89c75e7bdf1239952/roles/a9e42be86923434f8af52d3fc07fb4f7 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 18:02:24.822684 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31bff83f-5b00-4eac-b886-bc9a214dcbc0 admin admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:02:24.926488 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97765d64-5850-421f-9bca-a00e0d4117a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:02:24.927181 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97765d64-5850-421f-9bca-a00e0d4117a6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:02:24.927460 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97765d64-5850-421f-9bca-a00e0d4117a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:02:24.927733 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97765d64-5850-421f-9bca-a00e0d4117a6 admin admin] PATH_INFO: `/v3/projects/3cb0ad7c388e46d197464dd62bb44d38/users/c551f2d63d9345c6b6faafa0fca62ed9/roles/343cc8b1bc7243eebabdf08147e8366d` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:02:24.958124 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97765d64-5850-421f-9bca-a00e0d4117a6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3cb0ad7c388e46d197464dd62bb44d38, user_id=c551f2d63d9345c6b6faafa0fca62ed9, role_id=343cc8b1bc7243eebabdf08147e8366d)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:02:24.961100 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97765d64-5850-421f-9bca-a00e0d4117a6 admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:02:24.980691 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 915/1809] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Sep 15 18:02:24 2022] PUT /identity/v3/projects/3cb0ad7c388e46d197464dd62bb44d38/users/c551f2d63d9345c6b6faafa0fca62ed9/roles/343cc8b1bc7243eebabdf08147e8366d => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 18:02:24.982054 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc42f793-30f6-4b28-af06-e657044880c4 None None] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:02:24.982387 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc42f793-30f6-4b28-af06-e657044880c4 None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:02:24.982665 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc42f793-30f6-4b28-af06-e657044880c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:02:24.983110 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31bff83f-5b00-4eac-b886-bc9a214dcbc0 admin admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:02:25.039076 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.auth.core [None req-bc42f793-30f6-4b28-af06-e657044880c4 None None] MFA Rules not processed for user `c7628f32df5549d89c75e7bdf1239952`. Rule list: `[]` (Enabled: `True`). {{(pid=81593) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 18:02:25.042140 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-bc42f793-30f6-4b28-af06-e657044880c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:02:25.096386 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca49bb01-dbbe-4533-b68a-7ecbadf98162 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:02:25.097938 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca49bb01-dbbe-4533-b68a-7ecbadf98162 admin admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:02:25.098384 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca49bb01-dbbe-4533-b68a-7ecbadf98162 admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:02:25.098592 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca49bb01-dbbe-4533-b68a-7ecbadf98162 admin admin] PATH_INFO: `/v3/roles` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:02:25.099233 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca49bb01-dbbe-4533-b68a-7ecbadf98162 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:02:25.107228 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca49bb01-dbbe-4533-b68a-7ecbadf98162 admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:02:25.141437 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 895/1810] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Sep 15 18:02:24 2022] GET /identity/v3/roles => generated 1420 bytes in 319 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 18:02:25.143232 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca49bb01-dbbe-4533-b68a-7ecbadf98162 admin admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:02:25.150082 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-ca49bb01-dbbe-4533-b68a-7ecbadf98162 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:02:25.163266 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 18:02:25.174453 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca49bb01-dbbe-4533-b68a-7ecbadf98162 admin admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:02:25.181073 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53d0e93-6e1f-4d9b-8493-1b7ca2c03c6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:02:25.181946 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53d0e93-6e1f-4d9b-8493-1b7ca2c03c6c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:02:25.182431 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53d0e93-6e1f-4d9b-8493-1b7ca2c03c6c admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:02:25.182760 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53d0e93-6e1f-4d9b-8493-1b7ca2c03c6c admin admin] PATH_INFO: `/v3/projects/f836f23bd3064c58ba6fcaf9921b1a61` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:02:25.183996 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53d0e93-6e1f-4d9b-8493-1b7ca2c03c6c admin admin] RBAC: Authorizing `identity:delete_project(project_id=f836f23bd3064c58ba6fcaf9921b1a61)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:02:25.186052 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53d0e93-6e1f-4d9b-8493-1b7ca2c03c6c admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:02:25.193820 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 916/1811] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 15 18:02:24 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 18:02:25.197464 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ddc18c-60da-4f7b-90ff-a29f96926428 None None] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:02:25.198120 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ddc18c-60da-4f7b-90ff-a29f96926428 None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:02:25.198722 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ddc18c-60da-4f7b-90ff-a29f96926428 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:02:25.285764 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.auth.core [None req-a1ddc18c-60da-4f7b-90ff-a29f96926428 None None] MFA Rules not processed for user `c551f2d63d9345c6b6faafa0fca62ed9`. Rule list: `[]` (Enabled: `True`). {{(pid=81593) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 18:02:25.287194 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-a1ddc18c-60da-4f7b-90ff-a29f96926428 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:02:25.298269 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=93,keystone:INSERT=4,keystone:DELETE=3 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 18:02:25.305274 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-b53d0e93-6e1f-4d9b-8493-1b7ca2c03c6c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f836f23bd3064c58ba6fcaf9921b1a61', 'request_id': 'req-b53d0e93-6e1f-4d9b-8493-1b7ca2c03c6c'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:02:25.319841 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-b53d0e93-6e1f-4d9b-8493-1b7ca2c03c6c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f836f23bd3064c58ba6fcaf9921b1a61', 'request_id': 'req-b53d0e93-6e1f-4d9b-8493-1b7ca2c03c6c'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:02:25.335404 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-b53d0e93-6e1f-4d9b-8493-1b7ca2c03c6c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f836f23bd3064c58ba6fcaf9921b1a61', 'request_id': 'req-b53d0e93-6e1f-4d9b-8493-1b7ca2c03c6c'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:02:25.392948 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-b53d0e93-6e1f-4d9b-8493-1b7ca2c03c6c admin admin] The token cache is being invalidate because project f836f23bd3064c58ba6fcaf9921b1a61 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81592) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 18:02:25.393614 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-b53d0e93-6e1f-4d9b-8493-1b7ca2c03c6c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:02:25.396257 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-b53d0e93-6e1f-4d9b-8493-1b7ca2c03c6c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:02:25.411711 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 896/1812] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Sep 15 18:02:25 2022] DELETE /identity/v3/projects/f836f23bd3064c58ba6fcaf9921b1a61 => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 18:02:25.414904 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53d0e93-6e1f-4d9b-8493-1b7ca2c03c6c admin admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:02:25.417167 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-b53d0e93-6e1f-4d9b-8493-1b7ca2c03c6c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:02:25.498660 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 917/1813] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 15 18:02:25 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 304 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 18:02:25.499336 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ddc18c-60da-4f7b-90ff-a29f96926428 None None] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:02:25.505044 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-a1ddc18c-60da-4f7b-90ff-a29f96926428 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:02:25.517943 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53d0e93-6e1f-4d9b-8493-1b7ca2c03c6c admin admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:02:25.525162 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f67fbbd-3f58-45a4-b5c7-30db3b340720 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:02:25.527240 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f67fbbd-3f58-45a4-b5c7-30db3b340720 admin admin] REQUEST_METHOD: `PUT` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:02:25.527523 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f67fbbd-3f58-45a4-b5c7-30db3b340720 admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:02:25.527790 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f67fbbd-3f58-45a4-b5c7-30db3b340720 admin admin] PATH_INFO: `/v3/projects/b60560dff4344380820aadcdf3967a99/users/0097599184af4528bdccf19d12d6a962/roles/343cc8b1bc7243eebabdf08147e8366d` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:02:25.554275 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f67fbbd-3f58-45a4-b5c7-30db3b340720 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b60560dff4344380820aadcdf3967a99, user_id=0097599184af4528bdccf19d12d6a962, role_id=343cc8b1bc7243eebabdf08147e8366d)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:02:25.560243 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f67fbbd-3f58-45a4-b5c7-30db3b340720 admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:02:25.595523 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 897/1814] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Sep 15 18:02:25 2022] PUT /identity/v3/projects/b60560dff4344380820aadcdf3967a99/users/0097599184af4528bdccf19d12d6a962/roles/343cc8b1bc7243eebabdf08147e8366d => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 18:02:25.596656 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f67fbbd-3f58-45a4-b5c7-30db3b340720 admin admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:02:25.598494 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-8f67fbbd-3f58-45a4-b5c7-30db3b340720 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:02:25.639445 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ddc18c-60da-4f7b-90ff-a29f96926428 None None] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:02:25.719783 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf5b087-90af-4c42-9145-e8cec9469bdd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b232e7a841145ba93c6d8462ccb751a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1213c0d1b584404ba3998e136f166e89', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:02:25.721339 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf5b087-90af-4c42-9145-e8cec9469bdd service cinder] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:02:25.721705 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf5b087-90af-4c42-9145-e8cec9469bdd service cinder] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:02:25.722055 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf5b087-90af-4c42-9145-e8cec9469bdd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:02:25.725493 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-4cf5b087-90af-4c42-9145-e8cec9469bdd service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:02:25.771339 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f67fbbd-3f58-45a4-b5c7-30db3b340720 admin admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:02:25.788441 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1acb1fb9-f398-47d2-bc7f-e594d36c6dc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:02:25.789021 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acb1fb9-f398-47d2-bc7f-e594d36c6dc1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:02:25.789322 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acb1fb9-f398-47d2-bc7f-e594d36c6dc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:02:25.794346 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acb1fb9-f398-47d2-bc7f-e594d36c6dc1 admin admin] PATH_INFO: `/v3/users/ea5f9d7267044ec8851ea0f3a7db280c` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:02:25.795736 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1acb1fb9-f398-47d2-bc7f-e594d36c6dc1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ea5f9d7267044ec8851ea0f3a7db280c)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:02:25.798277 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1acb1fb9-f398-47d2-bc7f-e594d36c6dc1 admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:02:25.867338 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 18:02:25.875848 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-1acb1fb9-f398-47d2-bc7f-e594d36c6dc1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ea5f9d7267044ec8851ea0f3a7db280c'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:02:25.885325 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-1acb1fb9-f398-47d2-bc7f-e594d36c6dc1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ea5f9d7267044ec8851ea0f3a7db280c'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:02:25.887355 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-1acb1fb9-f398-47d2-bc7f-e594d36c6dc1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ea5f9d7267044ec8851ea0f3a7db280c'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:02:25.888131 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-1acb1fb9-f398-47d2-bc7f-e594d36c6dc1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ea5f9d7267044ec8851ea0f3a7db280c'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:02:25.889109 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf5b087-90af-4c42-9145-e8cec9469bdd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:02:25.891646 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf5b087-90af-4c42-9145-e8cec9469bdd service cinder] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:02:25.894020 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:DELETE=12,keystone:SELECT=85,keystone:INSERT=3 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 18:02:25.898340 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-1acb1fb9-f398-47d2-bc7f-e594d36c6dc1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ea5f9d7267044ec8851ea0f3a7db280c'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:02:25.917885 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 918/1815] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 15 18:02:25 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 419 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 18:02:25.919127 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf5b087-90af-4c42-9145-e8cec9469bdd service cinder] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:02:25.926786 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 898/1816] 10.222.0.25 () {58 vars in 1224 bytes} [Thu Sep 15 18:02:25 2022] DELETE /identity/v3/users/ea5f9d7267044ec8851ea0f3a7db280c => generated 0 bytes in 331 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 18:02:25.930046 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e34e0a9-c987-4623-abec-7fa81ae98444 None None] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:02:25.930046 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e34e0a9-c987-4623-abec-7fa81ae98444 None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:02:25.930279 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e34e0a9-c987-4623-abec-7fa81ae98444 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:02:25.932001 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-4cf5b087-90af-4c42-9145-e8cec9469bdd service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:02:25.966860 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf5b087-90af-4c42-9145-e8cec9469bdd service cinder] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:02:26.002881 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.auth.core [None req-6e34e0a9-c987-4623-abec-7fa81ae98444 None None] MFA Rules not processed for user `0097599184af4528bdccf19d12d6a962`. Rule list: `[]` (Enabled: `True`). {{(pid=81592) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 18:02:26.004321 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-6e34e0a9-c987-4623-abec-7fa81ae98444 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:02:26.090538 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4b9567-2033-49a0-a85d-e2aa041522f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:02:26.091461 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4b9567-2033-49a0-a85d-e2aa041522f1 admin admin] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:02:26.091876 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4b9567-2033-49a0-a85d-e2aa041522f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:02:26.092280 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4b9567-2033-49a0-a85d-e2aa041522f1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:02:26.093090 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4b9567-2033-49a0-a85d-e2aa041522f1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:02:26.096792 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4b9567-2033-49a0-a85d-e2aa041522f1 admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:02:26.115518 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 899/1817] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 15 18:02:25 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 18:02:26.120624 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e34e0a9-c987-4623-abec-7fa81ae98444 None None] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:02:26.128043 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-6e34e0a9-c987-4623-abec-7fa81ae98444 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:02:26.158786 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 919/1818] 10.222.0.25 () {60 vars in 1153 bytes} [Thu Sep 15 18:02:25 2022] POST /identity/v3/projects => generated 363 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 18:02:26.165337 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e34e0a9-c987-4623-abec-7fa81ae98444 None None] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:02:26.165515 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4b9567-2033-49a0-a85d-e2aa041522f1 admin admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:02:26.166395 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-8a4b9567-2033-49a0-a85d-e2aa041522f1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:02:26.289693 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4b9567-2033-49a0-a85d-e2aa041522f1 admin admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:02:26.300246 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5936ac3-ed3e-4a2f-baff-1fff26af81c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:02:26.300977 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5936ac3-ed3e-4a2f-baff-1fff26af81c9 admin admin] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:02:26.301342 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5936ac3-ed3e-4a2f-baff-1fff26af81c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:02:26.302749 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5936ac3-ed3e-4a2f-baff-1fff26af81c9 admin admin] PATH_INFO: `/v3/users` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:02:26.304146 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5936ac3-ed3e-4a2f-baff-1fff26af81c9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:02:26.307522 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5936ac3-ed3e-4a2f-baff-1fff26af81c9 admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:02:26.332400 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d835a7-2476-45e4-ad7b-7bb6724f6c03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:02:26.333793 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d835a7-2476-45e4-ad7b-7bb6724f6c03 admin admin] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:02:26.334349 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d835a7-2476-45e4-ad7b-7bb6724f6c03 admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:02:26.337353 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d835a7-2476-45e4-ad7b-7bb6724f6c03 admin admin] PATH_INFO: `/v3/projects` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:02:26.337353 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d835a7-2476-45e4-ad7b-7bb6724f6c03 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:02:26.339169 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d835a7-2476-45e4-ad7b-7bb6724f6c03 admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:02:26.353362 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 920/1819] 10.222.0.25 () {60 vars in 1144 bytes} [Thu Sep 15 18:02:26 2022] POST /identity/v3/users => generated 288 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 18:02:26.353362 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5936ac3-ed3e-4a2f-baff-1fff26af81c9 admin admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:02:26.356379 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-f5936ac3-ed3e-4a2f-baff-1fff26af81c9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:02:26.386686 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 900/1820] 10.222.0.25 () {60 vars in 1153 bytes} [Thu Sep 15 18:02:26 2022] POST /identity/v3/projects => generated 365 bytes in 266 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 18:02:26.387806 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d835a7-2476-45e4-ad7b-7bb6724f6c03 admin admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:02:26.470612 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=97,keystone:DELETE=2,keystone:INSERT=1 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 18:02:26.477439 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5936ac3-ed3e-4a2f-baff-1fff26af81c9 admin admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:02:26.529386 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d835a7-2476-45e4-ad7b-7bb6724f6c03 admin admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:02:26.529717 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 18:02:26.560787 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b7f055-ed23-4c00-9e08-2116d74225ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:02:26.561775 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b7f055-ed23-4c00-9e08-2116d74225ce admin admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:02:26.562200 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b7f055-ed23-4c00-9e08-2116d74225ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:02:26.562689 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b7f055-ed23-4c00-9e08-2116d74225ce admin admin] PATH_INFO: `/v3/roles` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:02:26.563879 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b7f055-ed23-4c00-9e08-2116d74225ce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:02:26.575422 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b7f055-ed23-4c00-9e08-2116d74225ce admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:02:26.592877 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a057f77b-4ec0-4a65-bae3-b26371b8079a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b232e7a841145ba93c6d8462ccb751a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1213c0d1b584404ba3998e136f166e89', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:02:26.594366 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a057f77b-4ec0-4a65-bae3-b26371b8079a service cinder] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:02:26.594814 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a057f77b-4ec0-4a65-bae3-b26371b8079a service cinder] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:02:26.595231 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a057f77b-4ec0-4a65-bae3-b26371b8079a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:02:26.597519 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-a057f77b-4ec0-4a65-bae3-b26371b8079a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:02:26.631899 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 901/1821] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Sep 15 18:02:26 2022] GET /identity/v3/roles => generated 1420 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 18:02:26.633470 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b7f055-ed23-4c00-9e08-2116d74225ce admin admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:02:26.663496 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b7f055-ed23-4c00-9e08-2116d74225ce admin admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:02:26.673801 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc59f6e-3a05-4c2e-9b5b-51a6e5c76d5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:02:26.674827 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc59f6e-3a05-4c2e-9b5b-51a6e5c76d5d admin admin] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:02:26.675351 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc59f6e-3a05-4c2e-9b5b-51a6e5c76d5d admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:02:26.675861 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc59f6e-3a05-4c2e-9b5b-51a6e5c76d5d admin admin] PATH_INFO: `/v3/users` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:02:26.676994 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc59f6e-3a05-4c2e-9b5b-51a6e5c76d5d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:02:26.680624 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc59f6e-3a05-4c2e-9b5b-51a6e5c76d5d admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:02:26.685184 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a057f77b-4ec0-4a65-bae3-b26371b8079a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:02:26.686861 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a057f77b-4ec0-4a65-bae3-b26371b8079a service cinder] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:02:26.713167 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 921/1822] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 15 18:02:26 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 361 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 18:02:26.720455 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a057f77b-4ec0-4a65-bae3-b26371b8079a service cinder] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:02:26.725412 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-a057f77b-4ec0-4a65-bae3-b26371b8079a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:02:26.733982 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 902/1823] 10.222.0.25 () {60 vars in 1144 bytes} [Thu Sep 15 18:02:26 2022] POST /identity/v3/users => generated 289 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 18:02:26.737716 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc59f6e-3a05-4c2e-9b5b-51a6e5c76d5d admin admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:02:26.774524 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc59f6e-3a05-4c2e-9b5b-51a6e5c76d5d admin admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:02:26.778719 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a057f77b-4ec0-4a65-bae3-b26371b8079a service cinder] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:02:26.798147 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3045dd6-3967-4ad9-b1a3-958df6f16dbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:02:26.799053 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3045dd6-3967-4ad9-b1a3-958df6f16dbf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:02:26.799699 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3045dd6-3967-4ad9-b1a3-958df6f16dbf admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:02:26.801098 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d724ca-6e14-46b3-9411-d787d4c5430c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:02:26.804243 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d724ca-6e14-46b3-9411-d787d4c5430c admin admin] REQUEST_METHOD: `PUT` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:02:26.804534 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d724ca-6e14-46b3-9411-d787d4c5430c admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:02:26.804818 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d724ca-6e14-46b3-9411-d787d4c5430c admin admin] PATH_INFO: `/v3/projects/972595ad54d74c93b7a918d62db3b65b/users/6f70968765944f029a1de9b7528bb8cb/roles/a9e42be86923434f8af52d3fc07fb4f7` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:02:26.808987 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3045dd6-3967-4ad9-b1a3-958df6f16dbf admin admin] PATH_INFO: `/v3/projects/37cf2ad05d8e4f3994c14f1477fe5e17` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:02:26.818799 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3045dd6-3967-4ad9-b1a3-958df6f16dbf admin admin] RBAC: Authorizing `identity:delete_project(project_id=37cf2ad05d8e4f3994c14f1477fe5e17)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:02:26.822063 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3045dd6-3967-4ad9-b1a3-958df6f16dbf admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:02:26.850457 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d724ca-6e14-46b3-9411-d787d4c5430c admin admin] RBAC: Authorizing `identity:create_grant(project_id=972595ad54d74c93b7a918d62db3b65b, user_id=6f70968765944f029a1de9b7528bb8cb, role_id=a9e42be86923434f8af52d3fc07fb4f7)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:02:26.861200 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d724ca-6e14-46b3-9411-d787d4c5430c admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:02:26.902876 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 903/1824] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Sep 15 18:02:26 2022] PUT /identity/v3/projects/972595ad54d74c93b7a918d62db3b65b/users/6f70968765944f029a1de9b7528bb8cb/roles/a9e42be86923434f8af52d3fc07fb4f7 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 18:02:26.915153 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d724ca-6e14-46b3-9411-d787d4c5430c admin admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:02:26.988926 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-b3045dd6-3967-4ad9-b1a3-958df6f16dbf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '37cf2ad05d8e4f3994c14f1477fe5e17', 'request_id': 'req-b3045dd6-3967-4ad9-b1a3-958df6f16dbf'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:02:27.000537 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-b3045dd6-3967-4ad9-b1a3-958df6f16dbf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '37cf2ad05d8e4f3994c14f1477fe5e17', 'request_id': 'req-b3045dd6-3967-4ad9-b1a3-958df6f16dbf'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:02:27.016655 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-b3045dd6-3967-4ad9-b1a3-958df6f16dbf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '37cf2ad05d8e4f3994c14f1477fe5e17', 'request_id': 'req-b3045dd6-3967-4ad9-b1a3-958df6f16dbf'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:02:27.046162 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-b3045dd6-3967-4ad9-b1a3-958df6f16dbf admin admin] The token cache is being invalidate because project 37cf2ad05d8e4f3994c14f1477fe5e17 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81593) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 18:02:27.047393 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-b3045dd6-3967-4ad9-b1a3-958df6f16dbf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:02:27.049103 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-b3045dd6-3967-4ad9-b1a3-958df6f16dbf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:02:27.055293 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 922/1825] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Sep 15 18:02:26 2022] DELETE /identity/v3/projects/37cf2ad05d8e4f3994c14f1477fe5e17 => generated 0 bytes in 341 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 18:02:27.056852 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3045dd6-3967-4ad9-b1a3-958df6f16dbf admin admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:02:27.067022 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-b3045dd6-3967-4ad9-b1a3-958df6f16dbf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:02:27.126838 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d724ca-6e14-46b3-9411-d787d4c5430c admin admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:02:27.252079 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3045dd6-3967-4ad9-b1a3-958df6f16dbf admin admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:02:27.259556 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7764bdd8-01e0-4f20-b78d-9e1c05f69ca1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:02:27.260407 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7764bdd8-01e0-4f20-b78d-9e1c05f69ca1 admin admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:02:27.260757 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7764bdd8-01e0-4f20-b78d-9e1c05f69ca1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:02:27.261101 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7764bdd8-01e0-4f20-b78d-9e1c05f69ca1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:02:27.261866 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7764bdd8-01e0-4f20-b78d-9e1c05f69ca1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:02:27.263706 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7764bdd8-01e0-4f20-b78d-9e1c05f69ca1 admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:02:27.265914 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 18:02:27.297009 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 923/1826] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Sep 15 18:02:27 2022] GET /identity/v3/roles => generated 1420 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 18:02:27.297009 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c892136-636f-40b5-aa32-a1ae90721747 None None] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:02:27.297009 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c892136-636f-40b5-aa32-a1ae90721747 None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:02:27.297009 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c892136-636f-40b5-aa32-a1ae90721747 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:02:27.316239 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e352296c-6d58-4bfc-bb58-60e653e39a0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:02:27.317202 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e352296c-6d58-4bfc-bb58-60e653e39a0a admin admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:02:27.317654 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e352296c-6d58-4bfc-bb58-60e653e39a0a admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:02:27.318068 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e352296c-6d58-4bfc-bb58-60e653e39a0a admin admin] PATH_INFO: `/v3/roles` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:02:27.319059 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e352296c-6d58-4bfc-bb58-60e653e39a0a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:02:27.322154 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.auth.core [None req-4c892136-636f-40b5-aa32-a1ae90721747 None None] MFA Rules not processed for user `5cfa58ef86774ab7800bf91930bf6028`. Rule list: `[]` (Enabled: `True`). {{(pid=81593) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 18:02:27.322387 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e352296c-6d58-4bfc-bb58-60e653e39a0a admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:02:27.323748 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-4c892136-636f-40b5-aa32-a1ae90721747 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:02:27.333948 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 924/1827] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 15 18:02:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 18:02:27.337735 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c892136-636f-40b5-aa32-a1ae90721747 None None] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:02:27.358533 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 904/1828] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Sep 15 18:02:26 2022] GET /identity/v3/roles => generated 1420 bytes in 452 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 18:02:27.358533 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3055b0-a77d-4590-84c9-542b651e1369 None None] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:02:27.358533 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3055b0-a77d-4590-84c9-542b651e1369 None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:02:27.358916 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3055b0-a77d-4590-84c9-542b651e1369 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:02:27.363244 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c892136-636f-40b5-aa32-a1ae90721747 None None] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:02:27.380348 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db121832-68b8-4ace-8d2d-0ea21bee543f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:02:27.384438 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db121832-68b8-4ace-8d2d-0ea21bee543f admin admin] REQUEST_METHOD: `PUT` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:02:27.384874 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db121832-68b8-4ace-8d2d-0ea21bee543f admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:02:27.385157 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db121832-68b8-4ace-8d2d-0ea21bee543f admin admin] PATH_INFO: `/v3/projects/972595ad54d74c93b7a918d62db3b65b/users/6f70968765944f029a1de9b7528bb8cb/roles/a9e42be86923434f8af52d3fc07fb4f7` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:02:27.390915 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db121832-68b8-4ace-8d2d-0ea21bee543f admin admin] RBAC: Authorizing `identity:create_grant(project_id=972595ad54d74c93b7a918d62db3b65b, user_id=6f70968765944f029a1de9b7528bb8cb, role_id=a9e42be86923434f8af52d3fc07fb4f7)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:02:27.395873 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db121832-68b8-4ace-8d2d-0ea21bee543f admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:02:27.398399 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.auth.core [None req-0e3055b0-a77d-4590-84c9-542b651e1369 None None] MFA Rules not processed for user `5cfa58ef86774ab7800bf91930bf6028`. Rule list: `[]` (Enabled: `True`). {{(pid=81592) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 18:02:27.400460 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-0e3055b0-a77d-4590-84c9-542b651e1369 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:02:27.413645 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 925/1829] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Sep 15 18:02:27 2022] PUT /identity/v3/projects/972595ad54d74c93b7a918d62db3b65b/users/6f70968765944f029a1de9b7528bb8cb/roles/a9e42be86923434f8af52d3fc07fb4f7 => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 18:02:27.414765 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db121832-68b8-4ace-8d2d-0ea21bee543f admin admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:02:27.425451 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 905/1830] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 15 18:02:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 18:02:27.425644 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-db121832-68b8-4ace-8d2d-0ea21bee543f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:02:27.433179 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3055b0-a77d-4590-84c9-542b651e1369 None None] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:02:27.455099 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3055b0-a77d-4590-84c9-542b651e1369 None None] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:02:27.577691 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db121832-68b8-4ace-8d2d-0ea21bee543f admin admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:02:27.598070 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 18:02:27.603657 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a92f9a2-e3ae-402f-8a73-ab8aa4cfbdc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:02:27.607427 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a92f9a2-e3ae-402f-8a73-ab8aa4cfbdc6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:02:27.608650 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a92f9a2-e3ae-402f-8a73-ab8aa4cfbdc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:02:27.609163 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a92f9a2-e3ae-402f-8a73-ab8aa4cfbdc6 admin admin] PATH_INFO: `/v3/projects/f7f8f03ecd8a450fa5b1c81c1b1b4d4f/users/d7caf8e63725483194e66e661e02d447/roles/a9e42be86923434f8af52d3fc07fb4f7` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:02:27.651792 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8984ef8c-e412-4d5b-9962-3a2ab15f8513 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:02:27.653019 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8984ef8c-e412-4d5b-9962-3a2ab15f8513 admin admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:02:27.653695 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8984ef8c-e412-4d5b-9962-3a2ab15f8513 admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:02:27.654090 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8984ef8c-e412-4d5b-9962-3a2ab15f8513 admin admin] PATH_INFO: `/v3/domains` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:02:27.654661 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a92f9a2-e3ae-402f-8a73-ab8aa4cfbdc6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f7f8f03ecd8a450fa5b1c81c1b1b4d4f, user_id=d7caf8e63725483194e66e661e02d447, role_id=a9e42be86923434f8af52d3fc07fb4f7)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:02:27.655190 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8984ef8c-e412-4d5b-9962-3a2ab15f8513 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81592) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 18:02:27.655680 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8984ef8c-e412-4d5b-9962-3a2ab15f8513 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:02:27.660675 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8984ef8c-e412-4d5b-9962-3a2ab15f8513 admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:02:27.664464 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a92f9a2-e3ae-402f-8a73-ab8aa4cfbdc6 admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:02:27.704837 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 906/1831] 10.222.0.25 () {58 vars in 1153 bytes} [Thu Sep 15 18:02:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 18:02:27.709513 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 926/1832] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Sep 15 18:02:27 2022] PUT /identity/v3/projects/f7f8f03ecd8a450fa5b1c81c1b1b4d4f/users/d7caf8e63725483194e66e661e02d447/roles/a9e42be86923434f8af52d3fc07fb4f7 => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 18:02:27.709652 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d07d30-5060-4e3d-b354-150bb722ad14 None None] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:02:27.709652 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d07d30-5060-4e3d-b354-150bb722ad14 None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:02:27.709816 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a92f9a2-e3ae-402f-8a73-ab8aa4cfbdc6 admin admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:02:27.709896 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d07d30-5060-4e3d-b354-150bb722ad14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:02:27.819638 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.auth.core [None req-22d07d30-5060-4e3d-b354-150bb722ad14 None None] MFA Rules not processed for user `6f70968765944f029a1de9b7528bb8cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81592) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 18:02:27.822631 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-22d07d30-5060-4e3d-b354-150bb722ad14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:02:27.826076 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a92f9a2-e3ae-402f-8a73-ab8aa4cfbdc6 admin admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:02:27.833748 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3345c61-6aa2-49d0-afd1-344fb8a5f186 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:02:27.834178 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3345c61-6aa2-49d0-afd1-344fb8a5f186 admin admin] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:02:27.834459 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3345c61-6aa2-49d0-afd1-344fb8a5f186 admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:02:27.834775 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3345c61-6aa2-49d0-afd1-344fb8a5f186 admin admin] PATH_INFO: `/v3/projects` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:02:27.835479 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3345c61-6aa2-49d0-afd1-344fb8a5f186 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:02:27.837647 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3345c61-6aa2-49d0-afd1-344fb8a5f186 admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:02:27.916280 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 927/1833] 10.222.0.25 () {60 vars in 1153 bytes} [Thu Sep 15 18:02:27 2022] POST /identity/v3/projects => generated 391 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 18:02:27.917795 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3345c61-6aa2-49d0-afd1-344fb8a5f186 admin admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:02:27.943958 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 907/1834] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 15 18:02:27 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 18:02:27.945515 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d07d30-5060-4e3d-b354-150bb722ad14 None None] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:02:27.962581 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d07d30-5060-4e3d-b354-150bb722ad14 None None] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:02:28.022333 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 18:02:28.061029 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3345c61-6aa2-49d0-afd1-344fb8a5f186 admin admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:02:28.077438 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7cc8b9-b559-43f5-8f86-755b9fc9eb24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:02:28.078771 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7cc8b9-b559-43f5-8f86-755b9fc9eb24 admin admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:02:28.079951 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7cc8b9-b559-43f5-8f86-755b9fc9eb24 admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:02:28.080777 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7cc8b9-b559-43f5-8f86-755b9fc9eb24 admin admin] PATH_INFO: `/v3/roles` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:02:28.082164 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f7cc8b9-b559-43f5-8f86-755b9fc9eb24 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:02:28.087390 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f7cc8b9-b559-43f5-8f86-755b9fc9eb24 admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:02:28.102148 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45fb88c-181d-48ab-a9bb-ecb8bd924595 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:02:28.103000 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45fb88c-181d-48ab-a9bb-ecb8bd924595 admin admin] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:02:28.103802 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45fb88c-181d-48ab-a9bb-ecb8bd924595 admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:02:28.103802 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45fb88c-181d-48ab-a9bb-ecb8bd924595 admin admin] PATH_INFO: `/v3/users` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:02:28.105326 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b45fb88c-181d-48ab-a9bb-ecb8bd924595 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:02:28.110511 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b45fb88c-181d-48ab-a9bb-ecb8bd924595 admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:02:28.136273 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 928/1835] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Sep 15 18:02:27 2022] GET /identity/v3/roles => generated 1420 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 18:02:28.137954 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7cc8b9-b559-43f5-8f86-755b9fc9eb24 admin admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:02:28.146686 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-8f7cc8b9-b559-43f5-8f86-755b9fc9eb24 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:02:28.186848 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 908/1836] 10.222.0.25 () {60 vars in 1144 bytes} [Thu Sep 15 18:02:27 2022] POST /identity/v3/users => generated 296 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 18:02:28.188804 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45fb88c-181d-48ab-a9bb-ecb8bd924595 admin admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:02:28.209748 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45fb88c-181d-48ab-a9bb-ecb8bd924595 admin admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:02:28.218268 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9da119-c804-4c3e-beea-9ac6eafa22fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:02:28.220042 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9da119-c804-4c3e-beea-9ac6eafa22fd admin admin] REQUEST_METHOD: `PUT` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:02:28.220695 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9da119-c804-4c3e-beea-9ac6eafa22fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:02:28.221234 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9da119-c804-4c3e-beea-9ac6eafa22fd admin admin] PATH_INFO: `/v3/projects/f7f8f03ecd8a450fa5b1c81c1b1b4d4f/users/d7caf8e63725483194e66e661e02d447/roles/a9e42be86923434f8af52d3fc07fb4f7` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:02:28.230973 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee9da119-c804-4c3e-beea-9ac6eafa22fd admin admin] RBAC: Authorizing `identity:create_grant(project_id=f7f8f03ecd8a450fa5b1c81c1b1b4d4f, user_id=d7caf8e63725483194e66e661e02d447, role_id=a9e42be86923434f8af52d3fc07fb4f7)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:02:28.238262 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee9da119-c804-4c3e-beea-9ac6eafa22fd admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:02:28.273675 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7cc8b9-b559-43f5-8f86-755b9fc9eb24 admin admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:02:28.284727 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 909/1837] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Sep 15 18:02:28 2022] PUT /identity/v3/projects/f7f8f03ecd8a450fa5b1c81c1b1b4d4f/users/d7caf8e63725483194e66e661e02d447/roles/a9e42be86923434f8af52d3fc07fb4f7 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 18:02:28.286134 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9da119-c804-4c3e-beea-9ac6eafa22fd admin admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:02:28.445558 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bee38ae-2ebb-4488-8de8-fe0d97a91b92 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b232e7a841145ba93c6d8462ccb751a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1213c0d1b584404ba3998e136f166e89', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:02:28.447307 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 18:02:28.448253 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bee38ae-2ebb-4488-8de8-fe0d97a91b92 service cinder] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:02:28.452029 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bee38ae-2ebb-4488-8de8-fe0d97a91b92 service cinder] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:02:28.453096 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bee38ae-2ebb-4488-8de8-fe0d97a91b92 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:02:28.534057 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9da119-c804-4c3e-beea-9ac6eafa22fd admin admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:02:28.548492 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd24272c-d6e5-4052-91ef-2a49e7f7f269 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:02:28.549123 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd24272c-d6e5-4052-91ef-2a49e7f7f269 admin admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:02:28.549429 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd24272c-d6e5-4052-91ef-2a49e7f7f269 admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:02:28.549701 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd24272c-d6e5-4052-91ef-2a49e7f7f269 admin admin] PATH_INFO: `/v3/roles` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:02:28.550359 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd24272c-d6e5-4052-91ef-2a49e7f7f269 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:02:28.552027 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd24272c-d6e5-4052-91ef-2a49e7f7f269 admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:02:28.580252 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 910/1838] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Sep 15 18:02:28 2022] GET /identity/v3/roles => generated 1420 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 18:02:28.586343 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225af7c7-2fb5-48b7-ab62-2818cc0344f9 None None] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:02:28.586558 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225af7c7-2fb5-48b7-ab62-2818cc0344f9 None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:02:28.586829 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225af7c7-2fb5-48b7-ab62-2818cc0344f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:02:28.647915 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.auth.core [None req-225af7c7-2fb5-48b7-ab62-2818cc0344f9 None None] MFA Rules not processed for user `d7caf8e63725483194e66e661e02d447`. Rule list: `[]` (Enabled: `True`). {{(pid=81592) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 18:02:28.651191 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-225af7c7-2fb5-48b7-ab62-2818cc0344f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:02:28.671503 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bee38ae-2ebb-4488-8de8-fe0d97a91b92 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:02:28.674423 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bee38ae-2ebb-4488-8de8-fe0d97a91b92 service cinder] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:02:28.709648 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 929/1839] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 15 18:02:28 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 573 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 18:02:28.711015 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bee38ae-2ebb-4488-8de8-fe0d97a91b92 service cinder] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:02:28.740499 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bee38ae-2ebb-4488-8de8-fe0d97a91b92 service cinder] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:02:28.760834 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ccbc5f-009e-45e3-8671-e94041adb1ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:02:28.761620 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ccbc5f-009e-45e3-8671-e94041adb1ae admin admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:02:28.761906 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ccbc5f-009e-45e3-8671-e94041adb1ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:02:28.762183 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ccbc5f-009e-45e3-8671-e94041adb1ae admin admin] PATH_INFO: `/v3/roles` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:02:28.763097 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ccbc5f-009e-45e3-8671-e94041adb1ae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:02:28.766924 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ccbc5f-009e-45e3-8671-e94041adb1ae admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:02:28.793551 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 930/1840] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Sep 15 18:02:28 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 18:02:28.799541 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ccbc5f-009e-45e3-8671-e94041adb1ae admin admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:02:28.827273 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ccbc5f-009e-45e3-8671-e94041adb1ae admin admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:02:28.841108 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad5d42a-9e02-4420-b875-c42f7122891c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:02:28.841847 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad5d42a-9e02-4420-b875-c42f7122891c admin admin] REQUEST_METHOD: `PUT` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:02:28.842138 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad5d42a-9e02-4420-b875-c42f7122891c admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:02:28.842422 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad5d42a-9e02-4420-b875-c42f7122891c admin admin] PATH_INFO: `/v3/projects/2f163ec03fc34c97a812723178482e92/users/61baa11be09c47aca1dad0d7f1e714db/roles/343cc8b1bc7243eebabdf08147e8366d` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:02:28.879685 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad5d42a-9e02-4420-b875-c42f7122891c admin admin] RBAC: Authorizing `identity:create_grant(project_id=2f163ec03fc34c97a812723178482e92, user_id=61baa11be09c47aca1dad0d7f1e714db, role_id=343cc8b1bc7243eebabdf08147e8366d)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:02:28.884148 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 911/1841] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 15 18:02:28 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 306 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 18:02:28.886362 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225af7c7-2fb5-48b7-ab62-2818cc0344f9 None None] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:02:28.889349 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad5d42a-9e02-4420-b875-c42f7122891c admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:02:28.922291 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 931/1842] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Sep 15 18:02:28 2022] PUT /identity/v3/projects/2f163ec03fc34c97a812723178482e92/users/61baa11be09c47aca1dad0d7f1e714db/roles/343cc8b1bc7243eebabdf08147e8366d => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 18:02:28.922291 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad5d42a-9e02-4420-b875-c42f7122891c admin admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:02:28.922580 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225af7c7-2fb5-48b7-ab62-2818cc0344f9 None None] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:02:28.925199 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-2ad5d42a-9e02-4420-b875-c42f7122891c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:02:28.961094 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 18:02:29.005271 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcbfd3df-6429-454b-ba09-9a0c454eb233 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b232e7a841145ba93c6d8462ccb751a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1213c0d1b584404ba3998e136f166e89', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:02:29.006200 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbfd3df-6429-454b-ba09-9a0c454eb233 service cinder] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:02:29.006996 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbfd3df-6429-454b-ba09-9a0c454eb233 service cinder] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:02:29.007558 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbfd3df-6429-454b-ba09-9a0c454eb233 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:02:29.011512 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-dcbfd3df-6429-454b-ba09-9a0c454eb233 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:02:29.098676 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad5d42a-9e02-4420-b875-c42f7122891c admin admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:02:29.114755 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8ca3cd-9f79-4f14-b727-9d544ab8391d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b232e7a841145ba93c6d8462ccb751a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1213c0d1b584404ba3998e136f166e89', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:02:29.117983 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8ca3cd-9f79-4f14-b727-9d544ab8391d service cinder] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:02:29.119503 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8ca3cd-9f79-4f14-b727-9d544ab8391d service cinder] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:02:29.121376 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8ca3cd-9f79-4f14-b727-9d544ab8391d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:02:29.181783 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcbfd3df-6429-454b-ba09-9a0c454eb233 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:02:29.184980 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcbfd3df-6429-454b-ba09-9a0c454eb233 service cinder] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:02:29.205875 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 912/1843] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 15 18:02:28 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 18:02:29.218653 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b271a2a-5454-4a08-b4bf-64d77a67f97f None None] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:02:29.220888 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b271a2a-5454-4a08-b4bf-64d77a67f97f None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:02:29.223003 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b271a2a-5454-4a08-b4bf-64d77a67f97f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:02:29.303687 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 18:02:29.319695 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.auth.core [None req-7b271a2a-5454-4a08-b4bf-64d77a67f97f None None] MFA Rules not processed for user `61baa11be09c47aca1dad0d7f1e714db`. Rule list: `[]` (Enabled: `True`). {{(pid=81592) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 18:02:29.330899 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-7b271a2a-5454-4a08-b4bf-64d77a67f97f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:02:29.341078 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8ca3cd-9f79-4f14-b727-9d544ab8391d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:02:29.344466 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8ca3cd-9f79-4f14-b727-9d544ab8391d service cinder] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:02:29.368562 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 932/1844] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 15 18:02:28 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 454 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 18:02:29.576329 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 913/1845] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 15 18:02:29 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 370 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 18:02:29.577915 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8ca3cd-9f79-4f14-b727-9d544ab8391d service cinder] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:02:29.594974 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b271a2a-5454-4a08-b4bf-64d77a67f97f None None] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:02:29.615495 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b271a2a-5454-4a08-b4bf-64d77a67f97f None None] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:02:29.622079 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b653aa2f-f9c2-4bac-9f92-ea37a662cd78 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b232e7a841145ba93c6d8462ccb751a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1213c0d1b584404ba3998e136f166e89', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:02:29.622821 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b653aa2f-f9c2-4bac-9f92-ea37a662cd78 service cinder] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:02:29.623110 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b653aa2f-f9c2-4bac-9f92-ea37a662cd78 service cinder] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:02:29.623440 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b653aa2f-f9c2-4bac-9f92-ea37a662cd78 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:02:29.627024 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-b653aa2f-f9c2-4bac-9f92-ea37a662cd78 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:02:29.799513 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8ca3cd-9f79-4f14-b727-9d544ab8391d service cinder] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:02:29.800987 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b653aa2f-f9c2-4bac-9f92-ea37a662cd78 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:02:29.803859 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b653aa2f-f9c2-4bac-9f92-ea37a662cd78 service cinder] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:02:29.820594 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890128dd-df89-46b9-b763-85e91ba4f5f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:02:29.857976 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890128dd-df89-46b9-b763-85e91ba4f5f5 admin admin] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:02:29.858345 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890128dd-df89-46b9-b763-85e91ba4f5f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:02:29.858762 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890128dd-df89-46b9-b763-85e91ba4f5f5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:02:29.859874 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890128dd-df89-46b9-b763-85e91ba4f5f5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:02:29.872916 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890128dd-df89-46b9-b763-85e91ba4f5f5 admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:02:29.903733 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 914/1846] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 15 18:02:29 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 15 18:02:29.906557 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdcb887-1c92-475e-a76b-72ec0141b67a None None] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:02:29.907083 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdcb887-1c92-475e-a76b-72ec0141b67a None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:02:29.907495 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdcb887-1c92-475e-a76b-72ec0141b67a None None] PATH_INFO: `/` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:02:29.922714 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 915/1847] 10.222.0.25 () {54 vars in 921 bytes} [Thu Sep 15 18:02:29 2022] GET /identity => generated 270 bytes in 16 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 18:02:29.984955 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 933/1848] 10.222.0.25 () {60 vars in 1153 bytes} [Thu Sep 15 18:02:29 2022] POST /identity/v3/projects => generated 393 bytes in 401 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 18:02:29.987210 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acdcb887-1c92-475e-a76b-72ec0141b67a None None] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:02:30.010583 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b0a209-c864-45d2-87cf-0dfe02678262 None None] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:02:30.010829 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b0a209-c864-45d2-87cf-0dfe02678262 None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:02:30.011105 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b0a209-c864-45d2-87cf-0dfe02678262 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:02:30.065266 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.auth.core [None req-b7b0a209-c864-45d2-87cf-0dfe02678262 None None] MFA Rules not processed for user `fe2244818e4d4dca9c424cd078653e6a`. Rule list: `[]` (Enabled: `True`). {{(pid=81593) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 18:02:30.067104 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-b7b0a209-c864-45d2-87cf-0dfe02678262 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:02:30.200044 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acdcb887-1c92-475e-a76b-72ec0141b67a None None] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:02:30.206597 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 18:02:30.213535 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94370e48-bd55-4846-a950-c1ff92738f78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:02:30.214233 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94370e48-bd55-4846-a950-c1ff92738f78 admin admin] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:02:30.214483 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94370e48-bd55-4846-a950-c1ff92738f78 admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:02:30.214718 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94370e48-bd55-4846-a950-c1ff92738f78 admin admin] PATH_INFO: `/v3/users` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:02:30.215350 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94370e48-bd55-4846-a950-c1ff92738f78 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:02:30.225532 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94370e48-bd55-4846-a950-c1ff92738f78 admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:02:30.307497 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 916/1849] 10.222.0.25 () {60 vars in 1144 bytes} [Thu Sep 15 18:02:29 2022] POST /identity/v3/users => generated 303 bytes in 322 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 18:02:30.314849 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94370e48-bd55-4846-a950-c1ff92738f78 admin admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:02:30.315833 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-94370e48-bd55-4846-a950-c1ff92738f78 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:02:30.328885 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 934/1850] 10.222.0.25 () {58 vars in 1018 bytes} [Thu Sep 15 18:02:30 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 319 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 18:02:30.332285 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b0a209-c864-45d2-87cf-0dfe02678262 None None] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:02:30.370526 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94370e48-bd55-4846-a950-c1ff92738f78 admin admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:02:30.393393 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b0a209-c864-45d2-87cf-0dfe02678262 None None] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:02:30.403138 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3540b1d-599b-40cc-95ab-d1ba3ab33848 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:02:30.403847 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f528756-0db7-43e7-b34a-3566fa4c6db8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:02:30.404083 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3540b1d-599b-40cc-95ab-d1ba3ab33848 admin admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:02:30.404532 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3540b1d-599b-40cc-95ab-d1ba3ab33848 admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:02:30.404909 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f528756-0db7-43e7-b34a-3566fa4c6db8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:02:30.405024 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3540b1d-599b-40cc-95ab-d1ba3ab33848 admin admin] PATH_INFO: `/v3/roles` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:02:30.406541 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3540b1d-599b-40cc-95ab-d1ba3ab33848 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:02:30.407517 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f528756-0db7-43e7-b34a-3566fa4c6db8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:02:30.407964 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f528756-0db7-43e7-b34a-3566fa4c6db8 admin admin] PATH_INFO: `/v3/users/0772d3e8a49f403bafaf858bb33dd204` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:02:30.409359 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3540b1d-599b-40cc-95ab-d1ba3ab33848 admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:02:30.410831 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f528756-0db7-43e7-b34a-3566fa4c6db8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0772d3e8a49f403bafaf858bb33dd204)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:02:30.429373 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 935/1851] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Sep 15 18:02:30 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 18:02:30.429373 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3540b1d-599b-40cc-95ab-d1ba3ab33848 admin admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:02:30.430069 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f528756-0db7-43e7-b34a-3566fa4c6db8 admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:02:30.433818 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-e3540b1d-599b-40cc-95ab-d1ba3ab33848 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:02:30.476970 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=93,keystone:INSERT=3,keystone:DELETE=4 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 18:02:30.478084 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3540b1d-599b-40cc-95ab-d1ba3ab33848 admin admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:02:30.487436 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7d3bc4-d5bd-4363-a382-d6ee15d65ce2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe2244818e4d4dca9c424cd078653e6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1213c0d1b584404ba3998e136f166e89', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:02:30.488361 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7d3bc4-d5bd-4363-a382-d6ee15d65ce2 service nova] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:02:30.489696 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7d3bc4-d5bd-4363-a382-d6ee15d65ce2 service nova] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:02:30.489696 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7d3bc4-d5bd-4363-a382-d6ee15d65ce2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:02:30.504462 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad7d3bc4-d5bd-4363-a382-d6ee15d65ce2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:02:30.504675 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-2f528756-0db7-43e7-b34a-3566fa4c6db8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0772d3e8a49f403bafaf858bb33dd204'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:02:30.507132 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad7d3bc4-d5bd-4363-a382-d6ee15d65ce2 service nova] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:02:30.513527 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-2f528756-0db7-43e7-b34a-3566fa4c6db8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0772d3e8a49f403bafaf858bb33dd204'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:02:30.514320 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-2f528756-0db7-43e7-b34a-3566fa4c6db8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0772d3e8a49f403bafaf858bb33dd204'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:02:30.516006 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-2f528756-0db7-43e7-b34a-3566fa4c6db8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0772d3e8a49f403bafaf858bb33dd204'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:02:30.523854 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 936/1852] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 15 18:02:30 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 18:02:30.525952 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-2f528756-0db7-43e7-b34a-3566fa4c6db8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0772d3e8a49f403bafaf858bb33dd204'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:02:30.528114 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7d3bc4-d5bd-4363-a382-d6ee15d65ce2 service nova] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:02:30.544043 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7d3bc4-d5bd-4363-a382-d6ee15d65ce2 service nova] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:02:30.547270 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 917/1853] 10.222.0.25 () {58 vars in 1224 bytes} [Thu Sep 15 18:02:30 2022] DELETE /identity/v3/users/0772d3e8a49f403bafaf858bb33dd204 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 18:02:30.553203 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298ef948-5517-44d7-a8d5-4ba9e9979729 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:02:30.553476 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78447210-8f49-46d4-9c39-a93fe76c6ff6 None None] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:02:30.553775 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78447210-8f49-46d4-9c39-a93fe76c6ff6 None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:02:30.554058 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78447210-8f49-46d4-9c39-a93fe76c6ff6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:02:30.554558 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298ef948-5517-44d7-a8d5-4ba9e9979729 admin admin] REQUEST_METHOD: `PUT` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:02:30.555053 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298ef948-5517-44d7-a8d5-4ba9e9979729 admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:02:30.555519 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298ef948-5517-44d7-a8d5-4ba9e9979729 admin admin] PATH_INFO: `/v3/projects/b440decbc44a4c2fa11727c86e713e2a/users/aec11880470042d398c4b07681dd973b/roles/a9e42be86923434f8af52d3fc07fb4f7` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:02:30.576064 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.auth.core [None req-78447210-8f49-46d4-9c39-a93fe76c6ff6 None None] MFA Rules not processed for user `5cfa58ef86774ab7800bf91930bf6028`. Rule list: `[]` (Enabled: `True`). {{(pid=81592) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 18:02:30.577382 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-78447210-8f49-46d4-9c39-a93fe76c6ff6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:02:30.579982 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298ef948-5517-44d7-a8d5-4ba9e9979729 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b440decbc44a4c2fa11727c86e713e2a, user_id=aec11880470042d398c4b07681dd973b, role_id=a9e42be86923434f8af52d3fc07fb4f7)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:02:30.584738 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298ef948-5517-44d7-a8d5-4ba9e9979729 admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:02:30.612542 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 937/1854] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Sep 15 18:02:30 2022] PUT /identity/v3/projects/b440decbc44a4c2fa11727c86e713e2a/users/aec11880470042d398c4b07681dd973b/roles/a9e42be86923434f8af52d3fc07fb4f7 => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 18:02:30.619100 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298ef948-5517-44d7-a8d5-4ba9e9979729 admin admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:02:30.621538 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-298ef948-5517-44d7-a8d5-4ba9e9979729 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:02:30.653427 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 918/1855] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 15 18:02:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 18:02:30.666149 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78447210-8f49-46d4-9c39-a93fe76c6ff6 None None] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:02:30.669029 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-78447210-8f49-46d4-9c39-a93fe76c6ff6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:02:30.719503 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298ef948-5517-44d7-a8d5-4ba9e9979729 admin admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:02:30.727359 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcca2fc7-97f9-4557-981e-6f7c9aa8fff6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:02:30.727992 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcca2fc7-97f9-4557-981e-6f7c9aa8fff6 admin admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:02:30.728274 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcca2fc7-97f9-4557-981e-6f7c9aa8fff6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:02:30.728550 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcca2fc7-97f9-4557-981e-6f7c9aa8fff6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:02:30.729206 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcca2fc7-97f9-4557-981e-6f7c9aa8fff6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:02:30.731007 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcca2fc7-97f9-4557-981e-6f7c9aa8fff6 admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:02:30.746670 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 938/1856] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Sep 15 18:02:30 2022] GET /identity/v3/roles => generated 1420 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 18:02:30.751318 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcca2fc7-97f9-4557-981e-6f7c9aa8fff6 admin admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:02:30.762130 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcca2fc7-97f9-4557-981e-6f7c9aa8fff6 admin admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:02:30.768174 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881c6fca-2e23-42e7-913b-8bb1750a2613 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:02:30.768865 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881c6fca-2e23-42e7-913b-8bb1750a2613 admin admin] REQUEST_METHOD: `PUT` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:02:30.769159 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881c6fca-2e23-42e7-913b-8bb1750a2613 admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:02:30.769465 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881c6fca-2e23-42e7-913b-8bb1750a2613 admin admin] PATH_INFO: `/v3/projects/b440decbc44a4c2fa11727c86e713e2a/users/aec11880470042d398c4b07681dd973b/roles/a9e42be86923434f8af52d3fc07fb4f7` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:02:30.771708 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881c6fca-2e23-42e7-913b-8bb1750a2613 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b440decbc44a4c2fa11727c86e713e2a, user_id=aec11880470042d398c4b07681dd973b, role_id=a9e42be86923434f8af52d3fc07fb4f7)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:02:30.774787 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881c6fca-2e23-42e7-913b-8bb1750a2613 admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:02:30.783707 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78447210-8f49-46d4-9c39-a93fe76c6ff6 None None] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:02:30.793555 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 939/1857] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Sep 15 18:02:30 2022] PUT /identity/v3/projects/b440decbc44a4c2fa11727c86e713e2a/users/aec11880470042d398c4b07681dd973b/roles/a9e42be86923434f8af52d3fc07fb4f7 => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 15 18:02:30.806193 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45361802-ebf0-42ce-8c10-5e66c5e5520e None None] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:02:30.806440 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45361802-ebf0-42ce-8c10-5e66c5e5520e None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:02:30.806623 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45361802-ebf0-42ce-8c10-5e66c5e5520e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:02:30.852557 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.auth.core [None req-45361802-ebf0-42ce-8c10-5e66c5e5520e None None] MFA Rules not processed for user `aec11880470042d398c4b07681dd973b`. Rule list: `[]` (Enabled: `True`). {{(pid=81593) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 18:02:30.853936 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-45361802-ebf0-42ce-8c10-5e66c5e5520e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:02:30.892450 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dba455b-a5cf-4ecb-ba15-a41a832d4c9d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a32274b4781b40fea9f28da8a9bde5ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1213c0d1b584404ba3998e136f166e89', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:02:30.893180 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dba455b-a5cf-4ecb-ba15-a41a832d4c9d service neutron] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:02:30.893591 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dba455b-a5cf-4ecb-ba15-a41a832d4c9d service neutron] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:02:30.893851 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dba455b-a5cf-4ecb-ba15-a41a832d4c9d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:02:30.912558 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dba455b-a5cf-4ecb-ba15-a41a832d4c9d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:02:30.914256 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dba455b-a5cf-4ecb-ba15-a41a832d4c9d service neutron] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:02:30.937871 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 919/1858] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 15 18:02:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 272 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 18:02:30.969387 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 18:02:30.984612 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 940/1859] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 15 18:02:30 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 18:02:30.991514 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dba455b-a5cf-4ecb-ba15-a41a832d4c9d service neutron] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:02:30.993036 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-8dba455b-a5cf-4ecb-ba15-a41a832d4c9d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:02:30.998792 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:DELETE=6,keystone:SELECT=93,keystone:INSERT=1 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 18:02:31.174495 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dba455b-a5cf-4ecb-ba15-a41a832d4c9d service neutron] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:02:31.449695 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c77afb-73eb-4f43-a3ae-af439ada1c41 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b232e7a841145ba93c6d8462ccb751a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1213c0d1b584404ba3998e136f166e89', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:02:31.451979 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c77afb-73eb-4f43-a3ae-af439ada1c41 service cinder] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:02:31.451979 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c77afb-73eb-4f43-a3ae-af439ada1c41 service cinder] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:02:31.452314 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c77afb-73eb-4f43-a3ae-af439ada1c41 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:02:31.486024 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c77afb-73eb-4f43-a3ae-af439ada1c41 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:02:31.489740 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c77afb-73eb-4f43-a3ae-af439ada1c41 service cinder] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:02:31.515904 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 920/1860] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 15 18:02:30 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 525 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 15 18:02:31.734517 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45361802-ebf0-42ce-8c10-5e66c5e5520e None None] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:02:31.737834 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-45361802-ebf0-42ce-8c10-5e66c5e5520e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:02:31.765030 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45361802-ebf0-42ce-8c10-5e66c5e5520e None None] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:02:31.773091 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc60506-4d19-425c-8cff-d8ba2df4469c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b232e7a841145ba93c6d8462ccb751a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1213c0d1b584404ba3998e136f166e89', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:02:31.774116 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc60506-4d19-425c-8cff-d8ba2df4469c service cinder] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:02:31.774590 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc60506-4d19-425c-8cff-d8ba2df4469c service cinder] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:02:31.775043 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc60506-4d19-425c-8cff-d8ba2df4469c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:02:31.779430 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-8bc60506-4d19-425c-8cff-d8ba2df4469c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:02:31.946206 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc60506-4d19-425c-8cff-d8ba2df4469c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:02:31.947915 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc60506-4d19-425c-8cff-d8ba2df4469c service cinder] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:02:31.952334 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9435068-fb54-4905-b424-0d6b286f1637 None None] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:02:31.953943 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9435068-fb54-4905-b424-0d6b286f1637 None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:02:31.954666 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9435068-fb54-4905-b424-0d6b286f1637 None None] PATH_INFO: `/` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:02:31.958828 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 921/1861] 10.222.0.25 () {54 vars in 921 bytes} [Thu Sep 15 18:02:31 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 18:02:31.959947 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 941/1862] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 15 18:02:31 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 227 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 18:02:31.978533 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a23b257-e108-4bb6-91d5-09a9237ad90a None None] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:02:31.979021 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a23b257-e108-4bb6-91d5-09a9237ad90a None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:02:31.979507 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a23b257-e108-4bb6-91d5-09a9237ad90a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:02:32.067757 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.auth.core [None req-7a23b257-e108-4bb6-91d5-09a9237ad90a None None] MFA Rules not processed for user `fe2244818e4d4dca9c424cd078653e6a`. Rule list: `[]` (Enabled: `True`). {{(pid=81592) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 18:02:32.069860 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-7a23b257-e108-4bb6-91d5-09a9237ad90a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:02:32.191646 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 922/1863] 10.222.0.25 () {58 vars in 1018 bytes} [Thu Sep 15 18:02:31 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 18:02:32.212858 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc60506-4d19-425c-8cff-d8ba2df4469c service cinder] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:02:32.214761 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-8bc60506-4d19-425c-8cff-d8ba2df4469c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:02:32.245092 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc60506-4d19-425c-8cff-d8ba2df4469c service cinder] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:02:32.268327 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ed30bf-1c9d-41c4-b718-0266f0ecd61c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe2244818e4d4dca9c424cd078653e6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1213c0d1b584404ba3998e136f166e89', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:02:32.281438 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ed30bf-1c9d-41c4-b718-0266f0ecd61c service nova] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:02:32.281793 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ed30bf-1c9d-41c4-b718-0266f0ecd61c service nova] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:02:32.282147 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ed30bf-1c9d-41c4-b718-0266f0ecd61c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:02:32.294616 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ed30bf-1c9d-41c4-b718-0266f0ecd61c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:02:32.296998 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ed30bf-1c9d-41c4-b718-0266f0ecd61c service nova] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:02:32.310840 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 942/1864] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 15 18:02:32 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 18:02:32.336293 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a23b257-e108-4bb6-91d5-09a9237ad90a None None] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:02:32.337819 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-7a23b257-e108-4bb6-91d5-09a9237ad90a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:02:32.416204 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 18:02:32.434289 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a23b257-e108-4bb6-91d5-09a9237ad90a None None] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:02:32.440455 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474e219e-c624-43bf-a9b9-e4eadcbe7941 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:02:32.443350 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474e219e-c624-43bf-a9b9-e4eadcbe7941 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:02:32.443350 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474e219e-c624-43bf-a9b9-e4eadcbe7941 admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:02:32.443350 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474e219e-c624-43bf-a9b9-e4eadcbe7941 admin admin] PATH_INFO: `/v3/projects/867153f4779043beac4d86cd0a3f564a` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:02:32.448601 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-474e219e-c624-43bf-a9b9-e4eadcbe7941 admin admin] RBAC: Authorizing `identity:delete_project(project_id=867153f4779043beac4d86cd0a3f564a)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:02:32.451470 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-474e219e-c624-43bf-a9b9-e4eadcbe7941 admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:02:32.575897 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-474e219e-c624-43bf-a9b9-e4eadcbe7941 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '867153f4779043beac4d86cd0a3f564a', 'request_id': 'req-474e219e-c624-43bf-a9b9-e4eadcbe7941'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:02:32.592302 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-474e219e-c624-43bf-a9b9-e4eadcbe7941 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '867153f4779043beac4d86cd0a3f564a', 'request_id': 'req-474e219e-c624-43bf-a9b9-e4eadcbe7941'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:02:32.609216 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-474e219e-c624-43bf-a9b9-e4eadcbe7941 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '867153f4779043beac4d86cd0a3f564a', 'request_id': 'req-474e219e-c624-43bf-a9b9-e4eadcbe7941'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:02:32.633185 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-474e219e-c624-43bf-a9b9-e4eadcbe7941 admin admin] The token cache is being invalidate because project 867153f4779043beac4d86cd0a3f564a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81592) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 18:02:32.634070 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-474e219e-c624-43bf-a9b9-e4eadcbe7941 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:02:32.634829 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-474e219e-c624-43bf-a9b9-e4eadcbe7941 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:02:32.638136 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 923/1865] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Sep 15 18:02:32 2022] DELETE /identity/v3/projects/867153f4779043beac4d86cd0a3f564a => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 15 18:02:32.642287 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ed30bf-1c9d-41c4-b718-0266f0ecd61c service nova] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:02:32.698680 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ed30bf-1c9d-41c4-b718-0266f0ecd61c service nova] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:02:32.975270 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe80199-3639-4f70-a7c1-048f3361bfdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:02:32.978824 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe80199-3639-4f70-a7c1-048f3361bfdc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:02:32.979215 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe80199-3639-4f70-a7c1-048f3361bfdc admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:02:32.980009 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe80199-3639-4f70-a7c1-048f3361bfdc admin admin] PATH_INFO: `/v3/users/c7628f32df5549d89c75e7bdf1239952` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:02:32.983067 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe80199-3639-4f70-a7c1-048f3361bfdc admin admin] RBAC: Authorizing `identity:delete_user(user_id=c7628f32df5549d89c75e7bdf1239952)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:02:32.989917 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe80199-3639-4f70-a7c1-048f3361bfdc admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:02:33.114180 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-2fe80199-3639-4f70-a7c1-048f3361bfdc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c7628f32df5549d89c75e7bdf1239952'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:02:33.135855 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-2fe80199-3639-4f70-a7c1-048f3361bfdc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c7628f32df5549d89c75e7bdf1239952'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:02:33.136931 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-2fe80199-3639-4f70-a7c1-048f3361bfdc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c7628f32df5549d89c75e7bdf1239952'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:02:33.137956 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-2fe80199-3639-4f70-a7c1-048f3361bfdc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c7628f32df5549d89c75e7bdf1239952'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:02:33.157327 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-2fe80199-3639-4f70-a7c1-048f3361bfdc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c7628f32df5549d89c75e7bdf1239952'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:02:33.198230 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 943/1866] 10.222.0.25 () {58 vars in 1224 bytes} [Thu Sep 15 18:02:32 2022] DELETE /identity/v3/users/c7628f32df5549d89c75e7bdf1239952 => generated 0 bytes in 556 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 15 18:02:34.738125 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474e219e-c624-43bf-a9b9-e4eadcbe7941 admin admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:02:34.740195 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-474e219e-c624-43bf-a9b9-e4eadcbe7941 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:02:34.776509 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474e219e-c624-43bf-a9b9-e4eadcbe7941 admin admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:02:34.950476 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565b5d42-51bc-4cef-99c8-b4815f99cc54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:02:34.951899 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565b5d42-51bc-4cef-99c8-b4815f99cc54 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:02:34.952448 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565b5d42-51bc-4cef-99c8-b4815f99cc54 admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:02:34.953609 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565b5d42-51bc-4cef-99c8-b4815f99cc54 admin admin] PATH_INFO: `/v3/projects/debd1ecf8a2243428f1057f8e42e0e78` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:02:34.967091 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-565b5d42-51bc-4cef-99c8-b4815f99cc54 admin admin] RBAC: Authorizing `identity:delete_project(project_id=debd1ecf8a2243428f1057f8e42e0e78)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:02:34.970497 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-565b5d42-51bc-4cef-99c8-b4815f99cc54 admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:02:35.117765 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-565b5d42-51bc-4cef-99c8-b4815f99cc54 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'debd1ecf8a2243428f1057f8e42e0e78', 'request_id': 'req-565b5d42-51bc-4cef-99c8-b4815f99cc54'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:02:35.136093 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-565b5d42-51bc-4cef-99c8-b4815f99cc54 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'debd1ecf8a2243428f1057f8e42e0e78', 'request_id': 'req-565b5d42-51bc-4cef-99c8-b4815f99cc54'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:02:35.148676 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-565b5d42-51bc-4cef-99c8-b4815f99cc54 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'debd1ecf8a2243428f1057f8e42e0e78', 'request_id': 'req-565b5d42-51bc-4cef-99c8-b4815f99cc54'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:02:35.176211 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-565b5d42-51bc-4cef-99c8-b4815f99cc54 admin admin] The token cache is being invalidate because project debd1ecf8a2243428f1057f8e42e0e78 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81592) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 18:02:35.176517 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-565b5d42-51bc-4cef-99c8-b4815f99cc54 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:02:35.178821 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-565b5d42-51bc-4cef-99c8-b4815f99cc54 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:02:35.180411 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 924/1867] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Sep 15 18:02:34 2022] DELETE /identity/v3/projects/debd1ecf8a2243428f1057f8e42e0e78 => generated 0 bytes in 444 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 18:02:35.187744 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa14e6f-490f-4abd-b849-f6acd6a63c7f None None] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:02:35.189029 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa14e6f-490f-4abd-b849-f6acd6a63c7f None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:02:35.189664 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa14e6f-490f-4abd-b849-f6acd6a63c7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:02:35.213270 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 18:02:35.261674 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.auth.core [None req-bfa14e6f-490f-4abd-b849-f6acd6a63c7f None None] MFA Rules not processed for user `5cfa58ef86774ab7800bf91930bf6028`. Rule list: `[]` (Enabled: `True`). {{(pid=81593) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 18:02:35.263107 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-bfa14e6f-490f-4abd-b849-f6acd6a63c7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:02:35.406684 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 944/1868] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 15 18:02:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 18:02:35.407780 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07a906e-2f3e-4cc4-ad46-60570a9c2f49 None None] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:02:35.408249 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07a906e-2f3e-4cc4-ad46-60570a9c2f49 None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:02:35.408686 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07a906e-2f3e-4cc4-ad46-60570a9c2f49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:02:35.508734 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.auth.core [None req-d07a906e-2f3e-4cc4-ad46-60570a9c2f49 None None] MFA Rules not processed for user `5cfa58ef86774ab7800bf91930bf6028`. Rule list: `[]` (Enabled: `True`). {{(pid=81592) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 18:02:35.510715 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-d07a906e-2f3e-4cc4-ad46-60570a9c2f49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:02:35.527015 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 925/1869] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 15 18:02:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 18:02:35.532273 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa14e6f-490f-4abd-b849-f6acd6a63c7f None None] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:02:35.565888 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa14e6f-490f-4abd-b849-f6acd6a63c7f None None] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:02:35.595417 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09c42bb-11a6-4f24-9d94-a38b9b6ca32d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:02:35.603427 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09c42bb-11a6-4f24-9d94-a38b9b6ca32d admin admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:02:35.603888 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09c42bb-11a6-4f24-9d94-a38b9b6ca32d admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:02:35.606900 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09c42bb-11a6-4f24-9d94-a38b9b6ca32d admin admin] PATH_INFO: `/v3/domains` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:02:35.612608 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09c42bb-11a6-4f24-9d94-a38b9b6ca32d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81593) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 18:02:35.616797 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09c42bb-11a6-4f24-9d94-a38b9b6ca32d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:02:35.618546 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09c42bb-11a6-4f24-9d94-a38b9b6ca32d admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:02:35.677766 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 945/1870] 10.222.0.25 () {58 vars in 1153 bytes} [Thu Sep 15 18:02:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 18:02:35.682670 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07a906e-2f3e-4cc4-ad46-60570a9c2f49 None None] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:02:35.703776 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07a906e-2f3e-4cc4-ad46-60570a9c2f49 None None] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:02:35.713145 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0deb99f9-8c23-4648-99e9-89920e1be1e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:02:35.713857 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0deb99f9-8c23-4648-99e9-89920e1be1e6 admin admin] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:02:35.714314 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0deb99f9-8c23-4648-99e9-89920e1be1e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:02:35.714421 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0deb99f9-8c23-4648-99e9-89920e1be1e6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:02:35.718945 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0deb99f9-8c23-4648-99e9-89920e1be1e6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:02:35.723244 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0deb99f9-8c23-4648-99e9-89920e1be1e6 admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:02:35.735793 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 18:02:35.795946 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 926/1871] 10.222.0.25 () {60 vars in 1153 bytes} [Thu Sep 15 18:02:35 2022] POST /identity/v3/projects => generated 387 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 18:02:35.800419 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09c42bb-11a6-4f24-9d94-a38b9b6ca32d admin admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:02:35.814020 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09c42bb-11a6-4f24-9d94-a38b9b6ca32d admin admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:02:35.946837 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b307c2d2-0b39-4835-8763-ad593f7d3ff3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:02:35.948311 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b307c2d2-0b39-4835-8763-ad593f7d3ff3 admin admin] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:02:35.948636 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b307c2d2-0b39-4835-8763-ad593f7d3ff3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:02:35.948984 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b307c2d2-0b39-4835-8763-ad593f7d3ff3 admin admin] PATH_INFO: `/v3/users` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:02:35.950047 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b307c2d2-0b39-4835-8763-ad593f7d3ff3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:02:35.962958 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b307c2d2-0b39-4835-8763-ad593f7d3ff3 admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:02:36.059661 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 946/1872] 10.222.0.25 () {60 vars in 1144 bytes} [Thu Sep 15 18:02:35 2022] POST /identity/v3/users => generated 294 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 18:02:36.061070 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0deb99f9-8c23-4648-99e9-89920e1be1e6 admin admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:02:36.080562 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0deb99f9-8c23-4648-99e9-89920e1be1e6 admin admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:02:36.095532 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45dda83-6101-43d7-93df-97580bb7ef99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:02:36.096178 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45dda83-6101-43d7-93df-97580bb7ef99 admin admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:02:36.096464 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45dda83-6101-43d7-93df-97580bb7ef99 admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:02:36.097237 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45dda83-6101-43d7-93df-97580bb7ef99 admin admin] PATH_INFO: `/v3/roles` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:02:36.098278 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e45dda83-6101-43d7-93df-97580bb7ef99 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:02:36.100366 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e45dda83-6101-43d7-93df-97580bb7ef99 admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:02:36.126634 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 927/1873] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Sep 15 18:02:36 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 18:02:36.129066 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b307c2d2-0b39-4835-8763-ad593f7d3ff3 admin admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:02:36.144476 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b307c2d2-0b39-4835-8763-ad593f7d3ff3 admin admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:02:36.159197 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b3a3e7-aa7b-4180-92bc-fe0bdaba0311 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:02:36.159831 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b3a3e7-aa7b-4180-92bc-fe0bdaba0311 admin admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:02:36.160281 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b3a3e7-aa7b-4180-92bc-fe0bdaba0311 admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:02:36.160566 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b3a3e7-aa7b-4180-92bc-fe0bdaba0311 admin admin] PATH_INFO: `/v3/roles` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:02:36.161447 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b3a3e7-aa7b-4180-92bc-fe0bdaba0311 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:02:36.163430 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b3a3e7-aa7b-4180-92bc-fe0bdaba0311 admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:02:36.180074 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 947/1874] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Sep 15 18:02:36 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 15 18:02:36.186516 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45dda83-6101-43d7-93df-97580bb7ef99 admin admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:02:36.213590 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45dda83-6101-43d7-93df-97580bb7ef99 admin admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:02:36.222914 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eda761c-c649-4617-8b53-0118cbcf856a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:02:36.223575 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eda761c-c649-4617-8b53-0118cbcf856a admin admin] REQUEST_METHOD: `PUT` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:02:36.223803 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eda761c-c649-4617-8b53-0118cbcf856a admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:02:36.224330 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eda761c-c649-4617-8b53-0118cbcf856a admin admin] PATH_INFO: `/v3/projects/a3a456a974a74ae1bc5b6fd0fb6be41f/users/f1c251da09004635a6426fcdefe592bc/roles/343cc8b1bc7243eebabdf08147e8366d` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:02:36.289393 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eda761c-c649-4617-8b53-0118cbcf856a admin admin] RBAC: Authorizing `identity:create_grant(project_id=a3a456a974a74ae1bc5b6fd0fb6be41f, user_id=f1c251da09004635a6426fcdefe592bc, role_id=343cc8b1bc7243eebabdf08147e8366d)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:02:36.292598 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eda761c-c649-4617-8b53-0118cbcf856a admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:02:36.310245 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 928/1875] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Sep 15 18:02:36 2022] PUT /identity/v3/projects/a3a456a974a74ae1bc5b6fd0fb6be41f/users/f1c251da09004635a6426fcdefe592bc/roles/343cc8b1bc7243eebabdf08147e8366d => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 18:02:36.322178 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0a1eb7-99f7-4268-bd6e-1910d2063fb3 None None] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:02:36.323008 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0a1eb7-99f7-4268-bd6e-1910d2063fb3 None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:02:36.323008 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0a1eb7-99f7-4268-bd6e-1910d2063fb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:02:36.356751 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.auth.core [None req-2c0a1eb7-99f7-4268-bd6e-1910d2063fb3 None None] MFA Rules not processed for user `f1c251da09004635a6426fcdefe592bc`. Rule list: `[]` (Enabled: `True`). {{(pid=81593) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 18:02:36.357995 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-2c0a1eb7-99f7-4268-bd6e-1910d2063fb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:02:36.376863 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eda761c-c649-4617-8b53-0118cbcf856a admin admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:02:36.378682 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-6eda761c-c649-4617-8b53-0118cbcf856a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:02:36.442895 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 18:02:36.454516 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 948/1876] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 15 18:02:36 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 18:02:36.459548 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0a1eb7-99f7-4268-bd6e-1910d2063fb3 None None] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:02:36.513100 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eda761c-c649-4617-8b53-0118cbcf856a admin admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:02:36.528311 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff450f94-982e-49e9-b9a6-9608508e3bff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:02:36.530834 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff450f94-982e-49e9-b9a6-9608508e3bff admin admin] REQUEST_METHOD: `DELETE` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:02:36.531414 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff450f94-982e-49e9-b9a6-9608508e3bff admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:02:36.531992 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff450f94-982e-49e9-b9a6-9608508e3bff admin admin] PATH_INFO: `/v3/users/0097599184af4528bdccf19d12d6a962` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:02:36.534241 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff450f94-982e-49e9-b9a6-9608508e3bff admin admin] RBAC: Authorizing `identity:delete_user(user_id=0097599184af4528bdccf19d12d6a962)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:02:36.538860 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff450f94-982e-49e9-b9a6-9608508e3bff admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:02:36.590172 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0a1eb7-99f7-4268-bd6e-1910d2063fb3 None None] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:02:36.616998 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c220ae-6ddb-423c-84c0-13df5f7db9ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:02:36.617763 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c220ae-6ddb-423c-84c0-13df5f7db9ea admin admin] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:02:36.618441 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c220ae-6ddb-423c-84c0-13df5f7db9ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:02:36.618441 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c220ae-6ddb-423c-84c0-13df5f7db9ea admin admin] PATH_INFO: `/v3/projects` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:02:36.622995 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c220ae-6ddb-423c-84c0-13df5f7db9ea admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:02:36.634822 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c220ae-6ddb-423c-84c0-13df5f7db9ea admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:02:36.680525 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-ff450f94-982e-49e9-b9a6-9608508e3bff admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0097599184af4528bdccf19d12d6a962'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:02:36.702981 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-ff450f94-982e-49e9-b9a6-9608508e3bff admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0097599184af4528bdccf19d12d6a962'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:02:36.705272 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-ff450f94-982e-49e9-b9a6-9608508e3bff admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0097599184af4528bdccf19d12d6a962'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:02:36.706497 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-ff450f94-982e-49e9-b9a6-9608508e3bff admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0097599184af4528bdccf19d12d6a962'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:02:36.723393 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-ff450f94-982e-49e9-b9a6-9608508e3bff admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0097599184af4528bdccf19d12d6a962'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:02:36.727504 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 949/1877] 10.222.0.25 () {60 vars in 1153 bytes} [Thu Sep 15 18:02:36 2022] POST /identity/v3/projects => generated 389 bytes in 269 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 15 18:02:36.732667 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c220ae-6ddb-423c-84c0-13df5f7db9ea admin admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:02:36.736087 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-c3c220ae-6ddb-423c-84c0-13df5f7db9ea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:02:36.750295 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 929/1878] 10.222.0.25 () {58 vars in 1224 bytes} [Thu Sep 15 18:02:36 2022] DELETE /identity/v3/users/0097599184af4528bdccf19d12d6a962 => generated 0 bytes in 374 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 15 18:02:36.754879 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cd2895-cc80-4c51-be52-2ee49d46314b None None] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:02:36.755784 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cd2895-cc80-4c51-be52-2ee49d46314b None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:02:36.756059 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cd2895-cc80-4c51-be52-2ee49d46314b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:02:36.788027 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.auth.core [None req-90cd2895-cc80-4c51-be52-2ee49d46314b None None] MFA Rules not processed for user `5cfa58ef86774ab7800bf91930bf6028`. Rule list: `[]` (Enabled: `True`). {{(pid=81592) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 18:02:36.789165 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-90cd2895-cc80-4c51-be52-2ee49d46314b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:02:36.830145 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 18:02:36.878954 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c220ae-6ddb-423c-84c0-13df5f7db9ea admin admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:02:36.895604 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 930/1879] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 15 18:02:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 18:02:36.907878 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90cd2895-cc80-4c51-be52-2ee49d46314b None None] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:02:36.910621 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-90cd2895-cc80-4c51-be52-2ee49d46314b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:02:36.986883 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96ce20c-6ec2-4904-8c9d-0720ee581097 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:02:36.987797 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96ce20c-6ec2-4904-8c9d-0720ee581097 admin admin] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:02:36.988213 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96ce20c-6ec2-4904-8c9d-0720ee581097 admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:02:36.988619 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96ce20c-6ec2-4904-8c9d-0720ee581097 admin admin] PATH_INFO: `/v3/users` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:02:36.990104 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96ce20c-6ec2-4904-8c9d-0720ee581097 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:02:36.992370 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96ce20c-6ec2-4904-8c9d-0720ee581097 admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:02:36.998148 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90cd2895-cc80-4c51-be52-2ee49d46314b None None] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:02:37.018124 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb8d922-7c3f-4913-8e29-ddc17a273753 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a32274b4781b40fea9f28da8a9bde5ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1213c0d1b584404ba3998e136f166e89', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:02:37.018830 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb8d922-7c3f-4913-8e29-ddc17a273753 service neutron] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:02:37.021116 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb8d922-7c3f-4913-8e29-ddc17a273753 service neutron] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:02:37.021436 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb8d922-7c3f-4913-8e29-ddc17a273753 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:02:37.022539 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 950/1880] 10.222.0.25 () {60 vars in 1144 bytes} [Thu Sep 15 18:02:36 2022] POST /identity/v3/users => generated 301 bytes in 290 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 18:02:37.027299 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96ce20c-6ec2-4904-8c9d-0720ee581097 admin admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:02:37.050865 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96ce20c-6ec2-4904-8c9d-0720ee581097 admin admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:02:37.060983 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4cec3af-b4b5-4a18-bd64-2a061237f047 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:02:37.062458 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cec3af-b4b5-4a18-bd64-2a061237f047 admin admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:02:37.063085 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cec3af-b4b5-4a18-bd64-2a061237f047 admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:02:37.063513 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cec3af-b4b5-4a18-bd64-2a061237f047 admin admin] PATH_INFO: `/v3/roles` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:02:37.064326 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4cec3af-b4b5-4a18-bd64-2a061237f047 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:02:37.066604 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4cec3af-b4b5-4a18-bd64-2a061237f047 admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:02:37.076161 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb8d922-7c3f-4913-8e29-ddc17a273753 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:02:37.080977 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb8d922-7c3f-4913-8e29-ddc17a273753 service neutron] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:02:37.087527 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 951/1881] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Sep 15 18:02:37 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 18:02:37.090910 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4cec3af-b4b5-4a18-bd64-2a061237f047 admin admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:02:37.108127 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4cec3af-b4b5-4a18-bd64-2a061237f047 admin admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:02:37.118191 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37733d2f-77b9-4786-9999-7f72e3bc2c71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:02:37.120183 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37733d2f-77b9-4786-9999-7f72e3bc2c71 admin admin] REQUEST_METHOD: `PUT` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:02:37.121143 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37733d2f-77b9-4786-9999-7f72e3bc2c71 admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:02:37.121622 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 931/1882] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 15 18:02:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 216 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 18:02:37.121877 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37733d2f-77b9-4786-9999-7f72e3bc2c71 admin admin] PATH_INFO: `/v3/projects/533098b378ef404cb34fbd88120b23a3/users/59a77b914a044836bb1b8061bef2618e/roles/a9e42be86923434f8af52d3fc07fb4f7` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:02:37.131588 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 18:02:37.166203 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37733d2f-77b9-4786-9999-7f72e3bc2c71 admin admin] RBAC: Authorizing `identity:create_grant(project_id=533098b378ef404cb34fbd88120b23a3, user_id=59a77b914a044836bb1b8061bef2618e, role_id=a9e42be86923434f8af52d3fc07fb4f7)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:02:37.168912 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37733d2f-77b9-4786-9999-7f72e3bc2c71 admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:02:37.192968 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 952/1883] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Sep 15 18:02:37 2022] PUT /identity/v3/projects/533098b378ef404cb34fbd88120b23a3/users/59a77b914a044836bb1b8061bef2618e/roles/a9e42be86923434f8af52d3fc07fb4f7 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 15 18:02:37.203271 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb8d922-7c3f-4913-8e29-ddc17a273753 service neutron] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:02:37.239834 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb8d922-7c3f-4913-8e29-ddc17a273753 service neutron] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:02:37.393410 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76b3398-2f01-4c4c-baa1-ed24326417a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:02:37.394631 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76b3398-2f01-4c4c-baa1-ed24326417a0 admin admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:02:37.394631 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76b3398-2f01-4c4c-baa1-ed24326417a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:02:37.394814 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76b3398-2f01-4c4c-baa1-ed24326417a0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:02:37.395552 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76b3398-2f01-4c4c-baa1-ed24326417a0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:02:37.397865 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76b3398-2f01-4c4c-baa1-ed24326417a0 admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:02:37.411586 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 932/1884] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Sep 15 18:02:37 2022] GET /identity/v3/roles => generated 1420 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 15 18:02:37.416234 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37733d2f-77b9-4786-9999-7f72e3bc2c71 admin admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:02:37.432107 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37733d2f-77b9-4786-9999-7f72e3bc2c71 admin admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:02:37.441134 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a9e815-5004-4675-888c-52035b4facb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:02:37.441475 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a9e815-5004-4675-888c-52035b4facb2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:02:37.441763 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a9e815-5004-4675-888c-52035b4facb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:02:37.442036 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a9e815-5004-4675-888c-52035b4facb2 admin admin] PATH_INFO: `/v3/projects/533098b378ef404cb34fbd88120b23a3/users/59a77b914a044836bb1b8061bef2618e/roles/a9e42be86923434f8af52d3fc07fb4f7` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:02:37.444434 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a9e815-5004-4675-888c-52035b4facb2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=533098b378ef404cb34fbd88120b23a3, user_id=59a77b914a044836bb1b8061bef2618e, role_id=a9e42be86923434f8af52d3fc07fb4f7)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:02:37.448939 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a9e815-5004-4675-888c-52035b4facb2 admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:02:37.465395 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 953/1885] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Sep 15 18:02:37 2022] PUT /identity/v3/projects/533098b378ef404cb34fbd88120b23a3/users/59a77b914a044836bb1b8061bef2618e/roles/a9e42be86923434f8af52d3fc07fb4f7 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 18:02:37.477380 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9b83a0-74fa-497c-a026-eaacb9677e22 None None] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:02:37.477679 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9b83a0-74fa-497c-a026-eaacb9677e22 None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:02:37.478175 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9b83a0-74fa-497c-a026-eaacb9677e22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:02:37.537746 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.auth.core [None req-da9b83a0-74fa-497c-a026-eaacb9677e22 None None] MFA Rules not processed for user `59a77b914a044836bb1b8061bef2618e`. Rule list: `[]` (Enabled: `True`). {{(pid=81592) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 18:02:37.538994 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-da9b83a0-74fa-497c-a026-eaacb9677e22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:02:37.620454 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 18:02:37.637736 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 933/1886] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 15 18:02:37 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 18:02:37.651013 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a9e815-5004-4675-888c-52035b4facb2 admin admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:02:37.652929 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-74a9e815-5004-4675-888c-52035b4facb2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:02:37.666147 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9b83a0-74fa-497c-a026-eaacb9677e22 None None] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:02:37.668161 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-da9b83a0-74fa-497c-a026-eaacb9677e22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:02:37.745205 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a9e815-5004-4675-888c-52035b4facb2 admin admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:02:37.757228 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9b83a0-74fa-497c-a026-eaacb9677e22 None None] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:02:37.762331 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d5d5f1-aa66-4048-b6fe-9523e698d31f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:02:37.762894 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e824e0-97ee-4860-a33f-9ab138db0f21 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b232e7a841145ba93c6d8462ccb751a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1213c0d1b584404ba3998e136f166e89', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:02:37.763090 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d5d5f1-aa66-4048-b6fe-9523e698d31f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:02:37.763430 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d5d5f1-aa66-4048-b6fe-9523e698d31f admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:02:37.763717 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d5d5f1-aa66-4048-b6fe-9523e698d31f admin admin] PATH_INFO: `/v3/projects/b60560dff4344380820aadcdf3967a99` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:02:37.765492 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d5d5f1-aa66-4048-b6fe-9523e698d31f admin admin] RBAC: Authorizing `identity:delete_project(project_id=b60560dff4344380820aadcdf3967a99)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:02:37.765932 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e824e0-97ee-4860-a33f-9ab138db0f21 service cinder] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:02:37.766669 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e824e0-97ee-4860-a33f-9ab138db0f21 service cinder] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:02:37.767208 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e824e0-97ee-4860-a33f-9ab138db0f21 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:02:37.771141 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d5d5f1-aa66-4048-b6fe-9523e698d31f admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:02:37.787668 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e824e0-97ee-4860-a33f-9ab138db0f21 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:02:37.790081 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e824e0-97ee-4860-a33f-9ab138db0f21 service cinder] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:02:37.807760 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 954/1887] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 15 18:02:37 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 18:02:37.858463 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-d9d5d5f1-aa66-4048-b6fe-9523e698d31f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b60560dff4344380820aadcdf3967a99', 'request_id': 'req-d9d5d5f1-aa66-4048-b6fe-9523e698d31f'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:02:37.868150 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-d9d5d5f1-aa66-4048-b6fe-9523e698d31f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b60560dff4344380820aadcdf3967a99', 'request_id': 'req-d9d5d5f1-aa66-4048-b6fe-9523e698d31f'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:02:37.878885 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-d9d5d5f1-aa66-4048-b6fe-9523e698d31f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b60560dff4344380820aadcdf3967a99', 'request_id': 'req-d9d5d5f1-aa66-4048-b6fe-9523e698d31f'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:02:37.895048 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-d9d5d5f1-aa66-4048-b6fe-9523e698d31f admin admin] The token cache is being invalidate because project b60560dff4344380820aadcdf3967a99 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81592) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 18:02:37.895347 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-d9d5d5f1-aa66-4048-b6fe-9523e698d31f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:02:37.896045 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-d9d5d5f1-aa66-4048-b6fe-9523e698d31f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:02:37.902025 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 934/1888] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Sep 15 18:02:37 2022] DELETE /identity/v3/projects/b60560dff4344380820aadcdf3967a99 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 15 18:02:37.903125 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e824e0-97ee-4860-a33f-9ab138db0f21 service cinder] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:02:37.928427 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e824e0-97ee-4860-a33f-9ab138db0f21 service cinder] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:02:37.965060 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d5d5f1-aa66-4048-b6fe-9523e698d31f admin admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:02:37.966688 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-d9d5d5f1-aa66-4048-b6fe-9523e698d31f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:02:38.078387 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ec1034-44e9-4360-8853-0a285ddf2dbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:02:38.079137 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ec1034-44e9-4360-8853-0a285ddf2dbb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:02:38.079468 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ec1034-44e9-4360-8853-0a285ddf2dbb admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:02:38.079750 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ec1034-44e9-4360-8853-0a285ddf2dbb admin admin] PATH_INFO: `/v3/users/d7caf8e63725483194e66e661e02d447` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:02:38.081049 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ec1034-44e9-4360-8853-0a285ddf2dbb admin admin] RBAC: Authorizing `identity:delete_user(user_id=d7caf8e63725483194e66e661e02d447)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:02:38.084004 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ec1034-44e9-4360-8853-0a285ddf2dbb admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:02:38.125105 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d5d5f1-aa66-4048-b6fe-9523e698d31f admin admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:02:38.131692 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539464c7-3156-409b-8694-1fa1ba6b2a08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:02:38.132716 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539464c7-3156-409b-8694-1fa1ba6b2a08 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:02:38.133674 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539464c7-3156-409b-8694-1fa1ba6b2a08 admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:02:38.133674 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539464c7-3156-409b-8694-1fa1ba6b2a08 admin admin] PATH_INFO: `/v3/users/f1c251da09004635a6426fcdefe592bc` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:02:38.136374 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539464c7-3156-409b-8694-1fa1ba6b2a08 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f1c251da09004635a6426fcdefe592bc)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:02:38.141165 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539464c7-3156-409b-8694-1fa1ba6b2a08 admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:02:38.169273 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-48ec1034-44e9-4360-8853-0a285ddf2dbb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd7caf8e63725483194e66e661e02d447'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:02:38.177510 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 18:02:38.185085 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-48ec1034-44e9-4360-8853-0a285ddf2dbb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd7caf8e63725483194e66e661e02d447'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:02:38.186391 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-48ec1034-44e9-4360-8853-0a285ddf2dbb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd7caf8e63725483194e66e661e02d447'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:02:38.189570 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-48ec1034-44e9-4360-8853-0a285ddf2dbb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd7caf8e63725483194e66e661e02d447'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:02:38.216836 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-48ec1034-44e9-4360-8853-0a285ddf2dbb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd7caf8e63725483194e66e661e02d447'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:02:38.240975 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-539464c7-3156-409b-8694-1fa1ba6b2a08 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f1c251da09004635a6426fcdefe592bc'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:02:38.261057 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=88,keystone:INSERT=3,keystone:DELETE=9 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 18:02:38.268820 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-539464c7-3156-409b-8694-1fa1ba6b2a08 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f1c251da09004635a6426fcdefe592bc'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:02:38.269561 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-539464c7-3156-409b-8694-1fa1ba6b2a08 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f1c251da09004635a6426fcdefe592bc'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:02:38.270216 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-539464c7-3156-409b-8694-1fa1ba6b2a08 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f1c251da09004635a6426fcdefe592bc'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:02:38.285061 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 955/1889] 10.222.0.25 () {58 vars in 1224 bytes} [Thu Sep 15 18:02:37 2022] DELETE /identity/v3/users/d7caf8e63725483194e66e661e02d447 => generated 0 bytes in 382 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 15 18:02:38.285687 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-539464c7-3156-409b-8694-1fa1ba6b2a08 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f1c251da09004635a6426fcdefe592bc'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:02:38.290064 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ec1034-44e9-4360-8853-0a285ddf2dbb admin admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:02:38.292553 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-48ec1034-44e9-4360-8853-0a285ddf2dbb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:02:38.323447 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 935/1890] 10.222.0.25 () {58 vars in 1224 bytes} [Thu Sep 15 18:02:37 2022] DELETE /identity/v3/users/f1c251da09004635a6426fcdefe592bc => generated 0 bytes in 359 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 18:02:38.329027 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c603155-4b98-4c64-96fd-6648af759857 None None] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:02:38.329356 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c603155-4b98-4c64-96fd-6648af759857 None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:02:38.329644 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c603155-4b98-4c64-96fd-6648af759857 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:02:38.378390 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.auth.core [None req-8c603155-4b98-4c64-96fd-6648af759857 None None] MFA Rules not processed for user `5cfa58ef86774ab7800bf91930bf6028`. Rule list: `[]` (Enabled: `True`). {{(pid=81592) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 18:02:38.379627 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-8c603155-4b98-4c64-96fd-6648af759857 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:02:38.379926 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ec1034-44e9-4360-8853-0a285ddf2dbb admin admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:02:38.479457 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b441bfa8-f044-4fb5-a165-a022a211cec4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:02:38.480343 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b441bfa8-f044-4fb5-a165-a022a211cec4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:02:38.480654 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b441bfa8-f044-4fb5-a165-a022a211cec4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:02:38.480788 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b441bfa8-f044-4fb5-a165-a022a211cec4 admin admin] PATH_INFO: `/v3/users/61baa11be09c47aca1dad0d7f1e714db` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:02:38.485987 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b441bfa8-f044-4fb5-a165-a022a211cec4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=61baa11be09c47aca1dad0d7f1e714db)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:02:38.491884 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b441bfa8-f044-4fb5-a165-a022a211cec4 admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:02:38.523495 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 936/1891] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 15 18:02:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 18:02:38.549707 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c603155-4b98-4c64-96fd-6648af759857 None None] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:02:38.551560 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-8c603155-4b98-4c64-96fd-6648af759857 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:02:38.612752 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-b441bfa8-f044-4fb5-a165-a022a211cec4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '61baa11be09c47aca1dad0d7f1e714db'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:02:38.645279 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-b441bfa8-f044-4fb5-a165-a022a211cec4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '61baa11be09c47aca1dad0d7f1e714db'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:02:38.646549 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-b441bfa8-f044-4fb5-a165-a022a211cec4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '61baa11be09c47aca1dad0d7f1e714db'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:02:38.647692 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-b441bfa8-f044-4fb5-a165-a022a211cec4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '61baa11be09c47aca1dad0d7f1e714db'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:02:38.677527 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-b441bfa8-f044-4fb5-a165-a022a211cec4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '61baa11be09c47aca1dad0d7f1e714db'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:02:38.802135 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 956/1892] 10.222.0.25 () {58 vars in 1224 bytes} [Thu Sep 15 18:02:38 2022] DELETE /identity/v3/users/61baa11be09c47aca1dad0d7f1e714db => generated 0 bytes in 513 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 18:02:38.812348 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b441bfa8-f044-4fb5-a165-a022a211cec4 admin admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:02:38.820835 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-b441bfa8-f044-4fb5-a165-a022a211cec4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:02:38.823145 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c603155-4b98-4c64-96fd-6648af759857 None None] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:02:38.903864 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:DELETE=11,keystone:SELECT=88,keystone:INSERT=1 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 18:02:38.966194 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2af7cb-ab4d-4506-95eb-373e634d3989 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a32274b4781b40fea9f28da8a9bde5ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1213c0d1b584404ba3998e136f166e89', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:02:38.967164 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2af7cb-ab4d-4506-95eb-373e634d3989 service neutron] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:02:38.967642 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2af7cb-ab4d-4506-95eb-373e634d3989 service neutron] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:02:38.969123 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2af7cb-ab4d-4506-95eb-373e634d3989 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:02:38.971532 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-1e2af7cb-ab4d-4506-95eb-373e634d3989 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:02:38.992803 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:DELETE=6,keystone:SELECT=93,keystone:INSERT=1 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 18:02:39.024875 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b441bfa8-f044-4fb5-a165-a022a211cec4 admin admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:02:39.033700 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c059d1-8791-46b9-a799-9888bc2390c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:02:39.034896 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c059d1-8791-46b9-a799-9888bc2390c6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:02:39.035405 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c059d1-8791-46b9-a799-9888bc2390c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:02:39.035959 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c059d1-8791-46b9-a799-9888bc2390c6 admin admin] PATH_INFO: `/v3/users/c551f2d63d9345c6b6faafa0fca62ed9` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:02:39.038269 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c059d1-8791-46b9-a799-9888bc2390c6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c551f2d63d9345c6b6faafa0fca62ed9)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:02:39.043240 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c059d1-8791-46b9-a799-9888bc2390c6 admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:02:39.087770 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2af7cb-ab4d-4506-95eb-373e634d3989 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:02:39.090212 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2af7cb-ab4d-4506-95eb-373e634d3989 service neutron] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:02:39.110439 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 937/1893] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 15 18:02:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 561 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 18:02:39.112523 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae41ea9-1bb5-49b1-b15d-0aa2a9b1071c None None] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:02:39.113100 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae41ea9-1bb5-49b1-b15d-0aa2a9b1071c None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:02:39.113607 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae41ea9-1bb5-49b1-b15d-0aa2a9b1071c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:02:39.147472 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.auth.core [None req-9ae41ea9-1bb5-49b1-b15d-0aa2a9b1071c None None] MFA Rules not processed for user `5cfa58ef86774ab7800bf91930bf6028`. Rule list: `[]` (Enabled: `True`). {{(pid=81592) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 18:02:39.149423 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-9ae41ea9-1bb5-49b1-b15d-0aa2a9b1071c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:02:39.159992 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-62c059d1-8791-46b9-a799-9888bc2390c6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c551f2d63d9345c6b6faafa0fca62ed9'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:02:39.168238 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 938/1894] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 15 18:02:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 18:02:39.168238 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae41ea9-1bb5-49b1-b15d-0aa2a9b1071c None None] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:02:39.168238 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-9ae41ea9-1bb5-49b1-b15d-0aa2a9b1071c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:02:39.175400 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-62c059d1-8791-46b9-a799-9888bc2390c6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c551f2d63d9345c6b6faafa0fca62ed9'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:02:39.176185 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-62c059d1-8791-46b9-a799-9888bc2390c6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c551f2d63d9345c6b6faafa0fca62ed9'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:02:39.176892 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-62c059d1-8791-46b9-a799-9888bc2390c6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c551f2d63d9345c6b6faafa0fca62ed9'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:02:39.188876 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-62c059d1-8791-46b9-a799-9888bc2390c6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c551f2d63d9345c6b6faafa0fca62ed9'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:02:39.198257 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae41ea9-1bb5-49b1-b15d-0aa2a9b1071c None None] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:02:39.215622 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55400292-9688-432c-83f3-0076a6114f4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:02:39.216645 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55400292-9688-432c-83f3-0076a6114f4f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:02:39.217071 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55400292-9688-432c-83f3-0076a6114f4f admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:02:39.217552 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55400292-9688-432c-83f3-0076a6114f4f admin admin] PATH_INFO: `/v3/projects/f7f8f03ecd8a450fa5b1c81c1b1b4d4f` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:02:39.220356 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55400292-9688-432c-83f3-0076a6114f4f admin admin] RBAC: Authorizing `identity:delete_project(project_id=f7f8f03ecd8a450fa5b1c81c1b1b4d4f)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:02:39.221530 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 957/1895] 10.222.0.25 () {58 vars in 1224 bytes} [Thu Sep 15 18:02:38 2022] DELETE /identity/v3/users/c551f2d63d9345c6b6faafa0fca62ed9 => generated 0 bytes in 419 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 18:02:39.223673 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55400292-9688-432c-83f3-0076a6114f4f admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:02:39.228254 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c059d1-8791-46b9-a799-9888bc2390c6 admin admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:02:39.231316 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-62c059d1-8791-46b9-a799-9888bc2390c6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:02:39.364776 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-55400292-9688-432c-83f3-0076a6114f4f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f7f8f03ecd8a450fa5b1c81c1b1b4d4f', 'request_id': 'req-55400292-9688-432c-83f3-0076a6114f4f'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:02:39.387245 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-55400292-9688-432c-83f3-0076a6114f4f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f7f8f03ecd8a450fa5b1c81c1b1b4d4f', 'request_id': 'req-55400292-9688-432c-83f3-0076a6114f4f'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:02:39.404330 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c059d1-8791-46b9-a799-9888bc2390c6 admin admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:02:39.404640 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-55400292-9688-432c-83f3-0076a6114f4f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f7f8f03ecd8a450fa5b1c81c1b1b4d4f', 'request_id': 'req-55400292-9688-432c-83f3-0076a6114f4f'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:02:39.443645 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-55400292-9688-432c-83f3-0076a6114f4f admin admin] The token cache is being invalidate because project f7f8f03ecd8a450fa5b1c81c1b1b4d4f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81592) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 18:02:39.444497 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-55400292-9688-432c-83f3-0076a6114f4f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:02:39.448855 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-55400292-9688-432c-83f3-0076a6114f4f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:02:39.453372 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 939/1896] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Sep 15 18:02:39 2022] DELETE /identity/v3/projects/f7f8f03ecd8a450fa5b1c81c1b1b4d4f => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 18:02:39.460640 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8082d23c-e92b-45a7-81c1-7e1f85608ecd None None] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:02:39.462676 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8082d23c-e92b-45a7-81c1-7e1f85608ecd None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:02:39.463397 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8082d23c-e92b-45a7-81c1-7e1f85608ecd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:02:39.497760 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a1428a-60b2-40fa-ba20-3ecf86274227 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a32274b4781b40fea9f28da8a9bde5ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1213c0d1b584404ba3998e136f166e89', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:02:39.501921 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a1428a-60b2-40fa-ba20-3ecf86274227 service neutron] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:02:39.502558 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a1428a-60b2-40fa-ba20-3ecf86274227 service neutron] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:02:39.502998 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a1428a-60b2-40fa-ba20-3ecf86274227 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:02:39.509364 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-29a1428a-60b2-40fa-ba20-3ecf86274227 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:02:39.513933 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.auth.core [None req-8082d23c-e92b-45a7-81c1-7e1f85608ecd None None] MFA Rules not processed for user `5cfa58ef86774ab7800bf91930bf6028`. Rule list: `[]` (Enabled: `True`). {{(pid=81592) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 18:02:39.515845 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-8082d23c-e92b-45a7-81c1-7e1f85608ecd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:02:39.540609 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 18:02:39.675707 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a1428a-60b2-40fa-ba20-3ecf86274227 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:02:39.678532 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a1428a-60b2-40fa-ba20-3ecf86274227 service neutron] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:02:39.716275 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 958/1897] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 15 18:02:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 481 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 18:02:39.716275 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333e967e-caaa-4e1f-b431-b77751e38178 None None] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:02:39.716275 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333e967e-caaa-4e1f-b431-b77751e38178 None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:02:39.716275 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333e967e-caaa-4e1f-b431-b77751e38178 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:02:39.726941 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 940/1898] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 15 18:02:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 268 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 18:02:39.742454 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8082d23c-e92b-45a7-81c1-7e1f85608ecd None None] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:02:39.744355 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-8082d23c-e92b-45a7-81c1-7e1f85608ecd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:02:39.758894 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.auth.core [None req-333e967e-caaa-4e1f-b431-b77751e38178 None None] MFA Rules not processed for user `5cfa58ef86774ab7800bf91930bf6028`. Rule list: `[]` (Enabled: `True`). {{(pid=81593) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 18:02:39.760616 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8082d23c-e92b-45a7-81c1-7e1f85608ecd None None] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:02:39.760737 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-333e967e-caaa-4e1f-b431-b77751e38178 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:02:39.769419 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98adb7ad-b666-4b27-8ce4-b3bd90735a72 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a32274b4781b40fea9f28da8a9bde5ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1213c0d1b584404ba3998e136f166e89', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:02:39.770298 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98adb7ad-b666-4b27-8ce4-b3bd90735a72 service neutron] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:02:39.770594 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98adb7ad-b666-4b27-8ce4-b3bd90735a72 service neutron] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:02:39.770875 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98adb7ad-b666-4b27-8ce4-b3bd90735a72 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:02:39.774110 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 959/1899] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 15 18:02:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 18:02:39.783170 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3954b561-23be-4d7d-9ca8-44f309b70391 None None] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:02:39.783626 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3954b561-23be-4d7d-9ca8-44f309b70391 None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:02:39.784039 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3954b561-23be-4d7d-9ca8-44f309b70391 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:02:39.791252 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98adb7ad-b666-4b27-8ce4-b3bd90735a72 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:02:39.794658 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98adb7ad-b666-4b27-8ce4-b3bd90735a72 service neutron] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:02:39.824808 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 941/1900] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 15 18:02:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 15 18:02:39.829742 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.auth.core [None req-3954b561-23be-4d7d-9ca8-44f309b70391 None None] MFA Rules not processed for user `5cfa58ef86774ab7800bf91930bf6028`. Rule list: `[]` (Enabled: `True`). {{(pid=81593) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 18:02:39.832493 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-3954b561-23be-4d7d-9ca8-44f309b70391 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:02:39.847716 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 960/1901] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 15 18:02:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 18:02:39.857953 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98adb7ad-b666-4b27-8ce4-b3bd90735a72 service neutron] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:02:39.868619 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98adb7ad-b666-4b27-8ce4-b3bd90735a72 service neutron] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:02:39.876204 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027b0dca-00fb-4fa4-9581-40f0f9747d1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:02:39.877810 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027b0dca-00fb-4fa4-9581-40f0f9747d1e admin admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:02:39.878272 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027b0dca-00fb-4fa4-9581-40f0f9747d1e admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:02:39.878753 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027b0dca-00fb-4fa4-9581-40f0f9747d1e admin admin] PATH_INFO: `/v3/domains` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:02:39.879743 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027b0dca-00fb-4fa4-9581-40f0f9747d1e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81592) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 18:02:39.880241 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027b0dca-00fb-4fa4-9581-40f0f9747d1e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:02:39.882320 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027b0dca-00fb-4fa4-9581-40f0f9747d1e admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:02:39.894970 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 18:02:39.901727 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 942/1902] 10.222.0.25 () {58 vars in 1153 bytes} [Thu Sep 15 18:02:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 18:02:39.905042 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3954b561-23be-4d7d-9ca8-44f309b70391 None None] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:02:39.930019 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3954b561-23be-4d7d-9ca8-44f309b70391 None None] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:02:39.963914 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda05916-9777-4295-a36f-505dbc99af0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:02:39.965594 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda05916-9777-4295-a36f-505dbc99af0c admin admin] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:02:39.966096 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda05916-9777-4295-a36f-505dbc99af0c admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:02:39.966689 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda05916-9777-4295-a36f-505dbc99af0c admin admin] PATH_INFO: `/v3/projects` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:02:39.970899 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda05916-9777-4295-a36f-505dbc99af0c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:02:39.973926 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda05916-9777-4295-a36f-505dbc99af0c admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:02:40.051614 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 961/1903] 10.222.0.25 () {60 vars in 1153 bytes} [Thu Sep 15 18:02:39 2022] POST /identity/v3/projects => generated 379 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 18:02:40.056112 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027b0dca-00fb-4fa4-9581-40f0f9747d1e admin admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:02:40.072946 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027b0dca-00fb-4fa4-9581-40f0f9747d1e admin admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:02:40.234955 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c801b92-e7c8-49f3-874d-baab7a88fa24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:02:40.236500 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c801b92-e7c8-49f3-874d-baab7a88fa24 admin admin] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:02:40.237243 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c801b92-e7c8-49f3-874d-baab7a88fa24 admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:02:40.238458 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c801b92-e7c8-49f3-874d-baab7a88fa24 admin admin] PATH_INFO: `/v3/users` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:02:40.239758 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c801b92-e7c8-49f3-874d-baab7a88fa24 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:02:40.244379 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c801b92-e7c8-49f3-874d-baab7a88fa24 admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:02:40.299539 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 943/1904] 10.222.0.25 () {60 vars in 1144 bytes} [Thu Sep 15 18:02:40 2022] POST /identity/v3/users => generated 290 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 15 18:02:40.303671 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda05916-9777-4295-a36f-505dbc99af0c admin admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:02:40.324617 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda05916-9777-4295-a36f-505dbc99af0c admin admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:02:40.335173 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb7d10f-4f5d-4880-aa97-f6c99dee9d3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:02:40.337706 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb7d10f-4f5d-4880-aa97-f6c99dee9d3c admin admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:02:40.337706 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb7d10f-4f5d-4880-aa97-f6c99dee9d3c admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:02:40.337706 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb7d10f-4f5d-4880-aa97-f6c99dee9d3c admin admin] PATH_INFO: `/v3/roles` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:02:40.338129 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb7d10f-4f5d-4880-aa97-f6c99dee9d3c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:02:40.340702 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb7d10f-4f5d-4880-aa97-f6c99dee9d3c admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:02:40.355117 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c801b92-e7c8-49f3-874d-baab7a88fa24 admin admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:02:40.361697 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-5c801b92-e7c8-49f3-874d-baab7a88fa24 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:02:40.372425 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 962/1905] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Sep 15 18:02:40 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 18:02:40.374314 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb7d10f-4f5d-4880-aa97-f6c99dee9d3c admin admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:02:40.383317 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c801b92-e7c8-49f3-874d-baab7a88fa24 admin admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:02:40.389893 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb7d10f-4f5d-4880-aa97-f6c99dee9d3c admin admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:02:40.393445 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3381fe60-4cdf-429d-843d-9f25b86b4e62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:02:40.394713 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3381fe60-4cdf-429d-843d-9f25b86b4e62 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:02:40.395989 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3381fe60-4cdf-429d-843d-9f25b86b4e62 admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:02:40.396902 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3381fe60-4cdf-429d-843d-9f25b86b4e62 admin admin] PATH_INFO: `/v3/projects/a3a456a974a74ae1bc5b6fd0fb6be41f` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:02:40.398688 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3381fe60-4cdf-429d-843d-9f25b86b4e62 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a3a456a974a74ae1bc5b6fd0fb6be41f)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:02:40.402248 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3381fe60-4cdf-429d-843d-9f25b86b4e62 admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:02:40.403238 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14bedcb-c7ab-4359-ae32-bb0564b33fa8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:02:40.404109 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14bedcb-c7ab-4359-ae32-bb0564b33fa8 admin admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:02:40.404394 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14bedcb-c7ab-4359-ae32-bb0564b33fa8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:02:40.404668 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14bedcb-c7ab-4359-ae32-bb0564b33fa8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:02:40.406155 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14bedcb-c7ab-4359-ae32-bb0564b33fa8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:02:40.407500 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14bedcb-c7ab-4359-ae32-bb0564b33fa8 admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:02:40.419945 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 963/1906] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Sep 15 18:02:40 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 18:02:40.424182 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14bedcb-c7ab-4359-ae32-bb0564b33fa8 admin admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:02:40.438758 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14bedcb-c7ab-4359-ae32-bb0564b33fa8 admin admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:02:40.458218 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cdb90c2-9b86-428a-a2b7-b039aba5d03d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:02:40.459384 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdb90c2-9b86-428a-a2b7-b039aba5d03d admin admin] REQUEST_METHOD: `PUT` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:02:40.459833 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdb90c2-9b86-428a-a2b7-b039aba5d03d admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:02:40.460287 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdb90c2-9b86-428a-a2b7-b039aba5d03d admin admin] PATH_INFO: `/v3/projects/6c9d58dddf654985879416a5c5fac0fc/users/578fbfd5b728455b976efdc5ebcf2ee7/roles/343cc8b1bc7243eebabdf08147e8366d` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:02:40.489687 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cdb90c2-9b86-428a-a2b7-b039aba5d03d admin admin] RBAC: Authorizing `identity:create_grant(project_id=6c9d58dddf654985879416a5c5fac0fc, user_id=578fbfd5b728455b976efdc5ebcf2ee7, role_id=343cc8b1bc7243eebabdf08147e8366d)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:02:40.495786 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cdb90c2-9b86-428a-a2b7-b039aba5d03d admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:02:40.500231 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-3381fe60-4cdf-429d-843d-9f25b86b4e62 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a3a456a974a74ae1bc5b6fd0fb6be41f', 'request_id': 'req-3381fe60-4cdf-429d-843d-9f25b86b4e62'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:02:40.508826 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-3381fe60-4cdf-429d-843d-9f25b86b4e62 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a3a456a974a74ae1bc5b6fd0fb6be41f', 'request_id': 'req-3381fe60-4cdf-429d-843d-9f25b86b4e62'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:02:40.520328 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-3381fe60-4cdf-429d-843d-9f25b86b4e62 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a3a456a974a74ae1bc5b6fd0fb6be41f', 'request_id': 'req-3381fe60-4cdf-429d-843d-9f25b86b4e62'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:02:40.523671 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 964/1907] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Sep 15 18:02:40 2022] PUT /identity/v3/projects/6c9d58dddf654985879416a5c5fac0fc/users/578fbfd5b728455b976efdc5ebcf2ee7/roles/343cc8b1bc7243eebabdf08147e8366d => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 15 18:02:40.534891 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c71a4cb-4146-4f82-b110-a1f179a00f34 None None] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:02:40.535182 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c71a4cb-4146-4f82-b110-a1f179a00f34 None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:02:40.535464 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c71a4cb-4146-4f82-b110-a1f179a00f34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:02:40.555433 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-3381fe60-4cdf-429d-843d-9f25b86b4e62 admin admin] The token cache is being invalidate because project a3a456a974a74ae1bc5b6fd0fb6be41f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81592) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 18:02:40.555872 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-3381fe60-4cdf-429d-843d-9f25b86b4e62 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:02:40.557734 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-3381fe60-4cdf-429d-843d-9f25b86b4e62 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:02:40.560915 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 944/1908] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Sep 15 18:02:40 2022] DELETE /identity/v3/projects/a3a456a974a74ae1bc5b6fd0fb6be41f => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 18:02:40.566814 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3381fe60-4cdf-429d-843d-9f25b86b4e62 admin admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:02:40.568357 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-3381fe60-4cdf-429d-843d-9f25b86b4e62 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:02:40.585391 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.auth.core [None req-4c71a4cb-4146-4f82-b110-a1f179a00f34 None None] MFA Rules not processed for user `578fbfd5b728455b976efdc5ebcf2ee7`. Rule list: `[]` (Enabled: `True`). {{(pid=81593) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 18:02:40.587051 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-4c71a4cb-4146-4f82-b110-a1f179a00f34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:02:40.679276 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3381fe60-4cdf-429d-843d-9f25b86b4e62 admin admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:02:40.700769 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 18:02:40.761663 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 965/1909] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 15 18:02:40 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 18:02:40.762893 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c71a4cb-4146-4f82-b110-a1f179a00f34 None None] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:02:40.765956 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-4c71a4cb-4146-4f82-b110-a1f179a00f34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:02:40.769802 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6887ae88-0782-469c-bfa3-c5dfae2b0d4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:02:40.770608 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6887ae88-0782-469c-bfa3-c5dfae2b0d4d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:02:40.770911 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6887ae88-0782-469c-bfa3-c5dfae2b0d4d admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:02:40.771168 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6887ae88-0782-469c-bfa3-c5dfae2b0d4d admin admin] PATH_INFO: `/v3/users/59a77b914a044836bb1b8061bef2618e` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:02:40.777826 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6887ae88-0782-469c-bfa3-c5dfae2b0d4d admin admin] RBAC: Authorizing `identity:delete_user(user_id=59a77b914a044836bb1b8061bef2618e)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:02:40.777826 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6887ae88-0782-469c-bfa3-c5dfae2b0d4d admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:02:40.786302 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c71a4cb-4146-4f82-b110-a1f179a00f34 None None] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:02:40.806061 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5abb347e-78fa-4308-a448-42b927bbd2ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:02:40.806727 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abb347e-78fa-4308-a448-42b927bbd2ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:02:40.807008 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abb347e-78fa-4308-a448-42b927bbd2ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:02:40.807287 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abb347e-78fa-4308-a448-42b927bbd2ac admin admin] PATH_INFO: `/v3/projects/3cb0ad7c388e46d197464dd62bb44d38` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:02:40.808475 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5abb347e-78fa-4308-a448-42b927bbd2ac admin admin] RBAC: Authorizing `identity:delete_project(project_id=3cb0ad7c388e46d197464dd62bb44d38)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:02:40.810727 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5abb347e-78fa-4308-a448-42b927bbd2ac admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:02:40.820397 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 18:02:40.862911 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-6887ae88-0782-469c-bfa3-c5dfae2b0d4d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '59a77b914a044836bb1b8061bef2618e'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:02:40.870470 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-5abb347e-78fa-4308-a448-42b927bbd2ac admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3cb0ad7c388e46d197464dd62bb44d38', 'request_id': 'req-5abb347e-78fa-4308-a448-42b927bbd2ac'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:02:40.872256 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-6887ae88-0782-469c-bfa3-c5dfae2b0d4d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '59a77b914a044836bb1b8061bef2618e'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:02:40.873182 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-6887ae88-0782-469c-bfa3-c5dfae2b0d4d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '59a77b914a044836bb1b8061bef2618e'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:02:40.873979 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-6887ae88-0782-469c-bfa3-c5dfae2b0d4d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '59a77b914a044836bb1b8061bef2618e'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:02:40.878850 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-5abb347e-78fa-4308-a448-42b927bbd2ac admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3cb0ad7c388e46d197464dd62bb44d38', 'request_id': 'req-5abb347e-78fa-4308-a448-42b927bbd2ac'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:02:40.884015 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-6887ae88-0782-469c-bfa3-c5dfae2b0d4d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '59a77b914a044836bb1b8061bef2618e'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:02:40.888239 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-5abb347e-78fa-4308-a448-42b927bbd2ac admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3cb0ad7c388e46d197464dd62bb44d38', 'request_id': 'req-5abb347e-78fa-4308-a448-42b927bbd2ac'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:02:40.907174 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-5abb347e-78fa-4308-a448-42b927bbd2ac admin admin] The token cache is being invalidate because project 3cb0ad7c388e46d197464dd62bb44d38 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81593) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 18:02:40.907383 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-5abb347e-78fa-4308-a448-42b927bbd2ac admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:02:40.920864 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-5abb347e-78fa-4308-a448-42b927bbd2ac admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:02:40.921214 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 945/1910] 10.222.0.25 () {58 vars in 1224 bytes} [Thu Sep 15 18:02:40 2022] DELETE /identity/v3/users/59a77b914a044836bb1b8061bef2618e => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 18:02:40.921214 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6887ae88-0782-469c-bfa3-c5dfae2b0d4d admin admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:02:40.921214 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-6887ae88-0782-469c-bfa3-c5dfae2b0d4d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:02:40.931249 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 966/1911] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Sep 15 18:02:40 2022] DELETE /identity/v3/projects/3cb0ad7c388e46d197464dd62bb44d38 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 18:02:40.934195 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5abb347e-78fa-4308-a448-42b927bbd2ac admin admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:02:40.938555 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-5abb347e-78fa-4308-a448-42b927bbd2ac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:02:41.013786 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6887ae88-0782-469c-bfa3-c5dfae2b0d4d admin admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:02:41.018863 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ba55dc-8534-4672-8422-f2179b6c8a6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:02:41.019523 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ba55dc-8534-4672-8422-f2179b6c8a6f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:02:41.019803 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ba55dc-8534-4672-8422-f2179b6c8a6f admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:02:41.020075 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ba55dc-8534-4672-8422-f2179b6c8a6f admin admin] PATH_INFO: `/v3/projects/2f163ec03fc34c97a812723178482e92` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:02:41.022429 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ba55dc-8534-4672-8422-f2179b6c8a6f admin admin] RBAC: Authorizing `identity:delete_project(project_id=2f163ec03fc34c97a812723178482e92)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:02:41.022863 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5abb347e-78fa-4308-a448-42b927bbd2ac admin admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:02:41.025452 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ba55dc-8534-4672-8422-f2179b6c8a6f admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:02:41.028234 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94ea64c-c903-4b89-9b00-7e15831c4566 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:02:41.028814 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94ea64c-c903-4b89-9b00-7e15831c4566 admin admin] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:02:41.029171 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94ea64c-c903-4b89-9b00-7e15831c4566 admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:02:41.029798 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94ea64c-c903-4b89-9b00-7e15831c4566 admin admin] PATH_INFO: `/v3/projects` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:02:41.031422 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d94ea64c-c903-4b89-9b00-7e15831c4566 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:02:41.033389 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d94ea64c-c903-4b89-9b00-7e15831c4566 admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:02:41.075272 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 967/1912] 10.222.0.25 () {60 vars in 1153 bytes} [Thu Sep 15 18:02:40 2022] POST /identity/v3/projects => generated 379 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 18:02:41.076274 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94ea64c-c903-4b89-9b00-7e15831c4566 admin admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:02:41.078859 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-d94ea64c-c903-4b89-9b00-7e15831c4566 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:02:41.092020 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 18:02:41.104075 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-09ba55dc-8534-4672-8422-f2179b6c8a6f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2f163ec03fc34c97a812723178482e92', 'request_id': 'req-09ba55dc-8534-4672-8422-f2179b6c8a6f'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:02:41.121182 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-09ba55dc-8534-4672-8422-f2179b6c8a6f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2f163ec03fc34c97a812723178482e92', 'request_id': 'req-09ba55dc-8534-4672-8422-f2179b6c8a6f'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:02:41.131051 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-09ba55dc-8534-4672-8422-f2179b6c8a6f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2f163ec03fc34c97a812723178482e92', 'request_id': 'req-09ba55dc-8534-4672-8422-f2179b6c8a6f'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:02:41.157957 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-09ba55dc-8534-4672-8422-f2179b6c8a6f admin admin] The token cache is being invalidate because project 2f163ec03fc34c97a812723178482e92 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81592) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 18:02:41.159735 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-09ba55dc-8534-4672-8422-f2179b6c8a6f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:02:41.164470 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-09ba55dc-8534-4672-8422-f2179b6c8a6f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:02:41.173215 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 946/1913] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Sep 15 18:02:40 2022] DELETE /identity/v3/projects/2f163ec03fc34c97a812723178482e92 => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 18:02:41.175226 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ba55dc-8534-4672-8422-f2179b6c8a6f admin admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:02:41.177616 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-09ba55dc-8534-4672-8422-f2179b6c8a6f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:02:41.239816 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94ea64c-c903-4b89-9b00-7e15831c4566 admin admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:02:41.319232 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 18:02:41.406247 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aded2ad-bf54-4236-ab8a-e3298f1169c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:02:41.406821 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aded2ad-bf54-4236-ab8a-e3298f1169c0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:02:41.407408 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aded2ad-bf54-4236-ab8a-e3298f1169c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:02:41.407690 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aded2ad-bf54-4236-ab8a-e3298f1169c0 admin admin] PATH_INFO: `/v3/users/6f70968765944f029a1de9b7528bb8cb` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:02:41.409671 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aded2ad-bf54-4236-ab8a-e3298f1169c0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6f70968765944f029a1de9b7528bb8cb)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:02:41.411678 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aded2ad-bf54-4236-ab8a-e3298f1169c0 admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:02:41.436385 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ba55dc-8534-4672-8422-f2179b6c8a6f admin admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:02:41.445565 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c6e5cf-eeec-48b2-8722-7d5f6bc4068e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:02:41.447069 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c6e5cf-eeec-48b2-8722-7d5f6bc4068e admin admin] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:02:41.447628 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c6e5cf-eeec-48b2-8722-7d5f6bc4068e admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:02:41.448112 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c6e5cf-eeec-48b2-8722-7d5f6bc4068e admin admin] PATH_INFO: `/v3/users` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:02:41.449598 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c6e5cf-eeec-48b2-8722-7d5f6bc4068e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:02:41.455556 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c6e5cf-eeec-48b2-8722-7d5f6bc4068e admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:02:41.519180 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 947/1914] 10.222.0.25 () {60 vars in 1144 bytes} [Thu Sep 15 18:02:41 2022] POST /identity/v3/users => generated 290 bytes in 345 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 18:02:41.521136 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-8aded2ad-bf54-4236-ab8a-e3298f1169c0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6f70968765944f029a1de9b7528bb8cb'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:02:41.522228 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c6e5cf-eeec-48b2-8722-7d5f6bc4068e admin admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:02:41.528128 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-c8c6e5cf-eeec-48b2-8722-7d5f6bc4068e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:02:41.538427 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-8aded2ad-bf54-4236-ab8a-e3298f1169c0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6f70968765944f029a1de9b7528bb8cb'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:02:41.540190 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-8aded2ad-bf54-4236-ab8a-e3298f1169c0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6f70968765944f029a1de9b7528bb8cb'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:02:41.541476 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-8aded2ad-bf54-4236-ab8a-e3298f1169c0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6f70968765944f029a1de9b7528bb8cb'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:02:41.560817 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c6e5cf-eeec-48b2-8722-7d5f6bc4068e admin admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:02:41.562741 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-8aded2ad-bf54-4236-ab8a-e3298f1169c0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6f70968765944f029a1de9b7528bb8cb'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:02:41.571235 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d68ca1-cb80-477b-8649-ab00abc83550 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:02:41.572545 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d68ca1-cb80-477b-8649-ab00abc83550 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:02:41.573014 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d68ca1-cb80-477b-8649-ab00abc83550 admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:02:41.573730 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d68ca1-cb80-477b-8649-ab00abc83550 admin admin] PATH_INFO: `/v3/users/aec11880470042d398c4b07681dd973b` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:02:41.581175 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d68ca1-cb80-477b-8649-ab00abc83550 admin admin] RBAC: Authorizing `identity:delete_user(user_id=aec11880470042d398c4b07681dd973b)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:02:41.583659 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d68ca1-cb80-477b-8649-ab00abc83550 admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:02:41.604087 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 968/1915] 10.222.0.25 () {58 vars in 1224 bytes} [Thu Sep 15 18:02:41 2022] DELETE /identity/v3/users/6f70968765944f029a1de9b7528bb8cb => generated 0 bytes in 528 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 18:02:41.609465 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aded2ad-bf54-4236-ab8a-e3298f1169c0 admin admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:02:41.611085 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-8aded2ad-bf54-4236-ab8a-e3298f1169c0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:02:41.714136 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-b1d68ca1-cb80-477b-8649-ab00abc83550 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aec11880470042d398c4b07681dd973b'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:02:41.741006 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-b1d68ca1-cb80-477b-8649-ab00abc83550 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aec11880470042d398c4b07681dd973b'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:02:41.741695 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-b1d68ca1-cb80-477b-8649-ab00abc83550 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aec11880470042d398c4b07681dd973b'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:02:41.745722 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-b1d68ca1-cb80-477b-8649-ab00abc83550 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aec11880470042d398c4b07681dd973b'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:02:41.762282 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aded2ad-bf54-4236-ab8a-e3298f1169c0 admin admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:02:41.764194 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-b1d68ca1-cb80-477b-8649-ab00abc83550 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aec11880470042d398c4b07681dd973b'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:02:41.786171 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3477170b-ce43-4245-b958-6e868747ceca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:02:41.787230 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3477170b-ce43-4245-b958-6e868747ceca admin admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:02:41.788051 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3477170b-ce43-4245-b958-6e868747ceca admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:02:41.788485 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3477170b-ce43-4245-b958-6e868747ceca admin admin] PATH_INFO: `/v3/roles` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:02:41.789393 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3477170b-ce43-4245-b958-6e868747ceca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:02:41.791636 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3477170b-ce43-4245-b958-6e868747ceca admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:02:41.800746 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 948/1916] 10.222.0.25 () {58 vars in 1224 bytes} [Thu Sep 15 18:02:41 2022] DELETE /identity/v3/users/aec11880470042d398c4b07681dd973b => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 18:02:41.818762 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 969/1917] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Sep 15 18:02:41 2022] GET /identity/v3/roles => generated 1420 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 18:02:41.822183 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d68ca1-cb80-477b-8649-ab00abc83550 admin admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:02:41.826035 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-b1d68ca1-cb80-477b-8649-ab00abc83550 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:02:41.871980 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3477170b-ce43-4245-b958-6e868747ceca admin admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:02:41.875788 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-3477170b-ce43-4245-b958-6e868747ceca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:02:41.891169 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=81,keystone:DELETE=14,keystone:INSERT=5 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 18:02:41.900044 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3477170b-ce43-4245-b958-6e868747ceca admin admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:02:41.962709 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d68ca1-cb80-477b-8649-ab00abc83550 admin admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:02:41.975410 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8312ec-df05-4665-89f8-723dc6137d04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:02:41.976117 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8312ec-df05-4665-89f8-723dc6137d04 admin admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:02:41.976403 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8312ec-df05-4665-89f8-723dc6137d04 admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:02:41.976677 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8312ec-df05-4665-89f8-723dc6137d04 admin admin] PATH_INFO: `/v3/roles` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:02:41.977363 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff8312ec-df05-4665-89f8-723dc6137d04 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:02:41.978987 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff8312ec-df05-4665-89f8-723dc6137d04 admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:02:41.993145 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 949/1918] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Sep 15 18:02:41 2022] GET /identity/v3/roles => generated 1420 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 15 18:02:41.994355 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8312ec-df05-4665-89f8-723dc6137d04 admin admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:02:42.006812 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8312ec-df05-4665-89f8-723dc6137d04 admin admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:02:42.011137 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 18:02:42.012789 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95bda48-369a-40bb-b1ec-c0b65473eb45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:02:42.013742 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95bda48-369a-40bb-b1ec-c0b65473eb45 admin admin] REQUEST_METHOD: `PUT` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:02:42.013993 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95bda48-369a-40bb-b1ec-c0b65473eb45 admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:02:42.014276 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95bda48-369a-40bb-b1ec-c0b65473eb45 admin admin] PATH_INFO: `/v3/projects/3b774e1a4b7041e2a83f4686aee80df2/users/9b32ec74046840058431b59e16c90971/roles/343cc8b1bc7243eebabdf08147e8366d` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:02:42.036265 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c95bda48-369a-40bb-b1ec-c0b65473eb45 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3b774e1a4b7041e2a83f4686aee80df2, user_id=9b32ec74046840058431b59e16c90971, role_id=343cc8b1bc7243eebabdf08147e8366d)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:02:42.039801 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c95bda48-369a-40bb-b1ec-c0b65473eb45 admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:02:42.042860 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c66f5d8-30fa-416d-b469-55dbc51c16dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:02:42.044176 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c66f5d8-30fa-416d-b469-55dbc51c16dc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:02:42.045141 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c66f5d8-30fa-416d-b469-55dbc51c16dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:02:42.045868 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c66f5d8-30fa-416d-b469-55dbc51c16dc admin admin] PATH_INFO: `/v3/projects/533098b378ef404cb34fbd88120b23a3` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:02:42.047337 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c66f5d8-30fa-416d-b469-55dbc51c16dc admin admin] RBAC: Authorizing `identity:delete_project(project_id=533098b378ef404cb34fbd88120b23a3)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:02:42.049391 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c66f5d8-30fa-416d-b469-55dbc51c16dc admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:02:42.057316 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 950/1919] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Sep 15 18:02:41 2022] PUT /identity/v3/projects/3b774e1a4b7041e2a83f4686aee80df2/users/9b32ec74046840058431b59e16c90971/roles/343cc8b1bc7243eebabdf08147e8366d => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 18:02:42.068962 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5fd49f-35f5-477e-88de-daabdc72885a None None] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:02:42.069271 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5fd49f-35f5-477e-88de-daabdc72885a None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:02:42.069559 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5fd49f-35f5-477e-88de-daabdc72885a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:02:42.116291 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.auth.core [None req-dd5fd49f-35f5-477e-88de-daabdc72885a None None] MFA Rules not processed for user `9b32ec74046840058431b59e16c90971`. Rule list: `[]` (Enabled: `True`). {{(pid=81592) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 18:02:42.118117 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-dd5fd49f-35f5-477e-88de-daabdc72885a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:02:42.198642 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-2c66f5d8-30fa-416d-b469-55dbc51c16dc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '533098b378ef404cb34fbd88120b23a3', 'request_id': 'req-2c66f5d8-30fa-416d-b469-55dbc51c16dc'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:02:42.215026 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-2c66f5d8-30fa-416d-b469-55dbc51c16dc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '533098b378ef404cb34fbd88120b23a3', 'request_id': 'req-2c66f5d8-30fa-416d-b469-55dbc51c16dc'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:02:42.259326 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 951/1920] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 15 18:02:42 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 18:02:42.259326 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5fd49f-35f5-477e-88de-daabdc72885a None None] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:02:42.314789 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-2c66f5d8-30fa-416d-b469-55dbc51c16dc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '533098b378ef404cb34fbd88120b23a3', 'request_id': 'req-2c66f5d8-30fa-416d-b469-55dbc51c16dc'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:02:42.339520 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-2c66f5d8-30fa-416d-b469-55dbc51c16dc admin admin] The token cache is being invalidate because project 533098b378ef404cb34fbd88120b23a3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81593) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 18:02:42.340250 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-2c66f5d8-30fa-416d-b469-55dbc51c16dc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:02:42.341175 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-2c66f5d8-30fa-416d-b469-55dbc51c16dc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:02:42.343545 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 970/1921] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Sep 15 18:02:41 2022] DELETE /identity/v3/projects/533098b378ef404cb34fbd88120b23a3 => generated 0 bytes in 472 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 15 18:02:42.349704 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce9b358-f93b-4ddb-bdd0-dbd5502cf630 None None] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:02:42.350282 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce9b358-f93b-4ddb-bdd0-dbd5502cf630 None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:02:42.350810 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce9b358-f93b-4ddb-bdd0-dbd5502cf630 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:02:42.365794 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5fd49f-35f5-477e-88de-daabdc72885a None None] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:02:42.372029 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28d1abb-ebb4-49d6-a467-8f97a0722d5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:02:42.373414 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28d1abb-ebb4-49d6-a467-8f97a0722d5c admin admin] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:02:42.373861 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28d1abb-ebb4-49d6-a467-8f97a0722d5c admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:02:42.374957 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28d1abb-ebb4-49d6-a467-8f97a0722d5c admin admin] PATH_INFO: `/v3/projects` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:02:42.375816 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a28d1abb-ebb4-49d6-a467-8f97a0722d5c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:02:42.377196 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.auth.core [None req-dce9b358-f93b-4ddb-bdd0-dbd5502cf630 None None] MFA Rules not processed for user `5cfa58ef86774ab7800bf91930bf6028`. Rule list: `[]` (Enabled: `True`). {{(pid=81593) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 18:02:42.378732 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a28d1abb-ebb4-49d6-a467-8f97a0722d5c admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:02:42.381440 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-dce9b358-f93b-4ddb-bdd0-dbd5502cf630 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:02:42.402860 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 971/1922] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 15 18:02:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 18:02:42.404134 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacfd5f6-03ad-4643-957b-37de64135b96 None None] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:02:42.404580 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacfd5f6-03ad-4643-957b-37de64135b96 None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:02:42.404886 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacfd5f6-03ad-4643-957b-37de64135b96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:02:42.431428 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.auth.core [None req-eacfd5f6-03ad-4643-957b-37de64135b96 None None] MFA Rules not processed for user `5cfa58ef86774ab7800bf91930bf6028`. Rule list: `[]` (Enabled: `True`). {{(pid=81593) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 18:02:42.433387 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 952/1923] 10.222.0.25 () {60 vars in 1153 bytes} [Thu Sep 15 18:02:42 2022] POST /identity/v3/projects => generated 379 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 15 18:02:42.437720 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-eacfd5f6-03ad-4643-957b-37de64135b96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:02:42.439559 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28d1abb-ebb4-49d6-a467-8f97a0722d5c admin admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:02:42.442502 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-a28d1abb-ebb4-49d6-a467-8f97a0722d5c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:02:42.478418 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 18:02:42.542910 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 972/1924] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 15 18:02:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 18:02:42.547305 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eacfd5f6-03ad-4643-957b-37de64135b96 None None] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:02:42.555148 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28d1abb-ebb4-49d6-a467-8f97a0722d5c admin admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:02:42.562765 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eacfd5f6-03ad-4643-957b-37de64135b96 None None] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:02:42.564972 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af089ee-80ff-4943-b8e6-36b2f5ff8066 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:02:42.565793 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af089ee-80ff-4943-b8e6-36b2f5ff8066 admin admin] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:02:42.566081 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af089ee-80ff-4943-b8e6-36b2f5ff8066 admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:02:42.566356 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af089ee-80ff-4943-b8e6-36b2f5ff8066 admin admin] PATH_INFO: `/v3/users` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:02:42.567007 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af089ee-80ff-4943-b8e6-36b2f5ff8066 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:02:42.569334 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686d0819-cd11-4e98-93ea-ffa647a57d5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:02:42.570135 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686d0819-cd11-4e98-93ea-ffa647a57d5b admin admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:02:42.570409 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af089ee-80ff-4943-b8e6-36b2f5ff8066 admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:02:42.570716 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686d0819-cd11-4e98-93ea-ffa647a57d5b admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:02:42.571094 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686d0819-cd11-4e98-93ea-ffa647a57d5b admin admin] PATH_INFO: `/v3/domains` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:02:42.571855 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-686d0819-cd11-4e98-93ea-ffa647a57d5b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81593) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 18:02:42.572390 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-686d0819-cd11-4e98-93ea-ffa647a57d5b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:02:42.574842 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-686d0819-cd11-4e98-93ea-ffa647a57d5b admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:02:42.594478 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 973/1925] 10.222.0.25 () {58 vars in 1153 bytes} [Thu Sep 15 18:02:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 18:02:42.598675 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686d0819-cd11-4e98-93ea-ffa647a57d5b admin admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:02:42.602254 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 953/1926] 10.222.0.25 () {60 vars in 1144 bytes} [Thu Sep 15 18:02:42 2022] POST /identity/v3/users => generated 296 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 18:02:42.605890 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af089ee-80ff-4943-b8e6-36b2f5ff8066 admin admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:02:42.614140 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686d0819-cd11-4e98-93ea-ffa647a57d5b admin admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:02:42.638228 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af089ee-80ff-4943-b8e6-36b2f5ff8066 admin admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:02:42.647556 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62aa1ff-5d66-41af-948b-1b78cfae9236 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:02:42.649819 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a7267c-27cd-4346-a73a-c51a55547223 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:02:42.650612 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a7267c-27cd-4346-a73a-c51a55547223 admin admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:02:42.650954 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a7267c-27cd-4346-a73a-c51a55547223 admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:02:42.651220 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62aa1ff-5d66-41af-948b-1b78cfae9236 admin admin] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:02:42.651981 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a7267c-27cd-4346-a73a-c51a55547223 admin admin] PATH_INFO: `/v3/roles` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:02:42.652864 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a7267c-27cd-4346-a73a-c51a55547223 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:02:42.653223 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62aa1ff-5d66-41af-948b-1b78cfae9236 admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:02:42.653629 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62aa1ff-5d66-41af-948b-1b78cfae9236 admin admin] PATH_INFO: `/v3/projects` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:02:42.655970 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62aa1ff-5d66-41af-948b-1b78cfae9236 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:02:42.657096 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a7267c-27cd-4346-a73a-c51a55547223 admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:02:42.668672 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62aa1ff-5d66-41af-948b-1b78cfae9236 admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:02:42.678080 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 954/1927] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Sep 15 18:02:42 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 18:02:42.678080 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a7267c-27cd-4346-a73a-c51a55547223 admin admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:02:42.679326 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-32a7267c-27cd-4346-a73a-c51a55547223 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:02:42.715474 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a7267c-27cd-4346-a73a-c51a55547223 admin admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:02:42.723173 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2826a994-dbe1-4aa9-9711-cde2d8ce4f99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:02:42.729088 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2826a994-dbe1-4aa9-9711-cde2d8ce4f99 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:02:42.729831 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2826a994-dbe1-4aa9-9711-cde2d8ce4f99 admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:02:42.729831 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2826a994-dbe1-4aa9-9711-cde2d8ce4f99 admin admin] PATH_INFO: `/v3/projects/b440decbc44a4c2fa11727c86e713e2a` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:02:42.733183 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 974/1928] 10.222.0.25 () {60 vars in 1153 bytes} [Thu Sep 15 18:02:42 2022] POST /identity/v3/projects => generated 381 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 18:02:42.733183 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62aa1ff-5d66-41af-948b-1b78cfae9236 admin admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:02:42.735146 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2826a994-dbe1-4aa9-9711-cde2d8ce4f99 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b440decbc44a4c2fa11727c86e713e2a)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:02:42.743151 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2826a994-dbe1-4aa9-9711-cde2d8ce4f99 admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:02:42.804328 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 18:02:42.812277 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-2826a994-dbe1-4aa9-9711-cde2d8ce4f99 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b440decbc44a4c2fa11727c86e713e2a', 'request_id': 'req-2826a994-dbe1-4aa9-9711-cde2d8ce4f99'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:02:42.827027 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-2826a994-dbe1-4aa9-9711-cde2d8ce4f99 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b440decbc44a4c2fa11727c86e713e2a', 'request_id': 'req-2826a994-dbe1-4aa9-9711-cde2d8ce4f99'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:02:42.838351 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-2826a994-dbe1-4aa9-9711-cde2d8ce4f99 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b440decbc44a4c2fa11727c86e713e2a', 'request_id': 'req-2826a994-dbe1-4aa9-9711-cde2d8ce4f99'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:02:42.853511 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62aa1ff-5d66-41af-948b-1b78cfae9236 admin admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:02:42.882612 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-2826a994-dbe1-4aa9-9711-cde2d8ce4f99 admin admin] The token cache is being invalidate because project b440decbc44a4c2fa11727c86e713e2a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81592) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 18:02:42.889120 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-2826a994-dbe1-4aa9-9711-cde2d8ce4f99 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:02:42.890406 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-2826a994-dbe1-4aa9-9711-cde2d8ce4f99 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:02:42.900943 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 955/1929] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Sep 15 18:02:42 2022] DELETE /identity/v3/projects/b440decbc44a4c2fa11727c86e713e2a => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 18:02:42.900943 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2826a994-dbe1-4aa9-9711-cde2d8ce4f99 admin admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:02:42.900943 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-2826a994-dbe1-4aa9-9711-cde2d8ce4f99 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:02:42.996123 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27078b8-f8c0-47d0-aaa0-871b3431f472 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:02:42.996815 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27078b8-f8c0-47d0-aaa0-871b3431f472 admin admin] REQUEST_METHOD: `PUT` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:02:42.997152 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27078b8-f8c0-47d0-aaa0-871b3431f472 admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:02:42.997397 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27078b8-f8c0-47d0-aaa0-871b3431f472 admin admin] PATH_INFO: `/v3/projects/b7e988163f0e4cfb88933a0a381cebb1/users/3c05bd7650b44bebbc133affe618ce51/roles/a9e42be86923434f8af52d3fc07fb4f7` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:02:43.051677 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c27078b8-f8c0-47d0-aaa0-871b3431f472 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b7e988163f0e4cfb88933a0a381cebb1, user_id=3c05bd7650b44bebbc133affe618ce51, role_id=a9e42be86923434f8af52d3fc07fb4f7)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:02:43.070253 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c27078b8-f8c0-47d0-aaa0-871b3431f472 admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:02:43.102890 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 975/1930] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Sep 15 18:02:42 2022] PUT /identity/v3/projects/b7e988163f0e4cfb88933a0a381cebb1/users/3c05bd7650b44bebbc133affe618ce51/roles/a9e42be86923434f8af52d3fc07fb4f7 => generated 0 bytes in 372 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 18:02:43.104739 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3359ce-1e5e-4722-81e9-ac095986e596 None None] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:02:43.105222 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3359ce-1e5e-4722-81e9-ac095986e596 None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:02:43.105799 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3359ce-1e5e-4722-81e9-ac095986e596 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:02:43.134887 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.auth.core [None req-3d3359ce-1e5e-4722-81e9-ac095986e596 None None] MFA Rules not processed for user `5cfa58ef86774ab7800bf91930bf6028`. Rule list: `[]` (Enabled: `True`). {{(pid=81593) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 18:02:43.135236 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2826a994-dbe1-4aa9-9711-cde2d8ce4f99 admin admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:02:43.137070 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-3d3359ce-1e5e-4722-81e9-ac095986e596 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:02:43.173389 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 18:02:43.231186 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763e3c47-33f4-4dbf-a6eb-d27089918d58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:02:43.231918 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763e3c47-33f4-4dbf-a6eb-d27089918d58 admin admin] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:02:43.232151 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 976/1931] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 15 18:02:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 18:02:43.233936 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3359ce-1e5e-4722-81e9-ac095986e596 None None] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:02:43.235967 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-3d3359ce-1e5e-4722-81e9-ac095986e596 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:02:43.240409 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763e3c47-33f4-4dbf-a6eb-d27089918d58 admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:02:43.241495 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763e3c47-33f4-4dbf-a6eb-d27089918d58 admin admin] PATH_INFO: `/v3/users` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:02:43.241699 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763e3c47-33f4-4dbf-a6eb-d27089918d58 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:02:43.243854 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763e3c47-33f4-4dbf-a6eb-d27089918d58 admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:02:43.254430 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3359ce-1e5e-4722-81e9-ac095986e596 None None] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:02:43.260274 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e09dee1-32e0-4cac-85a9-a103f7aeb4d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:02:43.260990 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e09dee1-32e0-4cac-85a9-a103f7aeb4d5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:02:43.261398 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e09dee1-32e0-4cac-85a9-a103f7aeb4d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:02:43.261571 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e09dee1-32e0-4cac-85a9-a103f7aeb4d5 admin admin] PATH_INFO: `/v3/projects/972595ad54d74c93b7a918d62db3b65b` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:02:43.262956 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e09dee1-32e0-4cac-85a9-a103f7aeb4d5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=972595ad54d74c93b7a918d62db3b65b)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:02:43.265431 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e09dee1-32e0-4cac-85a9-a103f7aeb4d5 admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:02:43.269124 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 956/1932] 10.222.0.25 () {60 vars in 1144 bytes} [Thu Sep 15 18:02:42 2022] POST /identity/v3/users => generated 291 bytes in 375 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 18:02:43.270087 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763e3c47-33f4-4dbf-a6eb-d27089918d58 admin admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:02:43.271938 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-763e3c47-33f4-4dbf-a6eb-d27089918d58 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:02:43.285844 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763e3c47-33f4-4dbf-a6eb-d27089918d58 admin admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:02:43.293137 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562e367d-4ad0-4dc6-90e7-f74b73da38bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:02:43.293805 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562e367d-4ad0-4dc6-90e7-f74b73da38bd admin admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:02:43.294124 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562e367d-4ad0-4dc6-90e7-f74b73da38bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:02:43.294363 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562e367d-4ad0-4dc6-90e7-f74b73da38bd admin admin] PATH_INFO: `/v3/roles` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:02:43.295573 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562e367d-4ad0-4dc6-90e7-f74b73da38bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:02:43.300561 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562e367d-4ad0-4dc6-90e7-f74b73da38bd admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:02:43.315919 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 957/1933] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Sep 15 18:02:43 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 18:02:43.317672 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271811e5-d8cd-41e5-8c8b-dab1dc0060d3 None None] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:02:43.317672 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271811e5-d8cd-41e5-8c8b-dab1dc0060d3 None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:02:43.317953 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271811e5-d8cd-41e5-8c8b-dab1dc0060d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:02:43.335636 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-8e09dee1-32e0-4cac-85a9-a103f7aeb4d5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '972595ad54d74c93b7a918d62db3b65b', 'request_id': 'req-8e09dee1-32e0-4cac-85a9-a103f7aeb4d5'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:02:43.344256 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-8e09dee1-32e0-4cac-85a9-a103f7aeb4d5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '972595ad54d74c93b7a918d62db3b65b', 'request_id': 'req-8e09dee1-32e0-4cac-85a9-a103f7aeb4d5'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:02:43.346237 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=93,keystone:INSERT=1,keystone:DELETE=6 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 18:02:43.348763 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.auth.core [None req-271811e5-d8cd-41e5-8c8b-dab1dc0060d3 None None] MFA Rules not processed for user `5cfa58ef86774ab7800bf91930bf6028`. Rule list: `[]` (Enabled: `True`). {{(pid=81592) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 18:02:43.350538 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-271811e5-d8cd-41e5-8c8b-dab1dc0060d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:02:43.363588 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-8e09dee1-32e0-4cac-85a9-a103f7aeb4d5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '972595ad54d74c93b7a918d62db3b65b', 'request_id': 'req-8e09dee1-32e0-4cac-85a9-a103f7aeb4d5'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:02:43.386116 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-8e09dee1-32e0-4cac-85a9-a103f7aeb4d5 admin admin] The token cache is being invalidate because project 972595ad54d74c93b7a918d62db3b65b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81593) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 18:02:43.386784 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-8e09dee1-32e0-4cac-85a9-a103f7aeb4d5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:02:43.387713 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-8e09dee1-32e0-4cac-85a9-a103f7aeb4d5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:02:43.392262 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 977/1934] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Sep 15 18:02:43 2022] DELETE /identity/v3/projects/972595ad54d74c93b7a918d62db3b65b => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 18:02:43.393583 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e09dee1-32e0-4cac-85a9-a103f7aeb4d5 admin admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:02:43.395570 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-8e09dee1-32e0-4cac-85a9-a103f7aeb4d5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:02:43.442858 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 958/1935] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 15 18:02:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 18:02:43.443697 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271811e5-d8cd-41e5-8c8b-dab1dc0060d3 None None] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:02:43.445129 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-271811e5-d8cd-41e5-8c8b-dab1dc0060d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:02:43.462603 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271811e5-d8cd-41e5-8c8b-dab1dc0060d3 None None] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:02:43.468582 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a488f5-ea6c-4396-88a7-4ce4b53fe082 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:02:43.469638 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a488f5-ea6c-4396-88a7-4ce4b53fe082 admin admin] REQUEST_METHOD: `PUT` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:02:43.469926 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a488f5-ea6c-4396-88a7-4ce4b53fe082 admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:02:43.470201 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a488f5-ea6c-4396-88a7-4ce4b53fe082 admin admin] PATH_INFO: `/v3/projects/b7e988163f0e4cfb88933a0a381cebb1/users/3c05bd7650b44bebbc133affe618ce51/roles/a9e42be86923434f8af52d3fc07fb4f7` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:02:43.472565 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a488f5-ea6c-4396-88a7-4ce4b53fe082 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b7e988163f0e4cfb88933a0a381cebb1, user_id=3c05bd7650b44bebbc133affe618ce51, role_id=a9e42be86923434f8af52d3fc07fb4f7)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:02:43.475536 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a488f5-ea6c-4396-88a7-4ce4b53fe082 admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:02:43.489977 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e09dee1-32e0-4cac-85a9-a103f7aeb4d5 admin admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:02:43.490925 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 959/1936] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Sep 15 18:02:43 2022] PUT /identity/v3/projects/b7e988163f0e4cfb88933a0a381cebb1/users/3c05bd7650b44bebbc133affe618ce51/roles/a9e42be86923434f8af52d3fc07fb4f7 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 18:02:43.492437 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c96a6d-85e1-4543-a6a1-bade7aeebcbc None None] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:02:43.492437 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c96a6d-85e1-4543-a6a1-bade7aeebcbc None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:02:43.492651 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c96a6d-85e1-4543-a6a1-bade7aeebcbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:02:43.521127 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.auth.core [None req-c5c96a6d-85e1-4543-a6a1-bade7aeebcbc None None] MFA Rules not processed for user `5cfa58ef86774ab7800bf91930bf6028`. Rule list: `[]` (Enabled: `True`). {{(pid=81592) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 18:02:43.523046 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-c5c96a6d-85e1-4543-a6a1-bade7aeebcbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:02:43.595465 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80dcf9c1-ee15-4f85-9a59-05cd9c681576 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:02:43.596357 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80dcf9c1-ee15-4f85-9a59-05cd9c681576 admin admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:02:43.596824 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80dcf9c1-ee15-4f85-9a59-05cd9c681576 admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:02:43.597379 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80dcf9c1-ee15-4f85-9a59-05cd9c681576 admin admin] PATH_INFO: `/v3/roles` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:02:43.598092 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80dcf9c1-ee15-4f85-9a59-05cd9c681576 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:02:43.603555 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80dcf9c1-ee15-4f85-9a59-05cd9c681576 admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:02:43.624780 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 978/1937] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Sep 15 18:02:43 2022] GET /identity/v3/roles => generated 1420 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 18:02:43.625903 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80dcf9c1-ee15-4f85-9a59-05cd9c681576 admin admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:02:43.632875 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 960/1938] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 15 18:02:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 18:02:43.634648 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76e7431-863b-4be6-adcc-dc72ef6747c7 None None] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:02:43.634998 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76e7431-863b-4be6-adcc-dc72ef6747c7 None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:02:43.635350 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76e7431-863b-4be6-adcc-dc72ef6747c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:02:43.645398 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80dcf9c1-ee15-4f85-9a59-05cd9c681576 admin admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:02:43.650491 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a664ee-6bef-4b16-8d81-1f00cf2bed1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:02:43.651277 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a664ee-6bef-4b16-8d81-1f00cf2bed1f admin admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:02:43.651767 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a664ee-6bef-4b16-8d81-1f00cf2bed1f admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:02:43.652765 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a664ee-6bef-4b16-8d81-1f00cf2bed1f admin admin] PATH_INFO: `/v3/domains` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:02:43.653604 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a664ee-6bef-4b16-8d81-1f00cf2bed1f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81593) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 18:02:43.654050 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a664ee-6bef-4b16-8d81-1f00cf2bed1f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:02:43.657019 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a664ee-6bef-4b16-8d81-1f00cf2bed1f admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:02:43.675879 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 979/1939] 10.222.0.25 () {58 vars in 1153 bytes} [Thu Sep 15 18:02:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 18:02:43.675879 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a664ee-6bef-4b16-8d81-1f00cf2bed1f admin admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:02:43.677329 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.auth.core [None req-a76e7431-863b-4be6-adcc-dc72ef6747c7 None None] MFA Rules not processed for user `3c05bd7650b44bebbc133affe618ce51`. Rule list: `[]` (Enabled: `True`). {{(pid=81592) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 18:02:43.678621 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-a76e7431-863b-4be6-adcc-dc72ef6747c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:02:43.686595 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a664ee-6bef-4b16-8d81-1f00cf2bed1f admin admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:02:43.692179 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30166cd-08ae-4e0d-a7f7-8aa73bc2e0b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:02:43.692904 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30166cd-08ae-4e0d-a7f7-8aa73bc2e0b2 admin admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:02:43.693245 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30166cd-08ae-4e0d-a7f7-8aa73bc2e0b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:02:43.693685 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30166cd-08ae-4e0d-a7f7-8aa73bc2e0b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:02:43.694429 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f30166cd-08ae-4e0d-a7f7-8aa73bc2e0b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:02:43.696116 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f30166cd-08ae-4e0d-a7f7-8aa73bc2e0b2 admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:02:43.704390 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 18:02:43.708103 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 980/1940] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Sep 15 18:02:43 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 18:02:43.710715 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1e6b11-03b0-4fac-9c05-0c4d17a4b257 None None] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:02:43.712424 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1e6b11-03b0-4fac-9c05-0c4d17a4b257 None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:02:43.712966 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1e6b11-03b0-4fac-9c05-0c4d17a4b257 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:02:43.739193 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.auth.core [None req-9e1e6b11-03b0-4fac-9c05-0c4d17a4b257 None None] MFA Rules not processed for user `5cfa58ef86774ab7800bf91930bf6028`. Rule list: `[]` (Enabled: `True`). {{(pid=81593) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 18:02:43.740463 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-9e1e6b11-03b0-4fac-9c05-0c4d17a4b257 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:02:43.749582 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 981/1941] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 15 18:02:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 18:02:43.750247 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1e6b11-03b0-4fac-9c05-0c4d17a4b257 None None] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:02:43.760708 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1e6b11-03b0-4fac-9c05-0c4d17a4b257 None None] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:02:43.765914 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 961/1942] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 15 18:02:43 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 18:02:43.766774 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76e7431-863b-4be6-adcc-dc72ef6747c7 None None] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:02:43.767056 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b2ccf9-e754-4e42-b970-3d2ad9fdb3ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:02:43.767716 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b2ccf9-e754-4e42-b970-3d2ad9fdb3ac admin admin] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:02:43.768029 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b2ccf9-e754-4e42-b970-3d2ad9fdb3ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:02:43.768439 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b2ccf9-e754-4e42-b970-3d2ad9fdb3ac admin admin] PATH_INFO: `/v3/projects` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:02:43.769060 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b2ccf9-e754-4e42-b970-3d2ad9fdb3ac admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:02:43.775047 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b2ccf9-e754-4e42-b970-3d2ad9fdb3ac admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:02:43.778538 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76e7431-863b-4be6-adcc-dc72ef6747c7 None None] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:02:43.785558 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05865eb3-f5f9-4f1b-aafa-c5791859cd29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:02:43.786503 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05865eb3-f5f9-4f1b-aafa-c5791859cd29 admin admin] REQUEST_METHOD: `PUT` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:02:43.786802 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05865eb3-f5f9-4f1b-aafa-c5791859cd29 admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:02:43.787063 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05865eb3-f5f9-4f1b-aafa-c5791859cd29 admin admin] PATH_INFO: `/v3/projects/faff8f65778941eeb5ad674252deea40/users/b071345e56144284ae26e34ad929cafe/roles/343cc8b1bc7243eebabdf08147e8366d` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:02:43.808064 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05865eb3-f5f9-4f1b-aafa-c5791859cd29 admin admin] RBAC: Authorizing `identity:create_grant(project_id=faff8f65778941eeb5ad674252deea40, user_id=b071345e56144284ae26e34ad929cafe, role_id=343cc8b1bc7243eebabdf08147e8366d)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:02:43.811108 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 982/1943] 10.222.0.25 () {60 vars in 1153 bytes} [Thu Sep 15 18:02:43 2022] POST /identity/v3/projects => generated 385 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 18:02:43.812144 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05865eb3-f5f9-4f1b-aafa-c5791859cd29 admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:02:43.812574 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b2ccf9-e754-4e42-b970-3d2ad9fdb3ac admin admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:02:43.829859 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 962/1944] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Sep 15 18:02:43 2022] PUT /identity/v3/projects/faff8f65778941eeb5ad674252deea40/users/b071345e56144284ae26e34ad929cafe/roles/343cc8b1bc7243eebabdf08147e8366d => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 18:02:43.831117 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05865eb3-f5f9-4f1b-aafa-c5791859cd29 admin admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:02:43.832964 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-05865eb3-f5f9-4f1b-aafa-c5791859cd29 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:02:43.872756 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:INSERT=2,keystone:DELETE=1,keystone:SELECT=97 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 18:02:43.918638 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b2ccf9-e754-4e42-b970-3d2ad9fdb3ac admin admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:02:43.965559 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05865eb3-f5f9-4f1b-aafa-c5791859cd29 admin admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:02:43.971055 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b2c4e5-34c2-4fe5-bae7-9afb64e9d485 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b232e7a841145ba93c6d8462ccb751a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1213c0d1b584404ba3998e136f166e89', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:02:43.972032 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b2c4e5-34c2-4fe5-bae7-9afb64e9d485 service cinder] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:02:43.972443 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b2c4e5-34c2-4fe5-bae7-9afb64e9d485 service cinder] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:02:43.972717 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b2c4e5-34c2-4fe5-bae7-9afb64e9d485 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:02:44.030698 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a235e7b-b5fb-4abb-93fa-3a49c949f44d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:02:44.032834 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a235e7b-b5fb-4abb-93fa-3a49c949f44d admin admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:02:44.033428 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a235e7b-b5fb-4abb-93fa-3a49c949f44d admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:02:44.035439 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a235e7b-b5fb-4abb-93fa-3a49c949f44d admin admin] PATH_INFO: `/v3/domains` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:02:44.036340 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a235e7b-b5fb-4abb-93fa-3a49c949f44d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81593) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 18:02:44.036830 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a235e7b-b5fb-4abb-93fa-3a49c949f44d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:02:44.038698 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a235e7b-b5fb-4abb-93fa-3a49c949f44d admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:02:44.059803 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 983/1945] 10.222.0.25 () {58 vars in 1153 bytes} [Thu Sep 15 18:02:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 18:02:44.062094 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a235e7b-b5fb-4abb-93fa-3a49c949f44d admin admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:02:44.075583 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a235e7b-b5fb-4abb-93fa-3a49c949f44d admin admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:02:44.078932 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b2c4e5-34c2-4fe5-bae7-9afb64e9d485 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:02:44.080578 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b2c4e5-34c2-4fe5-bae7-9afb64e9d485 service cinder] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:02:44.082039 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50176355-acdf-4264-b838-2c51e9d50c98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:02:44.082774 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50176355-acdf-4264-b838-2c51e9d50c98 admin admin] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:02:44.083056 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50176355-acdf-4264-b838-2c51e9d50c98 admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:02:44.083330 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50176355-acdf-4264-b838-2c51e9d50c98 admin admin] PATH_INFO: `/v3/users` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:02:44.084088 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50176355-acdf-4264-b838-2c51e9d50c98 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:02:44.086264 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50176355-acdf-4264-b838-2c51e9d50c98 admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:02:44.098386 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 963/1946] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 15 18:02:43 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 267 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 18:02:44.101335 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e67c44-f9c7-46eb-a84b-a36978dee7da None None] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:02:44.101745 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e67c44-f9c7-46eb-a84b-a36978dee7da None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:02:44.102504 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e67c44-f9c7-46eb-a84b-a36978dee7da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:02:44.123028 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 984/1947] 10.222.0.25 () {60 vars in 1144 bytes} [Thu Sep 15 18:02:44 2022] POST /identity/v3/users => generated 293 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 18:02:44.123028 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50176355-acdf-4264-b838-2c51e9d50c98 admin admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:02:44.182364 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50176355-acdf-4264-b838-2c51e9d50c98 admin admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:02:44.188190 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85fa9362-7840-4311-be0d-6a0ef511e41c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:02:44.188812 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fa9362-7840-4311-be0d-6a0ef511e41c admin admin] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:02:44.189161 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fa9362-7840-4311-be0d-6a0ef511e41c admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:02:44.189380 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fa9362-7840-4311-be0d-6a0ef511e41c admin admin] PATH_INFO: `/v3/projects` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:02:44.190026 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85fa9362-7840-4311-be0d-6a0ef511e41c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:02:44.203646 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85fa9362-7840-4311-be0d-6a0ef511e41c admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:02:44.208264 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.auth.core [None req-90e67c44-f9c7-46eb-a84b-a36978dee7da None None] MFA Rules not processed for user `b071345e56144284ae26e34ad929cafe`. Rule list: `[]` (Enabled: `True`). {{(pid=81592) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 18:02:44.211048 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-90e67c44-f9c7-46eb-a84b-a36978dee7da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:02:44.259715 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 985/1948] 10.222.0.25 () {60 vars in 1153 bytes} [Thu Sep 15 18:02:44 2022] POST /identity/v3/projects => generated 387 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 18:02:44.260719 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85fa9362-7840-4311-be0d-6a0ef511e41c admin admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:02:44.278451 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 18:02:44.369072 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 964/1949] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 15 18:02:44 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 270 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 18:02:44.370833 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e67c44-f9c7-46eb-a84b-a36978dee7da None None] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:02:44.409758 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e67c44-f9c7-46eb-a84b-a36978dee7da None None] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:02:44.462055 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85fa9362-7840-4311-be0d-6a0ef511e41c admin admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:02:44.470261 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658e0287-a4ee-48f8-8986-1bdb31fc12f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:02:44.471039 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658e0287-a4ee-48f8-8986-1bdb31fc12f0 admin admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:02:44.471255 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658e0287-a4ee-48f8-8986-1bdb31fc12f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:02:44.471591 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658e0287-a4ee-48f8-8986-1bdb31fc12f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:02:44.472282 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-658e0287-a4ee-48f8-8986-1bdb31fc12f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:02:44.476476 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-658e0287-a4ee-48f8-8986-1bdb31fc12f0 admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:02:44.508075 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 986/1950] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Sep 15 18:02:44 2022] GET /identity/v3/roles => generated 1420 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 18:02:44.509379 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658e0287-a4ee-48f8-8986-1bdb31fc12f0 admin admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:02:44.527666 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658e0287-a4ee-48f8-8986-1bdb31fc12f0 admin admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:02:44.529899 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa615e8-f521-4218-946d-267e586eb887 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b232e7a841145ba93c6d8462ccb751a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1213c0d1b584404ba3998e136f166e89', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:02:44.530903 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa615e8-f521-4218-946d-267e586eb887 service cinder] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:02:44.531178 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa615e8-f521-4218-946d-267e586eb887 service cinder] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:02:44.531465 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa615e8-f521-4218-946d-267e586eb887 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:02:44.534771 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-9aa615e8-f521-4218-946d-267e586eb887 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:02:44.542060 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4333d042-2545-47cb-91b8-64adebd5f3ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:02:44.542916 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4333d042-2545-47cb-91b8-64adebd5f3ce admin admin] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:02:44.543198 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4333d042-2545-47cb-91b8-64adebd5f3ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:02:44.543493 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4333d042-2545-47cb-91b8-64adebd5f3ce admin admin] PATH_INFO: `/v3/users` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:02:44.544139 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4333d042-2545-47cb-91b8-64adebd5f3ce admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:02:44.548369 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4333d042-2545-47cb-91b8-64adebd5f3ce admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:02:44.588558 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 987/1951] 10.222.0.25 () {60 vars in 1144 bytes} [Thu Sep 15 18:02:44 2022] POST /identity/v3/users => generated 294 bytes in 77 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 18:02:44.588558 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4333d042-2545-47cb-91b8-64adebd5f3ce admin admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:02:44.614766 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4333d042-2545-47cb-91b8-64adebd5f3ce admin admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:02:44.631033 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa615e8-f521-4218-946d-267e586eb887 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:02:44.631158 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19bb4f56-7b26-4a51-a593-d8371c98e4f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:02:44.631847 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bb4f56-7b26-4a51-a593-d8371c98e4f9 admin admin] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:02:44.632132 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bb4f56-7b26-4a51-a593-d8371c98e4f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:02:44.632494 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bb4f56-7b26-4a51-a593-d8371c98e4f9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:02:44.632711 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa615e8-f521-4218-946d-267e586eb887 service cinder] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:02:44.633225 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19bb4f56-7b26-4a51-a593-d8371c98e4f9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:02:44.635616 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19bb4f56-7b26-4a51-a593-d8371c98e4f9 admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:02:44.659070 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 965/1952] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 15 18:02:44 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 289 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 18:02:44.660254 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa615e8-f521-4218-946d-267e586eb887 service cinder] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:02:44.676472 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 18:02:44.700052 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa615e8-f521-4218-946d-267e586eb887 service cinder] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:02:44.701553 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 988/1953] 10.222.0.25 () {60 vars in 1153 bytes} [Thu Sep 15 18:02:44 2022] POST /identity/v3/projects => generated 379 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 18:02:44.703011 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19bb4f56-7b26-4a51-a593-d8371c98e4f9 admin admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:02:44.827896 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0fd1e3-49c9-49bd-b25a-4ba35eee0c42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:02:44.830240 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0fd1e3-49c9-49bd-b25a-4ba35eee0c42 admin admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:02:44.830582 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0fd1e3-49c9-49bd-b25a-4ba35eee0c42 admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:02:44.832381 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0fd1e3-49c9-49bd-b25a-4ba35eee0c42 admin admin] PATH_INFO: `/v3/roles` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:02:44.834561 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a0fd1e3-49c9-49bd-b25a-4ba35eee0c42 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:02:44.841979 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19bb4f56-7b26-4a51-a593-d8371c98e4f9 admin admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:02:44.844803 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a0fd1e3-49c9-49bd-b25a-4ba35eee0c42 admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:02:44.849507 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407696d6-2446-41c1-8d20-7fc55897dc2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:02:44.850276 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407696d6-2446-41c1-8d20-7fc55897dc2a admin admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:02:44.850561 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407696d6-2446-41c1-8d20-7fc55897dc2a admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:02:44.850869 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407696d6-2446-41c1-8d20-7fc55897dc2a admin admin] PATH_INFO: `/v3/roles` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:02:44.851491 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-407696d6-2446-41c1-8d20-7fc55897dc2a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:02:44.853126 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-407696d6-2446-41c1-8d20-7fc55897dc2a admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:02:44.898621 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 966/1954] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Sep 15 18:02:44 2022] GET /identity/v3/roles => generated 1420 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 18:02:44.902351 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0fd1e3-49c9-49bd-b25a-4ba35eee0c42 admin admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:02:44.911396 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 989/1955] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Sep 15 18:02:44 2022] GET /identity/v3/roles => generated 1420 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 18:02:44.916373 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407696d6-2446-41c1-8d20-7fc55897dc2a admin admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:02:44.948622 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0fd1e3-49c9-49bd-b25a-4ba35eee0c42 admin admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:02:44.954703 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407696d6-2446-41c1-8d20-7fc55897dc2a admin admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:02:44.959861 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e530c7-746a-4ea3-bdee-1a727c81f331 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:02:44.961150 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e530c7-746a-4ea3-bdee-1a727c81f331 admin admin] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:02:44.961618 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e530c7-746a-4ea3-bdee-1a727c81f331 admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:02:44.962116 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e530c7-746a-4ea3-bdee-1a727c81f331 admin admin] PATH_INFO: `/v3/users` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:02:44.962887 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e530c7-746a-4ea3-bdee-1a727c81f331 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:02:44.969715 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e530c7-746a-4ea3-bdee-1a727c81f331 admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:02:44.984402 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1728323-37a6-4cd6-8e6e-2688c42237c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:02:44.985091 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1728323-37a6-4cd6-8e6e-2688c42237c3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:02:44.985398 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1728323-37a6-4cd6-8e6e-2688c42237c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:02:44.985672 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1728323-37a6-4cd6-8e6e-2688c42237c3 admin admin] PATH_INFO: `/v3/projects/ce3d7b087eef483fb14f10da0d8e4bf9/users/f9da763038b5487e8a880f63f71b53ca/roles/343cc8b1bc7243eebabdf08147e8366d` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:02:45.030000 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 967/1956] 10.222.0.25 () {60 vars in 1144 bytes} [Thu Sep 15 18:02:44 2022] POST /identity/v3/users => generated 296 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 18:02:45.030000 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e530c7-746a-4ea3-bdee-1a727c81f331 admin admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:02:45.033339 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1728323-37a6-4cd6-8e6e-2688c42237c3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ce3d7b087eef483fb14f10da0d8e4bf9, user_id=f9da763038b5487e8a880f63f71b53ca, role_id=343cc8b1bc7243eebabdf08147e8366d)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:02:45.037551 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1728323-37a6-4cd6-8e6e-2688c42237c3 admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:02:45.048101 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e530c7-746a-4ea3-bdee-1a727c81f331 admin admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:02:45.056807 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 18:02:45.061068 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 990/1957] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Sep 15 18:02:44 2022] PUT /identity/v3/projects/ce3d7b087eef483fb14f10da0d8e4bf9/users/f9da763038b5487e8a880f63f71b53ca/roles/343cc8b1bc7243eebabdf08147e8366d => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 18:02:45.061888 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1728323-37a6-4cd6-8e6e-2688c42237c3 admin admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:02:45.178226 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39800a66-3ab9-49e2-ad15-4aa3b962c138 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:02:45.179569 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39800a66-3ab9-49e2-ad15-4aa3b962c138 admin admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:02:45.179684 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39800a66-3ab9-49e2-ad15-4aa3b962c138 admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:02:45.179918 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39800a66-3ab9-49e2-ad15-4aa3b962c138 admin admin] PATH_INFO: `/v3/roles` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:02:45.180609 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39800a66-3ab9-49e2-ad15-4aa3b962c138 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:02:45.182521 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39800a66-3ab9-49e2-ad15-4aa3b962c138 admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:02:45.185409 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1728323-37a6-4cd6-8e6e-2688c42237c3 admin admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:02:45.192253 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5c46fc-e631-44f6-b269-afb9f1297a8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:02:45.193453 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5c46fc-e631-44f6-b269-afb9f1297a8a admin admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:02:45.193865 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5c46fc-e631-44f6-b269-afb9f1297a8a admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:02:45.194247 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5c46fc-e631-44f6-b269-afb9f1297a8a admin admin] PATH_INFO: `/v3/roles` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:02:45.195003 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5c46fc-e631-44f6-b269-afb9f1297a8a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:02:45.195541 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 968/1958] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Sep 15 18:02:45 2022] GET /identity/v3/roles => generated 1420 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 18:02:45.208606 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5c46fc-e631-44f6-b269-afb9f1297a8a admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:02:45.208941 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fafe14-edec-45bc-a98d-86fe635193da None None] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:02:45.208941 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fafe14-edec-45bc-a98d-86fe635193da None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:02:45.208941 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fafe14-edec-45bc-a98d-86fe635193da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:02:45.222015 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 991/1959] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Sep 15 18:02:45 2022] GET /identity/v3/roles => generated 1420 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 18:02:45.222956 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5c46fc-e631-44f6-b269-afb9f1297a8a admin admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:02:45.239341 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5c46fc-e631-44f6-b269-afb9f1297a8a admin admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:02:45.245268 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3869a5-7b30-4eaf-9320-187a9d15fc7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:02:45.246546 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3869a5-7b30-4eaf-9320-187a9d15fc7c admin admin] REQUEST_METHOD: `PUT` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:02:45.246913 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3869a5-7b30-4eaf-9320-187a9d15fc7c admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:02:45.247264 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3869a5-7b30-4eaf-9320-187a9d15fc7c admin admin] PATH_INFO: `/v3/projects/85fb828e45114a54b9db2e180f1d2424/users/b7d37ac607e549c3a0e64723906fccc2/roles/343cc8b1bc7243eebabdf08147e8366d` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:02:45.249404 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.auth.core [None req-16fafe14-edec-45bc-a98d-86fe635193da None None] MFA Rules not processed for user `f9da763038b5487e8a880f63f71b53ca`. Rule list: `[]` (Enabled: `True`). {{(pid=81592) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 18:02:45.251515 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-16fafe14-edec-45bc-a98d-86fe635193da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:02:45.284986 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3869a5-7b30-4eaf-9320-187a9d15fc7c admin admin] RBAC: Authorizing `identity:create_grant(project_id=85fb828e45114a54b9db2e180f1d2424, user_id=b7d37ac607e549c3a0e64723906fccc2, role_id=343cc8b1bc7243eebabdf08147e8366d)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:02:45.287840 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3869a5-7b30-4eaf-9320-187a9d15fc7c admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:02:45.314496 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 992/1960] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Sep 15 18:02:45 2022] PUT /identity/v3/projects/85fb828e45114a54b9db2e180f1d2424/users/b7d37ac607e549c3a0e64723906fccc2/roles/343cc8b1bc7243eebabdf08147e8366d => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 18:02:45.315961 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3869a5-7b30-4eaf-9320-187a9d15fc7c admin admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:02:45.345456 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 969/1961] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 15 18:02:45 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 18:02:45.346902 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ffcd75-bce1-4aa5-bfb8-fd359345af46 None None] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:02:45.347296 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ffcd75-bce1-4aa5-bfb8-fd359345af46 None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:02:45.347674 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ffcd75-bce1-4aa5-bfb8-fd359345af46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:02:45.380115 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.auth.core [None req-36ffcd75-bce1-4aa5-bfb8-fd359345af46 None None] MFA Rules not processed for user `b7d37ac607e549c3a0e64723906fccc2`. Rule list: `[]` (Enabled: `True`). {{(pid=81592) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 18:02:45.381499 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-36ffcd75-bce1-4aa5-bfb8-fd359345af46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:02:45.393196 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 18:02:45.415321 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3869a5-7b30-4eaf-9320-187a9d15fc7c admin admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:02:45.420972 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50200f00-66a6-4e90-bfdc-bbfc88d531f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:02:45.421982 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50200f00-66a6-4e90-bfdc-bbfc88d531f9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:02:45.422197 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50200f00-66a6-4e90-bfdc-bbfc88d531f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:02:45.422475 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50200f00-66a6-4e90-bfdc-bbfc88d531f9 admin admin] PATH_INFO: `/v3/projects/e92693c3d7e94a76b241ad02eaa49537/users/52656926e08249928e127cb796d34fe7/roles/a9e42be86923434f8af52d3fc07fb4f7` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:02:45.450134 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50200f00-66a6-4e90-bfdc-bbfc88d531f9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e92693c3d7e94a76b241ad02eaa49537, user_id=52656926e08249928e127cb796d34fe7, role_id=a9e42be86923434f8af52d3fc07fb4f7)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:02:45.455161 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50200f00-66a6-4e90-bfdc-bbfc88d531f9 admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:02:45.477427 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 993/1962] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Sep 15 18:02:45 2022] PUT /identity/v3/projects/e92693c3d7e94a76b241ad02eaa49537/users/52656926e08249928e127cb796d34fe7/roles/a9e42be86923434f8af52d3fc07fb4f7 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 18:02:45.478662 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50200f00-66a6-4e90-bfdc-bbfc88d531f9 admin admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:02:45.486257 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 970/1963] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 15 18:02:45 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 18:02:45.487432 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ffcd75-bce1-4aa5-bfb8-fd359345af46 None None] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:02:45.502642 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ffcd75-bce1-4aa5-bfb8-fd359345af46 None None] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:02:45.537022 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 18:02:45.568954 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50200f00-66a6-4e90-bfdc-bbfc88d531f9 admin admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:02:45.575010 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b13462a-862b-43a6-ae73-d3512c4927fb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b232e7a841145ba93c6d8462ccb751a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1213c0d1b584404ba3998e136f166e89', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:02:45.575675 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b13462a-862b-43a6-ae73-d3512c4927fb service cinder] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:02:45.575958 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b13462a-862b-43a6-ae73-d3512c4927fb service cinder] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:02:45.576249 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b13462a-862b-43a6-ae73-d3512c4927fb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:02:45.588166 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3503596b-78e1-4d92-ac7a-295042e12410 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:02:45.588791 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3503596b-78e1-4d92-ac7a-295042e12410 admin admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:02:45.589068 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3503596b-78e1-4d92-ac7a-295042e12410 admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:02:45.589422 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3503596b-78e1-4d92-ac7a-295042e12410 admin admin] PATH_INFO: `/v3/roles` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:02:45.590024 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3503596b-78e1-4d92-ac7a-295042e12410 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:02:45.591648 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3503596b-78e1-4d92-ac7a-295042e12410 admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:02:45.604063 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 971/1964] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Sep 15 18:02:45 2022] GET /identity/v3/roles => generated 1420 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 18:02:45.608169 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3503596b-78e1-4d92-ac7a-295042e12410 admin admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:02:45.619255 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3503596b-78e1-4d92-ac7a-295042e12410 admin admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:02:45.626434 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0753a9e9-da82-42b1-831b-670802bb16af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:02:45.627114 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0753a9e9-da82-42b1-831b-670802bb16af admin admin] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:02:45.627452 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0753a9e9-da82-42b1-831b-670802bb16af admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:02:45.627736 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0753a9e9-da82-42b1-831b-670802bb16af admin admin] PATH_INFO: `/v3/projects` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:02:45.628287 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0753a9e9-da82-42b1-831b-670802bb16af admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:02:45.630254 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0753a9e9-da82-42b1-831b-670802bb16af admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:02:45.652430 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b13462a-862b-43a6-ae73-d3512c4927fb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:02:45.655526 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b13462a-862b-43a6-ae73-d3512c4927fb service cinder] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:02:45.665637 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 994/1965] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 15 18:02:45 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 188 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 18:02:45.666449 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b13462a-862b-43a6-ae73-d3512c4927fb service cinder] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:02:45.681039 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b13462a-862b-43a6-ae73-d3512c4927fb service cinder] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:02:45.686973 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4698d0-fc69-4b90-ad5b-eb08f02d8ceb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:02:45.687858 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4698d0-fc69-4b90-ad5b-eb08f02d8ceb admin admin] REQUEST_METHOD: `PUT` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:02:45.688281 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4698d0-fc69-4b90-ad5b-eb08f02d8ceb admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:02:45.688645 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 972/1966] 10.222.0.25 () {60 vars in 1153 bytes} [Thu Sep 15 18:02:45 2022] POST /identity/v3/projects => generated 387 bytes in 84 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 18:02:45.688795 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4698d0-fc69-4b90-ad5b-eb08f02d8ceb admin admin] PATH_INFO: `/v3/projects/e92693c3d7e94a76b241ad02eaa49537/users/52656926e08249928e127cb796d34fe7/roles/a9e42be86923434f8af52d3fc07fb4f7` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:02:45.691408 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4698d0-fc69-4b90-ad5b-eb08f02d8ceb admin admin] RBAC: Authorizing `identity:create_grant(project_id=e92693c3d7e94a76b241ad02eaa49537, user_id=52656926e08249928e127cb796d34fe7, role_id=a9e42be86923434f8af52d3fc07fb4f7)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:02:45.692216 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0753a9e9-da82-42b1-831b-670802bb16af admin admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:02:45.695181 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4698d0-fc69-4b90-ad5b-eb08f02d8ceb admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:02:45.714426 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 995/1967] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Sep 15 18:02:45 2022] PUT /identity/v3/projects/e92693c3d7e94a76b241ad02eaa49537/users/52656926e08249928e127cb796d34fe7/roles/a9e42be86923434f8af52d3fc07fb4f7 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 18:02:45.729676 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23220d1e-8062-4361-9be9-09b02f43e884 None None] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:02:45.730464 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23220d1e-8062-4361-9be9-09b02f43e884 None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:02:45.730820 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23220d1e-8062-4361-9be9-09b02f43e884 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:02:45.771000 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0753a9e9-da82-42b1-831b-670802bb16af admin admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:02:45.784668 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.auth.core [None req-23220d1e-8062-4361-9be9-09b02f43e884 None None] MFA Rules not processed for user `52656926e08249928e127cb796d34fe7`. Rule list: `[]` (Enabled: `True`). {{(pid=81593) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 18:02:45.786367 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-23220d1e-8062-4361-9be9-09b02f43e884 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:02:45.850848 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90f17bc-2aa1-4877-a69e-19b2fe079d3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:02:45.852199 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90f17bc-2aa1-4877-a69e-19b2fe079d3f admin admin] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:02:45.853078 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90f17bc-2aa1-4877-a69e-19b2fe079d3f admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:02:45.853463 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90f17bc-2aa1-4877-a69e-19b2fe079d3f admin admin] PATH_INFO: `/v3/users` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:02:45.854451 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a90f17bc-2aa1-4877-a69e-19b2fe079d3f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:02:45.857059 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a90f17bc-2aa1-4877-a69e-19b2fe079d3f admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:02:45.897143 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 973/1968] 10.222.0.25 () {60 vars in 1144 bytes} [Thu Sep 15 18:02:45 2022] POST /identity/v3/users => generated 300 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 15 18:02:45.904539 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90f17bc-2aa1-4877-a69e-19b2fe079d3f admin admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:02:45.921767 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90f17bc-2aa1-4877-a69e-19b2fe079d3f admin admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:02:45.930323 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32ee901-2793-498b-b9cd-bf432a885787 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:02:45.931556 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32ee901-2793-498b-b9cd-bf432a885787 admin admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:02:45.932144 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32ee901-2793-498b-b9cd-bf432a885787 admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:02:45.933039 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32ee901-2793-498b-b9cd-bf432a885787 admin admin] PATH_INFO: `/v3/roles` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:02:45.934681 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32ee901-2793-498b-b9cd-bf432a885787 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:02:45.938955 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32ee901-2793-498b-b9cd-bf432a885787 admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:02:45.941744 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 18:02:45.965498 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 974/1969] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Sep 15 18:02:45 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 15 18:02:45.970334 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32ee901-2793-498b-b9cd-bf432a885787 admin admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:02:45.991595 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32ee901-2793-498b-b9cd-bf432a885787 admin admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:02:45.994179 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 996/1970] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 15 18:02:45 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 270 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 18:02:46.004122 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e722390-5e72-49ff-941b-9e4af893eae0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:02:46.004122 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e722390-5e72-49ff-941b-9e4af893eae0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:02:46.004540 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e722390-5e72-49ff-941b-9e4af893eae0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:02:46.004672 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e722390-5e72-49ff-941b-9e4af893eae0 admin admin] PATH_INFO: `/v3/projects/b169427d06a64bddafd509af1278963d/users/17589430a6dc406b97dede581920de98/roles/a9e42be86923434f8af52d3fc07fb4f7` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:02:46.008071 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23220d1e-8062-4361-9be9-09b02f43e884 None None] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:02:46.010618 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-23220d1e-8062-4361-9be9-09b02f43e884 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:02:46.027371 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e722390-5e72-49ff-941b-9e4af893eae0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b169427d06a64bddafd509af1278963d, user_id=17589430a6dc406b97dede581920de98, role_id=a9e42be86923434f8af52d3fc07fb4f7)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:02:46.030940 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e722390-5e72-49ff-941b-9e4af893eae0 admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:02:46.049455 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 18:02:46.066246 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 975/1971] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Sep 15 18:02:45 2022] PUT /identity/v3/projects/b169427d06a64bddafd509af1278963d/users/17589430a6dc406b97dede581920de98/roles/a9e42be86923434f8af52d3fc07fb4f7 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 15 18:02:46.071898 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e722390-5e72-49ff-941b-9e4af893eae0 admin admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:02:46.114806 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23220d1e-8062-4361-9be9-09b02f43e884 None None] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:02:46.194995 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e722390-5e72-49ff-941b-9e4af893eae0 admin admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:02:46.201562 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4caf02-fda6-4fb1-8f48-4cd34ce72d0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:02:46.202585 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4caf02-fda6-4fb1-8f48-4cd34ce72d0f admin admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:02:46.203058 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4caf02-fda6-4fb1-8f48-4cd34ce72d0f admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:02:46.203559 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4caf02-fda6-4fb1-8f48-4cd34ce72d0f admin admin] PATH_INFO: `/v3/roles` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:02:46.204477 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4caf02-fda6-4fb1-8f48-4cd34ce72d0f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:02:46.207457 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4caf02-fda6-4fb1-8f48-4cd34ce72d0f admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:02:46.231480 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc158ef-4a61-4507-8c2f-a7507e7215cb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b232e7a841145ba93c6d8462ccb751a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1213c0d1b584404ba3998e136f166e89', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:02:46.232574 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc158ef-4a61-4507-8c2f-a7507e7215cb service cinder] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:02:46.233008 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc158ef-4a61-4507-8c2f-a7507e7215cb service cinder] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:02:46.233937 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc158ef-4a61-4507-8c2f-a7507e7215cb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:02:46.238061 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 976/1972] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Sep 15 18:02:46 2022] GET /identity/v3/roles => generated 1420 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 18:02:46.242245 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4caf02-fda6-4fb1-8f48-4cd34ce72d0f admin admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:02:46.291667 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4caf02-fda6-4fb1-8f48-4cd34ce72d0f admin admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:02:46.301785 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ef6699-e985-465c-9784-3fd77cd96fd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:02:46.303121 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ef6699-e985-465c-9784-3fd77cd96fd7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:02:46.303410 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ef6699-e985-465c-9784-3fd77cd96fd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:02:46.303684 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ef6699-e985-465c-9784-3fd77cd96fd7 admin admin] PATH_INFO: `/v3/projects/b169427d06a64bddafd509af1278963d/users/17589430a6dc406b97dede581920de98/roles/a9e42be86923434f8af52d3fc07fb4f7` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:02:46.307062 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ef6699-e985-465c-9784-3fd77cd96fd7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b169427d06a64bddafd509af1278963d, user_id=17589430a6dc406b97dede581920de98, role_id=a9e42be86923434f8af52d3fc07fb4f7)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:02:46.309768 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ef6699-e985-465c-9784-3fd77cd96fd7 admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:02:46.336167 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc158ef-4a61-4507-8c2f-a7507e7215cb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:02:46.337549 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 977/1973] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Sep 15 18:02:46 2022] PUT /identity/v3/projects/b169427d06a64bddafd509af1278963d/users/17589430a6dc406b97dede581920de98/roles/a9e42be86923434f8af52d3fc07fb4f7 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 15 18:02:46.337765 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc158ef-4a61-4507-8c2f-a7507e7215cb service cinder] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:02:46.348005 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d79aaf-f2c5-4d64-bfb5-15f2cdcea57d None None] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:02:46.348388 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d79aaf-f2c5-4d64-bfb5-15f2cdcea57d None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:02:46.348687 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d79aaf-f2c5-4d64-bfb5-15f2cdcea57d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:02:46.368308 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 997/1974] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 15 18:02:46 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 361 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 15 18:02:46.389920 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.auth.core [None req-e2d79aaf-f2c5-4d64-bfb5-15f2cdcea57d None None] MFA Rules not processed for user `17589430a6dc406b97dede581920de98`. Rule list: `[]` (Enabled: `True`). {{(pid=81592) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 18:02:46.391784 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-e2d79aaf-f2c5-4d64-bfb5-15f2cdcea57d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:02:46.525321 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 978/1975] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 15 18:02:46 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 18:02:46.611985 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc158ef-4a61-4507-8c2f-a7507e7215cb service cinder] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:02:46.624077 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc158ef-4a61-4507-8c2f-a7507e7215cb service cinder] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:02:46.691318 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb4f34e-4b4f-49ab-89f6-6189cbda0c5c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b232e7a841145ba93c6d8462ccb751a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1213c0d1b584404ba3998e136f166e89', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:02:46.692243 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb4f34e-4b4f-49ab-89f6-6189cbda0c5c service cinder] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:02:46.692606 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb4f34e-4b4f-49ab-89f6-6189cbda0c5c service cinder] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:02:46.692993 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb4f34e-4b4f-49ab-89f6-6189cbda0c5c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:02:46.707958 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb4f34e-4b4f-49ab-89f6-6189cbda0c5c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:02:46.710213 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb4f34e-4b4f-49ab-89f6-6189cbda0c5c service cinder] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:02:46.716451 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 18:02:46.727416 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 998/1976] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 15 18:02:46 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 18:02:46.829891 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d79aaf-f2c5-4d64-bfb5-15f2cdcea57d None None] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:02:46.959450 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d79aaf-f2c5-4d64-bfb5-15f2cdcea57d None None] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:02:46.973707 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6722cf12-e6f3-4969-8b10-b40f23ea5a2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:02:46.976251 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6722cf12-e6f3-4969-8b10-b40f23ea5a2f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:02:46.976710 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6722cf12-e6f3-4969-8b10-b40f23ea5a2f admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:02:46.977001 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6722cf12-e6f3-4969-8b10-b40f23ea5a2f admin admin] PATH_INFO: `/v3/users/b7d37ac607e549c3a0e64723906fccc2` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:02:46.979999 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6722cf12-e6f3-4969-8b10-b40f23ea5a2f admin admin] RBAC: Authorizing `identity:delete_user(user_id=b7d37ac607e549c3a0e64723906fccc2)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:02:46.984452 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6722cf12-e6f3-4969-8b10-b40f23ea5a2f admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:02:47.000677 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 18:02:47.079843 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-6722cf12-e6f3-4969-8b10-b40f23ea5a2f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b7d37ac607e549c3a0e64723906fccc2'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:02:47.090317 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-6722cf12-e6f3-4969-8b10-b40f23ea5a2f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b7d37ac607e549c3a0e64723906fccc2'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:02:47.091149 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-6722cf12-e6f3-4969-8b10-b40f23ea5a2f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b7d37ac607e549c3a0e64723906fccc2'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:02:47.091879 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-6722cf12-e6f3-4969-8b10-b40f23ea5a2f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b7d37ac607e549c3a0e64723906fccc2'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:02:47.103555 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-6722cf12-e6f3-4969-8b10-b40f23ea5a2f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b7d37ac607e549c3a0e64723906fccc2'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:02:47.134264 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 979/1977] 10.222.0.25 () {58 vars in 1224 bytes} [Thu Sep 15 18:02:46 2022] DELETE /identity/v3/users/b7d37ac607e549c3a0e64723906fccc2 => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 18:02:47.136420 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63c8dfc-3b93-4128-8453-277105a9a817 None None] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:02:47.136705 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63c8dfc-3b93-4128-8453-277105a9a817 None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:02:47.136980 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63c8dfc-3b93-4128-8453-277105a9a817 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:02:47.162655 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.auth.core [None req-b63c8dfc-3b93-4128-8453-277105a9a817 None None] MFA Rules not processed for user `5cfa58ef86774ab7800bf91930bf6028`. Rule list: `[]` (Enabled: `True`). {{(pid=81593) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 18:02:47.163974 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-b63c8dfc-3b93-4128-8453-277105a9a817 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:02:47.234337 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6722cf12-e6f3-4969-8b10-b40f23ea5a2f admin admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:02:47.235907 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-6722cf12-e6f3-4969-8b10-b40f23ea5a2f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:02:47.279338 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 999/1978] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 15 18:02:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 18:02:47.301487 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63c8dfc-3b93-4128-8453-277105a9a817 None None] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:02:47.304919 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-b63c8dfc-3b93-4128-8453-277105a9a817 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:02:47.370222 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6722cf12-e6f3-4969-8b10-b40f23ea5a2f admin admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:02:47.387040 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86fd1c20-772a-4c5c-b774-73f0b27e8895 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:02:47.391142 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fd1c20-772a-4c5c-b774-73f0b27e8895 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:02:47.391432 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fd1c20-772a-4c5c-b774-73f0b27e8895 admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:02:47.391712 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fd1c20-772a-4c5c-b774-73f0b27e8895 admin admin] PATH_INFO: `/v3/users/b071345e56144284ae26e34ad929cafe` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:02:47.397621 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86fd1c20-772a-4c5c-b774-73f0b27e8895 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b071345e56144284ae26e34ad929cafe)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:02:47.402579 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86fd1c20-772a-4c5c-b774-73f0b27e8895 admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:02:47.484957 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63c8dfc-3b93-4128-8453-277105a9a817 None None] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:02:47.491109 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c567d2cc-040f-4fd2-a10f-6cc0b6de6059 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a32274b4781b40fea9f28da8a9bde5ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1213c0d1b584404ba3998e136f166e89', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:02:47.492021 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c567d2cc-040f-4fd2-a10f-6cc0b6de6059 service neutron] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:02:47.492467 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c567d2cc-040f-4fd2-a10f-6cc0b6de6059 service neutron] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:02:47.493613 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c567d2cc-040f-4fd2-a10f-6cc0b6de6059 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:02:47.505127 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-86fd1c20-772a-4c5c-b774-73f0b27e8895 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b071345e56144284ae26e34ad929cafe'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:02:47.522050 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-86fd1c20-772a-4c5c-b774-73f0b27e8895 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b071345e56144284ae26e34ad929cafe'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:02:47.529820 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-86fd1c20-772a-4c5c-b774-73f0b27e8895 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b071345e56144284ae26e34ad929cafe'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:02:47.532624 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-86fd1c20-772a-4c5c-b774-73f0b27e8895 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b071345e56144284ae26e34ad929cafe'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:02:47.550993 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-86fd1c20-772a-4c5c-b774-73f0b27e8895 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b071345e56144284ae26e34ad929cafe'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:02:47.552732 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c567d2cc-040f-4fd2-a10f-6cc0b6de6059 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:02:47.557264 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c567d2cc-040f-4fd2-a10f-6cc0b6de6059 service neutron] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:02:47.591470 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 980/1979] 10.222.0.25 () {58 vars in 1224 bytes} [Thu Sep 15 18:02:47 2022] DELETE /identity/v3/users/b071345e56144284ae26e34ad929cafe => generated 0 bytes in 355 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 18:02:47.593661 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876138a3-29ea-4038-9dd9-41a14789a68e None None] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:02:47.593979 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876138a3-29ea-4038-9dd9-41a14789a68e None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:02:47.594219 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876138a3-29ea-4038-9dd9-41a14789a68e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:02:47.610425 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=78,keystone:DELETE=20,keystone:INSERT=2 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 18:02:47.614945 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1000/1980] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 15 18:02:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 18:02:47.636113 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.auth.core [None req-876138a3-29ea-4038-9dd9-41a14789a68e None None] MFA Rules not processed for user `5cfa58ef86774ab7800bf91930bf6028`. Rule list: `[]` (Enabled: `True`). {{(pid=81592) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 18:02:47.643054 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-876138a3-29ea-4038-9dd9-41a14789a68e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:02:47.768795 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 981/1981] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 15 18:02:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 18:02:47.790836 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c567d2cc-040f-4fd2-a10f-6cc0b6de6059 service neutron] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:02:47.835565 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c567d2cc-040f-4fd2-a10f-6cc0b6de6059 service neutron] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:02:47.943681 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928bb39c-0bdc-4c4a-b00f-bf91fc019037 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a32274b4781b40fea9f28da8a9bde5ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1213c0d1b584404ba3998e136f166e89', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:02:47.944882 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928bb39c-0bdc-4c4a-b00f-bf91fc019037 service neutron] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:02:47.946085 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928bb39c-0bdc-4c4a-b00f-bf91fc019037 service neutron] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:02:47.946376 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928bb39c-0bdc-4c4a-b00f-bf91fc019037 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:02:47.970461 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-928bb39c-0bdc-4c4a-b00f-bf91fc019037 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:02:47.974700 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-928bb39c-0bdc-4c4a-b00f-bf91fc019037 service neutron] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:02:47.992718 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1001/1982] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 15 18:02:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 202 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 18:02:48.318111 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876138a3-29ea-4038-9dd9-41a14789a68e None None] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:02:48.320545 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-876138a3-29ea-4038-9dd9-41a14789a68e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:02:48.338723 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876138a3-29ea-4038-9dd9-41a14789a68e None None] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:02:48.346230 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8039c8d1-1052-40ae-8100-0dc6560865d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:02:48.347144 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8039c8d1-1052-40ae-8100-0dc6560865d1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:02:48.347534 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8039c8d1-1052-40ae-8100-0dc6560865d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:02:48.348310 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8039c8d1-1052-40ae-8100-0dc6560865d1 admin admin] PATH_INFO: `/v3/users/578fbfd5b728455b976efdc5ebcf2ee7` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:02:48.349598 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8039c8d1-1052-40ae-8100-0dc6560865d1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=578fbfd5b728455b976efdc5ebcf2ee7)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:02:48.352093 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8039c8d1-1052-40ae-8100-0dc6560865d1 admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:02:48.411970 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-8039c8d1-1052-40ae-8100-0dc6560865d1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '578fbfd5b728455b976efdc5ebcf2ee7'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:02:48.422705 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-8039c8d1-1052-40ae-8100-0dc6560865d1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '578fbfd5b728455b976efdc5ebcf2ee7'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:02:48.423329 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-8039c8d1-1052-40ae-8100-0dc6560865d1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '578fbfd5b728455b976efdc5ebcf2ee7'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:02:48.423993 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-8039c8d1-1052-40ae-8100-0dc6560865d1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '578fbfd5b728455b976efdc5ebcf2ee7'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:02:48.430366 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928bb39c-0bdc-4c4a-b00f-bf91fc019037 service neutron] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:02:48.433129 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-928bb39c-0bdc-4c4a-b00f-bf91fc019037 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:02:48.435448 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-8039c8d1-1052-40ae-8100-0dc6560865d1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '578fbfd5b728455b976efdc5ebcf2ee7'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:02:48.460398 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 982/1983] 10.222.0.25 () {58 vars in 1224 bytes} [Thu Sep 15 18:02:48 2022] DELETE /identity/v3/users/578fbfd5b728455b976efdc5ebcf2ee7 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 18:02:48.464854 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f02180-6387-4f14-8906-722ad8e8bebe None None] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:02:48.465149 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f02180-6387-4f14-8906-722ad8e8bebe None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:02:48.465453 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f02180-6387-4f14-8906-722ad8e8bebe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:02:48.471730 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928bb39c-0bdc-4c4a-b00f-bf91fc019037 service neutron] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:02:48.492957 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.auth.core [None req-c5f02180-6387-4f14-8906-722ad8e8bebe None None] MFA Rules not processed for user `5cfa58ef86774ab7800bf91930bf6028`. Rule list: `[]` (Enabled: `True`). {{(pid=81592) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 18:02:48.494570 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-c5f02180-6387-4f14-8906-722ad8e8bebe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:02:48.551509 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 18:02:48.575548 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63696edb-d68d-49c2-821e-8a899fb1ee17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:02:48.576866 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63696edb-d68d-49c2-821e-8a899fb1ee17 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:02:48.577675 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63696edb-d68d-49c2-821e-8a899fb1ee17 admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:02:48.578154 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63696edb-d68d-49c2-821e-8a899fb1ee17 admin admin] PATH_INFO: `/v3/projects/faff8f65778941eeb5ad674252deea40` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:02:48.579168 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63696edb-d68d-49c2-821e-8a899fb1ee17 admin admin] RBAC: Authorizing `identity:delete_project(project_id=faff8f65778941eeb5ad674252deea40)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:02:48.583719 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63696edb-d68d-49c2-821e-8a899fb1ee17 admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:02:48.631926 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 983/1984] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 15 18:02:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 18:02:48.656677 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f02180-6387-4f14-8906-722ad8e8bebe None None] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:02:48.660293 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-c5f02180-6387-4f14-8906-722ad8e8bebe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:02:48.674583 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-63696edb-d68d-49c2-821e-8a899fb1ee17 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'faff8f65778941eeb5ad674252deea40', 'request_id': 'req-63696edb-d68d-49c2-821e-8a899fb1ee17'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:02:48.686584 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-63696edb-d68d-49c2-821e-8a899fb1ee17 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'faff8f65778941eeb5ad674252deea40', 'request_id': 'req-63696edb-d68d-49c2-821e-8a899fb1ee17'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:02:48.704169 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-63696edb-d68d-49c2-821e-8a899fb1ee17 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'faff8f65778941eeb5ad674252deea40', 'request_id': 'req-63696edb-d68d-49c2-821e-8a899fb1ee17'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:02:48.713761 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 18:02:48.735321 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-63696edb-d68d-49c2-821e-8a899fb1ee17 admin admin] The token cache is being invalidate because project faff8f65778941eeb5ad674252deea40 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81593) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 18:02:48.735747 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-63696edb-d68d-49c2-821e-8a899fb1ee17 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:02:48.736586 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-63696edb-d68d-49c2-821e-8a899fb1ee17 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:02:48.738643 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1002/1985] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Sep 15 18:02:48 2022] DELETE /identity/v3/projects/faff8f65778941eeb5ad674252deea40 => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 18:02:48.743413 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63696edb-d68d-49c2-821e-8a899fb1ee17 admin admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:02:48.744935 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-63696edb-d68d-49c2-821e-8a899fb1ee17 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:02:48.811156 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f02180-6387-4f14-8906-722ad8e8bebe None None] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:02:48.862292 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63696edb-d68d-49c2-821e-8a899fb1ee17 admin admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:02:48.873037 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85dc6c84-62c2-4816-9099-6d7347507276 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:02:48.874302 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85dc6c84-62c2-4816-9099-6d7347507276 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:02:48.874582 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85dc6c84-62c2-4816-9099-6d7347507276 admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:02:48.874926 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85dc6c84-62c2-4816-9099-6d7347507276 admin admin] PATH_INFO: `/v3/users/52656926e08249928e127cb796d34fe7` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:02:48.882246 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85dc6c84-62c2-4816-9099-6d7347507276 admin admin] RBAC: Authorizing `identity:delete_user(user_id=52656926e08249928e127cb796d34fe7)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:02:48.890674 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85dc6c84-62c2-4816-9099-6d7347507276 admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:02:48.997861 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9323e339-ee7f-4d1f-b994-7ee86d75e7b4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a32274b4781b40fea9f28da8a9bde5ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1213c0d1b584404ba3998e136f166e89', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:02:48.998645 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9323e339-ee7f-4d1f-b994-7ee86d75e7b4 service neutron] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:02:48.999495 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9323e339-ee7f-4d1f-b994-7ee86d75e7b4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:02:49.000495 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9323e339-ee7f-4d1f-b994-7ee86d75e7b4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:02:49.002461 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-9323e339-ee7f-4d1f-b994-7ee86d75e7b4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:02:49.022820 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-85dc6c84-62c2-4816-9099-6d7347507276 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '52656926e08249928e127cb796d34fe7'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:02:49.029353 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9323e339-ee7f-4d1f-b994-7ee86d75e7b4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:02:49.031370 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9323e339-ee7f-4d1f-b994-7ee86d75e7b4 service neutron] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:02:49.037909 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-85dc6c84-62c2-4816-9099-6d7347507276 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '52656926e08249928e127cb796d34fe7'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:02:49.040014 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-85dc6c84-62c2-4816-9099-6d7347507276 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '52656926e08249928e127cb796d34fe7'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:02:49.040567 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-85dc6c84-62c2-4816-9099-6d7347507276 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '52656926e08249928e127cb796d34fe7'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:02:49.057545 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 984/1986] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 15 18:02:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 403 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 18:02:49.059597 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-85dc6c84-62c2-4816-9099-6d7347507276 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '52656926e08249928e127cb796d34fe7'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:02:49.068505 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9323e339-ee7f-4d1f-b994-7ee86d75e7b4 service neutron] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:02:49.073956 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-9323e339-ee7f-4d1f-b994-7ee86d75e7b4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:02:49.074838 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 18:02:49.087779 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1003/1987] 10.222.0.25 () {58 vars in 1224 bytes} [Thu Sep 15 18:02:48 2022] DELETE /identity/v3/users/52656926e08249928e127cb796d34fe7 => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 18:02:49.105974 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9323e339-ee7f-4d1f-b994-7ee86d75e7b4 service neutron] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:02:49.209645 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8602b6c2-8ead-4099-adbc-549538565018 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:02:49.209645 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8602b6c2-8ead-4099-adbc-549538565018 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:02:49.209645 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8602b6c2-8ead-4099-adbc-549538565018 admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:02:49.209645 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8602b6c2-8ead-4099-adbc-549538565018 admin admin] PATH_INFO: `/v3/projects/85fb828e45114a54b9db2e180f1d2424` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:02:49.210124 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8602b6c2-8ead-4099-adbc-549538565018 admin admin] RBAC: Authorizing `identity:delete_project(project_id=85fb828e45114a54b9db2e180f1d2424)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:02:49.210719 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8602b6c2-8ead-4099-adbc-549538565018 admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:02:49.283836 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-8602b6c2-8ead-4099-adbc-549538565018 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '85fb828e45114a54b9db2e180f1d2424', 'request_id': 'req-8602b6c2-8ead-4099-adbc-549538565018'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:02:49.292346 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-8602b6c2-8ead-4099-adbc-549538565018 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '85fb828e45114a54b9db2e180f1d2424', 'request_id': 'req-8602b6c2-8ead-4099-adbc-549538565018'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:02:49.307583 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-8602b6c2-8ead-4099-adbc-549538565018 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '85fb828e45114a54b9db2e180f1d2424', 'request_id': 'req-8602b6c2-8ead-4099-adbc-549538565018'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:02:49.342852 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-8602b6c2-8ead-4099-adbc-549538565018 admin admin] The token cache is being invalidate because project 85fb828e45114a54b9db2e180f1d2424 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81592) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 18:02:49.343215 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-8602b6c2-8ead-4099-adbc-549538565018 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:02:49.344926 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-8602b6c2-8ead-4099-adbc-549538565018 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:02:49.349632 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 985/1988] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Sep 15 18:02:49 2022] DELETE /identity/v3/projects/85fb828e45114a54b9db2e180f1d2424 => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 18:02:49.353673 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85dc6c84-62c2-4816-9099-6d7347507276 admin admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:02:49.356345 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-85dc6c84-62c2-4816-9099-6d7347507276 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:02:49.391026 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85dc6c84-62c2-4816-9099-6d7347507276 admin admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:02:49.549957 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b104153-0ad6-4be9-8d78-89c782b15c87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:02:49.552610 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b104153-0ad6-4be9-8d78-89c782b15c87 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:02:49.553231 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b104153-0ad6-4be9-8d78-89c782b15c87 admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:02:49.554052 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b104153-0ad6-4be9-8d78-89c782b15c87 admin admin] PATH_INFO: `/v3/users/17589430a6dc406b97dede581920de98` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:02:49.556051 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b104153-0ad6-4be9-8d78-89c782b15c87 admin admin] RBAC: Authorizing `identity:delete_user(user_id=17589430a6dc406b97dede581920de98)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:02:49.569821 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b104153-0ad6-4be9-8d78-89c782b15c87 admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:02:49.672533 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8602b6c2-8ead-4099-adbc-549538565018 admin admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:02:49.676328 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-8602b6c2-8ead-4099-adbc-549538565018 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:02:49.677210 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-5b104153-0ad6-4be9-8d78-89c782b15c87 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '17589430a6dc406b97dede581920de98'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:02:49.701690 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-5b104153-0ad6-4be9-8d78-89c782b15c87 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '17589430a6dc406b97dede581920de98'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:02:49.702416 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-5b104153-0ad6-4be9-8d78-89c782b15c87 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '17589430a6dc406b97dede581920de98'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:02:49.703040 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8602b6c2-8ead-4099-adbc-549538565018 admin admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:02:49.703225 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-5b104153-0ad6-4be9-8d78-89c782b15c87 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '17589430a6dc406b97dede581920de98'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:02:49.711619 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46665d66-8ef3-4a85-80c4-346416b21d63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:02:49.713497 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46665d66-8ef3-4a85-80c4-346416b21d63 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:02:49.713873 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46665d66-8ef3-4a85-80c4-346416b21d63 admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:02:49.714423 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-5b104153-0ad6-4be9-8d78-89c782b15c87 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '17589430a6dc406b97dede581920de98'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:02:49.714538 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46665d66-8ef3-4a85-80c4-346416b21d63 admin admin] PATH_INFO: `/v3/projects/6c9d58dddf654985879416a5c5fac0fc` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:02:49.716251 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46665d66-8ef3-4a85-80c4-346416b21d63 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6c9d58dddf654985879416a5c5fac0fc)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:02:49.721741 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46665d66-8ef3-4a85-80c4-346416b21d63 admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:02:49.724627 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 18:02:49.754347 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1004/1989] 10.222.0.25 () {58 vars in 1224 bytes} [Thu Sep 15 18:02:49 2022] DELETE /identity/v3/users/17589430a6dc406b97dede581920de98 => generated 0 bytes in 398 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 18:02:49.754347 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b104153-0ad6-4be9-8d78-89c782b15c87 admin admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:02:49.764345 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-5b104153-0ad6-4be9-8d78-89c782b15c87 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:02:49.873242 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-46665d66-8ef3-4a85-80c4-346416b21d63 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6c9d58dddf654985879416a5c5fac0fc', 'request_id': 'req-46665d66-8ef3-4a85-80c4-346416b21d63'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:02:49.891006 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-46665d66-8ef3-4a85-80c4-346416b21d63 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6c9d58dddf654985879416a5c5fac0fc', 'request_id': 'req-46665d66-8ef3-4a85-80c4-346416b21d63'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:02:49.902505 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-46665d66-8ef3-4a85-80c4-346416b21d63 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6c9d58dddf654985879416a5c5fac0fc', 'request_id': 'req-46665d66-8ef3-4a85-80c4-346416b21d63'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:02:49.922425 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-46665d66-8ef3-4a85-80c4-346416b21d63 admin admin] The token cache is being invalidate because project 6c9d58dddf654985879416a5c5fac0fc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81592) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 18:02:49.922765 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-46665d66-8ef3-4a85-80c4-346416b21d63 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:02:49.923577 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-46665d66-8ef3-4a85-80c4-346416b21d63 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:02:49.926041 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 986/1990] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Sep 15 18:02:49 2022] DELETE /identity/v3/projects/6c9d58dddf654985879416a5c5fac0fc => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 18:02:49.931116 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46665d66-8ef3-4a85-80c4-346416b21d63 admin admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:02:49.932611 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-46665d66-8ef3-4a85-80c4-346416b21d63 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:02:49.958897 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b104153-0ad6-4be9-8d78-89c782b15c87 admin admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:02:50.003338 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:DELETE=11,keystone:SELECT=88,keystone:INSERT=1 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 18:02:50.104893 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46665d66-8ef3-4a85-80c4-346416b21d63 admin admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:02:50.142152 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3428af98-e2c5-420d-8eb2-d139cea2fd62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:02:50.142808 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3428af98-e2c5-420d-8eb2-d139cea2fd62 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:02:50.143083 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3428af98-e2c5-420d-8eb2-d139cea2fd62 admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:02:50.143447 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3428af98-e2c5-420d-8eb2-d139cea2fd62 admin admin] PATH_INFO: `/v3/users/9b32ec74046840058431b59e16c90971` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:02:50.152746 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3428af98-e2c5-420d-8eb2-d139cea2fd62 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9b32ec74046840058431b59e16c90971)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:02:50.158978 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3428af98-e2c5-420d-8eb2-d139cea2fd62 admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:02:50.164866 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5edeaabe-8fd7-44dd-a484-f73f13d0fd21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:02:50.179329 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edeaabe-8fd7-44dd-a484-f73f13d0fd21 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:02:50.180252 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edeaabe-8fd7-44dd-a484-f73f13d0fd21 admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:02:50.180850 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edeaabe-8fd7-44dd-a484-f73f13d0fd21 admin admin] PATH_INFO: `/v3/projects/e92693c3d7e94a76b241ad02eaa49537` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:02:50.190209 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5edeaabe-8fd7-44dd-a484-f73f13d0fd21 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e92693c3d7e94a76b241ad02eaa49537)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:02:50.198771 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5edeaabe-8fd7-44dd-a484-f73f13d0fd21 admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:02:50.298807 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-5edeaabe-8fd7-44dd-a484-f73f13d0fd21 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e92693c3d7e94a76b241ad02eaa49537', 'request_id': 'req-5edeaabe-8fd7-44dd-a484-f73f13d0fd21'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:02:50.307622 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-5edeaabe-8fd7-44dd-a484-f73f13d0fd21 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e92693c3d7e94a76b241ad02eaa49537', 'request_id': 'req-5edeaabe-8fd7-44dd-a484-f73f13d0fd21'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:02:50.317173 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-5edeaabe-8fd7-44dd-a484-f73f13d0fd21 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e92693c3d7e94a76b241ad02eaa49537', 'request_id': 'req-5edeaabe-8fd7-44dd-a484-f73f13d0fd21'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:02:50.328226 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-3428af98-e2c5-420d-8eb2-d139cea2fd62 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9b32ec74046840058431b59e16c90971'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:02:50.348586 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-5edeaabe-8fd7-44dd-a484-f73f13d0fd21 admin admin] The token cache is being invalidate because project e92693c3d7e94a76b241ad02eaa49537 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81593) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 18:02:50.348675 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-5edeaabe-8fd7-44dd-a484-f73f13d0fd21 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:02:50.349589 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-3428af98-e2c5-420d-8eb2-d139cea2fd62 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9b32ec74046840058431b59e16c90971'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:02:50.349940 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-5edeaabe-8fd7-44dd-a484-f73f13d0fd21 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:02:50.351276 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-3428af98-e2c5-420d-8eb2-d139cea2fd62 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9b32ec74046840058431b59e16c90971'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:02:50.352176 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-3428af98-e2c5-420d-8eb2-d139cea2fd62 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9b32ec74046840058431b59e16c90971'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:02:50.352494 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1005/1991] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Sep 15 18:02:49 2022] DELETE /identity/v3/projects/e92693c3d7e94a76b241ad02eaa49537 => generated 0 bytes in 601 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 18:02:50.353973 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5edeaabe-8fd7-44dd-a484-f73f13d0fd21 admin admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:02:50.355578 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-5edeaabe-8fd7-44dd-a484-f73f13d0fd21 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:02:50.365195 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-3428af98-e2c5-420d-8eb2-d139cea2fd62 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9b32ec74046840058431b59e16c90971'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:02:50.388589 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 987/1992] 10.222.0.25 () {58 vars in 1224 bytes} [Thu Sep 15 18:02:49 2022] DELETE /identity/v3/users/9b32ec74046840058431b59e16c90971 => generated 0 bytes in 458 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 18:02:50.390552 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fbc5d7-ee23-4d50-a6bc-b9227e2b01ef None None] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:02:50.390853 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fbc5d7-ee23-4d50-a6bc-b9227e2b01ef None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:02:50.391132 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fbc5d7-ee23-4d50-a6bc-b9227e2b01ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:02:50.415435 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.auth.core [None req-b6fbc5d7-ee23-4d50-a6bc-b9227e2b01ef None None] MFA Rules not processed for user `5cfa58ef86774ab7800bf91930bf6028`. Rule list: `[]` (Enabled: `True`). {{(pid=81592) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 18:02:50.416804 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-b6fbc5d7-ee23-4d50-a6bc-b9227e2b01ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:02:50.422599 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 18:02:50.449113 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5edeaabe-8fd7-44dd-a484-f73f13d0fd21 admin admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:02:50.540728 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 988/1993] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 15 18:02:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 18:02:50.548738 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7538aea-7661-42ec-a06d-0a07c68be235 None None] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:02:50.549025 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7538aea-7661-42ec-a06d-0a07c68be235 None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:02:50.549329 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7538aea-7661-42ec-a06d-0a07c68be235 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:02:50.554721 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 18:02:50.562712 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa684ca-330b-4ca0-b62f-57c105f5b48c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:02:50.563825 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa684ca-330b-4ca0-b62f-57c105f5b48c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:02:50.564938 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa684ca-330b-4ca0-b62f-57c105f5b48c admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:02:50.565757 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa684ca-330b-4ca0-b62f-57c105f5b48c admin admin] PATH_INFO: `/v3/projects/b169427d06a64bddafd509af1278963d` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:02:50.568410 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa684ca-330b-4ca0-b62f-57c105f5b48c admin admin] RBAC: Authorizing `identity:delete_project(project_id=b169427d06a64bddafd509af1278963d)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:02:50.571410 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.auth.core [None req-b7538aea-7661-42ec-a06d-0a07c68be235 None None] MFA Rules not processed for user `5cfa58ef86774ab7800bf91930bf6028`. Rule list: `[]` (Enabled: `True`). {{(pid=81592) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 18:02:50.573452 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-b7538aea-7661-42ec-a06d-0a07c68be235 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:02:50.574319 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa684ca-330b-4ca0-b62f-57c105f5b48c admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:02:50.585666 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 989/1994] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 15 18:02:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 18:02:50.588458 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7538aea-7661-42ec-a06d-0a07c68be235 None None] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:02:50.602668 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7538aea-7661-42ec-a06d-0a07c68be235 None None] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:02:50.608538 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5cb0919-4bfe-4835-a606-6147f25172d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:02:50.609530 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cb0919-4bfe-4835-a606-6147f25172d3 admin admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:02:50.609958 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cb0919-4bfe-4835-a606-6147f25172d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:02:50.610420 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cb0919-4bfe-4835-a606-6147f25172d3 admin admin] PATH_INFO: `/v3/domains` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:02:50.611361 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5cb0919-4bfe-4835-a606-6147f25172d3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81592) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 18:02:50.611803 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5cb0919-4bfe-4835-a606-6147f25172d3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:02:50.613992 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5cb0919-4bfe-4835-a606-6147f25172d3 admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:02:50.632760 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 990/1995] 10.222.0.25 () {58 vars in 1153 bytes} [Thu Sep 15 18:02:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 18:02:50.637425 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5cb0919-4bfe-4835-a606-6147f25172d3 admin admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:02:50.650188 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5cb0919-4bfe-4835-a606-6147f25172d3 admin admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:02:50.668551 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-8fa684ca-330b-4ca0-b62f-57c105f5b48c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b169427d06a64bddafd509af1278963d', 'request_id': 'req-8fa684ca-330b-4ca0-b62f-57c105f5b48c'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:02:50.676598 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-8fa684ca-330b-4ca0-b62f-57c105f5b48c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b169427d06a64bddafd509af1278963d', 'request_id': 'req-8fa684ca-330b-4ca0-b62f-57c105f5b48c'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:02:50.687101 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-8fa684ca-330b-4ca0-b62f-57c105f5b48c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b169427d06a64bddafd509af1278963d', 'request_id': 'req-8fa684ca-330b-4ca0-b62f-57c105f5b48c'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:02:50.702711 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-8fa684ca-330b-4ca0-b62f-57c105f5b48c admin admin] The token cache is being invalidate because project b169427d06a64bddafd509af1278963d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81593) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 18:02:50.703056 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-8fa684ca-330b-4ca0-b62f-57c105f5b48c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:02:50.703739 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-8fa684ca-330b-4ca0-b62f-57c105f5b48c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:02:50.705603 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1006/1996] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Sep 15 18:02:50 2022] DELETE /identity/v3/projects/b169427d06a64bddafd509af1278963d => generated 0 bytes in 352 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 18:02:50.714388 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e58b1f-aaa8-4e76-aaae-262e193e3577 None None] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:02:50.715164 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e58b1f-aaa8-4e76-aaae-262e193e3577 None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:02:50.715559 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e58b1f-aaa8-4e76-aaae-262e193e3577 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:02:50.738736 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99846057-cd13-45e3-ba1b-22fef59e39fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:02:50.739474 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99846057-cd13-45e3-ba1b-22fef59e39fc admin admin] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:02:50.740286 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99846057-cd13-45e3-ba1b-22fef59e39fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:02:50.740286 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99846057-cd13-45e3-ba1b-22fef59e39fc admin admin] PATH_INFO: `/v3/projects` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:02:50.740960 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99846057-cd13-45e3-ba1b-22fef59e39fc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:02:50.743425 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99846057-cd13-45e3-ba1b-22fef59e39fc admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:02:50.747166 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.auth.core [None req-32e58b1f-aaa8-4e76-aaae-262e193e3577 None None] MFA Rules not processed for user `5cfa58ef86774ab7800bf91930bf6028`. Rule list: `[]` (Enabled: `True`). {{(pid=81593) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 18:02:50.749498 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-32e58b1f-aaa8-4e76-aaae-262e193e3577 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:02:50.762327 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1007/1997] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 15 18:02:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 18:02:50.775542 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2b970b-d704-4372-8b93-cea0b5ee7481 None None] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:02:50.775965 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2b970b-d704-4372-8b93-cea0b5ee7481 None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:02:50.776373 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2b970b-d704-4372-8b93-cea0b5ee7481 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:02:50.777840 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 991/1998] 10.222.0.25 () {60 vars in 1153 bytes} [Thu Sep 15 18:02:50 2022] POST /identity/v3/projects => generated 373 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 15 18:02:50.782883 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99846057-cd13-45e3-ba1b-22fef59e39fc admin admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:02:50.785144 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-99846057-cd13-45e3-ba1b-22fef59e39fc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:02:50.805141 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.auth.core [None req-fe2b970b-d704-4372-8b93-cea0b5ee7481 None None] MFA Rules not processed for user `5cfa58ef86774ab7800bf91930bf6028`. Rule list: `[]` (Enabled: `True`). {{(pid=81593) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 18:02:50.806922 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-fe2b970b-d704-4372-8b93-cea0b5ee7481 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:02:50.867596 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99846057-cd13-45e3-ba1b-22fef59e39fc admin admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:02:50.877080 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af35f930-78fd-4609-82b9-e5e946b7794f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:02:50.877882 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af35f930-78fd-4609-82b9-e5e946b7794f admin admin] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:02:50.878341 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af35f930-78fd-4609-82b9-e5e946b7794f admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:02:50.879061 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af35f930-78fd-4609-82b9-e5e946b7794f admin admin] PATH_INFO: `/v3/users` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:02:50.879842 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af35f930-78fd-4609-82b9-e5e946b7794f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:02:50.882661 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af35f930-78fd-4609-82b9-e5e946b7794f admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:02:50.903989 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1008/1999] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 15 18:02:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 18:02:50.908792 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2b970b-d704-4372-8b93-cea0b5ee7481 None None] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:02:50.912549 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 992/2000] 10.222.0.25 () {60 vars in 1144 bytes} [Thu Sep 15 18:02:50 2022] POST /identity/v3/users => generated 287 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 15 18:02:50.916989 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af35f930-78fd-4609-82b9-e5e946b7794f admin admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:02:50.924864 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2b970b-d704-4372-8b93-cea0b5ee7481 None None] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:02:50.931607 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 18:02:50.932856 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c1d8d1-2fcf-4322-b214-eaab57015bfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:02:50.933683 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c1d8d1-2fcf-4322-b214-eaab57015bfe admin admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:02:50.934293 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c1d8d1-2fcf-4322-b214-eaab57015bfe admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:02:50.934574 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c1d8d1-2fcf-4322-b214-eaab57015bfe admin admin] PATH_INFO: `/v3/domains` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:02:50.935236 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c1d8d1-2fcf-4322-b214-eaab57015bfe admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81593) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 18:02:50.935541 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c1d8d1-2fcf-4322-b214-eaab57015bfe admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:02:50.937013 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af35f930-78fd-4609-82b9-e5e946b7794f admin admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:02:50.939413 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c1d8d1-2fcf-4322-b214-eaab57015bfe admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:02:50.944856 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef0f07c-f12c-45ab-a41c-4faeace41cce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:02:50.945678 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef0f07c-f12c-45ab-a41c-4faeace41cce admin admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:02:50.946088 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef0f07c-f12c-45ab-a41c-4faeace41cce admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:02:50.946470 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef0f07c-f12c-45ab-a41c-4faeace41cce admin admin] PATH_INFO: `/v3/roles` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:02:50.947349 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef0f07c-f12c-45ab-a41c-4faeace41cce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:02:50.949228 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef0f07c-f12c-45ab-a41c-4faeace41cce admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:02:50.956030 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1009/2001] 10.222.0.25 () {58 vars in 1153 bytes} [Thu Sep 15 18:02:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 18:02:50.957385 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c1d8d1-2fcf-4322-b214-eaab57015bfe admin admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:02:50.960083 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-f9c1d8d1-2fcf-4322-b214-eaab57015bfe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:02:50.977108 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c1d8d1-2fcf-4322-b214-eaab57015bfe admin admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:02:50.980883 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 993/2002] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Sep 15 18:02:50 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 18:02:50.982410 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ef0840-50ee-4f8b-8a90-42cfa2a4675a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:02:50.983602 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ef0840-50ee-4f8b-8a90-42cfa2a4675a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:02:50.983884 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ef0840-50ee-4f8b-8a90-42cfa2a4675a admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:02:50.984156 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ef0840-50ee-4f8b-8a90-42cfa2a4675a admin admin] PATH_INFO: `/v3/projects/3b774e1a4b7041e2a83f4686aee80df2` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:02:50.986218 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ef0840-50ee-4f8b-8a90-42cfa2a4675a admin admin] RBAC: Authorizing `identity:delete_project(project_id=3b774e1a4b7041e2a83f4686aee80df2)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:02:50.986501 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef0f07c-f12c-45ab-a41c-4faeace41cce admin admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:02:50.988217 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ef0840-50ee-4f8b-8a90-42cfa2a4675a admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:02:50.998263 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef0f07c-f12c-45ab-a41c-4faeace41cce admin admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:02:51.004332 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160120bb-1bfa-4780-b0aa-57985b168be5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:02:51.004952 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160120bb-1bfa-4780-b0aa-57985b168be5 admin admin] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:02:51.005235 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160120bb-1bfa-4780-b0aa-57985b168be5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:02:51.005693 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160120bb-1bfa-4780-b0aa-57985b168be5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:02:51.006344 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160120bb-1bfa-4780-b0aa-57985b168be5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:02:51.008263 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160120bb-1bfa-4780-b0aa-57985b168be5 admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:02:51.040720 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 994/2003] 10.222.0.25 () {60 vars in 1153 bytes} [Thu Sep 15 18:02:50 2022] POST /identity/v3/projects => generated 379 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 18:02:51.041937 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160120bb-1bfa-4780-b0aa-57985b168be5 admin admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:02:51.051265 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-d3ef0840-50ee-4f8b-8a90-42cfa2a4675a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3b774e1a4b7041e2a83f4686aee80df2', 'request_id': 'req-d3ef0840-50ee-4f8b-8a90-42cfa2a4675a'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:02:51.058801 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-d3ef0840-50ee-4f8b-8a90-42cfa2a4675a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3b774e1a4b7041e2a83f4686aee80df2', 'request_id': 'req-d3ef0840-50ee-4f8b-8a90-42cfa2a4675a'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:02:51.063275 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 18:02:51.069925 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-d3ef0840-50ee-4f8b-8a90-42cfa2a4675a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3b774e1a4b7041e2a83f4686aee80df2', 'request_id': 'req-d3ef0840-50ee-4f8b-8a90-42cfa2a4675a'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:02:51.091510 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-d3ef0840-50ee-4f8b-8a90-42cfa2a4675a admin admin] The token cache is being invalidate because project 3b774e1a4b7041e2a83f4686aee80df2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81593) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 18:02:51.091807 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-d3ef0840-50ee-4f8b-8a90-42cfa2a4675a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:02:51.093155 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-d3ef0840-50ee-4f8b-8a90-42cfa2a4675a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:02:51.098064 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1010/2004] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Sep 15 18:02:50 2022] DELETE /identity/v3/projects/3b774e1a4b7041e2a83f4686aee80df2 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 18:02:51.098064 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ef0840-50ee-4f8b-8a90-42cfa2a4675a admin admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:02:51.099547 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-d3ef0840-50ee-4f8b-8a90-42cfa2a4675a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:02:51.121190 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160120bb-1bfa-4780-b0aa-57985b168be5 admin admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:02:51.126921 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9ee236-7865-4a16-8ed6-89cf4c730849 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:02:51.127852 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9ee236-7865-4a16-8ed6-89cf4c730849 admin admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:02:51.128207 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9ee236-7865-4a16-8ed6-89cf4c730849 admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:02:51.128576 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9ee236-7865-4a16-8ed6-89cf4c730849 admin admin] PATH_INFO: `/v3/roles` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:02:51.129481 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9ee236-7865-4a16-8ed6-89cf4c730849 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:02:51.131262 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9ee236-7865-4a16-8ed6-89cf4c730849 admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:02:51.145430 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 995/2005] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Sep 15 18:02:51 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 18:02:51.145430 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9ee236-7865-4a16-8ed6-89cf4c730849 admin admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:02:51.147315 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-fe9ee236-7865-4a16-8ed6-89cf4c730849 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:02:51.187346 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9ee236-7865-4a16-8ed6-89cf4c730849 admin admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:02:51.198390 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ef0840-50ee-4f8b-8a90-42cfa2a4675a admin admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:02:51.204788 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb2db33-51b3-4252-bb35-f3ac300af3d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:02:51.205175 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb2db33-51b3-4252-bb35-f3ac300af3d4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:02:51.205597 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345c249f-3880-469f-b633-5e5d68103d61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:02:51.205725 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb2db33-51b3-4252-bb35-f3ac300af3d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:02:51.206134 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb2db33-51b3-4252-bb35-f3ac300af3d4 admin admin] PATH_INFO: `/v3/users/3c05bd7650b44bebbc133affe618ce51` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:02:51.206242 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345c249f-3880-469f-b633-5e5d68103d61 admin admin] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:02:51.206481 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345c249f-3880-469f-b633-5e5d68103d61 admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:02:51.206751 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345c249f-3880-469f-b633-5e5d68103d61 admin admin] PATH_INFO: `/v3/users` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:02:51.208228 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345c249f-3880-469f-b633-5e5d68103d61 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:02:51.209672 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345c249f-3880-469f-b633-5e5d68103d61 admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:02:51.212909 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb2db33-51b3-4252-bb35-f3ac300af3d4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3c05bd7650b44bebbc133affe618ce51)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:02:51.214909 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb2db33-51b3-4252-bb35-f3ac300af3d4 admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:02:51.248453 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1011/2006] 10.222.0.25 () {60 vars in 1144 bytes} [Thu Sep 15 18:02:51 2022] POST /identity/v3/users => generated 290 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 18:02:51.250535 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345c249f-3880-469f-b633-5e5d68103d61 admin admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:02:51.254547 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-345c249f-3880-469f-b633-5e5d68103d61 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:02:51.275573 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345c249f-3880-469f-b633-5e5d68103d61 admin admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:02:51.283168 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b00ac6-a2fe-4f35-ae3d-478a7b2fdc3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:02:51.284494 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b00ac6-a2fe-4f35-ae3d-478a7b2fdc3f admin admin] REQUEST_METHOD: `PUT` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:02:51.285380 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b00ac6-a2fe-4f35-ae3d-478a7b2fdc3f admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:02:51.285527 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b00ac6-a2fe-4f35-ae3d-478a7b2fdc3f admin admin] PATH_INFO: `/v3/projects/9f15bad754cc40e3a8f843ba8bd1a727/users/c8be5e66283445b4902550b07d43e50d/roles/343cc8b1bc7243eebabdf08147e8366d` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:02:51.307240 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-cfb2db33-51b3-4252-bb35-f3ac300af3d4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3c05bd7650b44bebbc133affe618ce51'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:02:51.309220 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b00ac6-a2fe-4f35-ae3d-478a7b2fdc3f admin admin] RBAC: Authorizing `identity:create_grant(project_id=9f15bad754cc40e3a8f843ba8bd1a727, user_id=c8be5e66283445b4902550b07d43e50d, role_id=343cc8b1bc7243eebabdf08147e8366d)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:02:51.321941 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b00ac6-a2fe-4f35-ae3d-478a7b2fdc3f admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:02:51.343565 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-cfb2db33-51b3-4252-bb35-f3ac300af3d4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3c05bd7650b44bebbc133affe618ce51'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:02:51.344313 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-cfb2db33-51b3-4252-bb35-f3ac300af3d4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3c05bd7650b44bebbc133affe618ce51'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:02:51.345128 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-cfb2db33-51b3-4252-bb35-f3ac300af3d4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3c05bd7650b44bebbc133affe618ce51'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:02:51.376428 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-cfb2db33-51b3-4252-bb35-f3ac300af3d4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3c05bd7650b44bebbc133affe618ce51'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:02:51.386202 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1012/2007] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Sep 15 18:02:51 2022] PUT /identity/v3/projects/9f15bad754cc40e3a8f843ba8bd1a727/users/c8be5e66283445b4902550b07d43e50d/roles/343cc8b1bc7243eebabdf08147e8366d => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 18:02:51.390824 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b00ac6-a2fe-4f35-ae3d-478a7b2fdc3f admin admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:02:51.396125 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-45b00ac6-a2fe-4f35-ae3d-478a7b2fdc3f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:02:51.441694 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 996/2008] 10.222.0.25 () {58 vars in 1224 bytes} [Thu Sep 15 18:02:51 2022] DELETE /identity/v3/users/3c05bd7650b44bebbc133affe618ce51 => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 18:02:51.443137 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa9c4b8-e686-48fa-a8a4-c3119fd65d22 None None] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:02:51.443624 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa9c4b8-e686-48fa-a8a4-c3119fd65d22 None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:02:51.445728 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa9c4b8-e686-48fa-a8a4-c3119fd65d22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:02:51.503326 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.auth.core [None req-afa9c4b8-e686-48fa-a8a4-c3119fd65d22 None None] MFA Rules not processed for user `c8be5e66283445b4902550b07d43e50d`. Rule list: `[]` (Enabled: `True`). {{(pid=81592) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 18:02:51.504611 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-afa9c4b8-e686-48fa-a8a4-c3119fd65d22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:02:51.519490 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b00ac6-a2fe-4f35-ae3d-478a7b2fdc3f admin admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:02:51.575080 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 18:02:51.644266 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b7f829-bb93-4d16-9e07-2d56efeafe47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:02:51.644904 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b7f829-bb93-4d16-9e07-2d56efeafe47 admin admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:02:51.645185 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b7f829-bb93-4d16-9e07-2d56efeafe47 admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:02:51.645871 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b7f829-bb93-4d16-9e07-2d56efeafe47 admin admin] PATH_INFO: `/v3/roles` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:02:51.648314 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b7f829-bb93-4d16-9e07-2d56efeafe47 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:02:51.652620 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b7f829-bb93-4d16-9e07-2d56efeafe47 admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:02:51.660308 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 997/2009] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 15 18:02:51 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 18:02:51.661848 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 18:02:51.669546 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1013/2010] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Sep 15 18:02:51 2022] GET /identity/v3/roles => generated 1420 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 18:02:51.674248 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b7f829-bb93-4d16-9e07-2d56efeafe47 admin admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:02:51.674464 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa9c4b8-e686-48fa-a8a4-c3119fd65d22 None None] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:02:51.677122 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-afa9c4b8-e686-48fa-a8a4-c3119fd65d22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:02:51.687029 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b7f829-bb93-4d16-9e07-2d56efeafe47 admin admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:02:51.693996 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78b1b6a-cce1-4cd4-b00f-f5cf367b4290 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:02:51.694699 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78b1b6a-cce1-4cd4-b00f-f5cf367b4290 admin admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:02:51.694975 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78b1b6a-cce1-4cd4-b00f-f5cf367b4290 admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:02:51.695248 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78b1b6a-cce1-4cd4-b00f-f5cf367b4290 admin admin] PATH_INFO: `/v3/roles` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:02:51.695897 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f78b1b6a-cce1-4cd4-b00f-f5cf367b4290 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:02:51.697877 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f78b1b6a-cce1-4cd4-b00f-f5cf367b4290 admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:02:51.709701 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1014/2011] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Sep 15 18:02:51 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 18:02:51.714450 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78b1b6a-cce1-4cd4-b00f-f5cf367b4290 admin admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:02:51.730502 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78b1b6a-cce1-4cd4-b00f-f5cf367b4290 admin admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:02:51.739534 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29fe1c1e-4203-46e5-85b2-ea0c4135ef08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:02:51.740439 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fe1c1e-4203-46e5-85b2-ea0c4135ef08 admin admin] REQUEST_METHOD: `PUT` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:02:51.741096 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fe1c1e-4203-46e5-85b2-ea0c4135ef08 admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:02:51.741606 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fe1c1e-4203-46e5-85b2-ea0c4135ef08 admin admin] PATH_INFO: `/v3/projects/8dfa4d270b6c48b6b598ea4578a7e9cf/users/0bd26908b7f14fe0b5dcece0df1c424c/roles/343cc8b1bc7243eebabdf08147e8366d` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:02:51.769374 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29fe1c1e-4203-46e5-85b2-ea0c4135ef08 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8dfa4d270b6c48b6b598ea4578a7e9cf, user_id=0bd26908b7f14fe0b5dcece0df1c424c, role_id=343cc8b1bc7243eebabdf08147e8366d)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:02:51.777077 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29fe1c1e-4203-46e5-85b2-ea0c4135ef08 admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:02:51.822425 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1015/2012] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Sep 15 18:02:51 2022] PUT /identity/v3/projects/8dfa4d270b6c48b6b598ea4578a7e9cf/users/0bd26908b7f14fe0b5dcece0df1c424c/roles/343cc8b1bc7243eebabdf08147e8366d => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 18:02:51.825507 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238b578f-1c57-424f-b4c4-f087af9bcbc9 None None] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:02:51.825918 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238b578f-1c57-424f-b4c4-f087af9bcbc9 None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:02:51.826462 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238b578f-1c57-424f-b4c4-f087af9bcbc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:02:51.862313 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa9c4b8-e686-48fa-a8a4-c3119fd65d22 None None] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:02:51.870536 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.auth.core [None req-238b578f-1c57-424f-b4c4-f087af9bcbc9 None None] MFA Rules not processed for user `0bd26908b7f14fe0b5dcece0df1c424c`. Rule list: `[]` (Enabled: `True`). {{(pid=81593) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 18:02:51.870536 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-238b578f-1c57-424f-b4c4-f087af9bcbc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:02:51.962212 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51453858-d4bd-4366-b7fd-d54b7482ebae service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c194f79928aa4a4d94619c417b4e39e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1213c0d1b584404ba3998e136f166e89', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:02:51.962948 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51453858-d4bd-4366-b7fd-d54b7482ebae service glance] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:02:51.963250 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51453858-d4bd-4366-b7fd-d54b7482ebae service glance] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:02:51.963502 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51453858-d4bd-4366-b7fd-d54b7482ebae service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:02:51.969797 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1016/2013] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 15 18:02:51 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 18:02:51.978002 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238b578f-1c57-424f-b4c4-f087af9bcbc9 None None] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:02:52.033743 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51453858-d4bd-4366-b7fd-d54b7482ebae service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:02:52.035236 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51453858-d4bd-4366-b7fd-d54b7482ebae service glance] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:02:52.047129 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 998/2014] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 15 18:02:51 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 18:02:52.048156 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51453858-d4bd-4366-b7fd-d54b7482ebae service glance] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:02:52.049598 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-51453858-d4bd-4366-b7fd-d54b7482ebae service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:02:52.055761 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238b578f-1c57-424f-b4c4-f087af9bcbc9 None None] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:02:52.060376 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad79986-50b6-438f-8aab-ec2867ec7e83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:02:52.062156 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad79986-50b6-438f-8aab-ec2867ec7e83 admin admin] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:02:52.062549 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad79986-50b6-438f-8aab-ec2867ec7e83 admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:02:52.062727 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad79986-50b6-438f-8aab-ec2867ec7e83 admin admin] PATH_INFO: `/v3/projects` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:02:52.063344 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad79986-50b6-438f-8aab-ec2867ec7e83 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:02:52.065266 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad79986-50b6-438f-8aab-ec2867ec7e83 admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:02:52.065767 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51453858-d4bd-4366-b7fd-d54b7482ebae service glance] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:02:52.080601 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465fe25c-e44f-4863-8a32-3d303f37f7d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:02:52.081751 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465fe25c-e44f-4863-8a32-3d303f37f7d9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:02:52.081976 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465fe25c-e44f-4863-8a32-3d303f37f7d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:02:52.082253 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465fe25c-e44f-4863-8a32-3d303f37f7d9 admin admin] PATH_INFO: `/v3/projects/b7e988163f0e4cfb88933a0a381cebb1` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:02:52.085635 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-465fe25c-e44f-4863-8a32-3d303f37f7d9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b7e988163f0e4cfb88933a0a381cebb1)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:02:52.088162 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-465fe25c-e44f-4863-8a32-3d303f37f7d9 admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:02:52.107232 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1017/2015] 10.222.0.25 () {60 vars in 1153 bytes} [Thu Sep 15 18:02:51 2022] POST /identity/v3/projects => generated 379 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 15 18:02:52.111541 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 18:02:52.111716 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad79986-50b6-438f-8aab-ec2867ec7e83 admin admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:02:52.155495 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-465fe25c-e44f-4863-8a32-3d303f37f7d9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b7e988163f0e4cfb88933a0a381cebb1', 'request_id': 'req-465fe25c-e44f-4863-8a32-3d303f37f7d9'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:02:52.166889 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-465fe25c-e44f-4863-8a32-3d303f37f7d9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b7e988163f0e4cfb88933a0a381cebb1', 'request_id': 'req-465fe25c-e44f-4863-8a32-3d303f37f7d9'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:02:52.171373 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 18:02:52.177262 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-465fe25c-e44f-4863-8a32-3d303f37f7d9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b7e988163f0e4cfb88933a0a381cebb1', 'request_id': 'req-465fe25c-e44f-4863-8a32-3d303f37f7d9'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:02:52.196473 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad79986-50b6-438f-8aab-ec2867ec7e83 admin admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:02:52.200291 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-465fe25c-e44f-4863-8a32-3d303f37f7d9 admin admin] The token cache is being invalidate because project b7e988163f0e4cfb88933a0a381cebb1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81592) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 18:02:52.200625 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-465fe25c-e44f-4863-8a32-3d303f37f7d9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:02:52.202512 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-465fe25c-e44f-4863-8a32-3d303f37f7d9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:02:52.205027 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 999/2016] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Sep 15 18:02:52 2022] DELETE /identity/v3/projects/b7e988163f0e4cfb88933a0a381cebb1 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 18:02:52.211969 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a81b99-debd-48f6-92f2-d9c14c54880d None None] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:02:52.212263 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a81b99-debd-48f6-92f2-d9c14c54880d None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:02:52.216685 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a81b99-debd-48f6-92f2-d9c14c54880d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:02:52.239700 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.auth.core [None req-97a81b99-debd-48f6-92f2-d9c14c54880d None None] MFA Rules not processed for user `5cfa58ef86774ab7800bf91930bf6028`. Rule list: `[]` (Enabled: `True`). {{(pid=81592) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 18:02:52.240926 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-97a81b99-debd-48f6-92f2-d9c14c54880d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:02:52.281866 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d796ccfa-b5a6-4d16-a864-c3f7aeeedbf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:02:52.283050 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d796ccfa-b5a6-4d16-a864-c3f7aeeedbf5 admin admin] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:02:52.283788 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d796ccfa-b5a6-4d16-a864-c3f7aeeedbf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:02:52.284268 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d796ccfa-b5a6-4d16-a864-c3f7aeeedbf5 admin admin] PATH_INFO: `/v3/users` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:02:52.285723 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d796ccfa-b5a6-4d16-a864-c3f7aeeedbf5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:02:52.296796 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d796ccfa-b5a6-4d16-a864-c3f7aeeedbf5 admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:02:52.325626 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1000/2017] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 15 18:02:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 18:02:52.329655 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f57d22c-f1f2-4839-a0a2-9c62e9f6f66e None None] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:02:52.330176 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f57d22c-f1f2-4839-a0a2-9c62e9f6f66e None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:02:52.331032 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f57d22c-f1f2-4839-a0a2-9c62e9f6f66e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:02:52.341088 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1018/2018] 10.222.0.25 () {60 vars in 1144 bytes} [Thu Sep 15 18:02:52 2022] POST /identity/v3/users => generated 296 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 15 18:02:52.342394 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d796ccfa-b5a6-4d16-a864-c3f7aeeedbf5 admin admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:02:52.344702 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-d796ccfa-b5a6-4d16-a864-c3f7aeeedbf5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:02:52.355096 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.auth.core [None req-8f57d22c-f1f2-4839-a0a2-9c62e9f6f66e None None] MFA Rules not processed for user `5cfa58ef86774ab7800bf91930bf6028`. Rule list: `[]` (Enabled: `True`). {{(pid=81592) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 18:02:52.356316 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-8f57d22c-f1f2-4839-a0a2-9c62e9f6f66e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:02:52.357950 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d796ccfa-b5a6-4d16-a864-c3f7aeeedbf5 admin admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:02:52.362996 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e625ce6b-f2ee-4f1c-a974-1f1491915b4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:02:52.363801 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e625ce6b-f2ee-4f1c-a974-1f1491915b4f admin admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:02:52.364181 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e625ce6b-f2ee-4f1c-a974-1f1491915b4f admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:02:52.364560 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e625ce6b-f2ee-4f1c-a974-1f1491915b4f admin admin] PATH_INFO: `/v3/roles` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:02:52.369030 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1001/2019] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 15 18:02:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 18:02:52.369264 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e625ce6b-f2ee-4f1c-a974-1f1491915b4f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:02:52.369264 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e625ce6b-f2ee-4f1c-a974-1f1491915b4f admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:02:52.369662 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f57d22c-f1f2-4839-a0a2-9c62e9f6f66e None None] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:02:52.383347 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1019/2020] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Sep 15 18:02:52 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 18:02:52.383529 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f57d22c-f1f2-4839-a0a2-9c62e9f6f66e None None] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:02:52.385364 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e625ce6b-f2ee-4f1c-a974-1f1491915b4f admin admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:02:52.386056 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b43f59c-dab6-4cf9-9d27-c8fb2aed51a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:02:52.386688 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b43f59c-dab6-4cf9-9d27-c8fb2aed51a2 admin admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:02:52.386971 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b43f59c-dab6-4cf9-9d27-c8fb2aed51a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:02:52.387699 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b43f59c-dab6-4cf9-9d27-c8fb2aed51a2 admin admin] PATH_INFO: `/v3/domains` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:02:52.388106 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b43f59c-dab6-4cf9-9d27-c8fb2aed51a2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81592) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 18:02:52.388424 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b43f59c-dab6-4cf9-9d27-c8fb2aed51a2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:02:52.391122 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b43f59c-dab6-4cf9-9d27-c8fb2aed51a2 admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:02:52.398063 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e625ce6b-f2ee-4f1c-a974-1f1491915b4f admin admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:02:52.405270 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517a225a-7313-49ab-9520-f5fb7135585e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:02:52.406322 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517a225a-7313-49ab-9520-f5fb7135585e admin admin] REQUEST_METHOD: `PUT` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:02:52.406743 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517a225a-7313-49ab-9520-f5fb7135585e admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:02:52.407182 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517a225a-7313-49ab-9520-f5fb7135585e admin admin] PATH_INFO: `/v3/projects/9aead8c629b9406fb1b55cdee347662f/users/7f67224accb04a7ea5410bba1850dde9/roles/a9e42be86923434f8af52d3fc07fb4f7` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:02:52.407802 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1002/2021] 10.222.0.25 () {58 vars in 1153 bytes} [Thu Sep 15 18:02:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 18:02:52.413654 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b43f59c-dab6-4cf9-9d27-c8fb2aed51a2 admin admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:02:52.429258 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-517a225a-7313-49ab-9520-f5fb7135585e admin admin] RBAC: Authorizing `identity:create_grant(project_id=9aead8c629b9406fb1b55cdee347662f, user_id=7f67224accb04a7ea5410bba1850dde9, role_id=a9e42be86923434f8af52d3fc07fb4f7)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:02:52.430793 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b43f59c-dab6-4cf9-9d27-c8fb2aed51a2 admin admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:02:52.433570 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-517a225a-7313-49ab-9520-f5fb7135585e admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:02:52.438816 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80aec919-9413-4d8d-a0f4-ab116a6ca659 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:02:52.439852 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80aec919-9413-4d8d-a0f4-ab116a6ca659 admin admin] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:02:52.440284 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80aec919-9413-4d8d-a0f4-ab116a6ca659 admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:02:52.440700 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80aec919-9413-4d8d-a0f4-ab116a6ca659 admin admin] PATH_INFO: `/v3/projects` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:02:52.441767 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80aec919-9413-4d8d-a0f4-ab116a6ca659 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:02:52.445045 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80aec919-9413-4d8d-a0f4-ab116a6ca659 admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:02:52.456309 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1020/2022] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Sep 15 18:02:52 2022] PUT /identity/v3/projects/9aead8c629b9406fb1b55cdee347662f/users/7f67224accb04a7ea5410bba1850dde9/roles/a9e42be86923434f8af52d3fc07fb4f7 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 18:02:52.457922 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517a225a-7313-49ab-9520-f5fb7135585e admin admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:02:52.485182 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1003/2023] 10.222.0.25 () {60 vars in 1153 bytes} [Thu Sep 15 18:02:52 2022] POST /identity/v3/projects => generated 373 bytes in 72 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 15 18:02:52.486541 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80aec919-9413-4d8d-a0f4-ab116a6ca659 admin admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:02:52.489137 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-80aec919-9413-4d8d-a0f4-ab116a6ca659 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:02:52.565768 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517a225a-7313-49ab-9520-f5fb7135585e admin admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:02:52.591710 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80aec919-9413-4d8d-a0f4-ab116a6ca659 admin admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:02:52.599211 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162f26b0-5d19-476c-b121-d33ce69a71e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:02:52.599897 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162f26b0-5d19-476c-b121-d33ce69a71e2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:02:52.600116 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162f26b0-5d19-476c-b121-d33ce69a71e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:02:52.600555 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162f26b0-5d19-476c-b121-d33ce69a71e2 admin admin] PATH_INFO: `/v3/users/f9da763038b5487e8a880f63f71b53ca` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:02:52.601749 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162f26b0-5d19-476c-b121-d33ce69a71e2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f9da763038b5487e8a880f63f71b53ca)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:02:52.604093 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162f26b0-5d19-476c-b121-d33ce69a71e2 admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:02:52.613028 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 18:02:52.648410 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 18:02:52.688117 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-162f26b0-5d19-476c-b121-d33ce69a71e2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f9da763038b5487e8a880f63f71b53ca'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:02:52.688254 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1178ef6-7732-4286-b00f-4216843d1304 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:02:52.688804 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1178ef6-7732-4286-b00f-4216843d1304 admin admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:02:52.689103 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1178ef6-7732-4286-b00f-4216843d1304 admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:02:52.689405 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1178ef6-7732-4286-b00f-4216843d1304 admin admin] PATH_INFO: `/v3/roles` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:02:52.690692 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1178ef6-7732-4286-b00f-4216843d1304 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:02:52.692872 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1178ef6-7732-4286-b00f-4216843d1304 admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:02:52.701982 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-162f26b0-5d19-476c-b121-d33ce69a71e2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f9da763038b5487e8a880f63f71b53ca'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:02:52.703958 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-162f26b0-5d19-476c-b121-d33ce69a71e2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f9da763038b5487e8a880f63f71b53ca'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:02:52.705658 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-162f26b0-5d19-476c-b121-d33ce69a71e2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f9da763038b5487e8a880f63f71b53ca'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:02:52.709792 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1021/2024] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Sep 15 18:02:52 2022] GET /identity/v3/roles => generated 1420 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 18:02:52.709792 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1178ef6-7732-4286-b00f-4216843d1304 admin admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:02:52.709792 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-e1178ef6-7732-4286-b00f-4216843d1304 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:02:52.719015 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-162f26b0-5d19-476c-b121-d33ce69a71e2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f9da763038b5487e8a880f63f71b53ca'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:02:52.724046 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1178ef6-7732-4286-b00f-4216843d1304 admin admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:02:52.735321 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3dff38-8ebd-4c8c-be4c-45ceb90ba3cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:02:52.735950 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3dff38-8ebd-4c8c-be4c-45ceb90ba3cb admin admin] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:02:52.736386 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3dff38-8ebd-4c8c-be4c-45ceb90ba3cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:02:52.736564 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3dff38-8ebd-4c8c-be4c-45ceb90ba3cb admin admin] PATH_INFO: `/v3/users` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:02:52.737224 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3dff38-8ebd-4c8c-be4c-45ceb90ba3cb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:02:52.739481 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3dff38-8ebd-4c8c-be4c-45ceb90ba3cb admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:02:52.743676 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1004/2025] 10.222.0.25 () {58 vars in 1224 bytes} [Thu Sep 15 18:02:52 2022] DELETE /identity/v3/users/f9da763038b5487e8a880f63f71b53ca => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 18:02:52.744763 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162f26b0-5d19-476c-b121-d33ce69a71e2 admin admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:02:52.746337 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-162f26b0-5d19-476c-b121-d33ce69a71e2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:02:52.769144 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1022/2026] 10.222.0.25 () {60 vars in 1144 bytes} [Thu Sep 15 18:02:52 2022] POST /identity/v3/users => generated 287 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 18:02:52.774769 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80e74fa-d04d-4f11-bf3e-158a2ab74976 None None] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:02:52.775711 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80e74fa-d04d-4f11-bf3e-158a2ab74976 None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:02:52.776678 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80e74fa-d04d-4f11-bf3e-158a2ab74976 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:02:52.801908 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.auth.core [None req-c80e74fa-d04d-4f11-bf3e-158a2ab74976 None None] MFA Rules not processed for user `5cfa58ef86774ab7800bf91930bf6028`. Rule list: `[]` (Enabled: `True`). {{(pid=81593) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 18:02:52.804479 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-c80e74fa-d04d-4f11-bf3e-158a2ab74976 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:02:52.871453 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162f26b0-5d19-476c-b121-d33ce69a71e2 admin admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:02:52.873899 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eba45e0-28e7-4f5d-9da9-f84976594759 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:02:52.874776 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eba45e0-28e7-4f5d-9da9-f84976594759 admin admin] REQUEST_METHOD: `PUT` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:02:52.875417 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eba45e0-28e7-4f5d-9da9-f84976594759 admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:02:52.875417 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eba45e0-28e7-4f5d-9da9-f84976594759 admin admin] PATH_INFO: `/v3/projects/9aead8c629b9406fb1b55cdee347662f/users/7f67224accb04a7ea5410bba1850dde9/roles/a9e42be86923434f8af52d3fc07fb4f7` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:02:52.877544 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eba45e0-28e7-4f5d-9da9-f84976594759 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9aead8c629b9406fb1b55cdee347662f, user_id=7f67224accb04a7ea5410bba1850dde9, role_id=a9e42be86923434f8af52d3fc07fb4f7)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:02:52.881638 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eba45e0-28e7-4f5d-9da9-f84976594759 admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:02:52.896482 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1005/2027] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Sep 15 18:02:52 2022] PUT /identity/v3/projects/9aead8c629b9406fb1b55cdee347662f/users/7f67224accb04a7ea5410bba1850dde9/roles/a9e42be86923434f8af52d3fc07fb4f7 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 18:02:52.897421 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eba45e0-28e7-4f5d-9da9-f84976594759 admin admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:02:52.919967 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1023/2028] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 15 18:02:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 18:02:52.922201 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a845e131-f642-4ba8-89e8-4404d321e8fc None None] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:02:52.922485 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a845e131-f642-4ba8-89e8-4404d321e8fc None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:02:52.923632 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a845e131-f642-4ba8-89e8-4404d321e8fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:02:52.965108 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.auth.core [None req-a845e131-f642-4ba8-89e8-4404d321e8fc None None] MFA Rules not processed for user `7f67224accb04a7ea5410bba1850dde9`. Rule list: `[]` (Enabled: `True`). {{(pid=81593) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 18:02:52.969660 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-a845e131-f642-4ba8-89e8-4404d321e8fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:02:53.013404 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eba45e0-28e7-4f5d-9da9-f84976594759 admin admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:02:53.026433 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca57b915-9f1a-4215-90d9-98ab18a1a7b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:02:53.027268 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca57b915-9f1a-4215-90d9-98ab18a1a7b7 admin admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:02:53.027625 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca57b915-9f1a-4215-90d9-98ab18a1a7b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:02:53.027944 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca57b915-9f1a-4215-90d9-98ab18a1a7b7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:02:53.028776 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca57b915-9f1a-4215-90d9-98ab18a1a7b7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:02:53.036389 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca57b915-9f1a-4215-90d9-98ab18a1a7b7 admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:02:53.057671 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1006/2029] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Sep 15 18:02:52 2022] GET /identity/v3/roles => generated 1420 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 18:02:53.057671 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca57b915-9f1a-4215-90d9-98ab18a1a7b7 admin admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:02:53.059993 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-ca57b915-9f1a-4215-90d9-98ab18a1a7b7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:02:53.079194 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 18:02:53.103320 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1024/2030] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 15 18:02:52 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 18:02:53.103320 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a845e131-f642-4ba8-89e8-4404d321e8fc None None] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:02:53.119604 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a845e131-f642-4ba8-89e8-4404d321e8fc None None] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:02:53.127017 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0aa29b6-357a-41c2-8ec9-a388142aaecd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:02:53.127660 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0aa29b6-357a-41c2-8ec9-a388142aaecd admin admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:02:53.131959 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0aa29b6-357a-41c2-8ec9-a388142aaecd admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:02:53.131959 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0aa29b6-357a-41c2-8ec9-a388142aaecd admin admin] PATH_INFO: `/v3/roles` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:02:53.131959 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0aa29b6-357a-41c2-8ec9-a388142aaecd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:02:53.134797 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0aa29b6-357a-41c2-8ec9-a388142aaecd admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:02:53.154267 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1025/2031] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Sep 15 18:02:53 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 18:02:53.154267 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0aa29b6-357a-41c2-8ec9-a388142aaecd admin admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:02:53.154267 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-e0aa29b6-357a-41c2-8ec9-a388142aaecd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:02:53.176499 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca57b915-9f1a-4215-90d9-98ab18a1a7b7 admin admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:02:53.181450 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdef7ca9-c11a-45b3-b443-0b28d9a2583b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a32274b4781b40fea9f28da8a9bde5ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1213c0d1b584404ba3998e136f166e89', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:02:53.182088 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdef7ca9-c11a-45b3-b443-0b28d9a2583b service neutron] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:02:53.182367 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdef7ca9-c11a-45b3-b443-0b28d9a2583b service neutron] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:02:53.182636 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdef7ca9-c11a-45b3-b443-0b28d9a2583b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:02:53.193166 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdef7ca9-c11a-45b3-b443-0b28d9a2583b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:02:53.194656 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdef7ca9-c11a-45b3-b443-0b28d9a2583b service neutron] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:02:53.206623 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1007/2032] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 15 18:02:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 18:02:53.207544 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdef7ca9-c11a-45b3-b443-0b28d9a2583b service neutron] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:02:53.218666 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdef7ca9-c11a-45b3-b443-0b28d9a2583b service neutron] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:02:53.225506 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0af19b4-d6fd-4a18-b404-a43885054708 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:02:53.226370 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0af19b4-d6fd-4a18-b404-a43885054708 admin admin] REQUEST_METHOD: `PUT` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:02:53.226688 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0af19b4-d6fd-4a18-b404-a43885054708 admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:02:53.227029 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0af19b4-d6fd-4a18-b404-a43885054708 admin admin] PATH_INFO: `/v3/projects/9673492fe688478095ce771a47bf18eb/users/867f28c48d594d5fb593dd9fa0c80558/roles/343cc8b1bc7243eebabdf08147e8366d` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:02:53.246713 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0af19b4-d6fd-4a18-b404-a43885054708 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9673492fe688478095ce771a47bf18eb, user_id=867f28c48d594d5fb593dd9fa0c80558, role_id=343cc8b1bc7243eebabdf08147e8366d)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:02:53.250543 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0af19b4-d6fd-4a18-b404-a43885054708 admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:02:53.273219 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 18:02:53.280539 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1008/2033] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Sep 15 18:02:53 2022] PUT /identity/v3/projects/9673492fe688478095ce771a47bf18eb/users/867f28c48d594d5fb593dd9fa0c80558/roles/343cc8b1bc7243eebabdf08147e8366d => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 18:02:53.283978 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07807b90-fd2e-4bf9-ae13-cb8a427b0fca None None] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:02:53.284654 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07807b90-fd2e-4bf9-ae13-cb8a427b0fca None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:02:53.284938 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07807b90-fd2e-4bf9-ae13-cb8a427b0fca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:02:53.304897 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0aa29b6-357a-41c2-8ec9-a388142aaecd admin admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:02:53.332268 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.auth.core [None req-07807b90-fd2e-4bf9-ae13-cb8a427b0fca None None] MFA Rules not processed for user `5cfa58ef86774ab7800bf91930bf6028`. Rule list: `[]` (Enabled: `True`). {{(pid=81592) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 18:02:53.336440 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-07807b90-fd2e-4bf9-ae13-cb8a427b0fca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:02:53.425785 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9096941f-65a4-4218-8715-e61b555eab78 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b232e7a841145ba93c6d8462ccb751a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1213c0d1b584404ba3998e136f166e89', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:02:53.427718 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9096941f-65a4-4218-8715-e61b555eab78 service cinder] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:02:53.428915 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9096941f-65a4-4218-8715-e61b555eab78 service cinder] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:02:53.429694 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9096941f-65a4-4218-8715-e61b555eab78 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:02:53.518718 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1009/2034] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 15 18:02:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 18:02:53.532601 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07807b90-fd2e-4bf9-ae13-cb8a427b0fca None None] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:02:53.594241 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9096941f-65a4-4218-8715-e61b555eab78 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:02:53.599774 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9096941f-65a4-4218-8715-e61b555eab78 service cinder] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:02:53.612424 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1026/2035] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 15 18:02:53 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 464 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 18:02:53.643197 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07807b90-fd2e-4bf9-ae13-cb8a427b0fca None None] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:02:53.656967 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5515ef9-db7f-4d98-bc5b-9d3cb4f885e8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a32274b4781b40fea9f28da8a9bde5ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1213c0d1b584404ba3998e136f166e89', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:02:53.658176 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5515ef9-db7f-4d98-bc5b-9d3cb4f885e8 service neutron] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:02:53.658176 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5515ef9-db7f-4d98-bc5b-9d3cb4f885e8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:02:53.658635 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5515ef9-db7f-4d98-bc5b-9d3cb4f885e8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:02:53.681224 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5515ef9-db7f-4d98-bc5b-9d3cb4f885e8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:02:53.681224 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5515ef9-db7f-4d98-bc5b-9d3cb4f885e8 service neutron] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:02:53.690132 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1010/2036] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 15 18:02:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 15 18:02:53.755739 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9096941f-65a4-4218-8715-e61b555eab78 service cinder] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:02:53.757060 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-9096941f-65a4-4218-8715-e61b555eab78 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:02:53.785743 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9096941f-65a4-4218-8715-e61b555eab78 service cinder] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:02:53.791294 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b90a2e4-7a0b-455b-be70-f2a05f0fa693 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:02:53.791939 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b90a2e4-7a0b-455b-be70-f2a05f0fa693 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:02:53.792216 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b90a2e4-7a0b-455b-be70-f2a05f0fa693 admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:02:53.792673 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b90a2e4-7a0b-455b-be70-f2a05f0fa693 admin admin] PATH_INFO: `/v3/projects/ce3d7b087eef483fb14f10da0d8e4bf9` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:02:53.811665 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b90a2e4-7a0b-455b-be70-f2a05f0fa693 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ce3d7b087eef483fb14f10da0d8e4bf9)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:02:53.822737 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b90a2e4-7a0b-455b-be70-f2a05f0fa693 admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:02:53.898344 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-2b90a2e4-7a0b-455b-be70-f2a05f0fa693 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ce3d7b087eef483fb14f10da0d8e4bf9', 'request_id': 'req-2b90a2e4-7a0b-455b-be70-f2a05f0fa693'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:02:53.906437 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-2b90a2e4-7a0b-455b-be70-f2a05f0fa693 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ce3d7b087eef483fb14f10da0d8e4bf9', 'request_id': 'req-2b90a2e4-7a0b-455b-be70-f2a05f0fa693'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:02:53.921266 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-2b90a2e4-7a0b-455b-be70-f2a05f0fa693 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ce3d7b087eef483fb14f10da0d8e4bf9', 'request_id': 'req-2b90a2e4-7a0b-455b-be70-f2a05f0fa693'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:02:53.944460 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-2b90a2e4-7a0b-455b-be70-f2a05f0fa693 admin admin] The token cache is being invalidate because project ce3d7b087eef483fb14f10da0d8e4bf9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81593) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 18:02:53.945286 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-2b90a2e4-7a0b-455b-be70-f2a05f0fa693 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:02:53.946316 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-2b90a2e4-7a0b-455b-be70-f2a05f0fa693 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:02:53.953711 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1027/2037] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Sep 15 18:02:53 2022] DELETE /identity/v3/projects/ce3d7b087eef483fb14f10da0d8e4bf9 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 18:02:53.955038 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef45f8e-9763-4026-8c76-a1deb2c99be1 None None] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:02:53.955543 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef45f8e-9763-4026-8c76-a1deb2c99be1 None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:02:53.955812 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef45f8e-9763-4026-8c76-a1deb2c99be1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:02:54.002486 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.auth.core [None req-5ef45f8e-9763-4026-8c76-a1deb2c99be1 None None] MFA Rules not processed for user `5cfa58ef86774ab7800bf91930bf6028`. Rule list: `[]` (Enabled: `True`). {{(pid=81592) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 18:02:54.005355 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-5ef45f8e-9763-4026-8c76-a1deb2c99be1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:02:54.074987 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 18:02:54.128623 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1011/2038] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 15 18:02:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 18:02:54.136812 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe93d3d-7bba-484a-a322-eca19aaccc19 None None] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:02:54.137377 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe93d3d-7bba-484a-a322-eca19aaccc19 None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:02:54.137458 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe93d3d-7bba-484a-a322-eca19aaccc19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:02:54.181699 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.auth.core [None req-2fe93d3d-7bba-484a-a322-eca19aaccc19 None None] MFA Rules not processed for user `5cfa58ef86774ab7800bf91930bf6028`. Rule list: `[]` (Enabled: `True`). {{(pid=81593) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 18:02:54.182623 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-2fe93d3d-7bba-484a-a322-eca19aaccc19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:02:54.212534 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef45f8e-9763-4026-8c76-a1deb2c99be1 None None] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:02:54.213089 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1028/2039] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 15 18:02:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 18:02:54.232197 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef45f8e-9763-4026-8c76-a1deb2c99be1 None None] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:02:54.239208 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e7c382-8653-42d2-89e1-7a24b65eda40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:02:54.239831 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e7c382-8653-42d2-89e1-7a24b65eda40 admin admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:02:54.240158 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e7c382-8653-42d2-89e1-7a24b65eda40 admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:02:54.240485 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e7c382-8653-42d2-89e1-7a24b65eda40 admin admin] PATH_INFO: `/v3/domains` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:02:54.241148 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e7c382-8653-42d2-89e1-7a24b65eda40 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81592) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 18:02:54.241501 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e7c382-8653-42d2-89e1-7a24b65eda40 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:02:54.243096 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e7c382-8653-42d2-89e1-7a24b65eda40 admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:02:54.258572 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe93d3d-7bba-484a-a322-eca19aaccc19 None None] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:02:54.260586 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-2fe93d3d-7bba-484a-a322-eca19aaccc19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:02:54.267764 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1012/2040] 10.222.0.25 () {58 vars in 1153 bytes} [Thu Sep 15 18:02:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 18:02:54.275786 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e7c382-8653-42d2-89e1-7a24b65eda40 admin admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:02:54.301813 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e7c382-8653-42d2-89e1-7a24b65eda40 admin admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:02:54.316782 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 18:02:54.319625 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e89a25-05ab-4b9e-97a0-5daa2b06b165 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:02:54.320383 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e89a25-05ab-4b9e-97a0-5daa2b06b165 admin admin] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:02:54.320664 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e89a25-05ab-4b9e-97a0-5daa2b06b165 admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:02:54.320973 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e89a25-05ab-4b9e-97a0-5daa2b06b165 admin admin] PATH_INFO: `/v3/projects` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:02:54.321659 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e89a25-05ab-4b9e-97a0-5daa2b06b165 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:02:54.325932 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e89a25-05ab-4b9e-97a0-5daa2b06b165 admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:02:54.393141 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1013/2041] 10.222.0.25 () {60 vars in 1153 bytes} [Thu Sep 15 18:02:54 2022] POST /identity/v3/projects => generated 373 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 18:02:54.397436 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e89a25-05ab-4b9e-97a0-5daa2b06b165 admin admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:02:54.408842 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe93d3d-7bba-484a-a322-eca19aaccc19 None None] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:02:54.487831 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e89a25-05ab-4b9e-97a0-5daa2b06b165 admin admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:02:54.501849 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39d2263-e82a-4c1e-8fa6-ce4410fbb1fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:02:54.502545 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39d2263-e82a-4c1e-8fa6-ce4410fbb1fd admin admin] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:02:54.502833 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39d2263-e82a-4c1e-8fa6-ce4410fbb1fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:02:54.503112 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39d2263-e82a-4c1e-8fa6-ce4410fbb1fd admin admin] PATH_INFO: `/v3/users` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:02:54.504687 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b39d2263-e82a-4c1e-8fa6-ce4410fbb1fd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:02:54.507386 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b39d2263-e82a-4c1e-8fa6-ce4410fbb1fd admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:02:54.548581 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9903a711-0b1c-4b99-98ed-6d22c88d1b24 tempest-VolumeQuotaClassesTest-175367999 tempest-VolumeQuotaClassesTest-175367999-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f67224accb04a7ea5410bba1850dde9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9aead8c629b9406fb1b55cdee347662f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:02:54.549372 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9903a711-0b1c-4b99-98ed-6d22c88d1b24 tempest-VolumeQuotaClassesTest-175367999 tempest-VolumeQuotaClassesTest-175367999-project-admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:02:54.549735 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9903a711-0b1c-4b99-98ed-6d22c88d1b24 tempest-VolumeQuotaClassesTest-175367999 tempest-VolumeQuotaClassesTest-175367999-project-admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:02:54.550086 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9903a711-0b1c-4b99-98ed-6d22c88d1b24 tempest-VolumeQuotaClassesTest-175367999 tempest-VolumeQuotaClassesTest-175367999-project-admin] PATH_INFO: `/v3/domains` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:02:54.550856 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9903a711-0b1c-4b99-98ed-6d22c88d1b24 tempest-VolumeQuotaClassesTest-175367999 tempest-VolumeQuotaClassesTest-175367999-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81593) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 18:02:54.551233 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9903a711-0b1c-4b99-98ed-6d22c88d1b24 tempest-VolumeQuotaClassesTest-175367999 tempest-VolumeQuotaClassesTest-175367999-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:02:54.553152 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9903a711-0b1c-4b99-98ed-6d22c88d1b24 tempest-VolumeQuotaClassesTest-175367999 tempest-VolumeQuotaClassesTest-175367999-project-admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:02:54.556921 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1014/2042] 10.222.0.25 () {60 vars in 1144 bytes} [Thu Sep 15 18:02:54 2022] POST /identity/v3/users => generated 287 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 15 18:02:54.560833 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39d2263-e82a-4c1e-8fa6-ce4410fbb1fd admin admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:02:54.573285 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1029/2043] 10.222.0.25 () {58 vars in 1153 bytes} [Thu Sep 15 18:02:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 312 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 18:02:54.575154 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9903a711-0b1c-4b99-98ed-6d22c88d1b24 tempest-VolumeQuotaClassesTest-175367999 tempest-VolumeQuotaClassesTest-175367999-project-admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:02:54.579269 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39d2263-e82a-4c1e-8fa6-ce4410fbb1fd admin admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:02:54.589186 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7a1e92-baf9-4d5c-9027-710e4c145f2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:02:54.589839 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7a1e92-baf9-4d5c-9027-710e4c145f2b admin admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:02:54.590116 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7a1e92-baf9-4d5c-9027-710e4c145f2b admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:02:54.590390 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7a1e92-baf9-4d5c-9027-710e4c145f2b admin admin] PATH_INFO: `/v3/roles` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:02:54.591045 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e7a1e92-baf9-4d5c-9027-710e4c145f2b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:02:54.593587 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e7a1e92-baf9-4d5c-9027-710e4c145f2b admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:02:54.596273 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9903a711-0b1c-4b99-98ed-6d22c88d1b24 tempest-VolumeQuotaClassesTest-175367999 tempest-VolumeQuotaClassesTest-175367999-project-admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:02:54.605814 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5d1be6-7284-4883-8bea-e71c157eb557 tempest-VolumeQuotaClassesTest-175367999 tempest-VolumeQuotaClassesTest-175367999-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f67224accb04a7ea5410bba1850dde9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9aead8c629b9406fb1b55cdee347662f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:02:54.607238 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5d1be6-7284-4883-8bea-e71c157eb557 tempest-VolumeQuotaClassesTest-175367999 tempest-VolumeQuotaClassesTest-175367999-project-admin] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:02:54.607996 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5d1be6-7284-4883-8bea-e71c157eb557 tempest-VolumeQuotaClassesTest-175367999 tempest-VolumeQuotaClassesTest-175367999-project-admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:02:54.608863 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5d1be6-7284-4883-8bea-e71c157eb557 tempest-VolumeQuotaClassesTest-175367999 tempest-VolumeQuotaClassesTest-175367999-project-admin] PATH_INFO: `/v3/projects` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:02:54.609916 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d5d1be6-7284-4883-8bea-e71c157eb557 tempest-VolumeQuotaClassesTest-175367999 tempest-VolumeQuotaClassesTest-175367999-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:02:54.612176 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1015/2044] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Sep 15 18:02:54 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 15 18:02:54.614059 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d5d1be6-7284-4883-8bea-e71c157eb557 tempest-VolumeQuotaClassesTest-175367999 tempest-VolumeQuotaClassesTest-175367999-project-admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:02:54.618169 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7a1e92-baf9-4d5c-9027-710e4c145f2b admin admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:02:54.652467 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7a1e92-baf9-4d5c-9027-710e4c145f2b admin admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:02:54.663104 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99942d7-c266-4ae2-a301-1cb3c01a45c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:02:54.663735 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99942d7-c266-4ae2-a301-1cb3c01a45c0 admin admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:02:54.664016 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99942d7-c266-4ae2-a301-1cb3c01a45c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:02:54.664293 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99942d7-c266-4ae2-a301-1cb3c01a45c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:02:54.666493 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a99942d7-c266-4ae2-a301-1cb3c01a45c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:02:54.677196 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a99942d7-c266-4ae2-a301-1cb3c01a45c0 admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:02:54.678900 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1030/2045] 10.222.0.25 () {60 vars in 1153 bytes} [Thu Sep 15 18:02:54 2022] POST /identity/v3/projects => generated 354 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 18:02:54.680188 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5d1be6-7284-4883-8bea-e71c157eb557 tempest-VolumeQuotaClassesTest-175367999 tempest-VolumeQuotaClassesTest-175367999-project-admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:02:54.708321 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1016/2046] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Sep 15 18:02:54 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 18:02:54.713651 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99942d7-c266-4ae2-a301-1cb3c01a45c0 admin admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:02:54.735557 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99942d7-c266-4ae2-a301-1cb3c01a45c0 admin admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:02:54.818790 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5d1be6-7284-4883-8bea-e71c157eb557 tempest-VolumeQuotaClassesTest-175367999 tempest-VolumeQuotaClassesTest-175367999-project-admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:02:54.834034 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ff00d7-a816-45f6-8575-ddafbc7cf180 tempest-VolumeQuotaClassesTest-175367999 tempest-VolumeQuotaClassesTest-175367999-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f67224accb04a7ea5410bba1850dde9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9aead8c629b9406fb1b55cdee347662f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:02:54.834651 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ff00d7-a816-45f6-8575-ddafbc7cf180 tempest-VolumeQuotaClassesTest-175367999 tempest-VolumeQuotaClassesTest-175367999-project-admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:02:54.834932 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ff00d7-a816-45f6-8575-ddafbc7cf180 tempest-VolumeQuotaClassesTest-175367999 tempest-VolumeQuotaClassesTest-175367999-project-admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:02:54.835209 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ff00d7-a816-45f6-8575-ddafbc7cf180 tempest-VolumeQuotaClassesTest-175367999 tempest-VolumeQuotaClassesTest-175367999-project-admin] PATH_INFO: `/v3/domains` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:02:54.835874 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ff00d7-a816-45f6-8575-ddafbc7cf180 tempest-VolumeQuotaClassesTest-175367999 tempest-VolumeQuotaClassesTest-175367999-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81593) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 18:02:54.837642 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ff00d7-a816-45f6-8575-ddafbc7cf180 tempest-VolumeQuotaClassesTest-175367999 tempest-VolumeQuotaClassesTest-175367999-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:02:54.839287 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ff00d7-a816-45f6-8575-ddafbc7cf180 tempest-VolumeQuotaClassesTest-175367999 tempest-VolumeQuotaClassesTest-175367999-project-admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:02:54.866563 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef7dcdd-2585-495d-8717-6155e633393b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:02:54.868075 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef7dcdd-2585-495d-8717-6155e633393b admin admin] REQUEST_METHOD: `PUT` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:02:54.868645 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef7dcdd-2585-495d-8717-6155e633393b admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:02:54.869062 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef7dcdd-2585-495d-8717-6155e633393b admin admin] PATH_INFO: `/v3/projects/58df28bce0f346e99e8cf2a7c69571a8/users/165bbac3e3674aa8a63f27497e4cd7d6/roles/343cc8b1bc7243eebabdf08147e8366d` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:02:54.881780 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1031/2047] 10.222.0.25 () {58 vars in 1153 bytes} [Thu Sep 15 18:02:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 18:02:54.890205 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 18:02:54.907399 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef7dcdd-2585-495d-8717-6155e633393b admin admin] RBAC: Authorizing `identity:create_grant(project_id=58df28bce0f346e99e8cf2a7c69571a8, user_id=165bbac3e3674aa8a63f27497e4cd7d6, role_id=343cc8b1bc7243eebabdf08147e8366d)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:02:54.910096 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef7dcdd-2585-495d-8717-6155e633393b admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:02:54.931669 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1017/2048] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Sep 15 18:02:54 2022] PUT /identity/v3/projects/58df28bce0f346e99e8cf2a7c69571a8/users/165bbac3e3674aa8a63f27497e4cd7d6/roles/343cc8b1bc7243eebabdf08147e8366d => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 18:02:54.947700 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917abdfb-ec8f-4a4a-a582-7840f38fbcc1 None None] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:02:54.947909 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917abdfb-ec8f-4a4a-a582-7840f38fbcc1 None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:02:54.949641 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917abdfb-ec8f-4a4a-a582-7840f38fbcc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:02:54.949914 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef02f47-f967-40cc-bda1-ffc58e234c71 None None] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:02:54.950210 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef02f47-f967-40cc-bda1-ffc58e234c71 None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:02:54.950492 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef02f47-f967-40cc-bda1-ffc58e234c71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:02:54.985235 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.auth.core [None req-917abdfb-ec8f-4a4a-a582-7840f38fbcc1 None None] MFA Rules not processed for user `165bbac3e3674aa8a63f27497e4cd7d6`. Rule list: `[]` (Enabled: `True`). {{(pid=81592) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 18:02:54.987195 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-917abdfb-ec8f-4a4a-a582-7840f38fbcc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:02:54.999731 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.auth.core [None req-eef02f47-f967-40cc-bda1-ffc58e234c71 None None] MFA Rules not processed for user `867f28c48d594d5fb593dd9fa0c80558`. Rule list: `[]` (Enabled: `True`). {{(pid=81593) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 18:02:55.002882 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-eef02f47-f967-40cc-bda1-ffc58e234c71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:02:55.058002 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 18:02:55.118188 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1018/2049] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 15 18:02:54 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 18:02:55.123870 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917abdfb-ec8f-4a4a-a582-7840f38fbcc1 None None] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:02:55.129812 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1032/2050] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 15 18:02:54 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 18:02:55.130447 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef02f47-f967-40cc-bda1-ffc58e234c71 None None] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:02:55.220668 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917abdfb-ec8f-4a4a-a582-7840f38fbcc1 None None] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:02:55.228109 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22ec75f-1535-4f22-ab10-87c90afcf414 tempest-VolumeQuotaClassesTest-175367999 tempest-VolumeQuotaClassesTest-175367999-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f67224accb04a7ea5410bba1850dde9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9aead8c629b9406fb1b55cdee347662f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:02:55.228978 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22ec75f-1535-4f22-ab10-87c90afcf414 tempest-VolumeQuotaClassesTest-175367999 tempest-VolumeQuotaClassesTest-175367999-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:02:55.229455 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22ec75f-1535-4f22-ab10-87c90afcf414 tempest-VolumeQuotaClassesTest-175367999 tempest-VolumeQuotaClassesTest-175367999-project-admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:02:55.229741 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22ec75f-1535-4f22-ab10-87c90afcf414 tempest-VolumeQuotaClassesTest-175367999 tempest-VolumeQuotaClassesTest-175367999-project-admin] PATH_INFO: `/v3/projects/d5007362bd654f34aa8a17fe2674acb5` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:02:55.231513 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22ec75f-1535-4f22-ab10-87c90afcf414 tempest-VolumeQuotaClassesTest-175367999 tempest-VolumeQuotaClassesTest-175367999-project-admin] RBAC: Authorizing `identity:delete_project(project_id=d5007362bd654f34aa8a17fe2674acb5)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:02:55.244473 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22ec75f-1535-4f22-ab10-87c90afcf414 tempest-VolumeQuotaClassesTest-175367999 tempest-VolumeQuotaClassesTest-175367999-project-admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:02:55.250648 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef02f47-f967-40cc-bda1-ffc58e234c71 None None] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:02:55.256810 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97526dd-849f-4817-8fc5-d7ca4a5ae1fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:02:55.259185 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97526dd-849f-4817-8fc5-d7ca4a5ae1fa admin admin] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:02:55.261272 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97526dd-849f-4817-8fc5-d7ca4a5ae1fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:02:55.261715 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97526dd-849f-4817-8fc5-d7ca4a5ae1fa admin admin] PATH_INFO: `/v3/projects` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:02:55.262547 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d97526dd-849f-4817-8fc5-d7ca4a5ae1fa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:02:55.270346 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d97526dd-849f-4817-8fc5-d7ca4a5ae1fa admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:02:55.325957 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1033/2051] 10.222.0.25 () {60 vars in 1153 bytes} [Thu Sep 15 18:02:55 2022] POST /identity/v3/projects => generated 369 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 18:02:55.327856 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97526dd-849f-4817-8fc5-d7ca4a5ae1fa admin admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:02:55.331617 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-d97526dd-849f-4817-8fc5-d7ca4a5ae1fa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:02:55.343822 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-b22ec75f-1535-4f22-ab10-87c90afcf414 tempest-VolumeQuotaClassesTest-175367999 tempest-VolumeQuotaClassesTest-175367999-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd5007362bd654f34aa8a17fe2674acb5', 'request_id': 'req-b22ec75f-1535-4f22-ab10-87c90afcf414'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:02:55.350263 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-b22ec75f-1535-4f22-ab10-87c90afcf414 tempest-VolumeQuotaClassesTest-175367999 tempest-VolumeQuotaClassesTest-175367999-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd5007362bd654f34aa8a17fe2674acb5', 'request_id': 'req-b22ec75f-1535-4f22-ab10-87c90afcf414'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:02:55.366857 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-b22ec75f-1535-4f22-ab10-87c90afcf414 tempest-VolumeQuotaClassesTest-175367999 tempest-VolumeQuotaClassesTest-175367999-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd5007362bd654f34aa8a17fe2674acb5', 'request_id': 'req-b22ec75f-1535-4f22-ab10-87c90afcf414'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:02:55.384811 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-b22ec75f-1535-4f22-ab10-87c90afcf414 tempest-VolumeQuotaClassesTest-175367999 tempest-VolumeQuotaClassesTest-175367999-project-admin] The token cache is being invalidate because project d5007362bd654f34aa8a17fe2674acb5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81592) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 18:02:55.385280 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-b22ec75f-1535-4f22-ab10-87c90afcf414 tempest-VolumeQuotaClassesTest-175367999 tempest-VolumeQuotaClassesTest-175367999-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:02:55.386086 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-b22ec75f-1535-4f22-ab10-87c90afcf414 tempest-VolumeQuotaClassesTest-175367999 tempest-VolumeQuotaClassesTest-175367999-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:02:55.388790 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1019/2052] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Sep 15 18:02:55 2022] DELETE /identity/v3/projects/d5007362bd654f34aa8a17fe2674acb5 => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 18:02:55.389707 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22ec75f-1535-4f22-ab10-87c90afcf414 tempest-VolumeQuotaClassesTest-175367999 tempest-VolumeQuotaClassesTest-175367999-project-admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:02:55.391578 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-b22ec75f-1535-4f22-ab10-87c90afcf414 tempest-VolumeQuotaClassesTest-175367999 tempest-VolumeQuotaClassesTest-175367999-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:02:55.439754 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97526dd-849f-4817-8fc5-d7ca4a5ae1fa admin admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:02:55.443913 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39de9cfb-cf32-4fd7-83e9-c4c3484f3532 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:02:55.444761 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39de9cfb-cf32-4fd7-83e9-c4c3484f3532 admin admin] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:02:55.445196 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39de9cfb-cf32-4fd7-83e9-c4c3484f3532 admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:02:55.446004 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 18:02:55.446523 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39de9cfb-cf32-4fd7-83e9-c4c3484f3532 admin admin] PATH_INFO: `/v3/projects` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:02:55.447667 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39de9cfb-cf32-4fd7-83e9-c4c3484f3532 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:02:55.452990 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39de9cfb-cf32-4fd7-83e9-c4c3484f3532 admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:02:55.562774 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1034/2053] 10.222.0.25 () {60 vars in 1153 bytes} [Thu Sep 15 18:02:55 2022] POST /identity/v3/projects => generated 371 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 18:02:55.566213 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22ec75f-1535-4f22-ab10-87c90afcf414 tempest-VolumeQuotaClassesTest-175367999 tempest-VolumeQuotaClassesTest-175367999-project-admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:02:55.570018 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39de9cfb-cf32-4fd7-83e9-c4c3484f3532 admin admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:02:55.572981 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-39de9cfb-cf32-4fd7-83e9-c4c3484f3532 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:02:55.640084 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 18:02:55.703334 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22fe7088-420f-43f7-8549-e8b48ed98456 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:02:55.704027 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fe7088-420f-43f7-8549-e8b48ed98456 admin admin] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:02:55.704241 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fe7088-420f-43f7-8549-e8b48ed98456 admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:02:55.704365 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39de9cfb-cf32-4fd7-83e9-c4c3484f3532 admin admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:02:55.704550 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fe7088-420f-43f7-8549-e8b48ed98456 admin admin] PATH_INFO: `/v3/users` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:02:55.705420 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22fe7088-420f-43f7-8549-e8b48ed98456 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:02:55.707419 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22fe7088-420f-43f7-8549-e8b48ed98456 admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:02:55.716216 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4125293-97e1-4f08-b7d6-8fc80ac13fa6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:02:55.716948 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4125293-97e1-4f08-b7d6-8fc80ac13fa6 admin admin] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:02:55.717789 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4125293-97e1-4f08-b7d6-8fc80ac13fa6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:02:55.718083 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4125293-97e1-4f08-b7d6-8fc80ac13fa6 admin admin] PATH_INFO: `/v3/users` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:02:55.718711 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4125293-97e1-4f08-b7d6-8fc80ac13fa6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:02:55.720694 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4125293-97e1-4f08-b7d6-8fc80ac13fa6 admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:02:55.747104 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1020/2054] 10.222.0.25 () {60 vars in 1144 bytes} [Thu Sep 15 18:02:55 2022] POST /identity/v3/users => generated 291 bytes in 358 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 18:02:55.750381 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1035/2055] 10.222.0.25 () {60 vars in 1144 bytes} [Thu Sep 15 18:02:55 2022] POST /identity/v3/users => generated 292 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 18:02:55.754276 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22fe7088-420f-43f7-8549-e8b48ed98456 admin admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:02:55.754899 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4125293-97e1-4f08-b7d6-8fc80ac13fa6 admin admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:02:55.777068 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4125293-97e1-4f08-b7d6-8fc80ac13fa6 admin admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:02:55.780411 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22fe7088-420f-43f7-8549-e8b48ed98456 admin admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:02:55.790003 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6dbcad2-e1f1-44b2-a6d5-552b7d4fd1af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:02:55.790911 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6dbcad2-e1f1-44b2-a6d5-552b7d4fd1af admin admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:02:55.791192 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6dbcad2-e1f1-44b2-a6d5-552b7d4fd1af admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:02:55.791464 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6dbcad2-e1f1-44b2-a6d5-552b7d4fd1af admin admin] PATH_INFO: `/v3/roles` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:02:55.792127 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6dbcad2-e1f1-44b2-a6d5-552b7d4fd1af admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:02:55.793820 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6dbcad2-e1f1-44b2-a6d5-552b7d4fd1af admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:02:55.794660 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430920fa-22d4-45f4-be7d-ebe3ae4df3aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:02:55.796509 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430920fa-22d4-45f4-be7d-ebe3ae4df3aa admin admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:02:55.797175 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430920fa-22d4-45f4-be7d-ebe3ae4df3aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:02:55.798015 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430920fa-22d4-45f4-be7d-ebe3ae4df3aa admin admin] PATH_INFO: `/v3/roles` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:02:55.799049 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-430920fa-22d4-45f4-be7d-ebe3ae4df3aa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:02:55.802066 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-430920fa-22d4-45f4-be7d-ebe3ae4df3aa admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:02:55.809052 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1036/2056] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Sep 15 18:02:55 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 18:02:55.812469 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6dbcad2-e1f1-44b2-a6d5-552b7d4fd1af admin admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:02:55.814992 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-c6dbcad2-e1f1-44b2-a6d5-552b7d4fd1af admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:02:55.817564 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1021/2057] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Sep 15 18:02:55 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 15 18:02:55.818365 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430920fa-22d4-45f4-be7d-ebe3ae4df3aa admin admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:02:55.829278 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430920fa-22d4-45f4-be7d-ebe3ae4df3aa admin admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:02:55.836366 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa42c237-b1bd-40a8-8583-d991079eb05f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:02:55.837035 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa42c237-b1bd-40a8-8583-d991079eb05f admin admin] REQUEST_METHOD: `PUT` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:02:55.837334 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa42c237-b1bd-40a8-8583-d991079eb05f admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:02:55.837614 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa42c237-b1bd-40a8-8583-d991079eb05f admin admin] PATH_INFO: `/v3/projects/202dad0b25d644cfb02cff78c3d5cd81/users/c195c04969624c10a7c662800e75a6a1/roles/a9e42be86923434f8af52d3fc07fb4f7` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:02:55.841563 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6dbcad2-e1f1-44b2-a6d5-552b7d4fd1af admin admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:02:55.846779 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712866d5-049e-4cc4-b1e0-f6cd381961a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:02:55.847422 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712866d5-049e-4cc4-b1e0-f6cd381961a2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:02:55.847697 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712866d5-049e-4cc4-b1e0-f6cd381961a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:02:55.847966 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712866d5-049e-4cc4-b1e0-f6cd381961a2 admin admin] PATH_INFO: `/v3/users/0bd26908b7f14fe0b5dcece0df1c424c` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:02:55.849982 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-712866d5-049e-4cc4-b1e0-f6cd381961a2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0bd26908b7f14fe0b5dcece0df1c424c)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:02:55.851920 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-712866d5-049e-4cc4-b1e0-f6cd381961a2 admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:02:55.857055 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa42c237-b1bd-40a8-8583-d991079eb05f admin admin] RBAC: Authorizing `identity:create_grant(project_id=202dad0b25d644cfb02cff78c3d5cd81, user_id=c195c04969624c10a7c662800e75a6a1, role_id=a9e42be86923434f8af52d3fc07fb4f7)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:02:55.860377 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa42c237-b1bd-40a8-8583-d991079eb05f admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:02:55.876769 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1022/2058] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Sep 15 18:02:55 2022] PUT /identity/v3/projects/202dad0b25d644cfb02cff78c3d5cd81/users/c195c04969624c10a7c662800e75a6a1/roles/a9e42be86923434f8af52d3fc07fb4f7 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 18:02:55.877800 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa42c237-b1bd-40a8-8583-d991079eb05f admin admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:02:55.923898 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-712866d5-049e-4cc4-b1e0-f6cd381961a2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0bd26908b7f14fe0b5dcece0df1c424c'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:02:55.937690 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-712866d5-049e-4cc4-b1e0-f6cd381961a2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0bd26908b7f14fe0b5dcece0df1c424c'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:02:55.938570 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-712866d5-049e-4cc4-b1e0-f6cd381961a2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0bd26908b7f14fe0b5dcece0df1c424c'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:02:55.939380 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-712866d5-049e-4cc4-b1e0-f6cd381961a2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0bd26908b7f14fe0b5dcece0df1c424c'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:02:55.949348 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-712866d5-049e-4cc4-b1e0-f6cd381961a2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0bd26908b7f14fe0b5dcece0df1c424c'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:02:55.984564 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1037/2059] 10.222.0.25 () {58 vars in 1224 bytes} [Thu Sep 15 18:02:55 2022] DELETE /identity/v3/users/0bd26908b7f14fe0b5dcece0df1c424c => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 18:02:55.985514 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712866d5-049e-4cc4-b1e0-f6cd381961a2 admin admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:02:55.986950 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-712866d5-049e-4cc4-b1e0-f6cd381961a2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:02:55.992649 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa42c237-b1bd-40a8-8583-d991079eb05f admin admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:02:56.007785 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 18:02:56.084885 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712866d5-049e-4cc4-b1e0-f6cd381961a2 admin admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:02:56.103942 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5899032-0a0f-4091-a080-caca19e6cded admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:02:56.104724 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5899032-0a0f-4091-a080-caca19e6cded admin admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:02:56.105130 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5899032-0a0f-4091-a080-caca19e6cded admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:02:56.105530 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5899032-0a0f-4091-a080-caca19e6cded admin admin] PATH_INFO: `/v3/roles` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:02:56.106365 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5899032-0a0f-4091-a080-caca19e6cded admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:02:56.108763 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5899032-0a0f-4091-a080-caca19e6cded admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:02:56.138254 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14743aaa-f3f5-470f-b414-9d7f39924d5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:02:56.139071 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14743aaa-f3f5-470f-b414-9d7f39924d5f admin admin] REQUEST_METHOD: `PUT` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:02:56.139379 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14743aaa-f3f5-470f-b414-9d7f39924d5f admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:02:56.139609 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14743aaa-f3f5-470f-b414-9d7f39924d5f admin admin] PATH_INFO: `/v3/projects/f60d8960b1f94bc9ac3984115fd6f2c1/users/8819cc84d8284b3eaa22fb7abade9ed4/roles/a9e42be86923434f8af52d3fc07fb4f7` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:02:56.140498 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1038/2060] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Sep 15 18:02:55 2022] GET /identity/v3/roles => generated 1420 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 18:02:56.141727 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218bbff0-cde1-428e-9b88-bf78d3225a62 None None] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:02:56.142079 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218bbff0-cde1-428e-9b88-bf78d3225a62 None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:02:56.142505 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218bbff0-cde1-428e-9b88-bf78d3225a62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:02:56.173272 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14743aaa-f3f5-470f-b414-9d7f39924d5f admin admin] RBAC: Authorizing `identity:create_grant(project_id=f60d8960b1f94bc9ac3984115fd6f2c1, user_id=8819cc84d8284b3eaa22fb7abade9ed4, role_id=a9e42be86923434f8af52d3fc07fb4f7)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:02:56.177742 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14743aaa-f3f5-470f-b414-9d7f39924d5f admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:02:56.191719 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.auth.core [None req-218bbff0-cde1-428e-9b88-bf78d3225a62 None None] MFA Rules not processed for user `5cfa58ef86774ab7800bf91930bf6028`. Rule list: `[]` (Enabled: `True`). {{(pid=81593) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 18:02:56.193675 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-218bbff0-cde1-428e-9b88-bf78d3225a62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:02:56.205222 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1039/2061] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 15 18:02:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 18:02:56.206093 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218bbff0-cde1-428e-9b88-bf78d3225a62 None None] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:02:56.218595 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218bbff0-cde1-428e-9b88-bf78d3225a62 None None] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:02:56.227025 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1023/2062] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Sep 15 18:02:55 2022] PUT /identity/v3/projects/f60d8960b1f94bc9ac3984115fd6f2c1/users/8819cc84d8284b3eaa22fb7abade9ed4/roles/a9e42be86923434f8af52d3fc07fb4f7 => generated 0 bytes in 350 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 18:02:56.228006 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14743aaa-f3f5-470f-b414-9d7f39924d5f admin admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:02:56.229774 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-14743aaa-f3f5-470f-b414-9d7f39924d5f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:02:56.238261 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 18:02:56.308251 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485b1013-e65a-4e3e-a6c5-f6833296d1a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:02:56.309244 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485b1013-e65a-4e3e-a6c5-f6833296d1a2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:02:56.309514 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485b1013-e65a-4e3e-a6c5-f6833296d1a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:02:56.309935 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485b1013-e65a-4e3e-a6c5-f6833296d1a2 admin admin] PATH_INFO: `/v3/projects/202dad0b25d644cfb02cff78c3d5cd81/users/c195c04969624c10a7c662800e75a6a1/roles/a9e42be86923434f8af52d3fc07fb4f7` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:02:56.312386 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485b1013-e65a-4e3e-a6c5-f6833296d1a2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=202dad0b25d644cfb02cff78c3d5cd81, user_id=c195c04969624c10a7c662800e75a6a1, role_id=a9e42be86923434f8af52d3fc07fb4f7)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:02:56.318990 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485b1013-e65a-4e3e-a6c5-f6833296d1a2 admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:02:56.344499 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1040/2063] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Sep 15 18:02:56 2022] PUT /identity/v3/projects/202dad0b25d644cfb02cff78c3d5cd81/users/c195c04969624c10a7c662800e75a6a1/roles/a9e42be86923434f8af52d3fc07fb4f7 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 18:02:56.346136 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485b1013-e65a-4e3e-a6c5-f6833296d1a2 admin admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:02:56.348317 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-485b1013-e65a-4e3e-a6c5-f6833296d1a2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:02:56.382053 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14743aaa-f3f5-470f-b414-9d7f39924d5f admin admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:02:56.457962 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485b1013-e65a-4e3e-a6c5-f6833296d1a2 admin admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:02:56.464406 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c343d7b9-bef6-4599-8d0c-3dcab3233595 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:02:56.465054 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c343d7b9-bef6-4599-8d0c-3dcab3233595 admin admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:02:56.465355 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c343d7b9-bef6-4599-8d0c-3dcab3233595 admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:02:56.465628 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c343d7b9-bef6-4599-8d0c-3dcab3233595 admin admin] PATH_INFO: `/v3/roles` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:02:56.466380 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c343d7b9-bef6-4599-8d0c-3dcab3233595 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:02:56.469083 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c343d7b9-bef6-4599-8d0c-3dcab3233595 admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:02:56.489835 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1041/2064] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Sep 15 18:02:56 2022] GET /identity/v3/roles => generated 1420 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 18:02:56.492469 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c343d7b9-bef6-4599-8d0c-3dcab3233595 admin admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:02:56.516125 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6267809f-4929-4a2c-b723-b54ffbd28fa8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a32274b4781b40fea9f28da8a9bde5ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1213c0d1b584404ba3998e136f166e89', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:02:56.517212 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6267809f-4929-4a2c-b723-b54ffbd28fa8 service neutron] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:02:56.517828 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6267809f-4929-4a2c-b723-b54ffbd28fa8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:02:56.518110 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6267809f-4929-4a2c-b723-b54ffbd28fa8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:02:56.527178 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c343d7b9-bef6-4599-8d0c-3dcab3233595 admin admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:02:56.541104 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6267809f-4929-4a2c-b723-b54ffbd28fa8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:02:56.543432 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d3e5d7-309b-44a5-8388-91a9f1ab5abe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:02:56.544641 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6267809f-4929-4a2c-b723-b54ffbd28fa8 service neutron] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:02:56.546025 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d3e5d7-309b-44a5-8388-91a9f1ab5abe admin admin] REQUEST_METHOD: `PUT` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:02:56.546305 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d3e5d7-309b-44a5-8388-91a9f1ab5abe admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:02:56.547798 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d3e5d7-309b-44a5-8388-91a9f1ab5abe admin admin] PATH_INFO: `/v3/projects/f60d8960b1f94bc9ac3984115fd6f2c1/users/8819cc84d8284b3eaa22fb7abade9ed4/roles/a9e42be86923434f8af52d3fc07fb4f7` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:02:56.555895 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d3e5d7-309b-44a5-8388-91a9f1ab5abe admin admin] RBAC: Authorizing `identity:create_grant(project_id=f60d8960b1f94bc9ac3984115fd6f2c1, user_id=8819cc84d8284b3eaa22fb7abade9ed4, role_id=a9e42be86923434f8af52d3fc07fb4f7)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:02:56.562956 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d3e5d7-309b-44a5-8388-91a9f1ab5abe admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:02:56.575932 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1024/2065] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 15 18:02:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 18:02:56.597215 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1042/2066] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Sep 15 18:02:56 2022] PUT /identity/v3/projects/f60d8960b1f94bc9ac3984115fd6f2c1/users/8819cc84d8284b3eaa22fb7abade9ed4/roles/a9e42be86923434f8af52d3fc07fb4f7 => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 18:02:56.599087 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f08420-b5c7-4c39-8e0b-56d9e61cb053 None None] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:02:56.599434 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f08420-b5c7-4c39-8e0b-56d9e61cb053 None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:02:56.600559 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f08420-b5c7-4c39-8e0b-56d9e61cb053 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:02:56.639917 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.auth.core [None req-65f08420-b5c7-4c39-8e0b-56d9e61cb053 None None] MFA Rules not processed for user `8819cc84d8284b3eaa22fb7abade9ed4`. Rule list: `[]` (Enabled: `True`). {{(pid=81592) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 18:02:56.641595 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-65f08420-b5c7-4c39-8e0b-56d9e61cb053 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:02:56.824799 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 18:02:56.855207 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d3e5d7-309b-44a5-8388-91a9f1ab5abe admin admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:02:56.858666 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-08d3e5d7-309b-44a5-8388-91a9f1ab5abe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:02:56.869404 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1025/2067] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 15 18:02:56 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 272 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 18:02:56.886685 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f08420-b5c7-4c39-8e0b-56d9e61cb053 None None] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:02:56.888429 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-65f08420-b5c7-4c39-8e0b-56d9e61cb053 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:02:57.010524 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f08420-b5c7-4c39-8e0b-56d9e61cb053 None None] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:02:57.023755 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d3e5d7-309b-44a5-8388-91a9f1ab5abe admin admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:02:57.024958 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c74903-57fd-4749-8b40-5c0598174095 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b232e7a841145ba93c6d8462ccb751a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1213c0d1b584404ba3998e136f166e89', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:02:57.029172 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c74903-57fd-4749-8b40-5c0598174095 service cinder] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:02:57.033923 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c74903-57fd-4749-8b40-5c0598174095 service cinder] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:02:57.034285 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c74903-57fd-4749-8b40-5c0598174095 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:02:57.039307 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-12c74903-57fd-4749-8b40-5c0598174095 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:02:57.042009 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9597a2-5ca2-4808-8948-f0394fefa199 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:02:57.042659 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9597a2-5ca2-4808-8948-f0394fefa199 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:02:57.042934 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9597a2-5ca2-4808-8948-f0394fefa199 admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:02:57.043210 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9597a2-5ca2-4808-8948-f0394fefa199 admin admin] PATH_INFO: `/v3/users/d069ed5a66e64b4c91b2f55ed0c6681f` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:02:57.046341 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d9597a2-5ca2-4808-8948-f0394fefa199 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d069ed5a66e64b4c91b2f55ed0c6681f)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:02:57.048479 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d9597a2-5ca2-4808-8948-f0394fefa199 admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:02:57.163521 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=93,keystone:INSERT=2,keystone:DELETE=5 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 18:02:57.183030 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-0d9597a2-5ca2-4808-8948-f0394fefa199 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd069ed5a66e64b4c91b2f55ed0c6681f'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:02:57.193905 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c74903-57fd-4749-8b40-5c0598174095 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:02:57.195244 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c74903-57fd-4749-8b40-5c0598174095 service cinder] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:02:57.197374 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-0d9597a2-5ca2-4808-8948-f0394fefa199 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd069ed5a66e64b4c91b2f55ed0c6681f'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:02:57.198425 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-0d9597a2-5ca2-4808-8948-f0394fefa199 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd069ed5a66e64b4c91b2f55ed0c6681f'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:02:57.199328 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-0d9597a2-5ca2-4808-8948-f0394fefa199 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd069ed5a66e64b4c91b2f55ed0c6681f'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:02:57.218290 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1026/2068] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 15 18:02:56 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 18:02:57.245429 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-0d9597a2-5ca2-4808-8948-f0394fefa199 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd069ed5a66e64b4c91b2f55ed0c6681f'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:02:57.308320 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1043/2069] 10.222.0.25 () {58 vars in 1224 bytes} [Thu Sep 15 18:02:56 2022] DELETE /identity/v3/users/d069ed5a66e64b4c91b2f55ed0c6681f => generated 0 bytes in 454 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 15 18:02:57.313987 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689ef494-0571-44e5-b8b6-178fa2b0d8e2 None None] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:02:57.314275 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689ef494-0571-44e5-b8b6-178fa2b0d8e2 None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:02:57.315049 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689ef494-0571-44e5-b8b6-178fa2b0d8e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:02:57.346107 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.auth.core [None req-689ef494-0571-44e5-b8b6-178fa2b0d8e2 None None] MFA Rules not processed for user `5cfa58ef86774ab7800bf91930bf6028`. Rule list: `[]` (Enabled: `True`). {{(pid=81592) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 18:02:57.347338 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-689ef494-0571-44e5-b8b6-178fa2b0d8e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:02:57.448488 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1027/2070] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 15 18:02:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 18:02:57.458778 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9597a2-5ca2-4808-8948-f0394fefa199 admin admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:02:57.460751 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-0d9597a2-5ca2-4808-8948-f0394fefa199 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:02:57.535544 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9597a2-5ca2-4808-8948-f0394fefa199 admin admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:02:57.541713 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8125db77-eae8-4757-9a8d-8d6cb721325f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a32274b4781b40fea9f28da8a9bde5ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1213c0d1b584404ba3998e136f166e89', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:02:57.542430 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8125db77-eae8-4757-9a8d-8d6cb721325f service neutron] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:02:57.542939 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8125db77-eae8-4757-9a8d-8d6cb721325f service neutron] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:02:57.543392 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8125db77-eae8-4757-9a8d-8d6cb721325f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:02:57.559873 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8125db77-eae8-4757-9a8d-8d6cb721325f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:02:57.561607 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8125db77-eae8-4757-9a8d-8d6cb721325f service neutron] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:02:57.573248 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1044/2071] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 15 18:02:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 18:02:57.577562 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689ef494-0571-44e5-b8b6-178fa2b0d8e2 None None] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:02:57.579083 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-689ef494-0571-44e5-b8b6-178fa2b0d8e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:02:57.608105 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689ef494-0571-44e5-b8b6-178fa2b0d8e2 None None] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:02:57.622817 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081bd0e0-9cc9-4742-8660-96cd6ca4cc07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:02:57.624003 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081bd0e0-9cc9-4742-8660-96cd6ca4cc07 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:02:57.624318 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081bd0e0-9cc9-4742-8660-96cd6ca4cc07 admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:02:57.624610 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081bd0e0-9cc9-4742-8660-96cd6ca4cc07 admin admin] PATH_INFO: `/v3/projects/8dfa4d270b6c48b6b598ea4578a7e9cf` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:02:57.626426 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-081bd0e0-9cc9-4742-8660-96cd6ca4cc07 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8dfa4d270b6c48b6b598ea4578a7e9cf)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:02:57.628358 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-081bd0e0-9cc9-4742-8660-96cd6ca4cc07 admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:02:57.780115 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 18:02:57.816661 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-081bd0e0-9cc9-4742-8660-96cd6ca4cc07 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8dfa4d270b6c48b6b598ea4578a7e9cf', 'request_id': 'req-081bd0e0-9cc9-4742-8660-96cd6ca4cc07'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:02:57.837624 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-081bd0e0-9cc9-4742-8660-96cd6ca4cc07 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8dfa4d270b6c48b6b598ea4578a7e9cf', 'request_id': 'req-081bd0e0-9cc9-4742-8660-96cd6ca4cc07'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:02:57.860381 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cf4767-4bc6-4963-9fac-5825d065a620 None None] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:02:57.861149 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cf4767-4bc6-4963-9fac-5825d065a620 None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:02:57.862175 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cf4767-4bc6-4963-9fac-5825d065a620 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:02:57.864131 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-081bd0e0-9cc9-4742-8660-96cd6ca4cc07 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8dfa4d270b6c48b6b598ea4578a7e9cf', 'request_id': 'req-081bd0e0-9cc9-4742-8660-96cd6ca4cc07'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:02:57.883705 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-081bd0e0-9cc9-4742-8660-96cd6ca4cc07 admin admin] The token cache is being invalidate because project 8dfa4d270b6c48b6b598ea4578a7e9cf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81592) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 18:02:57.887068 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-081bd0e0-9cc9-4742-8660-96cd6ca4cc07 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:02:57.897307 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-081bd0e0-9cc9-4742-8660-96cd6ca4cc07 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:02:57.899149 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1028/2072] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Sep 15 18:02:57 2022] DELETE /identity/v3/projects/8dfa4d270b6c48b6b598ea4578a7e9cf => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 18:02:57.903354 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081bd0e0-9cc9-4742-8660-96cd6ca4cc07 admin admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:02:57.907248 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-081bd0e0-9cc9-4742-8660-96cd6ca4cc07 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:02:57.925739 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.auth.core [None req-35cf4767-4bc6-4963-9fac-5825d065a620 None None] MFA Rules not processed for user `c195c04969624c10a7c662800e75a6a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81593) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 18:02:57.927156 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-35cf4767-4bc6-4963-9fac-5825d065a620 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:02:58.047835 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081bd0e0-9cc9-4742-8660-96cd6ca4cc07 admin admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:02:58.066942 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f315f4-d315-489c-b5b5-a47e81a38953 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:02:58.078340 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f315f4-d315-489c-b5b5-a47e81a38953 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:02:58.080143 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f315f4-d315-489c-b5b5-a47e81a38953 admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:02:58.082445 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f315f4-d315-489c-b5b5-a47e81a38953 admin admin] PATH_INFO: `/v3/users/7f67224accb04a7ea5410bba1850dde9` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:02:58.089483 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1045/2073] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 15 18:02:57 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 18:02:58.090590 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f315f4-d315-489c-b5b5-a47e81a38953 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7f67224accb04a7ea5410bba1850dde9)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:02:58.091197 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97cc536-8a0d-4b8a-b865-a02e64beeb3f None None] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:02:58.091492 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97cc536-8a0d-4b8a-b865-a02e64beeb3f None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:02:58.091770 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97cc536-8a0d-4b8a-b865-a02e64beeb3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:02:58.094335 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f315f4-d315-489c-b5b5-a47e81a38953 admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:02:58.118934 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.auth.core [None req-b97cc536-8a0d-4b8a-b865-a02e64beeb3f None None] MFA Rules not processed for user `867f28c48d594d5fb593dd9fa0c80558`. Rule list: `[]` (Enabled: `True`). {{(pid=81593) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 18:02:58.120523 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-b97cc536-8a0d-4b8a-b865-a02e64beeb3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:02:58.166998 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 18:02:58.200220 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1046/2074] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 15 18:02:58 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 18:02:58.213652 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97cc536-8a0d-4b8a-b865-a02e64beeb3f None None] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:02:58.216672 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-b97cc536-8a0d-4b8a-b865-a02e64beeb3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:02:58.228276 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-02f315f4-d315-489c-b5b5-a47e81a38953 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7f67224accb04a7ea5410bba1850dde9'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:02:58.243803 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-02f315f4-d315-489c-b5b5-a47e81a38953 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7f67224accb04a7ea5410bba1850dde9'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:02:58.244441 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-02f315f4-d315-489c-b5b5-a47e81a38953 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7f67224accb04a7ea5410bba1850dde9'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:02:58.245066 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-02f315f4-d315-489c-b5b5-a47e81a38953 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7f67224accb04a7ea5410bba1850dde9'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:02:58.251721 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97cc536-8a0d-4b8a-b865-a02e64beeb3f None None] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:02:58.255936 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-02f315f4-d315-489c-b5b5-a47e81a38953 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7f67224accb04a7ea5410bba1850dde9'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:02:58.266571 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d32b48-6889-4a79-8186-a6d00d37e57c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:02:58.267483 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d32b48-6889-4a79-8186-a6d00d37e57c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:02:58.267728 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d32b48-6889-4a79-8186-a6d00d37e57c admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:02:58.267998 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d32b48-6889-4a79-8186-a6d00d37e57c admin admin] PATH_INFO: `/v3/projects/d0423231070d408c8ad82c32fd9cf4bd` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:02:58.270319 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d32b48-6889-4a79-8186-a6d00d37e57c admin admin] RBAC: Authorizing `identity:delete_project(project_id=d0423231070d408c8ad82c32fd9cf4bd)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:02:58.272436 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d32b48-6889-4a79-8186-a6d00d37e57c admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:02:58.280295 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1029/2075] 10.222.0.25 () {58 vars in 1224 bytes} [Thu Sep 15 18:02:57 2022] DELETE /identity/v3/users/7f67224accb04a7ea5410bba1850dde9 => generated 0 bytes in 377 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 18:02:58.281352 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f315f4-d315-489c-b5b5-a47e81a38953 admin admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:02:58.284303 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-02f315f4-d315-489c-b5b5-a47e81a38953 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:02:58.378059 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:DELETE=15,keystone:SELECT=83,keystone:INSERT=2 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 18:02:58.410102 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-c7d32b48-6889-4a79-8186-a6d00d37e57c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd0423231070d408c8ad82c32fd9cf4bd', 'request_id': 'req-c7d32b48-6889-4a79-8186-a6d00d37e57c'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:02:58.430329 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f315f4-d315-489c-b5b5-a47e81a38953 admin admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:02:58.447469 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-c7d32b48-6889-4a79-8186-a6d00d37e57c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd0423231070d408c8ad82c32fd9cf4bd', 'request_id': 'req-c7d32b48-6889-4a79-8186-a6d00d37e57c'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:02:58.475752 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-c7d32b48-6889-4a79-8186-a6d00d37e57c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd0423231070d408c8ad82c32fd9cf4bd', 'request_id': 'req-c7d32b48-6889-4a79-8186-a6d00d37e57c'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:02:58.514924 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-c7d32b48-6889-4a79-8186-a6d00d37e57c admin admin] The token cache is being invalidate because project d0423231070d408c8ad82c32fd9cf4bd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81593) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 18:02:58.518440 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-c7d32b48-6889-4a79-8186-a6d00d37e57c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:02:58.522450 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-c7d32b48-6889-4a79-8186-a6d00d37e57c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:02:58.527836 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1047/2076] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Sep 15 18:02:58 2022] DELETE /identity/v3/projects/d0423231070d408c8ad82c32fd9cf4bd => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 18:02:58.531687 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d32b48-6889-4a79-8186-a6d00d37e57c admin admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:02:58.538403 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-c7d32b48-6889-4a79-8186-a6d00d37e57c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:02:58.570577 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a199402e-f437-4b76-84a7-c00d2b676c7c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe2244818e4d4dca9c424cd078653e6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1213c0d1b584404ba3998e136f166e89', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:02:58.570749 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a199402e-f437-4b76-84a7-c00d2b676c7c service nova] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:02:58.571072 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a199402e-f437-4b76-84a7-c00d2b676c7c service nova] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:02:58.571354 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a199402e-f437-4b76-84a7-c00d2b676c7c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:02:58.575364 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-a199402e-f437-4b76-84a7-c00d2b676c7c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:02:58.676722 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d32b48-6889-4a79-8186-a6d00d37e57c admin admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:02:58.693728 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc06a66-9466-441f-b527-cfd6d3b1197a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:02:58.694488 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc06a66-9466-441f-b527-cfd6d3b1197a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:02:58.695253 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc06a66-9466-441f-b527-cfd6d3b1197a admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:02:58.695253 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc06a66-9466-441f-b527-cfd6d3b1197a admin admin] PATH_INFO: `/v3/users/123f9f62011a46b7ac725461d084d833` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:02:58.698270 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc06a66-9466-441f-b527-cfd6d3b1197a admin admin] RBAC: Authorizing `identity:delete_user(user_id=123f9f62011a46b7ac725461d084d833)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:02:58.700528 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc06a66-9466-441f-b527-cfd6d3b1197a admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:02:58.784941 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a199402e-f437-4b76-84a7-c00d2b676c7c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:02:58.787245 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a199402e-f437-4b76-84a7-c00d2b676c7c service nova] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:02:58.805230 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1030/2077] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 15 18:02:58 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 524 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 18:02:58.869807 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-1dc06a66-9466-441f-b527-cfd6d3b1197a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '123f9f62011a46b7ac725461d084d833'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:02:58.885113 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a199402e-f437-4b76-84a7-c00d2b676c7c service nova] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:02:58.886870 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-a199402e-f437-4b76-84a7-c00d2b676c7c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:02:58.891411 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-1dc06a66-9466-441f-b527-cfd6d3b1197a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '123f9f62011a46b7ac725461d084d833'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:02:58.893196 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-1dc06a66-9466-441f-b527-cfd6d3b1197a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '123f9f62011a46b7ac725461d084d833'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:02:58.895578 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-1dc06a66-9466-441f-b527-cfd6d3b1197a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '123f9f62011a46b7ac725461d084d833'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:02:58.914101 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-1dc06a66-9466-441f-b527-cfd6d3b1197a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '123f9f62011a46b7ac725461d084d833'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:02:58.934543 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 18:02:58.936487 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a199402e-f437-4b76-84a7-c00d2b676c7c service nova] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:02:58.959977 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a2e8e7-f3ab-4a0a-950e-ea308426bff8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:02:58.960798 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a2e8e7-f3ab-4a0a-950e-ea308426bff8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:02:58.961156 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a2e8e7-f3ab-4a0a-950e-ea308426bff8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:02:58.961550 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a2e8e7-f3ab-4a0a-950e-ea308426bff8 admin admin] PATH_INFO: `/v3/projects/9aead8c629b9406fb1b55cdee347662f` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:02:58.963055 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a2e8e7-f3ab-4a0a-950e-ea308426bff8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9aead8c629b9406fb1b55cdee347662f)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:02:58.966161 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a2e8e7-f3ab-4a0a-950e-ea308426bff8 admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:02:58.972892 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1048/2078] 10.222.0.25 () {58 vars in 1224 bytes} [Thu Sep 15 18:02:58 2022] DELETE /identity/v3/users/123f9f62011a46b7ac725461d084d833 => generated 0 bytes in 435 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 15 18:02:59.086486 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-f8a2e8e7-f3ab-4a0a-950e-ea308426bff8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9aead8c629b9406fb1b55cdee347662f', 'request_id': 'req-f8a2e8e7-f3ab-4a0a-950e-ea308426bff8'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:02:59.104959 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-f8a2e8e7-f3ab-4a0a-950e-ea308426bff8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9aead8c629b9406fb1b55cdee347662f', 'request_id': 'req-f8a2e8e7-f3ab-4a0a-950e-ea308426bff8'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:02:59.134681 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-f8a2e8e7-f3ab-4a0a-950e-ea308426bff8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9aead8c629b9406fb1b55cdee347662f', 'request_id': 'req-f8a2e8e7-f3ab-4a0a-950e-ea308426bff8'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:02:59.147493 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 18:02:59.152646 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-f8a2e8e7-f3ab-4a0a-950e-ea308426bff8 admin admin] The token cache is being invalidate because project 9aead8c629b9406fb1b55cdee347662f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81592) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 18:02:59.158355 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-f8a2e8e7-f3ab-4a0a-950e-ea308426bff8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:02:59.164400 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-f8a2e8e7-f3ab-4a0a-950e-ea308426bff8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:02:59.166314 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1031/2079] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Sep 15 18:02:58 2022] DELETE /identity/v3/projects/9aead8c629b9406fb1b55cdee347662f => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 18:02:59.172436 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb4fb69-1eae-4481-991f-43c95f08e22b None None] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:02:59.173094 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb4fb69-1eae-4481-991f-43c95f08e22b None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:02:59.173094 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb4fb69-1eae-4481-991f-43c95f08e22b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:02:59.230601 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.auth.core [None req-cbb4fb69-1eae-4481-991f-43c95f08e22b None None] MFA Rules not processed for user `5cfa58ef86774ab7800bf91930bf6028`. Rule list: `[]` (Enabled: `True`). {{(pid=81593) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 18:02:59.234687 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-cbb4fb69-1eae-4481-991f-43c95f08e22b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:02:59.340354 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1049/2080] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 15 18:02:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 18:02:59.349453 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95aec5f-6813-4820-97a8-ffeb6c4c677d None None] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:02:59.349804 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95aec5f-6813-4820-97a8-ffeb6c4c677d None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:02:59.350113 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95aec5f-6813-4820-97a8-ffeb6c4c677d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:02:59.381817 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.auth.core [None req-b95aec5f-6813-4820-97a8-ffeb6c4c677d None None] MFA Rules not processed for user `5cfa58ef86774ab7800bf91930bf6028`. Rule list: `[]` (Enabled: `True`). {{(pid=81592) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 18:02:59.385112 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-b95aec5f-6813-4820-97a8-ffeb6c4c677d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:02:59.405972 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1032/2081] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 15 18:02:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 18:02:59.410730 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb4fb69-1eae-4481-991f-43c95f08e22b None None] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:02:59.423769 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb4fb69-1eae-4481-991f-43c95f08e22b None None] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:02:59.429723 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8459e50-5fbd-4750-939c-5ce887ca68f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:02:59.430475 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8459e50-5fbd-4750-939c-5ce887ca68f9 admin admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:02:59.430939 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8459e50-5fbd-4750-939c-5ce887ca68f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:02:59.431273 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8459e50-5fbd-4750-939c-5ce887ca68f9 admin admin] PATH_INFO: `/v3/domains` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:02:59.432002 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8459e50-5fbd-4750-939c-5ce887ca68f9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81593) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 18:02:59.432373 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8459e50-5fbd-4750-939c-5ce887ca68f9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:02:59.433786 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95aec5f-6813-4820-97a8-ffeb6c4c677d None None] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:02:59.435134 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8459e50-5fbd-4750-939c-5ce887ca68f9 admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:02:59.438070 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-b95aec5f-6813-4820-97a8-ffeb6c4c677d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:02:59.458826 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1050/2082] 10.222.0.25 () {58 vars in 1153 bytes} [Thu Sep 15 18:02:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 18:02:59.464018 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8459e50-5fbd-4750-939c-5ce887ca68f9 admin admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:02:59.467055 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95aec5f-6813-4820-97a8-ffeb6c4c677d None None] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:02:59.476216 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3c7c26-e408-4ba8-a6ee-0bfe817898c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:02:59.477233 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3c7c26-e408-4ba8-a6ee-0bfe817898c6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:02:59.477664 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3c7c26-e408-4ba8-a6ee-0bfe817898c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:02:59.477964 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3c7c26-e408-4ba8-a6ee-0bfe817898c6 admin admin] PATH_INFO: `/v3/projects/bc1c7178f75f4767b66fd4a5b10641f1` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:02:59.479292 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8459e50-5fbd-4750-939c-5ce887ca68f9 admin admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:02:59.480756 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b3c7c26-e408-4ba8-a6ee-0bfe817898c6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bc1c7178f75f4767b66fd4a5b10641f1)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:02:59.486781 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b3c7c26-e408-4ba8-a6ee-0bfe817898c6 admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:02:59.487213 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af87ff73-8363-43b7-bc8d-eac87c454ea0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:02:59.487925 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af87ff73-8363-43b7-bc8d-eac87c454ea0 admin admin] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:02:59.488108 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af87ff73-8363-43b7-bc8d-eac87c454ea0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:02:59.488508 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af87ff73-8363-43b7-bc8d-eac87c454ea0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:02:59.489807 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af87ff73-8363-43b7-bc8d-eac87c454ea0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:02:59.494129 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af87ff73-8363-43b7-bc8d-eac87c454ea0 admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:02:59.545598 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1051/2083] 10.222.0.25 () {60 vars in 1153 bytes} [Thu Sep 15 18:02:59 2022] POST /identity/v3/projects => generated 409 bytes in 83 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 18:02:59.547566 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af87ff73-8363-43b7-bc8d-eac87c454ea0 admin admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:02:59.611507 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-9b3c7c26-e408-4ba8-a6ee-0bfe817898c6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bc1c7178f75f4767b66fd4a5b10641f1', 'request_id': 'req-9b3c7c26-e408-4ba8-a6ee-0bfe817898c6'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:02:59.626642 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-9b3c7c26-e408-4ba8-a6ee-0bfe817898c6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bc1c7178f75f4767b66fd4a5b10641f1', 'request_id': 'req-9b3c7c26-e408-4ba8-a6ee-0bfe817898c6'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:02:59.636476 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-9b3c7c26-e408-4ba8-a6ee-0bfe817898c6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bc1c7178f75f4767b66fd4a5b10641f1', 'request_id': 'req-9b3c7c26-e408-4ba8-a6ee-0bfe817898c6'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:02:59.638546 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af87ff73-8363-43b7-bc8d-eac87c454ea0 admin admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:02:59.649271 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-9b3c7c26-e408-4ba8-a6ee-0bfe817898c6 admin admin] The token cache is being invalidate because project bc1c7178f75f4767b66fd4a5b10641f1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81592) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 18:02:59.649689 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-9b3c7c26-e408-4ba8-a6ee-0bfe817898c6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:02:59.650652 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-9b3c7c26-e408-4ba8-a6ee-0bfe817898c6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:02:59.652599 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1033/2084] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Sep 15 18:02:59 2022] DELETE /identity/v3/projects/bc1c7178f75f4767b66fd4a5b10641f1 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 18:02:59.658786 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d339fe3c-f093-4ed4-8e24-f1ea30bf7ad5 None None] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:02:59.659081 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d339fe3c-f093-4ed4-8e24-f1ea30bf7ad5 None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:02:59.659341 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d339fe3c-f093-4ed4-8e24-f1ea30bf7ad5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:02:59.684183 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.auth.core [None req-d339fe3c-f093-4ed4-8e24-f1ea30bf7ad5 None None] MFA Rules not processed for user `5cfa58ef86774ab7800bf91930bf6028`. Rule list: `[]` (Enabled: `True`). {{(pid=81592) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 18:02:59.685981 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-d339fe3c-f093-4ed4-8e24-f1ea30bf7ad5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:02:59.738565 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd04b1f-29ce-4fe0-9f3c-e412b86a32ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:02:59.739292 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd04b1f-29ce-4fe0-9f3c-e412b86a32ed admin admin] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:02:59.739574 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd04b1f-29ce-4fe0-9f3c-e412b86a32ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:02:59.739843 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd04b1f-29ce-4fe0-9f3c-e412b86a32ed admin admin] PATH_INFO: `/v3/users` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:02:59.740573 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd04b1f-29ce-4fe0-9f3c-e412b86a32ed admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:02:59.742844 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd04b1f-29ce-4fe0-9f3c-e412b86a32ed admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:02:59.755714 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1034/2085] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 15 18:02:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 18:02:59.756022 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=97,keystone:DELETE=1,keystone:INSERT=2 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 18:02:59.765873 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3140a37d-5680-44a9-9ea0-47ad2f836e05 None None] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:02:59.766266 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3140a37d-5680-44a9-9ea0-47ad2f836e05 None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:02:59.766526 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3140a37d-5680-44a9-9ea0-47ad2f836e05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:02:59.785556 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1052/2086] 10.222.0.25 () {60 vars in 1144 bytes} [Thu Sep 15 18:02:59 2022] POST /identity/v3/users => generated 305 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 18:02:59.790015 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd04b1f-29ce-4fe0-9f3c-e412b86a32ed admin admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:02:59.792244 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-4dd04b1f-29ce-4fe0-9f3c-e412b86a32ed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:02:59.792970 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.auth.core [None req-3140a37d-5680-44a9-9ea0-47ad2f836e05 None None] MFA Rules not processed for user `5cfa58ef86774ab7800bf91930bf6028`. Rule list: `[]` (Enabled: `True`). {{(pid=81592) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 18:02:59.794175 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-3140a37d-5680-44a9-9ea0-47ad2f836e05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:02:59.807264 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1035/2087] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 15 18:02:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 18:02:59.808226 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd04b1f-29ce-4fe0-9f3c-e412b86a32ed admin admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:02:59.808553 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3140a37d-5680-44a9-9ea0-47ad2f836e05 None None] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:02:59.814456 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1706a2-3449-4aa7-b5aa-98a0f9462a35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:02:59.815192 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1706a2-3449-4aa7-b5aa-98a0f9462a35 admin admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:02:59.815472 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1706a2-3449-4aa7-b5aa-98a0f9462a35 admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:02:59.815743 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1706a2-3449-4aa7-b5aa-98a0f9462a35 admin admin] PATH_INFO: `/v3/roles` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:02:59.816437 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c1706a2-3449-4aa7-b5aa-98a0f9462a35 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:02:59.818292 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c1706a2-3449-4aa7-b5aa-98a0f9462a35 admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:02:59.819744 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3140a37d-5680-44a9-9ea0-47ad2f836e05 None None] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:02:59.824837 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81da347f-ef93-415e-a2c6-a5667e60cdac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:02:59.825745 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81da347f-ef93-415e-a2c6-a5667e60cdac admin admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:02:59.825978 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81da347f-ef93-415e-a2c6-a5667e60cdac admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:02:59.827287 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81da347f-ef93-415e-a2c6-a5667e60cdac admin admin] PATH_INFO: `/v3/domains` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:02:59.827956 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81da347f-ef93-415e-a2c6-a5667e60cdac admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81592) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 18:02:59.828258 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81da347f-ef93-415e-a2c6-a5667e60cdac admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:02:59.829902 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81da347f-ef93-415e-a2c6-a5667e60cdac admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:02:59.835688 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1053/2088] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Sep 15 18:02:59 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 18:02:59.839510 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1706a2-3449-4aa7-b5aa-98a0f9462a35 admin admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:02:59.849984 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1036/2089] 10.222.0.25 () {58 vars in 1153 bytes} [Thu Sep 15 18:02:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 18:02:59.851444 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81da347f-ef93-415e-a2c6-a5667e60cdac admin admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:02:59.855284 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1706a2-3449-4aa7-b5aa-98a0f9462a35 admin admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:02:59.862421 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9bc75c-e821-40e3-a592-315da564a616 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:02:59.862551 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81da347f-ef93-415e-a2c6-a5667e60cdac admin admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:02:59.862982 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9bc75c-e821-40e3-a592-315da564a616 admin admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:02:59.863276 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9bc75c-e821-40e3-a592-315da564a616 admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:02:59.863528 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9bc75c-e821-40e3-a592-315da564a616 admin admin] PATH_INFO: `/v3/roles` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:02:59.864173 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be9bc75c-e821-40e3-a592-315da564a616 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:02:59.866277 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be9bc75c-e821-40e3-a592-315da564a616 admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:02:59.867285 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b384a2-81d7-4d82-a250-e5f5e6c01335 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:02:59.868070 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b384a2-81d7-4d82-a250-e5f5e6c01335 admin admin] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:02:59.868348 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b384a2-81d7-4d82-a250-e5f5e6c01335 admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:02:59.868994 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b384a2-81d7-4d82-a250-e5f5e6c01335 admin admin] PATH_INFO: `/v3/projects` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:02:59.869790 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b384a2-81d7-4d82-a250-e5f5e6c01335 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:02:59.871706 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b384a2-81d7-4d82-a250-e5f5e6c01335 admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:02:59.878175 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1054/2090] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Sep 15 18:02:59 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 18:02:59.882080 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9bc75c-e821-40e3-a592-315da564a616 admin admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:02:59.894808 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9bc75c-e821-40e3-a592-315da564a616 admin admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:02:59.901256 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e846840d-2ef1-4efe-b95a-3d4dd39de40f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:02:59.902636 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e846840d-2ef1-4efe-b95a-3d4dd39de40f admin admin] REQUEST_METHOD: `PUT` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:02:59.902636 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e846840d-2ef1-4efe-b95a-3d4dd39de40f admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:02:59.902636 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e846840d-2ef1-4efe-b95a-3d4dd39de40f admin admin] PATH_INFO: `/v3/projects/7bee4084609644b4ae09419b2c700845/users/689cb9339c484f6b87d4bd5de7b30105/roles/343cc8b1bc7243eebabdf08147e8366d` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:02:59.914798 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1037/2091] 10.222.0.25 () {60 vars in 1153 bytes} [Thu Sep 15 18:02:59 2022] POST /identity/v3/projects => generated 367 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 18:02:59.920747 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b384a2-81d7-4d82-a250-e5f5e6c01335 admin admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:02:59.943287 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e846840d-2ef1-4efe-b95a-3d4dd39de40f admin admin] RBAC: Authorizing `identity:create_grant(project_id=7bee4084609644b4ae09419b2c700845, user_id=689cb9339c484f6b87d4bd5de7b30105, role_id=343cc8b1bc7243eebabdf08147e8366d)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:02:59.945953 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e846840d-2ef1-4efe-b95a-3d4dd39de40f admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:02:59.974019 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1055/2092] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Sep 15 18:02:59 2022] PUT /identity/v3/projects/7bee4084609644b4ae09419b2c700845/users/689cb9339c484f6b87d4bd5de7b30105/roles/343cc8b1bc7243eebabdf08147e8366d => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 15 18:02:59.974019 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b65853-577b-48d7-b9d0-294c8a853443 None None] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:02:59.974019 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b65853-577b-48d7-b9d0-294c8a853443 None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:02:59.974019 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b65853-577b-48d7-b9d0-294c8a853443 None None] PATH_INFO: `/` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:02:59.984347 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1056/2093] 10.222.0.25 () {54 vars in 921 bytes} [Thu Sep 15 18:02:59 2022] GET /identity => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 18:02:59.985744 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78a3f28-6702-49f5-9f9d-47ea6ea229f2 None None] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:02:59.986025 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78a3f28-6702-49f5-9f9d-47ea6ea229f2 None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:02:59.986294 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78a3f28-6702-49f5-9f9d-47ea6ea229f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:02:59.996950 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 18:03:00.021797 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.auth.core [None req-a78a3f28-6702-49f5-9f9d-47ea6ea229f2 None None] MFA Rules not processed for user `689cb9339c484f6b87d4bd5de7b30105`. Rule list: `[]` (Enabled: `True`). {{(pid=81593) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 18:03:00.023022 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-a78a3f28-6702-49f5-9f9d-47ea6ea229f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:03:00.048383 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b384a2-81d7-4d82-a250-e5f5e6c01335 admin admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:03:00.106210 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1057/2094] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 15 18:02:59 2022] POST /identity/v3/auth/tokens => generated 3286 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 18:03:00.109115 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd43a96-3fed-4d17-8627-f6099ee39e6e None None] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:03:00.109948 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd43a96-3fed-4d17-8627-f6099ee39e6e None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:03:00.109948 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd43a96-3fed-4d17-8627-f6099ee39e6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:03:00.127042 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163f6cb7-874e-49fa-97b0-43e20d80ef93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:03:00.127571 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163f6cb7-874e-49fa-97b0-43e20d80ef93 admin admin] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:03:00.127932 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163f6cb7-874e-49fa-97b0-43e20d80ef93 admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:03:00.128297 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163f6cb7-874e-49fa-97b0-43e20d80ef93 admin admin] PATH_INFO: `/v3/users` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:03:00.129517 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-163f6cb7-874e-49fa-97b0-43e20d80ef93 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:03:00.131506 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-163f6cb7-874e-49fa-97b0-43e20d80ef93 admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:03:00.134791 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.auth.core [None req-9dd43a96-3fed-4d17-8627-f6099ee39e6e None None] MFA Rules not processed for user `10af119bd39841ed8163993676230fca`. Rule list: `[]` (Enabled: `True`). {{(pid=81593) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 18:03:00.135997 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-9dd43a96-3fed-4d17-8627-f6099ee39e6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:03:00.157709 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1038/2095] 10.222.0.25 () {60 vars in 1144 bytes} [Thu Sep 15 18:02:59 2022] POST /identity/v3/users => generated 284 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 18:03:00.158722 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163f6cb7-874e-49fa-97b0-43e20d80ef93 admin admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:03:00.160433 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-163f6cb7-874e-49fa-97b0-43e20d80ef93 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:03:00.175741 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163f6cb7-874e-49fa-97b0-43e20d80ef93 admin admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:03:00.180719 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba20f64-a30b-42d4-b4ed-8762419f166d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:03:00.181493 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba20f64-a30b-42d4-b4ed-8762419f166d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:03:00.181838 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba20f64-a30b-42d4-b4ed-8762419f166d admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:03:00.182180 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba20f64-a30b-42d4-b4ed-8762419f166d admin admin] PATH_INFO: `/v3/users/5b0a236a877446d59821a8860636adef` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:03:00.183403 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba20f64-a30b-42d4-b4ed-8762419f166d admin admin] RBAC: Authorizing `identity:delete_user(user_id=5b0a236a877446d59821a8860636adef)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:03:00.185598 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba20f64-a30b-42d4-b4ed-8762419f166d admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:03:00.218462 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1058/2096] 10.222.0.25 () {58 vars in 1018 bytes} [Thu Sep 15 18:03:00 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 18:03:00.219449 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd43a96-3fed-4d17-8627-f6099ee39e6e None None] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:03:00.236839 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd43a96-3fed-4d17-8627-f6099ee39e6e None None] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:03:00.242523 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81cef646-329a-465e-828e-33f3ee2ea1d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:03:00.243929 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cef646-329a-465e-828e-33f3ee2ea1d9 admin admin] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:03:00.244155 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cef646-329a-465e-828e-33f3ee2ea1d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:03:00.244432 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cef646-329a-465e-828e-33f3ee2ea1d9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:03:00.245067 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81cef646-329a-465e-828e-33f3ee2ea1d9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:03:00.251908 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-0ba20f64-a30b-42d4-b4ed-8762419f166d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5b0a236a877446d59821a8860636adef'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:03:00.253824 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81cef646-329a-465e-828e-33f3ee2ea1d9 admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:03:00.263136 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-0ba20f64-a30b-42d4-b4ed-8762419f166d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5b0a236a877446d59821a8860636adef'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:03:00.264435 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-0ba20f64-a30b-42d4-b4ed-8762419f166d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5b0a236a877446d59821a8860636adef'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:03:00.265199 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-0ba20f64-a30b-42d4-b4ed-8762419f166d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5b0a236a877446d59821a8860636adef'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:03:00.277183 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-0ba20f64-a30b-42d4-b4ed-8762419f166d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5b0a236a877446d59821a8860636adef'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:03:00.289712 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1059/2097] 10.222.0.25 () {60 vars in 1153 bytes} [Thu Sep 15 18:03:00 2022] POST /identity/v3/projects => generated 409 bytes in 71 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 18:03:00.290604 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81cef646-329a-465e-828e-33f3ee2ea1d9 admin admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:03:00.292237 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-81cef646-329a-465e-828e-33f3ee2ea1d9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:03:00.308293 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:INSERT=4,keystone:SELECT=96 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 18:03:00.310441 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1039/2098] 10.222.0.25 () {58 vars in 1224 bytes} [Thu Sep 15 18:03:00 2022] DELETE /identity/v3/users/5b0a236a877446d59821a8860636adef => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 18:03:00.312367 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da1b696-120b-476d-83ea-5a5c4c0199ee None None] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:03:00.313161 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da1b696-120b-476d-83ea-5a5c4c0199ee None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:03:00.313692 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da1b696-120b-476d-83ea-5a5c4c0199ee None None] PATH_INFO: `/` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:03:00.321003 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1040/2099] 10.222.0.25 () {54 vars in 961 bytes} [Thu Sep 15 18:03:00 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 18:03:00.321967 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da1b696-120b-476d-83ea-5a5c4c0199ee None None] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:03:00.328027 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-0da1b696-120b-476d-83ea-5a5c4c0199ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:03:00.415571 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81cef646-329a-465e-828e-33f3ee2ea1d9 admin admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:03:00.463877 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 18:03:00.501775 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da1b696-120b-476d-83ea-5a5c4c0199ee None None] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:03:00.506943 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101c65a2-c2af-4adb-8229-3ea4274b354f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:03:00.507581 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101c65a2-c2af-4adb-8229-3ea4274b354f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:03:00.507866 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101c65a2-c2af-4adb-8229-3ea4274b354f admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:03:00.508144 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101c65a2-c2af-4adb-8229-3ea4274b354f admin admin] PATH_INFO: `/v3/users/165bbac3e3674aa8a63f27497e4cd7d6` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:03:00.508817 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb325a13-aacb-4f98-a7e2-63b1b1996e99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:03:00.509553 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-101c65a2-c2af-4adb-8229-3ea4274b354f admin admin] RBAC: Authorizing `identity:delete_user(user_id=165bbac3e3674aa8a63f27497e4cd7d6)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:03:00.510174 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb325a13-aacb-4f98-a7e2-63b1b1996e99 admin admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:03:00.510660 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb325a13-aacb-4f98-a7e2-63b1b1996e99 admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:03:00.511125 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb325a13-aacb-4f98-a7e2-63b1b1996e99 admin admin] PATH_INFO: `/v3/roles` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:03:00.512022 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb325a13-aacb-4f98-a7e2-63b1b1996e99 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:03:00.513053 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-101c65a2-c2af-4adb-8229-3ea4274b354f admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:03:00.514303 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb325a13-aacb-4f98-a7e2-63b1b1996e99 admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:03:00.531735 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1060/2100] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Sep 15 18:03:00 2022] GET /identity/v3/roles => generated 1420 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 18:03:00.532913 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb325a13-aacb-4f98-a7e2-63b1b1996e99 admin admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:03:00.535990 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-cb325a13-aacb-4f98-a7e2-63b1b1996e99 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:03:00.556631 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb325a13-aacb-4f98-a7e2-63b1b1996e99 admin admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:03:00.565275 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce72766-c3cf-496b-bb2f-ee4b8ff114b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:03:00.566532 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce72766-c3cf-496b-bb2f-ee4b8ff114b6 admin admin] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:03:00.566887 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce72766-c3cf-496b-bb2f-ee4b8ff114b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:03:00.567233 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce72766-c3cf-496b-bb2f-ee4b8ff114b6 admin admin] PATH_INFO: `/v3/users` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:03:00.568189 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce72766-c3cf-496b-bb2f-ee4b8ff114b6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:03:00.570313 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce72766-c3cf-496b-bb2f-ee4b8ff114b6 admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:03:00.583239 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-101c65a2-c2af-4adb-8229-3ea4274b354f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '165bbac3e3674aa8a63f27497e4cd7d6'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:03:00.596047 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-101c65a2-c2af-4adb-8229-3ea4274b354f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '165bbac3e3674aa8a63f27497e4cd7d6'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:03:00.597148 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-101c65a2-c2af-4adb-8229-3ea4274b354f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '165bbac3e3674aa8a63f27497e4cd7d6'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:03:00.599421 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-101c65a2-c2af-4adb-8229-3ea4274b354f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '165bbac3e3674aa8a63f27497e4cd7d6'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:03:00.605806 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1061/2101] 10.222.0.25 () {60 vars in 1144 bytes} [Thu Sep 15 18:03:00 2022] POST /identity/v3/users => generated 311 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 18:03:00.607427 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d5d4fc-9719-4a2c-8b87-e2e784fdc936 None None] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:03:00.608003 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d5d4fc-9719-4a2c-8b87-e2e784fdc936 None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:03:00.608655 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d5d4fc-9719-4a2c-8b87-e2e784fdc936 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:03:00.633390 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-101c65a2-c2af-4adb-8229-3ea4274b354f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '165bbac3e3674aa8a63f27497e4cd7d6'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:03:00.635455 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.auth.core [None req-32d5d4fc-9719-4a2c-8b87-e2e784fdc936 None None] MFA Rules not processed for user `10af119bd39841ed8163993676230fca`. Rule list: `[]` (Enabled: `True`). {{(pid=81593) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 18:03:00.637018 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-32d5d4fc-9719-4a2c-8b87-e2e784fdc936 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:03:00.666308 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1041/2102] 10.222.0.25 () {58 vars in 1224 bytes} [Thu Sep 15 18:03:00 2022] DELETE /identity/v3/users/165bbac3e3674aa8a63f27497e4cd7d6 => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 18:03:00.667745 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101c65a2-c2af-4adb-8229-3ea4274b354f admin admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:03:00.670849 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-101c65a2-c2af-4adb-8229-3ea4274b354f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:03:00.744043 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1062/2103] 10.222.0.25 () {58 vars in 1058 bytes} [Thu Sep 15 18:03:00 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 18:03:00.744934 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d5d4fc-9719-4a2c-8b87-e2e784fdc936 None None] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:03:00.746557 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-32d5d4fc-9719-4a2c-8b87-e2e784fdc936 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:03:00.771332 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101c65a2-c2af-4adb-8229-3ea4274b354f admin admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:03:00.773897 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d5d4fc-9719-4a2c-8b87-e2e784fdc936 None None] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:03:00.778917 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa819ee-61f5-4d09-87d5-3a4b705ce5f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:03:00.779616 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa819ee-61f5-4d09-87d5-3a4b705ce5f6 admin admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:03:00.780382 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa819ee-61f5-4d09-87d5-3a4b705ce5f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:03:00.780382 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa819ee-61f5-4d09-87d5-3a4b705ce5f6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:03:00.780811 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa819ee-61f5-4d09-87d5-3a4b705ce5f6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:03:00.781626 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8d920c-16bc-41fe-9e74-b96e13dd0290 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:03:00.782465 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8d920c-16bc-41fe-9e74-b96e13dd0290 admin admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:03:00.782705 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa819ee-61f5-4d09-87d5-3a4b705ce5f6 admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:03:00.782812 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8d920c-16bc-41fe-9e74-b96e13dd0290 admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:03:00.783003 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8d920c-16bc-41fe-9e74-b96e13dd0290 admin admin] PATH_INFO: `/v3/roles` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:03:00.783666 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b8d920c-16bc-41fe-9e74-b96e13dd0290 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:03:00.785263 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b8d920c-16bc-41fe-9e74-b96e13dd0290 admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:03:00.797728 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1063/2104] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Sep 15 18:03:00 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 18:03:00.798690 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa819ee-61f5-4d09-87d5-3a4b705ce5f6 admin admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:03:00.798989 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1042/2105] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Sep 15 18:03:00 2022] GET /identity/v3/roles => generated 1420 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 18:03:00.800594 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42643b2e-fd7d-4971-aa24-ca1a010c40a9 None None] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:03:00.800880 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42643b2e-fd7d-4971-aa24-ca1a010c40a9 None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:03:00.801279 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42643b2e-fd7d-4971-aa24-ca1a010c40a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:03:00.810246 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-dfa819ee-61f5-4d09-87d5-3a4b705ce5f6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:03:00.826550 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa819ee-61f5-4d09-87d5-3a4b705ce5f6 admin admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:03:00.829057 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.auth.core [None req-42643b2e-fd7d-4971-aa24-ca1a010c40a9 None None] MFA Rules not processed for user `5cfa58ef86774ab7800bf91930bf6028`. Rule list: `[]` (Enabled: `True`). {{(pid=81592) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 18:03:00.830840 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-42643b2e-fd7d-4971-aa24-ca1a010c40a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:03:00.833156 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5628433-90af-49d8-b3f2-60c54d687a69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:03:00.833982 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5628433-90af-49d8-b3f2-60c54d687a69 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:03:00.834236 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5628433-90af-49d8-b3f2-60c54d687a69 admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:03:00.834508 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5628433-90af-49d8-b3f2-60c54d687a69 admin admin] PATH_INFO: `/v3/projects/c099c78661284aa6940b6f842b0c9af3` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:03:00.835690 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5628433-90af-49d8-b3f2-60c54d687a69 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c099c78661284aa6940b6f842b0c9af3)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:03:00.839522 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5628433-90af-49d8-b3f2-60c54d687a69 admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:03:00.844096 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1043/2106] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 15 18:03:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 18:03:00.844988 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42643b2e-fd7d-4971-aa24-ca1a010c40a9 None None] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:03:00.879059 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 18:03:00.955666 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-d5628433-90af-49d8-b3f2-60c54d687a69 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c099c78661284aa6940b6f842b0c9af3', 'request_id': 'req-d5628433-90af-49d8-b3f2-60c54d687a69'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:03:00.959113 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 18:03:00.972553 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-d5628433-90af-49d8-b3f2-60c54d687a69 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c099c78661284aa6940b6f842b0c9af3', 'request_id': 'req-d5628433-90af-49d8-b3f2-60c54d687a69'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:03:00.985620 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-d5628433-90af-49d8-b3f2-60c54d687a69 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c099c78661284aa6940b6f842b0c9af3', 'request_id': 'req-d5628433-90af-49d8-b3f2-60c54d687a69'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:03:00.988899 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42643b2e-fd7d-4971-aa24-ca1a010c40a9 None None] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:03:01.002382 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-d5628433-90af-49d8-b3f2-60c54d687a69 admin admin] The token cache is being invalidate because project c099c78661284aa6940b6f842b0c9af3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81593) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 18:03:01.002678 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-d5628433-90af-49d8-b3f2-60c54d687a69 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:03:01.003377 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-d5628433-90af-49d8-b3f2-60c54d687a69 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:03:01.005674 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1064/2107] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Sep 15 18:03:00 2022] DELETE /identity/v3/projects/c099c78661284aa6940b6f842b0c9af3 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 18:03:01.006422 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5628433-90af-49d8-b3f2-60c54d687a69 admin admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:03:01.007782 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-d5628433-90af-49d8-b3f2-60c54d687a69 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:03:01.085326 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e263f3-99bf-418e-b3ce-25a6d1f733b1 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10af119bd39841ed8163993676230fca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1213c0d1b584404ba3998e136f166e89', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:03:01.087261 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e263f3-99bf-418e-b3ce-25a6d1f733b1 service placement] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:03:01.087945 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e263f3-99bf-418e-b3ce-25a6d1f733b1 service placement] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:03:01.088395 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e263f3-99bf-418e-b3ce-25a6d1f733b1 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:03:01.088933 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5628433-90af-49d8-b3f2-60c54d687a69 admin admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:03:01.091381 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-79e263f3-99bf-418e-b3ce-25a6d1f733b1 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:03:01.103019 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8335948-b618-4311-8d19-a7dbc84ee8ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:03:01.103706 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8335948-b618-4311-8d19-a7dbc84ee8ec admin admin] REQUEST_METHOD: `PUT` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:03:01.104041 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8335948-b618-4311-8d19-a7dbc84ee8ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:03:01.104326 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8335948-b618-4311-8d19-a7dbc84ee8ec admin admin] PATH_INFO: `/v3/projects/8b74388e5a224c25bb019ed974732569/users/f8df5b20784f4a5e9e397e27b02425ae/roles/a9e42be86923434f8af52d3fc07fb4f7` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:03:01.110733 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e263f3-99bf-418e-b3ce-25a6d1f733b1 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:03:01.113360 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e263f3-99bf-418e-b3ce-25a6d1f733b1 service placement] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:03:01.126193 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8335948-b618-4311-8d19-a7dbc84ee8ec admin admin] RBAC: Authorizing `identity:create_grant(project_id=8b74388e5a224c25bb019ed974732569, user_id=f8df5b20784f4a5e9e397e27b02425ae, role_id=a9e42be86923434f8af52d3fc07fb4f7)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:03:01.129029 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1044/2108] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 15 18:03:00 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 285 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 18:03:01.129524 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8335948-b618-4311-8d19-a7dbc84ee8ec admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:03:01.130552 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e263f3-99bf-418e-b3ce-25a6d1f733b1 service placement] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:03:01.132349 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-79e263f3-99bf-418e-b3ce-25a6d1f733b1 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:03:01.146127 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1065/2109] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Sep 15 18:03:01 2022] PUT /identity/v3/projects/8b74388e5a224c25bb019ed974732569/users/f8df5b20784f4a5e9e397e27b02425ae/roles/a9e42be86923434f8af52d3fc07fb4f7 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 18:03:01.149736 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8335948-b618-4311-8d19-a7dbc84ee8ec admin admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:03:01.151561 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-f8335948-b618-4311-8d19-a7dbc84ee8ec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:03:01.159880 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e263f3-99bf-418e-b3ce-25a6d1f733b1 service placement] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:03:01.230438 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8335948-b618-4311-8d19-a7dbc84ee8ec admin admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:03:01.234901 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baefaf2f-821b-4669-8d10-fb62c53ef374 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a32274b4781b40fea9f28da8a9bde5ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1213c0d1b584404ba3998e136f166e89', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:03:01.235536 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baefaf2f-821b-4669-8d10-fb62c53ef374 service neutron] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:03:01.235811 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baefaf2f-821b-4669-8d10-fb62c53ef374 service neutron] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:03:01.236081 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baefaf2f-821b-4669-8d10-fb62c53ef374 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:03:01.238057 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-baefaf2f-821b-4669-8d10-fb62c53ef374 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:03:01.261370 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb73179-49f5-4edc-9813-3a38ba8ff65b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:03:01.261370 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb73179-49f5-4edc-9813-3a38ba8ff65b admin admin] REQUEST_METHOD: `PUT` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:03:01.261370 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb73179-49f5-4edc-9813-3a38ba8ff65b admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:03:01.261370 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb73179-49f5-4edc-9813-3a38ba8ff65b admin admin] PATH_INFO: `/v3/projects/0934026b192f4b2a8ffd3b2a10d29575/users/22487acb5cc0451a8f8738ac2df16f75/roles/343cc8b1bc7243eebabdf08147e8366d` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:03:01.282779 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb73179-49f5-4edc-9813-3a38ba8ff65b admin admin] RBAC: Authorizing `identity:create_grant(project_id=0934026b192f4b2a8ffd3b2a10d29575, user_id=22487acb5cc0451a8f8738ac2df16f75, role_id=343cc8b1bc7243eebabdf08147e8366d)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:03:01.285511 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb73179-49f5-4edc-9813-3a38ba8ff65b admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:03:01.302614 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1045/2110] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Sep 15 18:03:01 2022] PUT /identity/v3/projects/0934026b192f4b2a8ffd3b2a10d29575/users/22487acb5cc0451a8f8738ac2df16f75/roles/343cc8b1bc7243eebabdf08147e8366d => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 18:03:01.304420 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21273a8-c4b5-455f-8cad-4a24aea8e452 None None] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:03:01.304893 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21273a8-c4b5-455f-8cad-4a24aea8e452 None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:03:01.305408 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21273a8-c4b5-455f-8cad-4a24aea8e452 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:03:01.307663 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 18:03:01.327745 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.auth.core [None req-f21273a8-c4b5-455f-8cad-4a24aea8e452 None None] MFA Rules not processed for user `5cfa58ef86774ab7800bf91930bf6028`. Rule list: `[]` (Enabled: `True`). {{(pid=81592) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 18:03:01.328967 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-f21273a8-c4b5-455f-8cad-4a24aea8e452 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:03:01.336762 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baefaf2f-821b-4669-8d10-fb62c53ef374 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:03:01.338267 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baefaf2f-821b-4669-8d10-fb62c53ef374 service neutron] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:03:01.349447 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1066/2111] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 15 18:03:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 203 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 18:03:01.350627 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baefaf2f-821b-4669-8d10-fb62c53ef374 service neutron] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:03:01.362643 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baefaf2f-821b-4669-8d10-fb62c53ef374 service neutron] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:03:01.441124 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1046/2112] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 15 18:03:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 18:03:01.443043 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9b6640-0215-4344-a2f5-8b4516a79c1c None None] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:03:01.443328 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9b6640-0215-4344-a2f5-8b4516a79c1c None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:03:01.443625 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9b6640-0215-4344-a2f5-8b4516a79c1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:03:01.449308 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87965535-e2b1-443f-abc7-66fa01314543 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:03:01.450174 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87965535-e2b1-443f-abc7-66fa01314543 admin admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:03:01.450537 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87965535-e2b1-443f-abc7-66fa01314543 admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:03:01.450910 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87965535-e2b1-443f-abc7-66fa01314543 admin admin] PATH_INFO: `/v3/roles` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:03:01.451668 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87965535-e2b1-443f-abc7-66fa01314543 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:03:01.453364 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87965535-e2b1-443f-abc7-66fa01314543 admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:03:01.465675 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1067/2113] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Sep 15 18:03:01 2022] GET /identity/v3/roles => generated 1420 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 18:03:01.470141 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3fa713-5760-4f71-ba1c-249d082c7a71 None None] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:03:01.470655 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3fa713-5760-4f71-ba1c-249d082c7a71 None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:03:01.471114 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3fa713-5760-4f71-ba1c-249d082c7a71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:03:01.495690 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 18:03:01.499673 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.auth.core [None req-bf3fa713-5760-4f71-ba1c-249d082c7a71 None None] MFA Rules not processed for user `5cfa58ef86774ab7800bf91930bf6028`. Rule list: `[]` (Enabled: `True`). {{(pid=81593) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 18:03:01.502267 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-bf3fa713-5760-4f71-ba1c-249d082c7a71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:03:01.513118 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.auth.core [None req-df9b6640-0215-4344-a2f5-8b4516a79c1c None None] MFA Rules not processed for user `22487acb5cc0451a8f8738ac2df16f75`. Rule list: `[]` (Enabled: `True`). {{(pid=81592) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 18:03:01.514010 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1068/2114] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 15 18:03:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 18:03:01.515006 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3fa713-5760-4f71-ba1c-249d082c7a71 None None] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:03:01.516293 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-df9b6640-0215-4344-a2f5-8b4516a79c1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:03:01.529058 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3fa713-5760-4f71-ba1c-249d082c7a71 None None] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:03:01.534714 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26b532d-1a01-4254-80b8-6c74e337faf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:03:01.535662 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26b532d-1a01-4254-80b8-6c74e337faf1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:03:01.535942 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26b532d-1a01-4254-80b8-6c74e337faf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:03:01.536211 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26b532d-1a01-4254-80b8-6c74e337faf1 admin admin] PATH_INFO: `/v3/projects/8b74388e5a224c25bb019ed974732569/users/f8df5b20784f4a5e9e397e27b02425ae/roles/a9e42be86923434f8af52d3fc07fb4f7` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:03:01.538322 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26b532d-1a01-4254-80b8-6c74e337faf1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8b74388e5a224c25bb019ed974732569, user_id=f8df5b20784f4a5e9e397e27b02425ae, role_id=a9e42be86923434f8af52d3fc07fb4f7)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:03:01.541209 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26b532d-1a01-4254-80b8-6c74e337faf1 admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:03:01.561079 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1069/2115] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Sep 15 18:03:01 2022] PUT /identity/v3/projects/8b74388e5a224c25bb019ed974732569/users/f8df5b20784f4a5e9e397e27b02425ae/roles/a9e42be86923434f8af52d3fc07fb4f7 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 18:03:01.562209 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26b532d-1a01-4254-80b8-6c74e337faf1 admin admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:03:01.635477 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1047/2116] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 15 18:03:01 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 18:03:01.637588 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb06ac6-90e2-4406-ac2a-0ac23324c97a None None] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:03:01.638544 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb06ac6-90e2-4406-ac2a-0ac23324c97a None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:03:01.638990 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb06ac6-90e2-4406-ac2a-0ac23324c97a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:03:01.662461 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26b532d-1a01-4254-80b8-6c74e337faf1 admin admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:03:01.681152 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751fb411-6b29-4493-90c3-171fb0719b25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:03:01.681852 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751fb411-6b29-4493-90c3-171fb0719b25 admin admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:03:01.682113 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751fb411-6b29-4493-90c3-171fb0719b25 admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:03:01.682389 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751fb411-6b29-4493-90c3-171fb0719b25 admin admin] PATH_INFO: `/v3/domains` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:03:01.683051 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751fb411-6b29-4493-90c3-171fb0719b25 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81593) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 18:03:01.683354 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751fb411-6b29-4493-90c3-171fb0719b25 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:03:01.684975 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751fb411-6b29-4493-90c3-171fb0719b25 admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:03:01.695866 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.auth.core [None req-dbb06ac6-90e2-4406-ac2a-0ac23324c97a None None] MFA Rules not processed for user `f8df5b20784f4a5e9e397e27b02425ae`. Rule list: `[]` (Enabled: `True`). {{(pid=81592) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 18:03:01.697117 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-dbb06ac6-90e2-4406-ac2a-0ac23324c97a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:03:01.698515 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1070/2117] 10.222.0.25 () {58 vars in 1153 bytes} [Thu Sep 15 18:03:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 18:03:01.699170 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751fb411-6b29-4493-90c3-171fb0719b25 admin admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:03:01.709510 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751fb411-6b29-4493-90c3-171fb0719b25 admin admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:03:01.718535 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08796f6-a551-49e7-9ca1-dea33900e297 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:03:01.719351 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08796f6-a551-49e7-9ca1-dea33900e297 admin admin] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:03:01.720181 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08796f6-a551-49e7-9ca1-dea33900e297 admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:03:01.720460 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08796f6-a551-49e7-9ca1-dea33900e297 admin admin] PATH_INFO: `/v3/projects` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:03:01.721083 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f08796f6-a551-49e7-9ca1-dea33900e297 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:03:01.723490 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f08796f6-a551-49e7-9ca1-dea33900e297 admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:03:01.764579 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1071/2118] 10.222.0.25 () {60 vars in 1153 bytes} [Thu Sep 15 18:03:01 2022] POST /identity/v3/projects => generated 369 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 18:03:01.768638 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08796f6-a551-49e7-9ca1-dea33900e297 admin admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:03:01.804405 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 18:03:01.815807 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1048/2119] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 15 18:03:01 2022] POST /identity/v3/auth/tokens => generated 3353 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 18:03:01.816922 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb06ac6-90e2-4406-ac2a-0ac23324c97a None None] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:03:01.829370 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb06ac6-90e2-4406-ac2a-0ac23324c97a None None] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:03:01.857210 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08796f6-a551-49e7-9ca1-dea33900e297 admin admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:03:01.864352 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0241a5e-324a-4486-9805-3d5e226a3e43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:03:01.865038 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0241a5e-324a-4486-9805-3d5e226a3e43 admin admin] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:03:01.865355 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0241a5e-324a-4486-9805-3d5e226a3e43 admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:03:01.865656 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0241a5e-324a-4486-9805-3d5e226a3e43 admin admin] PATH_INFO: `/v3/projects` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:03:01.866516 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0241a5e-324a-4486-9805-3d5e226a3e43 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:03:01.869054 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0241a5e-324a-4486-9805-3d5e226a3e43 admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:03:01.905349 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1072/2120] 10.222.0.25 () {60 vars in 1153 bytes} [Thu Sep 15 18:03:01 2022] POST /identity/v3/projects => generated 373 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 18:03:01.905349 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0241a5e-324a-4486-9805-3d5e226a3e43 admin admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:03:01.905349 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-b0241a5e-324a-4486-9805-3d5e226a3e43 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:03:01.910201 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45fff2fa-512c-4f8d-b6f5-96f3367e0c33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:03:01.911169 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fff2fa-512c-4f8d-b6f5-96f3367e0c33 admin admin] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:03:01.911637 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fff2fa-512c-4f8d-b6f5-96f3367e0c33 admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:03:01.911982 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fff2fa-512c-4f8d-b6f5-96f3367e0c33 admin admin] PATH_INFO: `/v3/users` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:03:01.912827 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45fff2fa-512c-4f8d-b6f5-96f3367e0c33 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:03:01.917995 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45fff2fa-512c-4f8d-b6f5-96f3367e0c33 admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:03:01.963519 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1049/2121] 10.222.0.25 () {60 vars in 1144 bytes} [Thu Sep 15 18:03:01 2022] POST /identity/v3/users => generated 291 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 18:03:01.963519 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45fff2fa-512c-4f8d-b6f5-96f3367e0c33 admin admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:03:01.964453 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-45fff2fa-512c-4f8d-b6f5-96f3367e0c33 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:03:01.991053 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 18:03:02.005779 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0241a5e-324a-4486-9805-3d5e226a3e43 admin admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:03:02.011614 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3a441a-9b3c-48fc-8803-59b073febb80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:03:02.012381 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3a441a-9b3c-48fc-8803-59b073febb80 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:03:02.012648 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3a441a-9b3c-48fc-8803-59b073febb80 admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:03:02.012923 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3a441a-9b3c-48fc-8803-59b073febb80 admin admin] PATH_INFO: `/v3/projects/58df28bce0f346e99e8cf2a7c69571a8` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:03:02.015169 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be3a441a-9b3c-48fc-8803-59b073febb80 admin admin] RBAC: Authorizing `identity:delete_project(project_id=58df28bce0f346e99e8cf2a7c69571a8)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:03:02.016212 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be3a441a-9b3c-48fc-8803-59b073febb80 admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:03:02.081020 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-be3a441a-9b3c-48fc-8803-59b073febb80 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '58df28bce0f346e99e8cf2a7c69571a8', 'request_id': 'req-be3a441a-9b3c-48fc-8803-59b073febb80'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:03:02.083308 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45fff2fa-512c-4f8d-b6f5-96f3367e0c33 admin admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:03:02.095916 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-be3a441a-9b3c-48fc-8803-59b073febb80 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '58df28bce0f346e99e8cf2a7c69571a8', 'request_id': 'req-be3a441a-9b3c-48fc-8803-59b073febb80'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:03:02.106613 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-be3a441a-9b3c-48fc-8803-59b073febb80 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '58df28bce0f346e99e8cf2a7c69571a8', 'request_id': 'req-be3a441a-9b3c-48fc-8803-59b073febb80'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:03:02.121833 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-be3a441a-9b3c-48fc-8803-59b073febb80 admin admin] The token cache is being invalidate because project 58df28bce0f346e99e8cf2a7c69571a8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81593) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 18:03:02.121833 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-be3a441a-9b3c-48fc-8803-59b073febb80 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:03:02.122495 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-be3a441a-9b3c-48fc-8803-59b073febb80 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:03:02.124495 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1073/2122] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Sep 15 18:03:01 2022] DELETE /identity/v3/projects/58df28bce0f346e99e8cf2a7c69571a8 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 18:03:02.125889 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3a441a-9b3c-48fc-8803-59b073febb80 admin admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:03:02.127355 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-be3a441a-9b3c-48fc-8803-59b073febb80 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:03:02.186656 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f308c2-cbbd-4dfc-a656-1aa68fd8a9ba service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b232e7a841145ba93c6d8462ccb751a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1213c0d1b584404ba3998e136f166e89', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:03:02.187192 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f308c2-cbbd-4dfc-a656-1aa68fd8a9ba service cinder] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:03:02.187472 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f308c2-cbbd-4dfc-a656-1aa68fd8a9ba service cinder] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:03:02.187740 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f308c2-cbbd-4dfc-a656-1aa68fd8a9ba service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:03:02.189696 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-61f308c2-cbbd-4dfc-a656-1aa68fd8a9ba service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:03:02.191979 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 18:03:02.226276 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3a441a-9b3c-48fc-8803-59b073febb80 admin admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:03:02.231089 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6fca450-9a1f-436f-afa2-8eca6626b5f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:03:02.231785 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fca450-9a1f-436f-afa2-8eca6626b5f5 admin admin] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:03:02.232067 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fca450-9a1f-436f-afa2-8eca6626b5f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:03:02.232916 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fca450-9a1f-436f-afa2-8eca6626b5f5 admin admin] PATH_INFO: `/v3/users` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:03:02.233607 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6fca450-9a1f-436f-afa2-8eca6626b5f5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:03:02.235881 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6fca450-9a1f-436f-afa2-8eca6626b5f5 admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:03:02.265983 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1074/2123] 10.222.0.25 () {60 vars in 1144 bytes} [Thu Sep 15 18:03:02 2022] POST /identity/v3/users => generated 287 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 18:03:02.265983 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6fca450-9a1f-436f-afa2-8eca6626b5f5 admin admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:03:02.267066 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-d6fca450-9a1f-436f-afa2-8eca6626b5f5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:03:02.282453 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f308c2-cbbd-4dfc-a656-1aa68fd8a9ba service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:03:02.284295 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6fca450-9a1f-436f-afa2-8eca6626b5f5 admin admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:03:02.289229 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8f9bc4-3776-4f16-a295-9568cb2692e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:03:02.289533 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f308c2-cbbd-4dfc-a656-1aa68fd8a9ba service cinder] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:03:02.289970 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8f9bc4-3776-4f16-a295-9568cb2692e6 admin admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:03:02.290253 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8f9bc4-3776-4f16-a295-9568cb2692e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:03:02.290530 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8f9bc4-3776-4f16-a295-9568cb2692e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:03:02.291192 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8f9bc4-3776-4f16-a295-9568cb2692e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:03:02.292986 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8f9bc4-3776-4f16-a295-9568cb2692e6 admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:03:02.311549 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1075/2124] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Sep 15 18:03:02 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 18:03:02.312558 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8f9bc4-3776-4f16-a295-9568cb2692e6 admin admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:03:02.315633 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-7f8f9bc4-3776-4f16-a295-9568cb2692e6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:03:02.328667 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1050/2125] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 15 18:03:01 2022] GET /identity/v3/auth/tokens => generated 3353 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 18:03:02.331719 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f308c2-cbbd-4dfc-a656-1aa68fd8a9ba service cinder] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:03:02.332731 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8f9bc4-3776-4f16-a295-9568cb2692e6 admin admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:03:02.355606 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f308c2-cbbd-4dfc-a656-1aa68fd8a9ba service cinder] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:03:02.358794 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59bd0bb-38fc-45fc-8bc2-b42b95e44be0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:03:02.359612 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59bd0bb-38fc-45fc-8bc2-b42b95e44be0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:03:02.360104 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59bd0bb-38fc-45fc-8bc2-b42b95e44be0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:03:02.360462 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59bd0bb-38fc-45fc-8bc2-b42b95e44be0 admin admin] PATH_INFO: `/v3/users/8819cc84d8284b3eaa22fb7abade9ed4` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:03:02.362741 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c59bd0bb-38fc-45fc-8bc2-b42b95e44be0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8819cc84d8284b3eaa22fb7abade9ed4)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:03:02.369734 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c59bd0bb-38fc-45fc-8bc2-b42b95e44be0 admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:03:02.371753 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f9a8bd-9431-4227-990f-59d5fe5fba22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:03:02.372381 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f9a8bd-9431-4227-990f-59d5fe5fba22 admin admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:03:02.373074 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f9a8bd-9431-4227-990f-59d5fe5fba22 admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:03:02.373074 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f9a8bd-9431-4227-990f-59d5fe5fba22 admin admin] PATH_INFO: `/v3/roles` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:03:02.373726 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f9a8bd-9431-4227-990f-59d5fe5fba22 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:03:02.375473 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f9a8bd-9431-4227-990f-59d5fe5fba22 admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:03:02.401683 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1051/2126] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Sep 15 18:03:02 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 18:03:02.402630 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f9a8bd-9431-4227-990f-59d5fe5fba22 admin admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:03:02.414970 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f9a8bd-9431-4227-990f-59d5fe5fba22 admin admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:03:02.422784 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9e9240-c07c-47a7-81a9-ec82a605c5c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:03:02.423473 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9e9240-c07c-47a7-81a9-ec82a605c5c3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:03:02.423837 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9e9240-c07c-47a7-81a9-ec82a605c5c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:03:02.424020 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9e9240-c07c-47a7-81a9-ec82a605c5c3 admin admin] PATH_INFO: `/v3/projects/fd0d6c30ea21424dbc39b49488291fd6/users/bd2b847e6eed4f0487e6fb4d30cd07f4/roles/a9e42be86923434f8af52d3fc07fb4f7` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:03:02.453841 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c9e9240-c07c-47a7-81a9-ec82a605c5c3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fd0d6c30ea21424dbc39b49488291fd6, user_id=bd2b847e6eed4f0487e6fb4d30cd07f4, role_id=a9e42be86923434f8af52d3fc07fb4f7)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:03:02.456709 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c9e9240-c07c-47a7-81a9-ec82a605c5c3 admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:03:02.483126 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1052/2127] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Sep 15 18:03:02 2022] PUT /identity/v3/projects/fd0d6c30ea21424dbc39b49488291fd6/users/bd2b847e6eed4f0487e6fb4d30cd07f4/roles/a9e42be86923434f8af52d3fc07fb4f7 => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 18:03:02.484301 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9e9240-c07c-47a7-81a9-ec82a605c5c3 admin admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:03:02.544846 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-c59bd0bb-38fc-45fc-8bc2-b42b95e44be0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8819cc84d8284b3eaa22fb7abade9ed4'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:03:02.555922 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-c59bd0bb-38fc-45fc-8bc2-b42b95e44be0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8819cc84d8284b3eaa22fb7abade9ed4'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:03:02.557157 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-c59bd0bb-38fc-45fc-8bc2-b42b95e44be0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8819cc84d8284b3eaa22fb7abade9ed4'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:03:02.558396 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-c59bd0bb-38fc-45fc-8bc2-b42b95e44be0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8819cc84d8284b3eaa22fb7abade9ed4'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:03:02.586624 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-c59bd0bb-38fc-45fc-8bc2-b42b95e44be0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8819cc84d8284b3eaa22fb7abade9ed4'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:03:02.608041 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 18:03:02.620204 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1076/2128] 10.222.0.25 () {58 vars in 1224 bytes} [Thu Sep 15 18:03:02 2022] DELETE /identity/v3/users/8819cc84d8284b3eaa22fb7abade9ed4 => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 18:03:02.621352 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59bd0bb-38fc-45fc-8bc2-b42b95e44be0 admin admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:03:02.623382 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-c59bd0bb-38fc-45fc-8bc2-b42b95e44be0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:03:02.639301 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9e9240-c07c-47a7-81a9-ec82a605c5c3 admin admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:03:02.757328 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59bd0bb-38fc-45fc-8bc2-b42b95e44be0 admin admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:03:02.763718 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ca4f2f-11bf-480c-98b5-14baecd29a78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:03:02.764711 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ca4f2f-11bf-480c-98b5-14baecd29a78 admin admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:03:02.765363 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ca4f2f-11bf-480c-98b5-14baecd29a78 admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:03:02.765778 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ca4f2f-11bf-480c-98b5-14baecd29a78 admin admin] PATH_INFO: `/v3/roles` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:03:02.766550 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ca4f2f-11bf-480c-98b5-14baecd29a78 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:03:02.769390 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ca4f2f-11bf-480c-98b5-14baecd29a78 admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:03:02.776010 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d3fbe4-71fe-4e8b-815c-7186996fe6b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:03:02.780149 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d3fbe4-71fe-4e8b-815c-7186996fe6b3 admin admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:03:02.780444 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d3fbe4-71fe-4e8b-815c-7186996fe6b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:03:02.780810 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d3fbe4-71fe-4e8b-815c-7186996fe6b3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:03:02.781806 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d3fbe4-71fe-4e8b-815c-7186996fe6b3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:03:02.786143 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1077/2129] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Sep 15 18:03:02 2022] GET /identity/v3/roles => generated 1420 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 18:03:02.786317 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d3fbe4-71fe-4e8b-815c-7186996fe6b3 admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:03:02.786412 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ca4f2f-11bf-480c-98b5-14baecd29a78 admin admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:03:02.786412 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-26ca4f2f-11bf-480c-98b5-14baecd29a78 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:03:02.797053 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1053/2130] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Sep 15 18:03:02 2022] GET /identity/v3/roles => generated 1420 bytes in 313 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 18:03:02.798168 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d3fbe4-71fe-4e8b-815c-7186996fe6b3 admin admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:03:02.811729 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d3fbe4-71fe-4e8b-815c-7186996fe6b3 admin admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:03:02.819305 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b68214-91b7-4315-9594-5520e550a929 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:03:02.820221 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b68214-91b7-4315-9594-5520e550a929 admin admin] REQUEST_METHOD: `PUT` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:03:02.820504 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b68214-91b7-4315-9594-5520e550a929 admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:03:02.820774 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b68214-91b7-4315-9594-5520e550a929 admin admin] PATH_INFO: `/v3/projects/fd0d6c30ea21424dbc39b49488291fd6/users/bd2b847e6eed4f0487e6fb4d30cd07f4/roles/a9e42be86923434f8af52d3fc07fb4f7` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:03:02.824039 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b68214-91b7-4315-9594-5520e550a929 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fd0d6c30ea21424dbc39b49488291fd6, user_id=bd2b847e6eed4f0487e6fb4d30cd07f4, role_id=a9e42be86923434f8af52d3fc07fb4f7)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:03:02.828929 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b68214-91b7-4315-9594-5520e550a929 admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:03:02.841477 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 18:03:02.846799 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1054/2131] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Sep 15 18:03:02 2022] PUT /identity/v3/projects/fd0d6c30ea21424dbc39b49488291fd6/users/bd2b847e6eed4f0487e6fb4d30cd07f4/roles/a9e42be86923434f8af52d3fc07fb4f7 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 18:03:02.848144 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b68214-91b7-4315-9594-5520e550a929 admin admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:03:02.852481 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-67b68214-91b7-4315-9594-5520e550a929 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:03:02.905026 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ca4f2f-11bf-480c-98b5-14baecd29a78 admin admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:03:02.967188 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b68214-91b7-4315-9594-5520e550a929 admin admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:03:02.974288 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f185567-29b8-47d6-8886-01b12f2b9056 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:03:02.975212 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f185567-29b8-47d6-8886-01b12f2b9056 admin admin] REQUEST_METHOD: `PUT` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:03:02.975499 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f185567-29b8-47d6-8886-01b12f2b9056 admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:03:02.975870 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f185567-29b8-47d6-8886-01b12f2b9056 admin admin] PATH_INFO: `/v3/projects/1dcaf828f69c40cf94dcffa8804f8368/users/cdcb9c8e40474df39ad9473e14745cc4/roles/343cc8b1bc7243eebabdf08147e8366d` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:03:02.988205 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25173826-3fc8-4024-aa57-4f164de4111c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b232e7a841145ba93c6d8462ccb751a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1213c0d1b584404ba3998e136f166e89', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:03:02.989006 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25173826-3fc8-4024-aa57-4f164de4111c service cinder] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:03:02.989450 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25173826-3fc8-4024-aa57-4f164de4111c service cinder] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:03:02.989821 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25173826-3fc8-4024-aa57-4f164de4111c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:03:02.992074 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-25173826-3fc8-4024-aa57-4f164de4111c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:03:03.005156 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f185567-29b8-47d6-8886-01b12f2b9056 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1dcaf828f69c40cf94dcffa8804f8368, user_id=cdcb9c8e40474df39ad9473e14745cc4, role_id=343cc8b1bc7243eebabdf08147e8366d)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:03:03.010044 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f185567-29b8-47d6-8886-01b12f2b9056 admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:03:03.044343 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1055/2132] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Sep 15 18:03:02 2022] PUT /identity/v3/projects/1dcaf828f69c40cf94dcffa8804f8368/users/cdcb9c8e40474df39ad9473e14745cc4/roles/343cc8b1bc7243eebabdf08147e8366d => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 18:03:03.047027 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea63f9c-005d-4559-91ae-74215eb79058 None None] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:03:03.047629 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea63f9c-005d-4559-91ae-74215eb79058 None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:03:03.048737 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea63f9c-005d-4559-91ae-74215eb79058 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:03:03.098527 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.auth.core [None req-eea63f9c-005d-4559-91ae-74215eb79058 None None] MFA Rules not processed for user `bd2b847e6eed4f0487e6fb4d30cd07f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81592) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 18:03:03.100683 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-eea63f9c-005d-4559-91ae-74215eb79058 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:03:03.110306 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25173826-3fc8-4024-aa57-4f164de4111c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:03:03.113088 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25173826-3fc8-4024-aa57-4f164de4111c service cinder] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:03:03.139423 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1078/2133] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 15 18:03:02 2022] GET /identity/v3/auth/tokens => generated 3286 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 18:03:03.140726 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb017034-e0ce-4a6f-bf82-94b2fca6598e None None] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:03:03.141117 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb017034-e0ce-4a6f-bf82-94b2fca6598e None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:03:03.141281 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb017034-e0ce-4a6f-bf82-94b2fca6598e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:03:03.203749 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.auth.core [None req-eb017034-e0ce-4a6f-bf82-94b2fca6598e None None] MFA Rules not processed for user `cdcb9c8e40474df39ad9473e14745cc4`. Rule list: `[]` (Enabled: `True`). {{(pid=81593) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 18:03:03.205450 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-eb017034-e0ce-4a6f-bf82-94b2fca6598e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:03:03.220030 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 18:03:03.255117 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1056/2134] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 15 18:03:03 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 18:03:03.256264 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea63f9c-005d-4559-91ae-74215eb79058 None None] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:03:03.257661 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-eea63f9c-005d-4559-91ae-74215eb79058 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:03:03.305899 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1079/2135] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 15 18:03:03 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 18:03:03.311737 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb017034-e0ce-4a6f-bf82-94b2fca6598e None None] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:03:03.315485 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-eb017034-e0ce-4a6f-bf82-94b2fca6598e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:03:03.349362 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea63f9c-005d-4559-91ae-74215eb79058 None None] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:03:03.360491 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c671c7db-47ea-46a3-881c-1fdaf91dd48a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:03:03.361478 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c671c7db-47ea-46a3-881c-1fdaf91dd48a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:03:03.361899 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c671c7db-47ea-46a3-881c-1fdaf91dd48a admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:03:03.362290 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c671c7db-47ea-46a3-881c-1fdaf91dd48a admin admin] PATH_INFO: `/v3/projects/f60d8960b1f94bc9ac3984115fd6f2c1` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:03:03.362821 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 18:03:03.363591 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c671c7db-47ea-46a3-881c-1fdaf91dd48a admin admin] RBAC: Authorizing `identity:delete_project(project_id=f60d8960b1f94bc9ac3984115fd6f2c1)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:03:03.365860 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c671c7db-47ea-46a3-881c-1fdaf91dd48a admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:03:03.402041 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb017034-e0ce-4a6f-bf82-94b2fca6598e None None] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:03:03.409228 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef086c6-c53d-483a-92c5-117a38b15088 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b232e7a841145ba93c6d8462ccb751a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1213c0d1b584404ba3998e136f166e89', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:03:03.410148 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef086c6-c53d-483a-92c5-117a38b15088 service cinder] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:03:03.410545 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef086c6-c53d-483a-92c5-117a38b15088 service cinder] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:03:03.411061 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef086c6-c53d-483a-92c5-117a38b15088 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:03:03.422345 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef086c6-c53d-483a-92c5-117a38b15088 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:03:03.424214 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef086c6-c53d-483a-92c5-117a38b15088 service cinder] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:03:03.435194 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1080/2136] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 15 18:03:03 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 18:03:03.437449 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef086c6-c53d-483a-92c5-117a38b15088 service cinder] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:03:03.438866 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-eef086c6-c53d-483a-92c5-117a38b15088 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:03:03.488573 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-c671c7db-47ea-46a3-881c-1fdaf91dd48a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f60d8960b1f94bc9ac3984115fd6f2c1', 'request_id': 'req-c671c7db-47ea-46a3-881c-1fdaf91dd48a'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:03:03.499932 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-c671c7db-47ea-46a3-881c-1fdaf91dd48a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f60d8960b1f94bc9ac3984115fd6f2c1', 'request_id': 'req-c671c7db-47ea-46a3-881c-1fdaf91dd48a'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:03:03.518528 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-c671c7db-47ea-46a3-881c-1fdaf91dd48a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f60d8960b1f94bc9ac3984115fd6f2c1', 'request_id': 'req-c671c7db-47ea-46a3-881c-1fdaf91dd48a'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:03:03.550428 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-c671c7db-47ea-46a3-881c-1fdaf91dd48a admin admin] The token cache is being invalidate because project f60d8960b1f94bc9ac3984115fd6f2c1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81592) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 18:03:03.550788 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-c671c7db-47ea-46a3-881c-1fdaf91dd48a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:03:03.551563 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-c671c7db-47ea-46a3-881c-1fdaf91dd48a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:03:03.559852 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1057/2137] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Sep 15 18:03:03 2022] DELETE /identity/v3/projects/f60d8960b1f94bc9ac3984115fd6f2c1 => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 18:03:03.562257 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ce3414-d198-4824-b189-f2409b057ee4 None None] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:03:03.562547 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ce3414-d198-4824-b189-f2409b057ee4 None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:03:03.562825 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ce3414-d198-4824-b189-f2409b057ee4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:03:03.620623 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef086c6-c53d-483a-92c5-117a38b15088 service cinder] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:03:03.629753 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.auth.core [None req-b1ce3414-d198-4824-b189-f2409b057ee4 None None] MFA Rules not processed for user `5cfa58ef86774ab7800bf91930bf6028`. Rule list: `[]` (Enabled: `True`). {{(pid=81592) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 18:03:03.631050 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-b1ce3414-d198-4824-b189-f2409b057ee4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:03:03.774753 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e2be2c-6b4b-415f-8c97-31f293001f2f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe2244818e4d4dca9c424cd078653e6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1213c0d1b584404ba3998e136f166e89', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:03:03.775689 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1058/2138] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 15 18:03:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 18:03:03.778121 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e2be2c-6b4b-415f-8c97-31f293001f2f service nova] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:03:03.778553 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e2be2c-6b4b-415f-8c97-31f293001f2f service nova] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:03:03.779609 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e2be2c-6b4b-415f-8c97-31f293001f2f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:03:03.784146 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777edce7-a1f0-4bd6-b84e-6082bd542495 None None] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:03:03.784792 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777edce7-a1f0-4bd6-b84e-6082bd542495 None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:03:03.785067 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777edce7-a1f0-4bd6-b84e-6082bd542495 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:03:03.790723 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-51e2be2c-6b4b-415f-8c97-31f293001f2f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:03:03.825026 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.auth.core [None req-777edce7-a1f0-4bd6-b84e-6082bd542495 None None] MFA Rules not processed for user `5cfa58ef86774ab7800bf91930bf6028`. Rule list: `[]` (Enabled: `True`). {{(pid=81592) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 18:03:03.834998 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-777edce7-a1f0-4bd6-b84e-6082bd542495 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:03:03.855042 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1059/2139] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 15 18:03:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 18:03:03.859514 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777edce7-a1f0-4bd6-b84e-6082bd542495 None None] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:03:03.874176 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777edce7-a1f0-4bd6-b84e-6082bd542495 None None] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:03:03.882354 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38837ae-17cf-43fa-a4ca-0a575e166333 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:03:03.882976 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38837ae-17cf-43fa-a4ca-0a575e166333 admin admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:03:03.883288 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38837ae-17cf-43fa-a4ca-0a575e166333 admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:03:03.883569 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38837ae-17cf-43fa-a4ca-0a575e166333 admin admin] PATH_INFO: `/v3/domains` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:03:03.884699 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38837ae-17cf-43fa-a4ca-0a575e166333 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81592) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 18:03:03.884699 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38837ae-17cf-43fa-a4ca-0a575e166333 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:03:03.886281 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38837ae-17cf-43fa-a4ca-0a575e166333 admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:03:03.888113 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 18:03:03.917080 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1060/2140] 10.222.0.25 () {58 vars in 1153 bytes} [Thu Sep 15 18:03:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 18:03:03.918346 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38837ae-17cf-43fa-a4ca-0a575e166333 admin admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:03:03.944714 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38837ae-17cf-43fa-a4ca-0a575e166333 admin admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:03:03.953112 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19bbb61-a7ee-4bdd-808c-fb7d027ccb60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:03:03.953936 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19bbb61-a7ee-4bdd-808c-fb7d027ccb60 admin admin] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:03:03.954982 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19bbb61-a7ee-4bdd-808c-fb7d027ccb60 admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:03:03.954982 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19bbb61-a7ee-4bdd-808c-fb7d027ccb60 admin admin] PATH_INFO: `/v3/projects` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:03:03.958689 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e2be2c-6b4b-415f-8c97-31f293001f2f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:03:03.961864 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e2be2c-6b4b-415f-8c97-31f293001f2f service nova] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:03:03.967177 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f19bbb61-a7ee-4bdd-808c-fb7d027ccb60 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:03:03.972195 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f19bbb61-a7ee-4bdd-808c-fb7d027ccb60 admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:03:03.992061 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1081/2141] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 15 18:03:03 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 556 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 18:03:04.042280 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1061/2142] 10.222.0.25 () {60 vars in 1153 bytes} [Thu Sep 15 18:03:03 2022] POST /identity/v3/projects => generated 375 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 18:03:04.043323 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e2be2c-6b4b-415f-8c97-31f293001f2f service nova] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:03:04.054330 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 18:03:04.062388 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e2be2c-6b4b-415f-8c97-31f293001f2f service nova] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:03:04.226967 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749b81c9-d4a3-4f82-b92f-b3c1c6c952c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:03:04.227853 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749b81c9-d4a3-4f82-b92f-b3c1c6c952c8 admin admin] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:03:04.229066 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749b81c9-d4a3-4f82-b92f-b3c1c6c952c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:03:04.229223 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749b81c9-d4a3-4f82-b92f-b3c1c6c952c8 admin admin] PATH_INFO: `/v3/users` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:03:04.233744 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-749b81c9-d4a3-4f82-b92f-b3c1c6c952c8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:03:04.236639 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-749b81c9-d4a3-4f82-b92f-b3c1c6c952c8 admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:03:04.272424 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1082/2143] 10.222.0.25 () {60 vars in 1144 bytes} [Thu Sep 15 18:03:04 2022] POST /identity/v3/users => generated 288 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 15 18:03:04.277286 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19bbb61-a7ee-4bdd-808c-fb7d027ccb60 admin admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:03:04.299848 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19bbb61-a7ee-4bdd-808c-fb7d027ccb60 admin admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:03:04.310181 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1b8e45-d113-42ca-b07a-7a759a64930a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:03:04.311241 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1b8e45-d113-42ca-b07a-7a759a64930a admin admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:03:04.311392 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1b8e45-d113-42ca-b07a-7a759a64930a admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:03:04.311761 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1b8e45-d113-42ca-b07a-7a759a64930a admin admin] PATH_INFO: `/v3/roles` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:03:04.312471 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa1b8e45-d113-42ca-b07a-7a759a64930a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:03:04.314539 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa1b8e45-d113-42ca-b07a-7a759a64930a admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:03:04.349700 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1062/2144] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Sep 15 18:03:04 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 18:03:04.352270 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749b81c9-d4a3-4f82-b92f-b3c1c6c952c8 admin admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:03:04.355143 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1b8e45-d113-42ca-b07a-7a759a64930a admin admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:03:04.355143 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-fa1b8e45-d113-42ca-b07a-7a759a64930a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:03:04.363633 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749b81c9-d4a3-4f82-b92f-b3c1c6c952c8 admin admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:03:04.368753 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1b8e45-d113-42ca-b07a-7a759a64930a admin admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:03:04.370738 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba217b4-51cc-420f-ba4f-488d0d2518b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:03:04.371529 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba217b4-51cc-420f-ba4f-488d0d2518b3 admin admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:03:04.372264 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba217b4-51cc-420f-ba4f-488d0d2518b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:03:04.372264 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba217b4-51cc-420f-ba4f-488d0d2518b3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:03:04.373085 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba217b4-51cc-420f-ba4f-488d0d2518b3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:03:04.374346 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6495706d-df21-4819-b1d3-e531a6193288 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:03:04.374986 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba217b4-51cc-420f-ba4f-488d0d2518b3 admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:03:04.375111 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6495706d-df21-4819-b1d3-e531a6193288 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:03:04.375339 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6495706d-df21-4819-b1d3-e531a6193288 admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:03:04.375618 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6495706d-df21-4819-b1d3-e531a6193288 admin admin] PATH_INFO: `/v3/users/cdcb9c8e40474df39ad9473e14745cc4` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:03:04.378138 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6495706d-df21-4819-b1d3-e531a6193288 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cdcb9c8e40474df39ad9473e14745cc4)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:03:04.382801 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6495706d-df21-4819-b1d3-e531a6193288 admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:03:04.394053 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1083/2145] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Sep 15 18:03:04 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 15 18:03:04.398056 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba217b4-51cc-420f-ba4f-488d0d2518b3 admin admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:03:04.413231 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba217b4-51cc-420f-ba4f-488d0d2518b3 admin admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:03:04.420566 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322205fb-49ac-4198-a422-c0ebe72ede21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:03:04.421639 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322205fb-49ac-4198-a422-c0ebe72ede21 admin admin] REQUEST_METHOD: `PUT` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:03:04.422139 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322205fb-49ac-4198-a422-c0ebe72ede21 admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:03:04.422762 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322205fb-49ac-4198-a422-c0ebe72ede21 admin admin] PATH_INFO: `/v3/projects/44abe74208db4725b8e0ba7b91408455/users/7191e1b3773f476ca986f078bec24447/roles/343cc8b1bc7243eebabdf08147e8366d` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:03:04.458809 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-322205fb-49ac-4198-a422-c0ebe72ede21 admin admin] RBAC: Authorizing `identity:create_grant(project_id=44abe74208db4725b8e0ba7b91408455, user_id=7191e1b3773f476ca986f078bec24447, role_id=343cc8b1bc7243eebabdf08147e8366d)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:03:04.463898 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-322205fb-49ac-4198-a422-c0ebe72ede21 admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:03:04.465912 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-6495706d-df21-4819-b1d3-e531a6193288 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cdcb9c8e40474df39ad9473e14745cc4'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:03:04.474569 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-6495706d-df21-4819-b1d3-e531a6193288 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cdcb9c8e40474df39ad9473e14745cc4'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:03:04.475201 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-6495706d-df21-4819-b1d3-e531a6193288 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cdcb9c8e40474df39ad9473e14745cc4'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:03:04.476050 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-6495706d-df21-4819-b1d3-e531a6193288 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cdcb9c8e40474df39ad9473e14745cc4'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:03:04.485478 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-6495706d-df21-4819-b1d3-e531a6193288 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cdcb9c8e40474df39ad9473e14745cc4'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:03:04.501957 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1084/2146] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Sep 15 18:03:04 2022] PUT /identity/v3/projects/44abe74208db4725b8e0ba7b91408455/users/7191e1b3773f476ca986f078bec24447/roles/343cc8b1bc7243eebabdf08147e8366d => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 15 18:03:04.514058 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe57284-5926-4d9e-91dd-a779d11c572d None None] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:03:04.514356 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe57284-5926-4d9e-91dd-a779d11c572d None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:03:04.514634 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe57284-5926-4d9e-91dd-a779d11c572d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:03:04.524327 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1063/2147] 10.222.0.25 () {58 vars in 1224 bytes} [Thu Sep 15 18:03:04 2022] DELETE /identity/v3/users/cdcb9c8e40474df39ad9473e14745cc4 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 18:03:04.526101 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0d025b-dc2b-4f24-a1b8-64b755e88b2f None None] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:03:04.526401 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0d025b-dc2b-4f24-a1b8-64b755e88b2f None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:03:04.527115 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0d025b-dc2b-4f24-a1b8-64b755e88b2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:03:04.554880 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.auth.core [None req-0fe57284-5926-4d9e-91dd-a779d11c572d None None] MFA Rules not processed for user `7191e1b3773f476ca986f078bec24447`. Rule list: `[]` (Enabled: `True`). {{(pid=81593) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 18:03:04.556362 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-0fe57284-5926-4d9e-91dd-a779d11c572d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:03:04.566386 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.auth.core [None req-4e0d025b-dc2b-4f24-a1b8-64b755e88b2f None None] MFA Rules not processed for user `5cfa58ef86774ab7800bf91930bf6028`. Rule list: `[]` (Enabled: `True`). {{(pid=81592) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 18:03:04.567621 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-4e0d025b-dc2b-4f24-a1b8-64b755e88b2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:03:04.680483 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1085/2148] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 15 18:03:04 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 18:03:04.685833 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1064/2149] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 15 18:03:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 18:03:04.696156 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0d025b-dc2b-4f24-a1b8-64b755e88b2f None None] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:03:04.696442 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe57284-5926-4d9e-91dd-a779d11c572d None None] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:03:04.697540 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-4e0d025b-dc2b-4f24-a1b8-64b755e88b2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:03:04.700648 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-0fe57284-5926-4d9e-91dd-a779d11c572d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:03:04.764041 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 18:03:04.769335 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 18:03:04.784618 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe57284-5926-4d9e-91dd-a779d11c572d None None] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:03:04.794345 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9e35bc-a646-4143-9ba7-7a5292fdae92 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a32274b4781b40fea9f28da8a9bde5ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1213c0d1b584404ba3998e136f166e89', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:03:04.794996 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9e35bc-a646-4143-9ba7-7a5292fdae92 service neutron] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:03:04.795278 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9e35bc-a646-4143-9ba7-7a5292fdae92 service neutron] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:03:04.795523 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9e35bc-a646-4143-9ba7-7a5292fdae92 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:03:04.805056 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0d025b-dc2b-4f24-a1b8-64b755e88b2f None None] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:03:04.806000 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9e35bc-a646-4143-9ba7-7a5292fdae92 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:03:04.807645 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9e35bc-a646-4143-9ba7-7a5292fdae92 service neutron] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:03:04.808994 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b1ab40-01b5-4d16-900d-43a8bfd15b93 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b232e7a841145ba93c6d8462ccb751a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1213c0d1b584404ba3998e136f166e89', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:03:04.809724 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b1ab40-01b5-4d16-900d-43a8bfd15b93 service cinder] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:03:04.810738 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b1ab40-01b5-4d16-900d-43a8bfd15b93 service cinder] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:03:04.811220 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b1ab40-01b5-4d16-900d-43a8bfd15b93 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:03:04.833658 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b1ab40-01b5-4d16-900d-43a8bfd15b93 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:03:04.835678 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b1ab40-01b5-4d16-900d-43a8bfd15b93 service cinder] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:03:04.836542 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1086/2150] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 15 18:03:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 18:03:04.871908 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1065/2151] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 15 18:03:04 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 18:03:05.480437 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9e35bc-a646-4143-9ba7-7a5292fdae92 service neutron] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:03:05.494222 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-cb9e35bc-a646-4143-9ba7-7a5292fdae92 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:03:05.518243 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9e35bc-a646-4143-9ba7-7a5292fdae92 service neutron] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:03:05.523040 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9dca9f-a0fe-485f-bc1e-7066fb62e16f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:03:05.523660 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9dca9f-a0fe-485f-bc1e-7066fb62e16f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:03:05.523936 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9dca9f-a0fe-485f-bc1e-7066fb62e16f admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:03:05.524204 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9dca9f-a0fe-485f-bc1e-7066fb62e16f admin admin] PATH_INFO: `/v3/projects/1dcaf828f69c40cf94dcffa8804f8368` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:03:05.525421 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f9dca9f-a0fe-485f-bc1e-7066fb62e16f admin admin] RBAC: Authorizing `identity:delete_project(project_id=1dcaf828f69c40cf94dcffa8804f8368)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:03:05.527316 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f9dca9f-a0fe-485f-bc1e-7066fb62e16f admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:03:05.579483 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-9f9dca9f-a0fe-485f-bc1e-7066fb62e16f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1dcaf828f69c40cf94dcffa8804f8368', 'request_id': 'req-9f9dca9f-a0fe-485f-bc1e-7066fb62e16f'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:03:05.585557 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-9f9dca9f-a0fe-485f-bc1e-7066fb62e16f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1dcaf828f69c40cf94dcffa8804f8368', 'request_id': 'req-9f9dca9f-a0fe-485f-bc1e-7066fb62e16f'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:03:05.594663 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-9f9dca9f-a0fe-485f-bc1e-7066fb62e16f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1dcaf828f69c40cf94dcffa8804f8368', 'request_id': 'req-9f9dca9f-a0fe-485f-bc1e-7066fb62e16f'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:03:05.606535 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-9f9dca9f-a0fe-485f-bc1e-7066fb62e16f admin admin] The token cache is being invalidate because project 1dcaf828f69c40cf94dcffa8804f8368 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81593) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 18:03:05.606827 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-9f9dca9f-a0fe-485f-bc1e-7066fb62e16f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:03:05.607533 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-9f9dca9f-a0fe-485f-bc1e-7066fb62e16f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:03:05.609057 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1087/2152] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Sep 15 18:03:05 2022] DELETE /identity/v3/projects/1dcaf828f69c40cf94dcffa8804f8368 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 18:03:05.614232 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7ba454-7329-4ea1-ad26-39a17fd72e23 None None] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:03:05.614740 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7ba454-7329-4ea1-ad26-39a17fd72e23 None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:03:05.614997 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7ba454-7329-4ea1-ad26-39a17fd72e23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:03:05.634982 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.auth.core [None req-3b7ba454-7329-4ea1-ad26-39a17fd72e23 None None] MFA Rules not processed for user `5cfa58ef86774ab7800bf91930bf6028`. Rule list: `[]` (Enabled: `True`). {{(pid=81592) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 18:03:05.636267 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-3b7ba454-7329-4ea1-ad26-39a17fd72e23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:03:05.703908 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1066/2153] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 15 18:03:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 18:03:05.712911 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f104d73-c179-4cda-b767-05aab2471768 None None] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:03:05.714413 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f104d73-c179-4cda-b767-05aab2471768 None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:03:05.714413 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f104d73-c179-4cda-b767-05aab2471768 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:03:05.738482 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.auth.core [None req-2f104d73-c179-4cda-b767-05aab2471768 None None] MFA Rules not processed for user `5cfa58ef86774ab7800bf91930bf6028`. Rule list: `[]` (Enabled: `True`). {{(pid=81593) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 18:03:05.740626 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-2f104d73-c179-4cda-b767-05aab2471768 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:03:05.748672 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1088/2154] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 15 18:03:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 18:03:05.753651 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7ba454-7329-4ea1-ad26-39a17fd72e23 None None] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:03:05.764185 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7ba454-7329-4ea1-ad26-39a17fd72e23 None None] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:03:05.768861 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940eebbe-ee79-421e-aa73-44b69ff37e38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:03:05.769495 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940eebbe-ee79-421e-aa73-44b69ff37e38 admin admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:03:05.769769 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940eebbe-ee79-421e-aa73-44b69ff37e38 admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:03:05.770045 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940eebbe-ee79-421e-aa73-44b69ff37e38 admin admin] PATH_INFO: `/v3/domains` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:03:05.770686 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-940eebbe-ee79-421e-aa73-44b69ff37e38 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81592) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 18:03:05.770989 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-940eebbe-ee79-421e-aa73-44b69ff37e38 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:03:05.772629 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-940eebbe-ee79-421e-aa73-44b69ff37e38 admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:03:05.786347 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1067/2155] 10.222.0.25 () {58 vars in 1153 bytes} [Thu Sep 15 18:03:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 18:03:05.790722 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f104d73-c179-4cda-b767-05aab2471768 None None] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:03:05.800447 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f104d73-c179-4cda-b767-05aab2471768 None None] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:03:05.805140 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcbd0eb0-b84e-4064-8d47-41e094abe9ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:03:05.805856 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbd0eb0-b84e-4064-8d47-41e094abe9ff admin admin] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:03:05.806137 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbd0eb0-b84e-4064-8d47-41e094abe9ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:03:05.806410 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbd0eb0-b84e-4064-8d47-41e094abe9ff admin admin] PATH_INFO: `/v3/projects` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:03:05.807056 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcbd0eb0-b84e-4064-8d47-41e094abe9ff admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:03:05.809006 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcbd0eb0-b84e-4064-8d47-41e094abe9ff admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:03:05.853132 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1089/2156] 10.222.0.25 () {60 vars in 1153 bytes} [Thu Sep 15 18:03:05 2022] POST /identity/v3/projects => generated 359 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 18:03:05.857804 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940eebbe-ee79-421e-aa73-44b69ff37e38 admin admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:03:05.867821 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940eebbe-ee79-421e-aa73-44b69ff37e38 admin admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:03:05.905554 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcbd0eb0-b84e-4064-8d47-41e094abe9ff admin admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:03:05.907283 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-dcbd0eb0-b84e-4064-8d47-41e094abe9ff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:03:05.938299 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9105a5e-15e5-4c94-b336-e129d5433ffa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:03:05.938910 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9105a5e-15e5-4c94-b336-e129d5433ffa admin admin] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:03:05.939191 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9105a5e-15e5-4c94-b336-e129d5433ffa admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:03:05.939467 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9105a5e-15e5-4c94-b336-e129d5433ffa admin admin] PATH_INFO: `/v3/users` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:03:05.940132 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9105a5e-15e5-4c94-b336-e129d5433ffa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:03:05.942180 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9105a5e-15e5-4c94-b336-e129d5433ffa admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:03:05.964693 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1068/2157] 10.222.0.25 () {60 vars in 1144 bytes} [Thu Sep 15 18:03:05 2022] POST /identity/v3/users => generated 280 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 18:03:05.969261 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9105a5e-15e5-4c94-b336-e129d5433ffa admin admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:03:05.979163 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9105a5e-15e5-4c94-b336-e129d5433ffa admin admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:03:05.982197 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcbd0eb0-b84e-4064-8d47-41e094abe9ff admin admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:03:05.983668 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4981155-c11b-4a4a-9049-0cc441d4ce27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:03:05.984252 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4981155-c11b-4a4a-9049-0cc441d4ce27 admin admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:03:05.984531 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4981155-c11b-4a4a-9049-0cc441d4ce27 admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:03:05.984802 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4981155-c11b-4a4a-9049-0cc441d4ce27 admin admin] PATH_INFO: `/v3/roles` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:03:05.985469 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4981155-c11b-4a4a-9049-0cc441d4ce27 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:03:05.987059 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4981155-c11b-4a4a-9049-0cc441d4ce27 admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:03:05.987289 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5a0732-c444-41dd-beda-e768698feefd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:03:05.987918 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5a0732-c444-41dd-beda-e768698feefd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:03:05.988202 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5a0732-c444-41dd-beda-e768698feefd admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:03:05.988476 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5a0732-c444-41dd-beda-e768698feefd admin admin] PATH_INFO: `/v3/users/22487acb5cc0451a8f8738ac2df16f75` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:03:05.989700 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5a0732-c444-41dd-beda-e768698feefd admin admin] RBAC: Authorizing `identity:delete_user(user_id=22487acb5cc0451a8f8738ac2df16f75)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:03:05.991620 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5a0732-c444-41dd-beda-e768698feefd admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:03:05.997831 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1069/2158] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Sep 15 18:03:05 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 15 18:03:06.001976 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4981155-c11b-4a4a-9049-0cc441d4ce27 admin admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:03:06.011955 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4981155-c11b-4a4a-9049-0cc441d4ce27 admin admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:03:06.018006 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae38aa2-4b91-479f-9068-9eebea9a79ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:03:06.018566 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae38aa2-4b91-479f-9068-9eebea9a79ce admin admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:03:06.018977 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae38aa2-4b91-479f-9068-9eebea9a79ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:03:06.019532 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae38aa2-4b91-479f-9068-9eebea9a79ce admin admin] PATH_INFO: `/v3/roles` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:03:06.020265 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae38aa2-4b91-479f-9068-9eebea9a79ce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:03:06.022051 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae38aa2-4b91-479f-9068-9eebea9a79ce admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:03:06.033686 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1070/2159] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Sep 15 18:03:06 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 15 18:03:06.037736 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae38aa2-4b91-479f-9068-9eebea9a79ce admin admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:03:06.038773 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-de5a0732-c444-41dd-beda-e768698feefd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '22487acb5cc0451a8f8738ac2df16f75'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:03:06.040682 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 18:03:06.048874 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae38aa2-4b91-479f-9068-9eebea9a79ce admin admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:03:06.049282 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-de5a0732-c444-41dd-beda-e768698feefd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '22487acb5cc0451a8f8738ac2df16f75'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:03:06.050410 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-de5a0732-c444-41dd-beda-e768698feefd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '22487acb5cc0451a8f8738ac2df16f75'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:03:06.051902 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-de5a0732-c444-41dd-beda-e768698feefd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '22487acb5cc0451a8f8738ac2df16f75'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:03:06.054466 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc505d1c-9430-43fb-b336-75437ba5a129 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:03:06.055130 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc505d1c-9430-43fb-b336-75437ba5a129 admin admin] REQUEST_METHOD: `PUT` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:03:06.055405 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc505d1c-9430-43fb-b336-75437ba5a129 admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:03:06.055702 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc505d1c-9430-43fb-b336-75437ba5a129 admin admin] PATH_INFO: `/v3/projects/f20210e40f4a40a8a4093e134097ad43/users/7641b9142ed24fb9a23aea7c6f256882/roles/343cc8b1bc7243eebabdf08147e8366d` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:03:06.060334 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-de5a0732-c444-41dd-beda-e768698feefd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '22487acb5cc0451a8f8738ac2df16f75'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:03:06.071068 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc505d1c-9430-43fb-b336-75437ba5a129 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f20210e40f4a40a8a4093e134097ad43, user_id=7641b9142ed24fb9a23aea7c6f256882, role_id=343cc8b1bc7243eebabdf08147e8366d)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:03:06.073827 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc505d1c-9430-43fb-b336-75437ba5a129 admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:03:06.079306 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1090/2160] 10.222.0.25 () {58 vars in 1224 bytes} [Thu Sep 15 18:03:05 2022] DELETE /identity/v3/users/22487acb5cc0451a8f8738ac2df16f75 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 15 18:03:06.084882 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60489de-28c0-43cd-a34b-96ddcbcfd5f3 None None] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:03:06.085326 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60489de-28c0-43cd-a34b-96ddcbcfd5f3 None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:03:06.085754 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60489de-28c0-43cd-a34b-96ddcbcfd5f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:03:06.088906 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1071/2161] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Sep 15 18:03:06 2022] PUT /identity/v3/projects/f20210e40f4a40a8a4093e134097ad43/users/7641b9142ed24fb9a23aea7c6f256882/roles/343cc8b1bc7243eebabdf08147e8366d => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 15 18:03:06.099992 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c246de-274a-4a42-b1af-9284362f0eb0 None None] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:03:06.100282 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c246de-274a-4a42-b1af-9284362f0eb0 None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:03:06.100552 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c246de-274a-4a42-b1af-9284362f0eb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:03:06.113681 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.auth.core [None req-b60489de-28c0-43cd-a34b-96ddcbcfd5f3 None None] MFA Rules not processed for user `5cfa58ef86774ab7800bf91930bf6028`. Rule list: `[]` (Enabled: `True`). {{(pid=81593) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 18:03:06.114924 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-b60489de-28c0-43cd-a34b-96ddcbcfd5f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:03:06.122632 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 18:03:06.139073 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.auth.core [None req-37c246de-274a-4a42-b1af-9284362f0eb0 None None] MFA Rules not processed for user `7641b9142ed24fb9a23aea7c6f256882`. Rule list: `[]` (Enabled: `True`). {{(pid=81592) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 18:03:06.140283 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-37c246de-274a-4a42-b1af-9284362f0eb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:03:06.178421 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1091/2162] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 15 18:03:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 18:03:06.188494 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60489de-28c0-43cd-a34b-96ddcbcfd5f3 None None] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:03:06.190037 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-b60489de-28c0-43cd-a34b-96ddcbcfd5f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:03:06.230820 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1072/2163] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 15 18:03:06 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 18:03:06.274335 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c246de-274a-4a42-b1af-9284362f0eb0 None None] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:03:06.275938 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-37c246de-274a-4a42-b1af-9284362f0eb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:03:06.287844 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60489de-28c0-43cd-a34b-96ddcbcfd5f3 None None] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:03:06.293144 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a1d2d3-f670-4594-a389-4e37633eabff service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a32274b4781b40fea9f28da8a9bde5ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1213c0d1b584404ba3998e136f166e89', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:03:06.293801 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a1d2d3-f670-4594-a389-4e37633eabff service neutron] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:03:06.294093 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a1d2d3-f670-4594-a389-4e37633eabff service neutron] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:03:06.294349 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a1d2d3-f670-4594-a389-4e37633eabff service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:03:06.306581 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a1d2d3-f670-4594-a389-4e37633eabff service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:03:06.309328 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a1d2d3-f670-4594-a389-4e37633eabff service neutron] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:03:06.324547 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1092/2164] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 15 18:03:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 18:03:06.365424 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c246de-274a-4a42-b1af-9284362f0eb0 None None] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:03:06.370869 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f307a5a-2540-41d2-9ea6-a377503e2eae service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b232e7a841145ba93c6d8462ccb751a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1213c0d1b584404ba3998e136f166e89', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:03:06.371680 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f307a5a-2540-41d2-9ea6-a377503e2eae service cinder] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:03:06.372114 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f307a5a-2540-41d2-9ea6-a377503e2eae service cinder] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:03:06.373263 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f307a5a-2540-41d2-9ea6-a377503e2eae service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:03:06.387890 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f307a5a-2540-41d2-9ea6-a377503e2eae service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:03:06.389780 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f307a5a-2540-41d2-9ea6-a377503e2eae service cinder] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:03:06.400831 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1073/2165] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 15 18:03:06 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 18:03:06.419391 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a1d2d3-f670-4594-a389-4e37633eabff service neutron] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:03:06.421211 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-81a1d2d3-f670-4594-a389-4e37633eabff service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:03:06.442132 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a1d2d3-f670-4594-a389-4e37633eabff service neutron] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:03:06.448406 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4518bb76-731c-4b20-b2a2-6f4ef5579d46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:03:06.449858 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4518bb76-731c-4b20-b2a2-6f4ef5579d46 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:03:06.450697 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4518bb76-731c-4b20-b2a2-6f4ef5579d46 admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:03:06.451317 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4518bb76-731c-4b20-b2a2-6f4ef5579d46 admin admin] PATH_INFO: `/v3/users/7641b9142ed24fb9a23aea7c6f256882` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:03:06.455749 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4518bb76-731c-4b20-b2a2-6f4ef5579d46 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7641b9142ed24fb9a23aea7c6f256882)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:03:06.459486 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4518bb76-731c-4b20-b2a2-6f4ef5579d46 admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:03:06.538199 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-4518bb76-731c-4b20-b2a2-6f4ef5579d46 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7641b9142ed24fb9a23aea7c6f256882'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:03:06.552615 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-4518bb76-731c-4b20-b2a2-6f4ef5579d46 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7641b9142ed24fb9a23aea7c6f256882'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:03:06.553625 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-4518bb76-731c-4b20-b2a2-6f4ef5579d46 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7641b9142ed24fb9a23aea7c6f256882'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:03:06.554889 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-4518bb76-731c-4b20-b2a2-6f4ef5579d46 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7641b9142ed24fb9a23aea7c6f256882'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:03:06.565184 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-4518bb76-731c-4b20-b2a2-6f4ef5579d46 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7641b9142ed24fb9a23aea7c6f256882'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:03:06.566728 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:INSERT=2,keystone:DELETE=11,keystone:SELECT=87 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 18:03:06.606081 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1093/2166] 10.222.0.25 () {58 vars in 1224 bytes} [Thu Sep 15 18:03:06 2022] DELETE /identity/v3/users/7641b9142ed24fb9a23aea7c6f256882 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 18:03:06.612601 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b7034a-d82f-4b73-9325-782a26068021 None None] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:03:06.613992 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b7034a-d82f-4b73-9325-782a26068021 None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:03:06.614583 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b7034a-d82f-4b73-9325-782a26068021 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:03:06.663685 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.auth.core [None req-a8b7034a-d82f-4b73-9325-782a26068021 None None] MFA Rules not processed for user `5cfa58ef86774ab7800bf91930bf6028`. Rule list: `[]` (Enabled: `True`). {{(pid=81592) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 18:03:06.667035 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-a8b7034a-d82f-4b73-9325-782a26068021 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:03:06.847959 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1074/2167] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 15 18:03:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 18:03:06.861332 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4518bb76-731c-4b20-b2a2-6f4ef5579d46 admin admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:03:06.863720 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-4518bb76-731c-4b20-b2a2-6f4ef5579d46 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:03:06.935208 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b7034a-d82f-4b73-9325-782a26068021 None None] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:03:06.936792 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-a8b7034a-d82f-4b73-9325-782a26068021 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:03:06.959263 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b7034a-d82f-4b73-9325-782a26068021 None None] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:03:06.964276 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6678893b-ef58-4860-aa89-cda1807563c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:03:06.964907 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6678893b-ef58-4860-aa89-cda1807563c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:03:06.965184 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6678893b-ef58-4860-aa89-cda1807563c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:03:06.965521 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6678893b-ef58-4860-aa89-cda1807563c1 admin admin] PATH_INFO: `/v3/projects/0934026b192f4b2a8ffd3b2a10d29575` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:03:06.966710 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6678893b-ef58-4860-aa89-cda1807563c1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0934026b192f4b2a8ffd3b2a10d29575)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:03:06.968918 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6678893b-ef58-4860-aa89-cda1807563c1 admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:03:07.011935 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4518bb76-731c-4b20-b2a2-6f4ef5579d46 admin admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:03:07.020058 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-decbe55d-d936-4408-8ca3-8dd60898f915 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a32274b4781b40fea9f28da8a9bde5ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1213c0d1b584404ba3998e136f166e89', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:03:07.020962 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decbe55d-d936-4408-8ca3-8dd60898f915 service neutron] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:03:07.021440 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decbe55d-d936-4408-8ca3-8dd60898f915 service neutron] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:03:07.021857 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decbe55d-d936-4408-8ca3-8dd60898f915 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:03:07.028872 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 18:03:07.036987 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-decbe55d-d936-4408-8ca3-8dd60898f915 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:03:07.039386 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-decbe55d-d936-4408-8ca3-8dd60898f915 service neutron] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:03:07.055757 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-6678893b-ef58-4860-aa89-cda1807563c1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0934026b192f4b2a8ffd3b2a10d29575', 'request_id': 'req-6678893b-ef58-4860-aa89-cda1807563c1'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:03:07.056310 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1094/2168] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 15 18:03:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 195 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 15 18:03:07.064419 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-6678893b-ef58-4860-aa89-cda1807563c1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0934026b192f4b2a8ffd3b2a10d29575', 'request_id': 'req-6678893b-ef58-4860-aa89-cda1807563c1'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:03:07.074740 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-6678893b-ef58-4860-aa89-cda1807563c1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0934026b192f4b2a8ffd3b2a10d29575', 'request_id': 'req-6678893b-ef58-4860-aa89-cda1807563c1'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:03:07.088642 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-6678893b-ef58-4860-aa89-cda1807563c1 admin admin] The token cache is being invalidate because project 0934026b192f4b2a8ffd3b2a10d29575 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81592) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 18:03:07.088946 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-6678893b-ef58-4860-aa89-cda1807563c1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:03:07.089714 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-6678893b-ef58-4860-aa89-cda1807563c1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:03:07.091257 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1075/2169] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Sep 15 18:03:06 2022] DELETE /identity/v3/projects/0934026b192f4b2a8ffd3b2a10d29575 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 18:03:07.096441 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-decbe55d-d936-4408-8ca3-8dd60898f915 service neutron] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:03:07.114769 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-decbe55d-d936-4408-8ca3-8dd60898f915 service neutron] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:03:07.187889 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40def96b-a955-4f7e-9e0f-07601185c84d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:03:07.188725 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40def96b-a955-4f7e-9e0f-07601185c84d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:03:07.189159 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40def96b-a955-4f7e-9e0f-07601185c84d admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:03:07.189656 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40def96b-a955-4f7e-9e0f-07601185c84d admin admin] PATH_INFO: `/v3/users/bd2b847e6eed4f0487e6fb4d30cd07f4` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:03:07.190923 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40def96b-a955-4f7e-9e0f-07601185c84d admin admin] RBAC: Authorizing `identity:delete_user(user_id=bd2b847e6eed4f0487e6fb4d30cd07f4)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:03:07.193353 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40def96b-a955-4f7e-9e0f-07601185c84d admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:03:07.257129 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-40def96b-a955-4f7e-9e0f-07601185c84d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bd2b847e6eed4f0487e6fb4d30cd07f4'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:03:07.267756 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-40def96b-a955-4f7e-9e0f-07601185c84d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bd2b847e6eed4f0487e6fb4d30cd07f4'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:03:07.268535 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-40def96b-a955-4f7e-9e0f-07601185c84d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bd2b847e6eed4f0487e6fb4d30cd07f4'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:03:07.269414 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-40def96b-a955-4f7e-9e0f-07601185c84d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bd2b847e6eed4f0487e6fb4d30cd07f4'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:03:07.286485 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-40def96b-a955-4f7e-9e0f-07601185c84d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bd2b847e6eed4f0487e6fb4d30cd07f4'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:03:07.311105 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1095/2170] 10.222.0.25 () {58 vars in 1224 bytes} [Thu Sep 15 18:03:07 2022] DELETE /identity/v3/users/bd2b847e6eed4f0487e6fb4d30cd07f4 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 18:03:07.494722 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6678893b-ef58-4860-aa89-cda1807563c1 admin admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:03:07.496631 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-6678893b-ef58-4860-aa89-cda1807563c1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:03:07.513846 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6678893b-ef58-4860-aa89-cda1807563c1 admin admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:03:07.595959 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82784fc-fec5-436f-b22a-09f1f38107c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:03:07.596791 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82784fc-fec5-436f-b22a-09f1f38107c5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:03:07.597171 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82784fc-fec5-436f-b22a-09f1f38107c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:03:07.597576 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82784fc-fec5-436f-b22a-09f1f38107c5 admin admin] PATH_INFO: `/v3/projects/f20210e40f4a40a8a4093e134097ad43` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:03:07.602513 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f82784fc-fec5-436f-b22a-09f1f38107c5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f20210e40f4a40a8a4093e134097ad43)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:03:07.604676 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f82784fc-fec5-436f-b22a-09f1f38107c5 admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:03:07.658619 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-f82784fc-fec5-436f-b22a-09f1f38107c5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f20210e40f4a40a8a4093e134097ad43', 'request_id': 'req-f82784fc-fec5-436f-b22a-09f1f38107c5'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:03:07.666585 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-f82784fc-fec5-436f-b22a-09f1f38107c5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f20210e40f4a40a8a4093e134097ad43', 'request_id': 'req-f82784fc-fec5-436f-b22a-09f1f38107c5'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:03:07.676112 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-f82784fc-fec5-436f-b22a-09f1f38107c5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f20210e40f4a40a8a4093e134097ad43', 'request_id': 'req-f82784fc-fec5-436f-b22a-09f1f38107c5'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:03:07.688650 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-f82784fc-fec5-436f-b22a-09f1f38107c5 admin admin] The token cache is being invalidate because project f20210e40f4a40a8a4093e134097ad43 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81592) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 18:03:07.688952 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-f82784fc-fec5-436f-b22a-09f1f38107c5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:03:07.689220 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40def96b-a955-4f7e-9e0f-07601185c84d admin admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:03:07.689741 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-f82784fc-fec5-436f-b22a-09f1f38107c5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:03:07.691090 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-40def96b-a955-4f7e-9e0f-07601185c84d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:03:07.693520 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1076/2171] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Sep 15 18:03:07 2022] DELETE /identity/v3/projects/f20210e40f4a40a8a4093e134097ad43 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 18:03:07.699053 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df04077-2110-468d-b41f-947c635f54e8 None None] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:03:07.699418 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df04077-2110-468d-b41f-947c635f54e8 None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:03:07.699872 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df04077-2110-468d-b41f-947c635f54e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:03:07.700550 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 18:03:07.707265 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40def96b-a955-4f7e-9e0f-07601185c84d admin admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:03:07.728844 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.auth.core [None req-3df04077-2110-468d-b41f-947c635f54e8 None None] MFA Rules not processed for user `5cfa58ef86774ab7800bf91930bf6028`. Rule list: `[]` (Enabled: `True`). {{(pid=81592) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 18:03:07.730101 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-3df04077-2110-468d-b41f-947c635f54e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:03:07.776254 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c51b53-d3ad-4098-a376-fb233089e3cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:03:07.776914 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c51b53-d3ad-4098-a376-fb233089e3cf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:03:07.777205 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c51b53-d3ad-4098-a376-fb233089e3cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:03:07.777968 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c51b53-d3ad-4098-a376-fb233089e3cf admin admin] PATH_INFO: `/v3/projects/fd0d6c30ea21424dbc39b49488291fd6` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:03:07.779882 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c51b53-d3ad-4098-a376-fb233089e3cf admin admin] RBAC: Authorizing `identity:delete_project(project_id=fd0d6c30ea21424dbc39b49488291fd6)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:03:07.782027 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c51b53-d3ad-4098-a376-fb233089e3cf admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:03:07.786051 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:DELETE=12,keystone:SELECT=86,keystone:INSERT=2 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 18:03:07.806217 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1077/2172] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 15 18:03:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 18:03:07.815372 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3092ea90-dcd0-470a-97da-01ed7175a278 None None] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:03:07.815866 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3092ea90-dcd0-470a-97da-01ed7175a278 None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:03:07.816248 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3092ea90-dcd0-470a-97da-01ed7175a278 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:03:07.837365 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.auth.core [None req-3092ea90-dcd0-470a-97da-01ed7175a278 None None] MFA Rules not processed for user `5cfa58ef86774ab7800bf91930bf6028`. Rule list: `[]` (Enabled: `True`). {{(pid=81592) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 18:03:07.838691 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-3092ea90-dcd0-470a-97da-01ed7175a278 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:03:07.863817 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-23c51b53-d3ad-4098-a376-fb233089e3cf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fd0d6c30ea21424dbc39b49488291fd6', 'request_id': 'req-23c51b53-d3ad-4098-a376-fb233089e3cf'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:03:07.875203 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-23c51b53-d3ad-4098-a376-fb233089e3cf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fd0d6c30ea21424dbc39b49488291fd6', 'request_id': 'req-23c51b53-d3ad-4098-a376-fb233089e3cf'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:03:07.889605 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-23c51b53-d3ad-4098-a376-fb233089e3cf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fd0d6c30ea21424dbc39b49488291fd6', 'request_id': 'req-23c51b53-d3ad-4098-a376-fb233089e3cf'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:03:07.908771 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-23c51b53-d3ad-4098-a376-fb233089e3cf admin admin] The token cache is being invalidate because project fd0d6c30ea21424dbc39b49488291fd6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81593) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 18:03:07.909067 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-23c51b53-d3ad-4098-a376-fb233089e3cf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:03:07.915342 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-23c51b53-d3ad-4098-a376-fb233089e3cf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:03:07.920888 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1096/2173] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Sep 15 18:03:07 2022] DELETE /identity/v3/projects/fd0d6c30ea21424dbc39b49488291fd6 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 15 18:03:07.922487 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998a62e1-e165-4d64-9a5b-5366fa444329 None None] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:03:07.922781 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998a62e1-e165-4d64-9a5b-5366fa444329 None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:03:07.923058 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998a62e1-e165-4d64-9a5b-5366fa444329 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:03:07.931219 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1078/2174] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 15 18:03:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 18:03:07.942648 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3092ea90-dcd0-470a-97da-01ed7175a278 None None] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:03:07.953042 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.auth.core [None req-998a62e1-e165-4d64-9a5b-5366fa444329 None None] MFA Rules not processed for user `5cfa58ef86774ab7800bf91930bf6028`. Rule list: `[]` (Enabled: `True`). {{(pid=81593) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 18:03:07.953862 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3092ea90-dcd0-470a-97da-01ed7175a278 None None] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:03:07.955131 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-998a62e1-e165-4d64-9a5b-5366fa444329 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:03:07.969613 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f7270b-b8a0-4fcb-8de3-a84370a6b027 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:03:07.969613 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f7270b-b8a0-4fcb-8de3-a84370a6b027 admin admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:03:07.969613 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f7270b-b8a0-4fcb-8de3-a84370a6b027 admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:03:07.969613 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f7270b-b8a0-4fcb-8de3-a84370a6b027 admin admin] PATH_INFO: `/v3/domains` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:03:07.970009 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f7270b-b8a0-4fcb-8de3-a84370a6b027 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81592) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 18:03:07.970009 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f7270b-b8a0-4fcb-8de3-a84370a6b027 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:03:07.970009 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f7270b-b8a0-4fcb-8de3-a84370a6b027 admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:03:07.970194 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1097/2175] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 15 18:03:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 18:03:07.978262 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d3132c-8094-470c-be31-38a9ea5d9772 None None] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:03:07.978541 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d3132c-8094-470c-be31-38a9ea5d9772 None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:03:07.978818 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d3132c-8094-470c-be31-38a9ea5d9772 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:03:07.984761 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1079/2176] 10.222.0.25 () {58 vars in 1153 bytes} [Thu Sep 15 18:03:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 18:03:07.987171 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f7270b-b8a0-4fcb-8de3-a84370a6b027 admin admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:03:08.003238 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.auth.core [None req-42d3132c-8094-470c-be31-38a9ea5d9772 None None] MFA Rules not processed for user `5cfa58ef86774ab7800bf91930bf6028`. Rule list: `[]` (Enabled: `True`). {{(pid=81593) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 18:03:08.003941 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-42d3132c-8094-470c-be31-38a9ea5d9772 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:03:08.009044 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f7270b-b8a0-4fcb-8de3-a84370a6b027 admin admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:03:08.012758 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1098/2177] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 15 18:03:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 18:03:08.016501 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d3132c-8094-470c-be31-38a9ea5d9772 None None] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:03:08.018062 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897c7a94-7762-41d4-9f0b-347e4730f931 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:03:08.018863 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897c7a94-7762-41d4-9f0b-347e4730f931 admin admin] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:03:08.019315 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897c7a94-7762-41d4-9f0b-347e4730f931 admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:03:08.019721 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897c7a94-7762-41d4-9f0b-347e4730f931 admin admin] PATH_INFO: `/v3/projects` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:03:08.020515 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-897c7a94-7762-41d4-9f0b-347e4730f931 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:03:08.022670 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-897c7a94-7762-41d4-9f0b-347e4730f931 admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:03:08.027301 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d3132c-8094-470c-be31-38a9ea5d9772 None None] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:03:08.037207 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d860ada9-d019-4115-95e0-d67ae6811209 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:03:08.037938 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d860ada9-d019-4115-95e0-d67ae6811209 admin admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:03:08.038312 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d860ada9-d019-4115-95e0-d67ae6811209 admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:03:08.038685 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d860ada9-d019-4115-95e0-d67ae6811209 admin admin] PATH_INFO: `/v3/domains` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:03:08.039423 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d860ada9-d019-4115-95e0-d67ae6811209 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81593) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 18:03:08.039805 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d860ada9-d019-4115-95e0-d67ae6811209 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:03:08.041444 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d860ada9-d019-4115-95e0-d67ae6811209 admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:03:08.054540 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1099/2178] 10.222.0.25 () {58 vars in 1153 bytes} [Thu Sep 15 18:03:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 18:03:08.058846 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d860ada9-d019-4115-95e0-d67ae6811209 admin admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:03:08.062860 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1080/2179] 10.222.0.25 () {60 vars in 1153 bytes} [Thu Sep 15 18:03:07 2022] POST /identity/v3/projects => generated 383 bytes in 77 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 18:03:08.066731 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897c7a94-7762-41d4-9f0b-347e4730f931 admin admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:03:08.069256 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d860ada9-d019-4115-95e0-d67ae6811209 admin admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:03:08.132067 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5504aff0-e02c-4e34-80f9-abd63cb4083f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:03:08.132705 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5504aff0-e02c-4e34-80f9-abd63cb4083f admin admin] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:03:08.133022 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5504aff0-e02c-4e34-80f9-abd63cb4083f admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:03:08.133384 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5504aff0-e02c-4e34-80f9-abd63cb4083f admin admin] PATH_INFO: `/v3/projects` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:03:08.134065 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5504aff0-e02c-4e34-80f9-abd63cb4083f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:03:08.136214 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5504aff0-e02c-4e34-80f9-abd63cb4083f admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:03:08.139005 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897c7a94-7762-41d4-9f0b-347e4730f931 admin admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:03:08.144124 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa99afb-74b7-4f90-a9ce-304d0e81cd0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:03:08.144727 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa99afb-74b7-4f90-a9ce-304d0e81cd0a admin admin] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:03:08.145057 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa99afb-74b7-4f90-a9ce-304d0e81cd0a admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:03:08.145523 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa99afb-74b7-4f90-a9ce-304d0e81cd0a admin admin] PATH_INFO: `/v3/users` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:03:08.146070 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa99afb-74b7-4f90-a9ce-304d0e81cd0a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:03:08.148091 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa99afb-74b7-4f90-a9ce-304d0e81cd0a admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:03:08.149899 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 18:03:08.170610 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1100/2180] 10.222.0.25 () {60 vars in 1153 bytes} [Thu Sep 15 18:03:08 2022] POST /identity/v3/projects => generated 387 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 15 18:03:08.173386 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1081/2181] 10.222.0.25 () {60 vars in 1144 bytes} [Thu Sep 15 18:03:08 2022] POST /identity/v3/users => generated 292 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 15 18:03:08.173535 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5504aff0-e02c-4e34-80f9-abd63cb4083f admin admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:03:08.174531 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa99afb-74b7-4f90-a9ce-304d0e81cd0a admin admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:03:08.184392 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa99afb-74b7-4f90-a9ce-304d0e81cd0a admin admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:03:08.233832 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 18:03:08.239839 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5504aff0-e02c-4e34-80f9-abd63cb4083f admin admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:03:08.245517 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cacbed7d-24b7-475e-97dc-63352322a81a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:03:08.246123 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacbed7d-24b7-475e-97dc-63352322a81a admin admin] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:03:08.246405 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacbed7d-24b7-475e-97dc-63352322a81a admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:03:08.246676 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacbed7d-24b7-475e-97dc-63352322a81a admin admin] PATH_INFO: `/v3/users` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:03:08.247304 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cacbed7d-24b7-475e-97dc-63352322a81a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:03:08.248717 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0307ea5-4dc4-4598-bf52-ad4c28694fad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:03:08.249345 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cacbed7d-24b7-475e-97dc-63352322a81a admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:03:08.249448 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0307ea5-4dc4-4598-bf52-ad4c28694fad admin admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:03:08.249628 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0307ea5-4dc4-4598-bf52-ad4c28694fad admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:03:08.249902 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0307ea5-4dc4-4598-bf52-ad4c28694fad admin admin] PATH_INFO: `/v3/roles` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:03:08.250547 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0307ea5-4dc4-4598-bf52-ad4c28694fad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:03:08.252112 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0307ea5-4dc4-4598-bf52-ad4c28694fad admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:03:08.264099 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1082/2182] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Sep 15 18:03:08 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 18:03:08.268322 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0307ea5-4dc4-4598-bf52-ad4c28694fad admin admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:03:08.270892 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1101/2183] 10.222.0.25 () {60 vars in 1144 bytes} [Thu Sep 15 18:03:08 2022] POST /identity/v3/users => generated 294 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 15 18:03:08.275413 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cacbed7d-24b7-475e-97dc-63352322a81a admin admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:03:08.278256 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0307ea5-4dc4-4598-bf52-ad4c28694fad admin admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:03:08.283663 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd22f987-b110-408d-ab7e-f028c1e5030a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:03:08.284255 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd22f987-b110-408d-ab7e-f028c1e5030a admin admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:03:08.284569 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd22f987-b110-408d-ab7e-f028c1e5030a admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:03:08.284841 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd22f987-b110-408d-ab7e-f028c1e5030a admin admin] PATH_INFO: `/v3/roles` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:03:08.285457 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cacbed7d-24b7-475e-97dc-63352322a81a admin admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:03:08.285556 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd22f987-b110-408d-ab7e-f028c1e5030a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:03:08.287077 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd22f987-b110-408d-ab7e-f028c1e5030a admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:03:08.290377 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50098731-7ad1-485f-8176-46c8a27f2c01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:03:08.290907 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50098731-7ad1-485f-8176-46c8a27f2c01 admin admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:03:08.291191 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50098731-7ad1-485f-8176-46c8a27f2c01 admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:03:08.291470 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50098731-7ad1-485f-8176-46c8a27f2c01 admin admin] PATH_INFO: `/v3/roles` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:03:08.292114 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50098731-7ad1-485f-8176-46c8a27f2c01 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:03:08.293763 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50098731-7ad1-485f-8176-46c8a27f2c01 admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:03:08.302041 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1083/2184] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Sep 15 18:03:08 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 15 18:03:08.302961 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd22f987-b110-408d-ab7e-f028c1e5030a admin admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:03:08.307177 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1102/2185] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Sep 15 18:03:08 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 15 18:03:08.308319 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50098731-7ad1-485f-8176-46c8a27f2c01 admin admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:03:08.312730 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd22f987-b110-408d-ab7e-f028c1e5030a admin admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:03:08.317279 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794ed979-a2f5-4f5f-8f2b-1252e2dfd188 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:03:08.317836 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50098731-7ad1-485f-8176-46c8a27f2c01 admin admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:03:08.317964 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794ed979-a2f5-4f5f-8f2b-1252e2dfd188 admin admin] REQUEST_METHOD: `PUT` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:03:08.318207 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794ed979-a2f5-4f5f-8f2b-1252e2dfd188 admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:03:08.318477 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794ed979-a2f5-4f5f-8f2b-1252e2dfd188 admin admin] PATH_INFO: `/v3/projects/f43d7fa6813d4a1bb56cdb3e7784e6e7/users/8ba5073dd8df48599413c76ea587bcd1/roles/343cc8b1bc7243eebabdf08147e8366d` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:03:08.322768 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183c72fb-461d-4283-9f19-5b2057c42161 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:03:08.323360 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183c72fb-461d-4283-9f19-5b2057c42161 admin admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:03:08.323643 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183c72fb-461d-4283-9f19-5b2057c42161 admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:03:08.323917 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183c72fb-461d-4283-9f19-5b2057c42161 admin admin] PATH_INFO: `/v3/roles` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:03:08.324553 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183c72fb-461d-4283-9f19-5b2057c42161 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:03:08.326712 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183c72fb-461d-4283-9f19-5b2057c42161 admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:03:08.333667 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-794ed979-a2f5-4f5f-8f2b-1252e2dfd188 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f43d7fa6813d4a1bb56cdb3e7784e6e7, user_id=8ba5073dd8df48599413c76ea587bcd1, role_id=343cc8b1bc7243eebabdf08147e8366d)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:03:08.336291 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-794ed979-a2f5-4f5f-8f2b-1252e2dfd188 admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:03:08.338902 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1103/2186] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Sep 15 18:03:08 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 15 18:03:08.343336 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183c72fb-461d-4283-9f19-5b2057c42161 admin admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:03:08.349837 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1084/2187] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Sep 15 18:03:08 2022] PUT /identity/v3/projects/f43d7fa6813d4a1bb56cdb3e7784e6e7/users/8ba5073dd8df48599413c76ea587bcd1/roles/343cc8b1bc7243eebabdf08147e8366d => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 18:03:08.353476 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183c72fb-461d-4283-9f19-5b2057c42161 admin admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:03:08.362161 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68dbe68-f5cd-4963-9d6a-547f7fcaaadf None None] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:03:08.362451 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68dbe68-f5cd-4963-9d6a-547f7fcaaadf None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:03:08.362759 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68dbe68-f5cd-4963-9d6a-547f7fcaaadf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:03:08.391098 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.auth.core [None req-a68dbe68-f5cd-4963-9d6a-547f7fcaaadf None None] MFA Rules not processed for user `8ba5073dd8df48599413c76ea587bcd1`. Rule list: `[]` (Enabled: `True`). {{(pid=81592) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 18:03:08.392312 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-a68dbe68-f5cd-4963-9d6a-547f7fcaaadf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:03:08.417714 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08e7310-80eb-440d-9ab3-f749b479b145 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:03:08.418382 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08e7310-80eb-440d-9ab3-f749b479b145 admin admin] REQUEST_METHOD: `PUT` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:03:08.418660 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08e7310-80eb-440d-9ab3-f749b479b145 admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:03:08.418937 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08e7310-80eb-440d-9ab3-f749b479b145 admin admin] PATH_INFO: `/v3/projects/020ee7da4b5140ab847068464de9e174/users/f0c3bb005dd64483b472b47558c3f89b/roles/343cc8b1bc7243eebabdf08147e8366d` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:03:08.436769 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a08e7310-80eb-440d-9ab3-f749b479b145 admin admin] RBAC: Authorizing `identity:create_grant(project_id=020ee7da4b5140ab847068464de9e174, user_id=f0c3bb005dd64483b472b47558c3f89b, role_id=343cc8b1bc7243eebabdf08147e8366d)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:03:08.439640 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a08e7310-80eb-440d-9ab3-f749b479b145 admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:03:08.454438 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1104/2188] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Sep 15 18:03:08 2022] PUT /identity/v3/projects/020ee7da4b5140ab847068464de9e174/users/f0c3bb005dd64483b472b47558c3f89b/roles/343cc8b1bc7243eebabdf08147e8366d => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 15 18:03:08.462243 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08e7310-80eb-440d-9ab3-f749b479b145 admin admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:03:08.463056 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1085/2189] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 15 18:03:08 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 18:03:08.464267 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-a08e7310-80eb-440d-9ab3-f749b479b145 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:03:08.466759 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49da4583-e48d-4c4d-8844-33abbd2f7331 None None] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:03:08.467119 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49da4583-e48d-4c4d-8844-33abbd2f7331 None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:03:08.467484 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49da4583-e48d-4c4d-8844-33abbd2f7331 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:03:08.497127 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.auth.core [None req-49da4583-e48d-4c4d-8844-33abbd2f7331 None None] MFA Rules not processed for user `f0c3bb005dd64483b472b47558c3f89b`. Rule list: `[]` (Enabled: `True`). {{(pid=81592) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 18:03:08.498513 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-49da4583-e48d-4c4d-8844-33abbd2f7331 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:03:08.514487 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 18:03:08.537616 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08e7310-80eb-440d-9ab3-f749b479b145 admin admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:03:08.542465 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60312b3b-ffde-4971-a1d5-007d399f553f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:03:08.543039 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60312b3b-ffde-4971-a1d5-007d399f553f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:03:08.543319 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60312b3b-ffde-4971-a1d5-007d399f553f admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:03:08.543597 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60312b3b-ffde-4971-a1d5-007d399f553f admin admin] PATH_INFO: `/v3/users/7191e1b3773f476ca986f078bec24447` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:03:08.545289 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60312b3b-ffde-4971-a1d5-007d399f553f admin admin] RBAC: Authorizing `identity:delete_user(user_id=7191e1b3773f476ca986f078bec24447)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:03:08.547323 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60312b3b-ffde-4971-a1d5-007d399f553f admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:03:08.568217 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1086/2190] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 15 18:03:08 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 18:03:08.570645 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49da4583-e48d-4c4d-8844-33abbd2f7331 None None] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:03:08.582322 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49da4583-e48d-4c4d-8844-33abbd2f7331 None None] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:03:08.587100 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b479b378-65b3-49c7-afc6-adec56e60f62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:03:08.587706 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b479b378-65b3-49c7-afc6-adec56e60f62 admin admin] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:03:08.587991 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b479b378-65b3-49c7-afc6-adec56e60f62 admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:03:08.588269 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b479b378-65b3-49c7-afc6-adec56e60f62 admin admin] PATH_INFO: `/v3/projects` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:03:08.588901 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b479b378-65b3-49c7-afc6-adec56e60f62 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:03:08.590866 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b479b378-65b3-49c7-afc6-adec56e60f62 admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:03:08.596103 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-60312b3b-ffde-4971-a1d5-007d399f553f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7191e1b3773f476ca986f078bec24447'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:03:08.604138 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-60312b3b-ffde-4971-a1d5-007d399f553f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7191e1b3773f476ca986f078bec24447'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:03:08.605032 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-60312b3b-ffde-4971-a1d5-007d399f553f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7191e1b3773f476ca986f078bec24447'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:03:08.605689 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-60312b3b-ffde-4971-a1d5-007d399f553f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7191e1b3773f476ca986f078bec24447'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:03:08.613557 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-60312b3b-ffde-4971-a1d5-007d399f553f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7191e1b3773f476ca986f078bec24447'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:03:08.623995 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1087/2191] 10.222.0.25 () {60 vars in 1153 bytes} [Thu Sep 15 18:03:08 2022] POST /identity/v3/projects => generated 383 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 18:03:08.623995 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b479b378-65b3-49c7-afc6-adec56e60f62 admin admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:03:08.625974 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-b479b378-65b3-49c7-afc6-adec56e60f62 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:03:08.632791 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1105/2192] 10.222.0.25 () {58 vars in 1224 bytes} [Thu Sep 15 18:03:08 2022] DELETE /identity/v3/users/7191e1b3773f476ca986f078bec24447 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 18:03:08.636621 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60312b3b-ffde-4971-a1d5-007d399f553f admin admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:03:08.637574 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 18:03:08.639185 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-60312b3b-ffde-4971-a1d5-007d399f553f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:03:08.704273 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b479b378-65b3-49c7-afc6-adec56e60f62 admin admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:03:08.710972 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c243c8e-dda8-4157-b066-45b7d54bbb6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:03:08.711590 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c243c8e-dda8-4157-b066-45b7d54bbb6d admin admin] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:03:08.711876 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c243c8e-dda8-4157-b066-45b7d54bbb6d admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:03:08.712153 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c243c8e-dda8-4157-b066-45b7d54bbb6d admin admin] PATH_INFO: `/v3/projects` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:03:08.712796 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c243c8e-dda8-4157-b066-45b7d54bbb6d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:03:08.714746 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c243c8e-dda8-4157-b066-45b7d54bbb6d admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:03:08.715860 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60312b3b-ffde-4971-a1d5-007d399f553f admin admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:03:08.720698 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ef5d36-fa3a-4f51-a85e-0758f3145ee1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:03:08.721318 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ef5d36-fa3a-4f51-a85e-0758f3145ee1 admin admin] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:03:08.721626 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ef5d36-fa3a-4f51-a85e-0758f3145ee1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:03:08.721944 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ef5d36-fa3a-4f51-a85e-0758f3145ee1 admin admin] PATH_INFO: `/v3/users` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:03:08.722576 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ef5d36-fa3a-4f51-a85e-0758f3145ee1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:03:08.724763 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ef5d36-fa3a-4f51-a85e-0758f3145ee1 admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:03:08.746984 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1088/2193] 10.222.0.25 () {60 vars in 1153 bytes} [Thu Sep 15 18:03:08 2022] POST /identity/v3/projects => generated 387 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 18:03:08.749232 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1106/2194] 10.222.0.25 () {60 vars in 1144 bytes} [Thu Sep 15 18:03:08 2022] POST /identity/v3/users => generated 292 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 18:03:08.750638 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e477b536-6df6-4a32-a2c7-8a44dfea475f None None] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:03:08.750928 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e477b536-6df6-4a32-a2c7-8a44dfea475f None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:03:08.751203 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e477b536-6df6-4a32-a2c7-8a44dfea475f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:03:08.752677 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c243c8e-dda8-4157-b066-45b7d54bbb6d admin admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:03:08.770929 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.auth.core [None req-e477b536-6df6-4a32-a2c7-8a44dfea475f None None] MFA Rules not processed for user `5cfa58ef86774ab7800bf91930bf6028`. Rule list: `[]` (Enabled: `True`). {{(pid=81593) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 18:03:08.772150 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-e477b536-6df6-4a32-a2c7-8a44dfea475f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:03:08.839361 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c243c8e-dda8-4157-b066-45b7d54bbb6d admin admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:03:08.844356 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f464fbbf-0f9c-47a8-96ad-7fdd13792105 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:03:08.844963 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f464fbbf-0f9c-47a8-96ad-7fdd13792105 admin admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:03:08.845375 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f464fbbf-0f9c-47a8-96ad-7fdd13792105 admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:03:08.845582 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f464fbbf-0f9c-47a8-96ad-7fdd13792105 admin admin] PATH_INFO: `/v3/roles` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:03:08.847331 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 18:03:08.847472 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f464fbbf-0f9c-47a8-96ad-7fdd13792105 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:03:08.848034 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f464fbbf-0f9c-47a8-96ad-7fdd13792105 admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:03:08.861152 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1089/2195] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Sep 15 18:03:08 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 15 18:03:08.862080 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f464fbbf-0f9c-47a8-96ad-7fdd13792105 admin admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:03:08.867852 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1107/2196] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 15 18:03:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 18:03:08.871832 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e477b536-6df6-4a32-a2c7-8a44dfea475f None None] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:03:08.875621 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f464fbbf-0f9c-47a8-96ad-7fdd13792105 admin admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:03:08.880517 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66aee2b-ae4b-43f1-a955-ddc4036f9508 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:03:08.881112 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66aee2b-ae4b-43f1-a955-ddc4036f9508 admin admin] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:03:08.881429 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66aee2b-ae4b-43f1-a955-ddc4036f9508 admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:03:08.881708 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66aee2b-ae4b-43f1-a955-ddc4036f9508 admin admin] PATH_INFO: `/v3/users` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:03:08.881817 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e477b536-6df6-4a32-a2c7-8a44dfea475f None None] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:03:08.882521 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f66aee2b-ae4b-43f1-a955-ddc4036f9508 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:03:08.884518 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f66aee2b-ae4b-43f1-a955-ddc4036f9508 admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:03:08.886374 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16756d02-c52f-4438-89d8-52236e640be7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:03:08.886973 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16756d02-c52f-4438-89d8-52236e640be7 admin admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:03:08.887256 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16756d02-c52f-4438-89d8-52236e640be7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:03:08.887806 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16756d02-c52f-4438-89d8-52236e640be7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:03:08.889028 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16756d02-c52f-4438-89d8-52236e640be7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:03:08.890664 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16756d02-c52f-4438-89d8-52236e640be7 admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:03:08.905203 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1108/2197] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Sep 15 18:03:08 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 18:03:08.905203 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16756d02-c52f-4438-89d8-52236e640be7 admin admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:03:08.906690 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-16756d02-c52f-4438-89d8-52236e640be7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:03:08.908576 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1090/2198] 10.222.0.25 () {60 vars in 1144 bytes} [Thu Sep 15 18:03:08 2022] POST /identity/v3/users => generated 294 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 18:03:08.909480 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66aee2b-ae4b-43f1-a955-ddc4036f9508 admin admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:03:08.920691 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66aee2b-ae4b-43f1-a955-ddc4036f9508 admin admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:03:08.927124 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50df0d21-0603-415e-b8b8-ce61bfba666a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:03:08.927968 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50df0d21-0603-415e-b8b8-ce61bfba666a admin admin] REQUEST_METHOD: `PUT` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:03:08.928320 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50df0d21-0603-415e-b8b8-ce61bfba666a admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:03:08.928725 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50df0d21-0603-415e-b8b8-ce61bfba666a admin admin] PATH_INFO: `/v3/projects/6e2a4e8ac72a4753932e5be7dc23d94e/users/6578746fcb4749a484930f0075ae369f/roles/343cc8b1bc7243eebabdf08147e8366d` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:03:08.946826 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50df0d21-0603-415e-b8b8-ce61bfba666a admin admin] RBAC: Authorizing `identity:create_grant(project_id=6e2a4e8ac72a4753932e5be7dc23d94e, user_id=6578746fcb4749a484930f0075ae369f, role_id=343cc8b1bc7243eebabdf08147e8366d)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:03:08.949592 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50df0d21-0603-415e-b8b8-ce61bfba666a admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:03:08.963402 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1091/2199] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Sep 15 18:03:08 2022] PUT /identity/v3/projects/6e2a4e8ac72a4753932e5be7dc23d94e/users/6578746fcb4749a484930f0075ae369f/roles/343cc8b1bc7243eebabdf08147e8366d => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 18:03:08.964398 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50df0d21-0603-415e-b8b8-ce61bfba666a admin admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:03:08.975667 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16756d02-c52f-4438-89d8-52236e640be7 admin admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:03:09.019787 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 18:03:09.040484 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50df0d21-0603-415e-b8b8-ce61bfba666a admin admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:03:09.045940 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f4abf6-e505-41b5-940e-de39bdeaf8e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:03:09.046803 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f4abf6-e505-41b5-940e-de39bdeaf8e7 admin admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:03:09.047020 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f4abf6-e505-41b5-940e-de39bdeaf8e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:03:09.047257 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f4abf6-e505-41b5-940e-de39bdeaf8e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:03:09.047917 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f4abf6-e505-41b5-940e-de39bdeaf8e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:03:09.049560 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f4abf6-e505-41b5-940e-de39bdeaf8e7 admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:03:09.051721 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4736a88c-311f-46e1-afb1-96916a154ea4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a32274b4781b40fea9f28da8a9bde5ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1213c0d1b584404ba3998e136f166e89', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:03:09.052847 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4736a88c-311f-46e1-afb1-96916a154ea4 service neutron] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:03:09.053286 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4736a88c-311f-46e1-afb1-96916a154ea4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:03:09.053594 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4736a88c-311f-46e1-afb1-96916a154ea4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:03:09.063987 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1092/2200] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Sep 15 18:03:08 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 18:03:09.063987 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c933ec-2c75-4558-ba50-587862c718b3 None None] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:03:09.063987 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c933ec-2c75-4558-ba50-587862c718b3 None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:03:09.063987 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c933ec-2c75-4558-ba50-587862c718b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:03:09.064913 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4736a88c-311f-46e1-afb1-96916a154ea4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:03:09.066788 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4736a88c-311f-46e1-afb1-96916a154ea4 service neutron] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:03:09.078691 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1109/2201] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 15 18:03:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 18:03:09.087306 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4736a88c-311f-46e1-afb1-96916a154ea4 service neutron] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:03:09.104449 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.auth.core [None req-94c933ec-2c75-4558-ba50-587862c718b3 None None] MFA Rules not processed for user `6578746fcb4749a484930f0075ae369f`. Rule list: `[]` (Enabled: `True`). {{(pid=81592) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 18:03:09.106437 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-94c933ec-2c75-4558-ba50-587862c718b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:03:09.109514 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4736a88c-311f-46e1-afb1-96916a154ea4 service neutron] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:03:09.128763 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5badc7-6248-479b-a467-720c9467df13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:03:09.129810 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5badc7-6248-479b-a467-720c9467df13 admin admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:03:09.130160 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5badc7-6248-479b-a467-720c9467df13 admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:03:09.132606 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5badc7-6248-479b-a467-720c9467df13 admin admin] PATH_INFO: `/v3/roles` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:03:09.133315 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd5badc7-6248-479b-a467-720c9467df13 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:03:09.135010 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd5badc7-6248-479b-a467-720c9467df13 admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:03:09.151884 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1110/2202] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Sep 15 18:03:09 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 18:03:09.155964 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5badc7-6248-479b-a467-720c9467df13 admin admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:03:09.173230 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5badc7-6248-479b-a467-720c9467df13 admin admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:03:09.186057 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3a5042-7423-4189-afe3-e9b714c8eddd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:03:09.189857 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3a5042-7423-4189-afe3-e9b714c8eddd admin admin] REQUEST_METHOD: `PUT` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:03:09.190155 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3a5042-7423-4189-afe3-e9b714c8eddd admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:03:09.190452 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3a5042-7423-4189-afe3-e9b714c8eddd admin admin] PATH_INFO: `/v3/projects/dead21f9244149de969547a8ef2d4157/users/adf4072e0eb1480f8dd2dfc7cea8ccf3/roles/343cc8b1bc7243eebabdf08147e8366d` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:03:09.237158 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b3a5042-7423-4189-afe3-e9b714c8eddd admin admin] RBAC: Authorizing `identity:create_grant(project_id=dead21f9244149de969547a8ef2d4157, user_id=adf4072e0eb1480f8dd2dfc7cea8ccf3, role_id=343cc8b1bc7243eebabdf08147e8366d)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:03:09.238078 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1093/2203] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 15 18:03:09 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 18:03:09.240846 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b3a5042-7423-4189-afe3-e9b714c8eddd admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:03:09.242811 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c933ec-2c75-4558-ba50-587862c718b3 None None] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:03:09.256256 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c933ec-2c75-4558-ba50-587862c718b3 None None] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:03:09.270782 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1111/2204] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Sep 15 18:03:09 2022] PUT /identity/v3/projects/dead21f9244149de969547a8ef2d4157/users/adf4072e0eb1480f8dd2dfc7cea8ccf3/roles/343cc8b1bc7243eebabdf08147e8366d => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 18:03:09.273574 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00979bd-95b6-40c5-8e04-3ac034572faa None None] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:03:09.273873 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00979bd-95b6-40c5-8e04-3ac034572faa None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:03:09.274152 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00979bd-95b6-40c5-8e04-3ac034572faa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:03:09.314917 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.auth.core [None req-d00979bd-95b6-40c5-8e04-3ac034572faa None None] MFA Rules not processed for user `adf4072e0eb1480f8dd2dfc7cea8ccf3`. Rule list: `[]` (Enabled: `True`). {{(pid=81593) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 18:03:09.316451 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-d00979bd-95b6-40c5-8e04-3ac034572faa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:03:09.375828 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65bb2766-ae35-4bdc-81ae-8b353b5e9116 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:03:09.376600 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65bb2766-ae35-4bdc-81ae-8b353b5e9116 admin admin] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:03:09.376985 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65bb2766-ae35-4bdc-81ae-8b353b5e9116 admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:03:09.377394 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65bb2766-ae35-4bdc-81ae-8b353b5e9116 admin admin] PATH_INFO: `/v3/projects` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:03:09.378159 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65bb2766-ae35-4bdc-81ae-8b353b5e9116 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:03:09.380289 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65bb2766-ae35-4bdc-81ae-8b353b5e9116 admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:03:09.404685 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 18:03:09.421929 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1112/2205] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 15 18:03:09 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 18:03:09.422135 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1094/2206] 10.222.0.25 () {60 vars in 1153 bytes} [Thu Sep 15 18:03:09 2022] POST /identity/v3/projects => generated 383 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 18:03:09.422236 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00979bd-95b6-40c5-8e04-3ac034572faa None None] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:03:09.422236 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-d00979bd-95b6-40c5-8e04-3ac034572faa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:03:09.423692 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65bb2766-ae35-4bdc-81ae-8b353b5e9116 admin admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:03:09.436937 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00979bd-95b6-40c5-8e04-3ac034572faa None None] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:03:09.497552 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 18:03:09.503001 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65bb2766-ae35-4bdc-81ae-8b353b5e9116 admin admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:03:09.511770 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d949efb-369f-4761-bfca-d84bf6e4c871 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:03:09.512496 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d949efb-369f-4761-bfca-d84bf6e4c871 admin admin] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:03:09.513002 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d949efb-369f-4761-bfca-d84bf6e4c871 admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:03:09.513507 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d949efb-369f-4761-bfca-d84bf6e4c871 admin admin] PATH_INFO: `/v3/users` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:03:09.514411 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d949efb-369f-4761-bfca-d84bf6e4c871 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:03:09.515092 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0422993e-cf93-42c3-b384-0cde2e50265f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:03:09.515984 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0422993e-cf93-42c3-b384-0cde2e50265f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:03:09.516263 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0422993e-cf93-42c3-b384-0cde2e50265f admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:03:09.516528 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0422993e-cf93-42c3-b384-0cde2e50265f admin admin] PATH_INFO: `/v3/users/689cb9339c484f6b87d4bd5de7b30105` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:03:09.517704 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0422993e-cf93-42c3-b384-0cde2e50265f admin admin] RBAC: Authorizing `identity:delete_user(user_id=689cb9339c484f6b87d4bd5de7b30105)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:03:09.517858 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d949efb-369f-4761-bfca-d84bf6e4c871 admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:03:09.520039 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0422993e-cf93-42c3-b384-0cde2e50265f admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:03:09.545070 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1095/2207] 10.222.0.25 () {60 vars in 1144 bytes} [Thu Sep 15 18:03:09 2022] POST /identity/v3/users => generated 298 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 18:03:09.546200 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d949efb-369f-4761-bfca-d84bf6e4c871 admin admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:03:09.560683 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d949efb-369f-4761-bfca-d84bf6e4c871 admin admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:03:09.575379 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc18e34f-3455-4a10-8c2d-4a14e04bc5d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:03:09.577125 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc18e34f-3455-4a10-8c2d-4a14e04bc5d7 admin admin] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:03:09.577541 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc18e34f-3455-4a10-8c2d-4a14e04bc5d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:03:09.577836 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc18e34f-3455-4a10-8c2d-4a14e04bc5d7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:03:09.577936 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-0422993e-cf93-42c3-b384-0cde2e50265f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '689cb9339c484f6b87d4bd5de7b30105'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:03:09.579104 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc18e34f-3455-4a10-8c2d-4a14e04bc5d7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:03:09.581532 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc18e34f-3455-4a10-8c2d-4a14e04bc5d7 admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:03:09.586942 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-0422993e-cf93-42c3-b384-0cde2e50265f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '689cb9339c484f6b87d4bd5de7b30105'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:03:09.588255 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-0422993e-cf93-42c3-b384-0cde2e50265f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '689cb9339c484f6b87d4bd5de7b30105'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:03:09.589126 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-0422993e-cf93-42c3-b384-0cde2e50265f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '689cb9339c484f6b87d4bd5de7b30105'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:03:09.603326 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-0422993e-cf93-42c3-b384-0cde2e50265f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '689cb9339c484f6b87d4bd5de7b30105'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:03:09.613501 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1096/2208] 10.222.0.25 () {60 vars in 1153 bytes} [Thu Sep 15 18:03:09 2022] POST /identity/v3/projects => generated 385 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 18:03:09.614743 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc18e34f-3455-4a10-8c2d-4a14e04bc5d7 admin admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:03:09.617127 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-fc18e34f-3455-4a10-8c2d-4a14e04bc5d7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:03:09.624963 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1113/2209] 10.222.0.25 () {58 vars in 1224 bytes} [Thu Sep 15 18:03:09 2022] DELETE /identity/v3/users/689cb9339c484f6b87d4bd5de7b30105 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 18:03:09.625913 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0422993e-cf93-42c3-b384-0cde2e50265f admin admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:03:09.627331 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-0422993e-cf93-42c3-b384-0cde2e50265f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:03:09.683448 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc18e34f-3455-4a10-8c2d-4a14e04bc5d7 admin admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:03:09.697262 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0422993e-cf93-42c3-b384-0cde2e50265f admin admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:03:09.703243 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7edc0f4a-1700-4f13-afb8-e254aa186f01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:03:09.703900 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edc0f4a-1700-4f13-afb8-e254aa186f01 admin admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:03:09.704247 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edc0f4a-1700-4f13-afb8-e254aa186f01 admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:03:09.704586 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edc0f4a-1700-4f13-afb8-e254aa186f01 admin admin] PATH_INFO: `/v3/roles` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:03:09.705498 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7edc0f4a-1700-4f13-afb8-e254aa186f01 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:03:09.707091 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7edc0f4a-1700-4f13-afb8-e254aa186f01 admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:03:09.717678 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1114/2210] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Sep 15 18:03:09 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 18:03:09.718670 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7edc0f4a-1700-4f13-afb8-e254aa186f01 admin admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:03:09.722452 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-7edc0f4a-1700-4f13-afb8-e254aa186f01 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:03:09.735660 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7edc0f4a-1700-4f13-afb8-e254aa186f01 admin admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:03:09.740346 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792a9acc-4d89-4a35-b303-8aad9ac6d00d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:03:09.740937 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792a9acc-4d89-4a35-b303-8aad9ac6d00d admin admin] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:03:09.741240 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792a9acc-4d89-4a35-b303-8aad9ac6d00d admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:03:09.741520 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792a9acc-4d89-4a35-b303-8aad9ac6d00d admin admin] PATH_INFO: `/v3/users` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:03:09.742173 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-792a9acc-4d89-4a35-b303-8aad9ac6d00d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:03:09.744118 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-792a9acc-4d89-4a35-b303-8aad9ac6d00d admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:03:09.744229 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be55e752-452e-4235-8c35-0cdb90bb5949 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:03:09.744749 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be55e752-452e-4235-8c35-0cdb90bb5949 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:03:09.745031 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be55e752-452e-4235-8c35-0cdb90bb5949 admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:03:09.745346 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be55e752-452e-4235-8c35-0cdb90bb5949 admin admin] PATH_INFO: `/v3/projects/44abe74208db4725b8e0ba7b91408455` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:03:09.746475 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be55e752-452e-4235-8c35-0cdb90bb5949 admin admin] RBAC: Authorizing `identity:delete_project(project_id=44abe74208db4725b8e0ba7b91408455)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:03:09.748509 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be55e752-452e-4235-8c35-0cdb90bb5949 admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:03:09.753206 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 18:03:09.769174 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1115/2211] 10.222.0.25 () {60 vars in 1144 bytes} [Thu Sep 15 18:03:09 2022] POST /identity/v3/users => generated 299 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 18:03:09.770584 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff6ca2d-e177-430f-a3f3-65e4de10720d None None] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:03:09.770922 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff6ca2d-e177-430f-a3f3-65e4de10720d None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:03:09.771200 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff6ca2d-e177-430f-a3f3-65e4de10720d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:03:09.790812 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.auth.core [None req-8ff6ca2d-e177-430f-a3f3-65e4de10720d None None] MFA Rules not processed for user `5cfa58ef86774ab7800bf91930bf6028`. Rule list: `[]` (Enabled: `True`). {{(pid=81593) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 18:03:09.792428 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-8ff6ca2d-e177-430f-a3f3-65e4de10720d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:03:09.815783 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-be55e752-452e-4235-8c35-0cdb90bb5949 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '44abe74208db4725b8e0ba7b91408455', 'request_id': 'req-be55e752-452e-4235-8c35-0cdb90bb5949'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:03:09.823847 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-be55e752-452e-4235-8c35-0cdb90bb5949 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '44abe74208db4725b8e0ba7b91408455', 'request_id': 'req-be55e752-452e-4235-8c35-0cdb90bb5949'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:03:09.834639 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-be55e752-452e-4235-8c35-0cdb90bb5949 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '44abe74208db4725b8e0ba7b91408455', 'request_id': 'req-be55e752-452e-4235-8c35-0cdb90bb5949'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:03:09.850966 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-be55e752-452e-4235-8c35-0cdb90bb5949 admin admin] The token cache is being invalidate because project 44abe74208db4725b8e0ba7b91408455 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81592) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 18:03:09.851308 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-be55e752-452e-4235-8c35-0cdb90bb5949 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:03:09.851905 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-be55e752-452e-4235-8c35-0cdb90bb5949 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:03:09.853549 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1097/2212] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Sep 15 18:03:09 2022] DELETE /identity/v3/projects/44abe74208db4725b8e0ba7b91408455 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 18:03:09.854333 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be55e752-452e-4235-8c35-0cdb90bb5949 admin admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:03:09.855634 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-be55e752-452e-4235-8c35-0cdb90bb5949 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:03:09.860952 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 18:03:09.869733 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1116/2213] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 15 18:03:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 18:03:09.870586 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff6ca2d-e177-430f-a3f3-65e4de10720d None None] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:03:09.872134 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-8ff6ca2d-e177-430f-a3f3-65e4de10720d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:03:09.887930 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff6ca2d-e177-430f-a3f3-65e4de10720d None None] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:03:09.892595 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9901a4b0-39a0-4900-8bac-a83b28343e63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:03:09.894186 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9901a4b0-39a0-4900-8bac-a83b28343e63 admin admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:03:09.894551 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9901a4b0-39a0-4900-8bac-a83b28343e63 admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:03:09.894898 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9901a4b0-39a0-4900-8bac-a83b28343e63 admin admin] PATH_INFO: `/v3/roles` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:03:09.895618 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9901a4b0-39a0-4900-8bac-a83b28343e63 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:03:09.897958 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9901a4b0-39a0-4900-8bac-a83b28343e63 admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:03:09.910970 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1117/2214] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Sep 15 18:03:09 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 18:03:09.912560 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f27884a-b4bf-43b0-b63a-3c6fa30d4e3c None None] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:03:09.912918 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f27884a-b4bf-43b0-b63a-3c6fa30d4e3c None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:03:09.913276 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f27884a-b4bf-43b0-b63a-3c6fa30d4e3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:03:09.938752 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.auth.core [None req-0f27884a-b4bf-43b0-b63a-3c6fa30d4e3c None None] MFA Rules not processed for user `5cfa58ef86774ab7800bf91930bf6028`. Rule list: `[]` (Enabled: `True`). {{(pid=81593) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 18:03:09.939961 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-0f27884a-b4bf-43b0-b63a-3c6fa30d4e3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:03:09.948115 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1118/2215] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 15 18:03:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 18:03:09.955621 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f27884a-b4bf-43b0-b63a-3c6fa30d4e3c None None] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:03:09.955621 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-0f27884a-b4bf-43b0-b63a-3c6fa30d4e3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:03:09.958422 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be55e752-452e-4235-8c35-0cdb90bb5949 admin admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:03:09.963477 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d47ed1-0823-47fe-abc9-9ff2fd26154f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:03:09.964158 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d47ed1-0823-47fe-abc9-9ff2fd26154f admin admin] REQUEST_METHOD: `PUT` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:03:09.964440 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d47ed1-0823-47fe-abc9-9ff2fd26154f admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:03:09.964711 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d47ed1-0823-47fe-abc9-9ff2fd26154f admin admin] PATH_INFO: `/v3/projects/c80b11ae6a324bd6b4bcd8ed9ec01745/users/1da6bf666f104270a32ef616deff8a7d/roles/a9e42be86923434f8af52d3fc07fb4f7` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:03:09.988848 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d47ed1-0823-47fe-abc9-9ff2fd26154f admin admin] RBAC: Authorizing `identity:create_grant(project_id=c80b11ae6a324bd6b4bcd8ed9ec01745, user_id=1da6bf666f104270a32ef616deff8a7d, role_id=a9e42be86923434f8af52d3fc07fb4f7)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:03:09.991860 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d47ed1-0823-47fe-abc9-9ff2fd26154f admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:03:10.021837 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1098/2216] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Sep 15 18:03:09 2022] PUT /identity/v3/projects/c80b11ae6a324bd6b4bcd8ed9ec01745/users/1da6bf666f104270a32ef616deff8a7d/roles/a9e42be86923434f8af52d3fc07fb4f7 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 18:03:10.022455 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d47ed1-0823-47fe-abc9-9ff2fd26154f admin admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:03:10.026281 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f27884a-b4bf-43b0-b63a-3c6fa30d4e3c None None] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:03:10.085086 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79627dd-581e-487c-90ce-8b53621a3ec9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a32274b4781b40fea9f28da8a9bde5ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1213c0d1b584404ba3998e136f166e89', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:03:10.086545 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79627dd-581e-487c-90ce-8b53621a3ec9 service neutron] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:03:10.087270 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79627dd-581e-487c-90ce-8b53621a3ec9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:03:10.087737 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79627dd-581e-487c-90ce-8b53621a3ec9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:03:10.089862 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d47ed1-0823-47fe-abc9-9ff2fd26154f admin admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:03:10.097853 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6bd8fb5-cfbe-468c-8c5e-67ac08aac4a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:03:10.098325 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79627dd-581e-487c-90ce-8b53621a3ec9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:03:10.099003 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bd8fb5-cfbe-468c-8c5e-67ac08aac4a1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:03:10.099375 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bd8fb5-cfbe-468c-8c5e-67ac08aac4a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:03:10.099716 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bd8fb5-cfbe-468c-8c5e-67ac08aac4a1 admin admin] PATH_INFO: `/v3/projects/5d39e7e6676547ee9be49acd49cbb08c/users/40fb43567f364a5c98966b9fb738b304/roles/a9e42be86923434f8af52d3fc07fb4f7` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:03:10.100541 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79627dd-581e-487c-90ce-8b53621a3ec9 service neutron] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:03:10.112181 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1119/2217] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 15 18:03:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 18:03:10.119354 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6bd8fb5-cfbe-468c-8c5e-67ac08aac4a1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5d39e7e6676547ee9be49acd49cbb08c, user_id=40fb43567f364a5c98966b9fb738b304, role_id=a9e42be86923434f8af52d3fc07fb4f7)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:03:10.122028 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6bd8fb5-cfbe-468c-8c5e-67ac08aac4a1 admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:03:10.126280 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c303e217-003b-4898-8bbc-c93526c2490a None None] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:03:10.128467 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c303e217-003b-4898-8bbc-c93526c2490a None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:03:10.128764 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c303e217-003b-4898-8bbc-c93526c2490a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:03:10.145584 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1099/2218] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Sep 15 18:03:10 2022] PUT /identity/v3/projects/5d39e7e6676547ee9be49acd49cbb08c/users/40fb43567f364a5c98966b9fb738b304/roles/a9e42be86923434f8af52d3fc07fb4f7 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 18:03:10.146695 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6bd8fb5-cfbe-468c-8c5e-67ac08aac4a1 admin admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:03:10.154962 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.auth.core [None req-c303e217-003b-4898-8bbc-c93526c2490a None None] MFA Rules not processed for user `5cfa58ef86774ab7800bf91930bf6028`. Rule list: `[]` (Enabled: `True`). {{(pid=81593) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 18:03:10.157589 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-c303e217-003b-4898-8bbc-c93526c2490a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:03:10.205503 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 18:03:10.251795 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1120/2219] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 15 18:03:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 18:03:10.253602 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c303e217-003b-4898-8bbc-c93526c2490a None None] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:03:10.266422 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c303e217-003b-4898-8bbc-c93526c2490a None None] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:03:10.271909 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5959ce24-1fc7-4b87-bd4b-ab3ba42eaebb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:03:10.272613 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5959ce24-1fc7-4b87-bd4b-ab3ba42eaebb admin admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:03:10.272938 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5959ce24-1fc7-4b87-bd4b-ab3ba42eaebb admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:03:10.273150 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5959ce24-1fc7-4b87-bd4b-ab3ba42eaebb admin admin] PATH_INFO: `/v3/roles` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:03:10.273883 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5959ce24-1fc7-4b87-bd4b-ab3ba42eaebb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:03:10.275559 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5959ce24-1fc7-4b87-bd4b-ab3ba42eaebb admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:03:10.290453 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6bd8fb5-cfbe-468c-8c5e-67ac08aac4a1 admin admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:03:10.310218 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39fa6428-357d-4bbb-bccd-4430314d6714 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:03:10.310880 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fa6428-357d-4bbb-bccd-4430314d6714 admin admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:03:10.313490 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fa6428-357d-4bbb-bccd-4430314d6714 admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:03:10.313864 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fa6428-357d-4bbb-bccd-4430314d6714 admin admin] PATH_INFO: `/v3/roles` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:03:10.314664 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39fa6428-357d-4bbb-bccd-4430314d6714 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:03:10.316296 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39fa6428-357d-4bbb-bccd-4430314d6714 admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:03:10.316901 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1121/2220] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Sep 15 18:03:10 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 18:03:10.318023 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5959ce24-1fc7-4b87-bd4b-ab3ba42eaebb admin admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:03:10.327940 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1100/2221] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Sep 15 18:03:10 2022] GET /identity/v3/roles => generated 1420 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 18:03:10.329012 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39fa6428-357d-4bbb-bccd-4430314d6714 admin admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:03:10.338831 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5959ce24-1fc7-4b87-bd4b-ab3ba42eaebb admin admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:03:10.339707 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 18:03:10.345449 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39fa6428-357d-4bbb-bccd-4430314d6714 admin admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:03:10.356065 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900a627f-1519-4369-bc8d-7e7bbd1003e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:03:10.356947 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900a627f-1519-4369-bc8d-7e7bbd1003e9 admin admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:03:10.357583 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab2a6ed-4128-4865-9cb7-f18903a569a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:03:10.358371 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab2a6ed-4128-4865-9cb7-f18903a569a5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:03:10.358578 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900a627f-1519-4369-bc8d-7e7bbd1003e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:03:10.358908 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab2a6ed-4128-4865-9cb7-f18903a569a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:03:10.359353 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab2a6ed-4128-4865-9cb7-f18903a569a5 admin admin] PATH_INFO: `/v3/projects/5d39e7e6676547ee9be49acd49cbb08c/users/40fb43567f364a5c98966b9fb738b304/roles/a9e42be86923434f8af52d3fc07fb4f7` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:03:10.359688 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900a627f-1519-4369-bc8d-7e7bbd1003e9 admin admin] PATH_INFO: `/v3/domains` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:03:10.360501 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-900a627f-1519-4369-bc8d-7e7bbd1003e9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81593) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 18:03:10.360946 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-900a627f-1519-4369-bc8d-7e7bbd1003e9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:03:10.362796 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-900a627f-1519-4369-bc8d-7e7bbd1003e9 admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:03:10.363259 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab2a6ed-4128-4865-9cb7-f18903a569a5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5d39e7e6676547ee9be49acd49cbb08c, user_id=40fb43567f364a5c98966b9fb738b304, role_id=a9e42be86923434f8af52d3fc07fb4f7)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:03:10.366867 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab2a6ed-4128-4865-9cb7-f18903a569a5 admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:03:10.382659 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1122/2222] 10.222.0.25 () {58 vars in 1153 bytes} [Thu Sep 15 18:03:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 18:03:10.383573 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900a627f-1519-4369-bc8d-7e7bbd1003e9 admin admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:03:10.389982 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1101/2223] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Sep 15 18:03:10 2022] PUT /identity/v3/projects/5d39e7e6676547ee9be49acd49cbb08c/users/40fb43567f364a5c98966b9fb738b304/roles/a9e42be86923434f8af52d3fc07fb4f7 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 18:03:10.399863 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab2a6ed-4128-4865-9cb7-f18903a569a5 admin admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:03:10.400312 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900a627f-1519-4369-bc8d-7e7bbd1003e9 admin admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:03:10.491498 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab2a6ed-4128-4865-9cb7-f18903a569a5 admin admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:03:10.498105 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b276d0-2617-46da-b976-4a05a4644dcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:03:10.498727 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b276d0-2617-46da-b976-4a05a4644dcc admin admin] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:03:10.499458 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b276d0-2617-46da-b976-4a05a4644dcc admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:03:10.499741 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b276d0-2617-46da-b976-4a05a4644dcc admin admin] PATH_INFO: `/v3/projects` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:03:10.500722 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b276d0-2617-46da-b976-4a05a4644dcc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:03:10.502995 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b276d0-2617-46da-b976-4a05a4644dcc admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:03:10.532231 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6204c989-8c63-4f80-b83b-141f6e64fa14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:03:10.532907 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6204c989-8c63-4f80-b83b-141f6e64fa14 admin admin] REQUEST_METHOD: `PUT` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:03:10.533219 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6204c989-8c63-4f80-b83b-141f6e64fa14 admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:03:10.533675 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6204c989-8c63-4f80-b83b-141f6e64fa14 admin admin] PATH_INFO: `/v3/projects/c80b11ae6a324bd6b4bcd8ed9ec01745/users/1da6bf666f104270a32ef616deff8a7d/roles/a9e42be86923434f8af52d3fc07fb4f7` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:03:10.537390 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6204c989-8c63-4f80-b83b-141f6e64fa14 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c80b11ae6a324bd6b4bcd8ed9ec01745, user_id=1da6bf666f104270a32ef616deff8a7d, role_id=a9e42be86923434f8af52d3fc07fb4f7)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:03:10.542067 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6204c989-8c63-4f80-b83b-141f6e64fa14 admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:03:10.548992 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1102/2224] 10.222.0.25 () {60 vars in 1153 bytes} [Thu Sep 15 18:03:10 2022] POST /identity/v3/projects => generated 369 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 18:03:10.551440 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb515c29-4f88-4cf0-a575-2ef58e062382 None None] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:03:10.551820 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb515c29-4f88-4cf0-a575-2ef58e062382 None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:03:10.552104 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb515c29-4f88-4cf0-a575-2ef58e062382 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:03:10.560919 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1123/2225] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Sep 15 18:03:10 2022] PUT /identity/v3/projects/c80b11ae6a324bd6b4bcd8ed9ec01745/users/1da6bf666f104270a32ef616deff8a7d/roles/a9e42be86923434f8af52d3fc07fb4f7 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 18:03:10.562254 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6204c989-8c63-4f80-b83b-141f6e64fa14 admin admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:03:10.591460 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.auth.core [None req-fb515c29-4f88-4cf0-a575-2ef58e062382 None None] MFA Rules not processed for user `40fb43567f364a5c98966b9fb738b304`. Rule list: `[]` (Enabled: `True`). {{(pid=81592) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 18:03:10.593073 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-fb515c29-4f88-4cf0-a575-2ef58e062382 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:03:10.665929 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6204c989-8c63-4f80-b83b-141f6e64fa14 admin admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:03:10.673316 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1dd223-b99d-4d1b-a390-73374c1cbd2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:03:10.673980 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1dd223-b99d-4d1b-a390-73374c1cbd2e admin admin] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:03:10.674266 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1dd223-b99d-4d1b-a390-73374c1cbd2e admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:03:10.674542 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1dd223-b99d-4d1b-a390-73374c1cbd2e admin admin] PATH_INFO: `/v3/users` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:03:10.675190 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1dd223-b99d-4d1b-a390-73374c1cbd2e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:03:10.677417 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1dd223-b99d-4d1b-a390-73374c1cbd2e admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:03:10.694314 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1103/2226] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 15 18:03:10 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 18:03:10.698009 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98a8add-0dca-4fed-9bcc-cfc820192187 None None] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:03:10.698009 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98a8add-0dca-4fed-9bcc-cfc820192187 None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:03:10.698009 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98a8add-0dca-4fed-9bcc-cfc820192187 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:03:10.706502 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1124/2227] 10.222.0.25 () {60 vars in 1144 bytes} [Thu Sep 15 18:03:10 2022] POST /identity/v3/users => generated 285 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 18:03:10.707512 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1dd223-b99d-4d1b-a390-73374c1cbd2e admin admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:03:10.709099 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-0c1dd223-b99d-4d1b-a390-73374c1cbd2e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:03:10.722553 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1dd223-b99d-4d1b-a390-73374c1cbd2e admin admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:03:10.728211 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340d05b0-f242-4776-a855-308b899c27f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:03:10.728835 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340d05b0-f242-4776-a855-308b899c27f2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:03:10.729477 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340d05b0-f242-4776-a855-308b899c27f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:03:10.729612 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340d05b0-f242-4776-a855-308b899c27f2 admin admin] PATH_INFO: `/v3/projects/7bee4084609644b4ae09419b2c700845` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:03:10.730697 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-340d05b0-f242-4776-a855-308b899c27f2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7bee4084609644b4ae09419b2c700845)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:03:10.732812 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.auth.core [None req-b98a8add-0dca-4fed-9bcc-cfc820192187 None None] MFA Rules not processed for user `1da6bf666f104270a32ef616deff8a7d`. Rule list: `[]` (Enabled: `True`). {{(pid=81592) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 18:03:10.733479 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-340d05b0-f242-4776-a855-308b899c27f2 admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:03:10.734195 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-b98a8add-0dca-4fed-9bcc-cfc820192187 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:03:10.766510 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=94,keystone:INSERT=4,keystone:DELETE=2 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 18:03:10.787041 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 18:03:10.787586 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-340d05b0-f242-4776-a855-308b899c27f2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7bee4084609644b4ae09419b2c700845', 'request_id': 'req-340d05b0-f242-4776-a855-308b899c27f2'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:03:10.793348 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-340d05b0-f242-4776-a855-308b899c27f2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7bee4084609644b4ae09419b2c700845', 'request_id': 'req-340d05b0-f242-4776-a855-308b899c27f2'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:03:10.802024 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-340d05b0-f242-4776-a855-308b899c27f2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7bee4084609644b4ae09419b2c700845', 'request_id': 'req-340d05b0-f242-4776-a855-308b899c27f2'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:03:10.814176 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1104/2228] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 15 18:03:10 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 18:03:10.815310 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98a8add-0dca-4fed-9bcc-cfc820192187 None None] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:03:10.815921 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-340d05b0-f242-4776-a855-308b899c27f2 admin admin] The token cache is being invalidate because project 7bee4084609644b4ae09419b2c700845 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81593) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 18:03:10.816223 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-340d05b0-f242-4776-a855-308b899c27f2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:03:10.816952 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-340d05b0-f242-4776-a855-308b899c27f2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:03:10.817652 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-b98a8add-0dca-4fed-9bcc-cfc820192187 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:03:10.818488 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1125/2229] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Sep 15 18:03:10 2022] DELETE /identity/v3/projects/7bee4084609644b4ae09419b2c700845 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 18:03:10.821423 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340d05b0-f242-4776-a855-308b899c27f2 admin admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:03:10.821423 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-340d05b0-f242-4776-a855-308b899c27f2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:03:10.886915 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98a8add-0dca-4fed-9bcc-cfc820192187 None None] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:03:10.890948 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340d05b0-f242-4776-a855-308b899c27f2 admin admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:03:10.895853 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b074f8-0d19-4828-a1ee-10ae6b653196 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:03:10.896827 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b074f8-0d19-4828-a1ee-10ae6b653196 admin admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:03:10.897088 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b074f8-0d19-4828-a1ee-10ae6b653196 admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:03:10.897441 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b074f8-0d19-4828-a1ee-10ae6b653196 admin admin] PATH_INFO: `/v3/roles` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:03:10.898355 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b074f8-0d19-4828-a1ee-10ae6b653196 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:03:10.900064 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b074f8-0d19-4828-a1ee-10ae6b653196 admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:03:10.913353 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1126/2230] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Sep 15 18:03:10 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 18:03:10.915068 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b074f8-0d19-4828-a1ee-10ae6b653196 admin admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:03:10.917075 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-52b074f8-0d19-4828-a1ee-10ae6b653196 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:03:10.931820 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b074f8-0d19-4828-a1ee-10ae6b653196 admin admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:03:10.937571 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8a8560-fedc-4203-9038-8fcff1de4d91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:03:10.938396 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8a8560-fedc-4203-9038-8fcff1de4d91 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:03:10.938677 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8a8560-fedc-4203-9038-8fcff1de4d91 admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:03:10.938955 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8a8560-fedc-4203-9038-8fcff1de4d91 admin admin] PATH_INFO: `/v3/users/f8df5b20784f4a5e9e397e27b02425ae` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:03:10.940093 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef8a8560-fedc-4203-9038-8fcff1de4d91 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f8df5b20784f4a5e9e397e27b02425ae)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:03:10.942285 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef8a8560-fedc-4203-9038-8fcff1de4d91 admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:03:10.944282 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbd352d-0343-4209-8446-153b68bbcc97 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b232e7a841145ba93c6d8462ccb751a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1213c0d1b584404ba3998e136f166e89', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:03:10.945017 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbd352d-0343-4209-8446-153b68bbcc97 service cinder] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:03:10.945308 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbd352d-0343-4209-8446-153b68bbcc97 service cinder] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:03:10.945745 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbd352d-0343-4209-8446-153b68bbcc97 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:03:10.947666 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-3cbd352d-0343-4209-8446-153b68bbcc97 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:03:10.996748 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-ef8a8560-fedc-4203-9038-8fcff1de4d91 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f8df5b20784f4a5e9e397e27b02425ae'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:03:11.006655 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-ef8a8560-fedc-4203-9038-8fcff1de4d91 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f8df5b20784f4a5e9e397e27b02425ae'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:03:11.007777 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-ef8a8560-fedc-4203-9038-8fcff1de4d91 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f8df5b20784f4a5e9e397e27b02425ae'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:03:11.008747 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-ef8a8560-fedc-4203-9038-8fcff1de4d91 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f8df5b20784f4a5e9e397e27b02425ae'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:03:11.019320 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cbd352d-0343-4209-8446-153b68bbcc97 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:03:11.020757 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cbd352d-0343-4209-8446-153b68bbcc97 service cinder] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:03:11.021913 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-ef8a8560-fedc-4203-9038-8fcff1de4d91 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f8df5b20784f4a5e9e397e27b02425ae'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:03:11.034799 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1105/2231] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 15 18:03:10 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 218 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 18:03:11.035825 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbd352d-0343-4209-8446-153b68bbcc97 service cinder] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:03:11.038058 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-3cbd352d-0343-4209-8446-153b68bbcc97 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:03:11.047045 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1127/2232] 10.222.0.25 () {58 vars in 1224 bytes} [Thu Sep 15 18:03:10 2022] DELETE /identity/v3/users/f8df5b20784f4a5e9e397e27b02425ae => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 18:03:11.050638 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8a8560-fedc-4203-9038-8fcff1de4d91 admin admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:03:11.050638 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-ef8a8560-fedc-4203-9038-8fcff1de4d91 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:03:11.058481 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbd352d-0343-4209-8446-153b68bbcc97 service cinder] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:03:11.098301 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 18:03:11.158516 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e48ae0-6689-4da6-8576-02d7edfa37c1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b232e7a841145ba93c6d8462ccb751a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1213c0d1b584404ba3998e136f166e89', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:03:11.159159 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e48ae0-6689-4da6-8576-02d7edfa37c1 service cinder] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:03:11.159461 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e48ae0-6689-4da6-8576-02d7edfa37c1 service cinder] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:03:11.159722 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e48ae0-6689-4da6-8576-02d7edfa37c1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:03:11.161566 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-14e48ae0-6689-4da6-8576-02d7edfa37c1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:03:11.169021 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 18:03:11.182874 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8a8560-fedc-4203-9038-8fcff1de4d91 admin admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:03:11.190171 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c69c1dc-6ce8-4358-af3b-5a41eeedb1b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:03:11.190867 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c69c1dc-6ce8-4358-af3b-5a41eeedb1b6 admin admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:03:11.191158 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c69c1dc-6ce8-4358-af3b-5a41eeedb1b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:03:11.191414 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c69c1dc-6ce8-4358-af3b-5a41eeedb1b6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:03:11.192255 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c69c1dc-6ce8-4358-af3b-5a41eeedb1b6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:03:11.194185 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c69c1dc-6ce8-4358-af3b-5a41eeedb1b6 admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:03:11.207694 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1128/2233] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Sep 15 18:03:11 2022] GET /identity/v3/roles => generated 1420 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 18:03:11.212407 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c69c1dc-6ce8-4358-af3b-5a41eeedb1b6 admin admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:03:11.225724 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c69c1dc-6ce8-4358-af3b-5a41eeedb1b6 admin admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:03:11.232879 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b703225-f900-4d5f-abdb-227fbe9c6949 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:03:11.234341 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b703225-f900-4d5f-abdb-227fbe9c6949 admin admin] REQUEST_METHOD: `PUT` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:03:11.234690 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b703225-f900-4d5f-abdb-227fbe9c6949 admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:03:11.235033 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b703225-f900-4d5f-abdb-227fbe9c6949 admin admin] PATH_INFO: `/v3/projects/c0d9937e354a4d7595db38d336d37d28/users/7f53142e42414b6d8b1f5a399c3f4e80/roles/343cc8b1bc7243eebabdf08147e8366d` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:03:11.252764 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e48ae0-6689-4da6-8576-02d7edfa37c1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:03:11.254907 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e48ae0-6689-4da6-8576-02d7edfa37c1 service cinder] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:03:11.261935 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b703225-f900-4d5f-abdb-227fbe9c6949 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c0d9937e354a4d7595db38d336d37d28, user_id=7f53142e42414b6d8b1f5a399c3f4e80, role_id=343cc8b1bc7243eebabdf08147e8366d)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:03:11.266263 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1106/2234] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 15 18:03:11 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 231 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 18:03:11.268393 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b703225-f900-4d5f-abdb-227fbe9c6949 admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:03:11.329656 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1129/2235] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Sep 15 18:03:11 2022] PUT /identity/v3/projects/c0d9937e354a4d7595db38d336d37d28/users/7f53142e42414b6d8b1f5a399c3f4e80/roles/343cc8b1bc7243eebabdf08147e8366d => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 18:03:11.340451 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b89ffc1-6170-4505-a658-9f664664fc0c None None] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:03:11.340997 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b89ffc1-6170-4505-a658-9f664664fc0c None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:03:11.341755 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b89ffc1-6170-4505-a658-9f664664fc0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:03:11.406451 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.auth.core [None req-6b89ffc1-6170-4505-a658-9f664664fc0c None None] MFA Rules not processed for user `7f53142e42414b6d8b1f5a399c3f4e80`. Rule list: `[]` (Enabled: `True`). {{(pid=81592) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 18:03:11.408073 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-6b89ffc1-6170-4505-a658-9f664664fc0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:03:11.508987 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b703225-f900-4d5f-abdb-227fbe9c6949 admin admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:03:11.512065 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-0b703225-f900-4d5f-abdb-227fbe9c6949 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:03:11.525397 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1107/2236] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 15 18:03:11 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 18:03:11.541788 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b89ffc1-6170-4505-a658-9f664664fc0c None None] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:03:11.543907 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-6b89ffc1-6170-4505-a658-9f664664fc0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:03:11.680835 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b89ffc1-6170-4505-a658-9f664664fc0c None None] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:03:11.680835 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab06dca1-93b5-417b-b9fc-7a738096215d service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c194f79928aa4a4d94619c417b4e39e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1213c0d1b584404ba3998e136f166e89', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:03:11.680835 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab06dca1-93b5-417b-b9fc-7a738096215d service glance] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:03:11.685626 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b703225-f900-4d5f-abdb-227fbe9c6949 admin admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:03:11.686951 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab06dca1-93b5-417b-b9fc-7a738096215d service glance] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:03:11.687415 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab06dca1-93b5-417b-b9fc-7a738096215d service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:03:11.698307 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0700f73c-e857-4794-a8a9-3f06a79e15a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:03:11.698960 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0700f73c-e857-4794-a8a9-3f06a79e15a7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:03:11.699249 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0700f73c-e857-4794-a8a9-3f06a79e15a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:03:11.699549 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0700f73c-e857-4794-a8a9-3f06a79e15a7 admin admin] PATH_INFO: `/v3/projects/8b74388e5a224c25bb019ed974732569` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:03:11.701496 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab06dca1-93b5-417b-b9fc-7a738096215d service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:03:11.704003 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0700f73c-e857-4794-a8a9-3f06a79e15a7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8b74388e5a224c25bb019ed974732569)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:03:11.704193 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab06dca1-93b5-417b-b9fc-7a738096215d service glance] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:03:11.706085 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0700f73c-e857-4794-a8a9-3f06a79e15a7 admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:03:11.719511 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1108/2237] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 15 18:03:11 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 179 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 15 18:03:11.720496 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab06dca1-93b5-417b-b9fc-7a738096215d service glance] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:03:11.722181 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-ab06dca1-93b5-417b-b9fc-7a738096215d service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:03:11.742462 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab06dca1-93b5-417b-b9fc-7a738096215d service glance] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:03:11.761479 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ce02ad-84cf-4ef6-850a-6b9f3f50b5df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:03:11.763785 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ce02ad-84cf-4ef6-850a-6b9f3f50b5df admin admin] REQUEST_METHOD: `DELETE` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:03:11.764530 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ce02ad-84cf-4ef6-850a-6b9f3f50b5df admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:03:11.765015 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ce02ad-84cf-4ef6-850a-6b9f3f50b5df admin admin] PATH_INFO: `/v3/users/c8be5e66283445b4902550b07d43e50d` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:03:11.767635 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ce02ad-84cf-4ef6-850a-6b9f3f50b5df admin admin] RBAC: Authorizing `identity:delete_user(user_id=c8be5e66283445b4902550b07d43e50d)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:03:11.773183 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ce02ad-84cf-4ef6-850a-6b9f3f50b5df admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:03:11.838035 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 18:03:11.849885 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-0700f73c-e857-4794-a8a9-3f06a79e15a7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8b74388e5a224c25bb019ed974732569', 'request_id': 'req-0700f73c-e857-4794-a8a9-3f06a79e15a7'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:03:11.871717 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-46ce02ad-84cf-4ef6-850a-6b9f3f50b5df admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c8be5e66283445b4902550b07d43e50d'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:03:11.875964 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-0700f73c-e857-4794-a8a9-3f06a79e15a7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8b74388e5a224c25bb019ed974732569', 'request_id': 'req-0700f73c-e857-4794-a8a9-3f06a79e15a7'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:03:11.891706 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-0700f73c-e857-4794-a8a9-3f06a79e15a7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8b74388e5a224c25bb019ed974732569', 'request_id': 'req-0700f73c-e857-4794-a8a9-3f06a79e15a7'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:03:11.900319 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-46ce02ad-84cf-4ef6-850a-6b9f3f50b5df admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c8be5e66283445b4902550b07d43e50d'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:03:11.901284 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-46ce02ad-84cf-4ef6-850a-6b9f3f50b5df admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c8be5e66283445b4902550b07d43e50d'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:03:11.902798 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-46ce02ad-84cf-4ef6-850a-6b9f3f50b5df admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c8be5e66283445b4902550b07d43e50d'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:03:11.918898 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-0700f73c-e857-4794-a8a9-3f06a79e15a7 admin admin] The token cache is being invalidate because project 8b74388e5a224c25bb019ed974732569 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81593) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 18:03:11.919460 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-0700f73c-e857-4794-a8a9-3f06a79e15a7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:03:11.920254 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-46ce02ad-84cf-4ef6-850a-6b9f3f50b5df admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c8be5e66283445b4902550b07d43e50d'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:03:11.920426 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-0700f73c-e857-4794-a8a9-3f06a79e15a7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:03:11.922534 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1130/2238] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Sep 15 18:03:11 2022] DELETE /identity/v3/projects/8b74388e5a224c25bb019ed974732569 => generated 0 bytes in 414 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 15 18:03:11.935461 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490512ed-b6e8-4554-863d-6a48691cf9b6 None None] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:03:11.935761 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490512ed-b6e8-4554-863d-6a48691cf9b6 None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:03:11.936125 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490512ed-b6e8-4554-863d-6a48691cf9b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:03:11.973797 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1109/2239] 10.222.0.25 () {58 vars in 1224 bytes} [Thu Sep 15 18:03:11 2022] DELETE /identity/v3/users/c8be5e66283445b4902550b07d43e50d => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 18:03:11.977699 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd75860-05ac-4d31-a773-bd36f1c56b3f None None] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:03:11.977982 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd75860-05ac-4d31-a773-bd36f1c56b3f None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:03:11.978253 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd75860-05ac-4d31-a773-bd36f1c56b3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:03:11.991386 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.auth.core [None req-490512ed-b6e8-4554-863d-6a48691cf9b6 None None] MFA Rules not processed for user `5cfa58ef86774ab7800bf91930bf6028`. Rule list: `[]` (Enabled: `True`). {{(pid=81593) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 18:03:11.992668 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-490512ed-b6e8-4554-863d-6a48691cf9b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:03:12.027711 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 18:03:12.048593 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.auth.core [None req-fdd75860-05ac-4d31-a773-bd36f1c56b3f None None] MFA Rules not processed for user `5cfa58ef86774ab7800bf91930bf6028`. Rule list: `[]` (Enabled: `True`). {{(pid=81592) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 18:03:12.049826 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-fdd75860-05ac-4d31-a773-bd36f1c56b3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:03:12.093698 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1131/2240] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 15 18:03:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 18:03:12.094734 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490512ed-b6e8-4554-863d-6a48691cf9b6 None None] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:03:12.099362 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-490512ed-b6e8-4554-863d-6a48691cf9b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:03:12.149879 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1110/2241] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 15 18:03:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 18:03:12.155479 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9c66ce-fca4-4675-a3f9-5110bf29cd7d None None] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:03:12.156080 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9c66ce-fca4-4675-a3f9-5110bf29cd7d None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:03:12.156514 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9c66ce-fca4-4675-a3f9-5110bf29cd7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:03:12.172624 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490512ed-b6e8-4554-863d-6a48691cf9b6 None None] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:03:12.176659 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2cb4c8-b909-4fa7-a552-a23ba51f2de5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b232e7a841145ba93c6d8462ccb751a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1213c0d1b584404ba3998e136f166e89', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:03:12.177865 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2cb4c8-b909-4fa7-a552-a23ba51f2de5 service cinder] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:03:12.177865 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2cb4c8-b909-4fa7-a552-a23ba51f2de5 service cinder] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:03:12.178061 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2cb4c8-b909-4fa7-a552-a23ba51f2de5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:03:12.178298 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.auth.core [None req-7f9c66ce-fca4-4675-a3f9-5110bf29cd7d None None] MFA Rules not processed for user `5cfa58ef86774ab7800bf91930bf6028`. Rule list: `[]` (Enabled: `True`). {{(pid=81592) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 18:03:12.179556 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-7f9c66ce-fca4-4675-a3f9-5110bf29cd7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:03:12.179944 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-6c2cb4c8-b909-4fa7-a552-a23ba51f2de5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:03:12.189019 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1111/2242] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 15 18:03:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 18:03:12.189878 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9c66ce-fca4-4675-a3f9-5110bf29cd7d None None] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:03:12.191181 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-7f9c66ce-fca4-4675-a3f9-5110bf29cd7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:03:12.252625 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9c66ce-fca4-4675-a3f9-5110bf29cd7d None None] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:03:12.254624 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2cb4c8-b909-4fa7-a552-a23ba51f2de5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:03:12.256588 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2cb4c8-b909-4fa7-a552-a23ba51f2de5 service cinder] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:03:12.257257 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27706b2b-086d-42e0-9bc4-5156d7caa660 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a32274b4781b40fea9f28da8a9bde5ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1213c0d1b584404ba3998e136f166e89', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:03:12.257920 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27706b2b-086d-42e0-9bc4-5156d7caa660 service neutron] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:03:12.258226 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27706b2b-086d-42e0-9bc4-5156d7caa660 service neutron] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:03:12.258531 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27706b2b-086d-42e0-9bc4-5156d7caa660 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:03:12.267990 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1132/2243] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 15 18:03:12 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 174 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 18:03:12.269171 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2cb4c8-b909-4fa7-a552-a23ba51f2de5 service cinder] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:03:12.271250 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27706b2b-086d-42e0-9bc4-5156d7caa660 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:03:12.273141 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27706b2b-086d-42e0-9bc4-5156d7caa660 service neutron] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:03:12.283404 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2cb4c8-b909-4fa7-a552-a23ba51f2de5 service cinder] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:03:12.289709 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d092c8-1414-443d-b208-8978bfe342f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:03:12.290420 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d092c8-1414-443d-b208-8978bfe342f3 admin admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:03:12.290827 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d092c8-1414-443d-b208-8978bfe342f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:03:12.291393 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1112/2244] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 15 18:03:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 18:03:12.291511 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d092c8-1414-443d-b208-8978bfe342f3 admin admin] PATH_INFO: `/v3/domains` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:03:12.292241 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d092c8-1414-443d-b208-8978bfe342f3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81593) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 18:03:12.292651 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d092c8-1414-443d-b208-8978bfe342f3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:03:12.294455 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d092c8-1414-443d-b208-8978bfe342f3 admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:03:12.319576 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1133/2245] 10.222.0.25 () {58 vars in 1153 bytes} [Thu Sep 15 18:03:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 18:03:12.324252 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27706b2b-086d-42e0-9bc4-5156d7caa660 service neutron] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:03:12.335732 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27706b2b-086d-42e0-9bc4-5156d7caa660 service neutron] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:03:12.340741 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e59fd9-e868-4b7b-8e77-6639ac424470 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:03:12.341509 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e59fd9-e868-4b7b-8e77-6639ac424470 admin admin] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:03:12.341859 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e59fd9-e868-4b7b-8e77-6639ac424470 admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:03:12.342204 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e59fd9-e868-4b7b-8e77-6639ac424470 admin admin] PATH_INFO: `/v3/projects` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:03:12.342914 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e59fd9-e868-4b7b-8e77-6639ac424470 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:03:12.346098 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e59fd9-e868-4b7b-8e77-6639ac424470 admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:03:12.385811 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1113/2246] 10.222.0.25 () {60 vars in 1153 bytes} [Thu Sep 15 18:03:12 2022] POST /identity/v3/projects => generated 383 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 18:03:12.387026 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d092c8-1414-443d-b208-8978bfe342f3 admin admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:03:12.401465 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d092c8-1414-443d-b208-8978bfe342f3 admin admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:03:12.515518 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058e1ebd-24fe-45e0-a76e-c37c7bced30c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:03:12.516231 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058e1ebd-24fe-45e0-a76e-c37c7bced30c admin admin] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:03:12.516866 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058e1ebd-24fe-45e0-a76e-c37c7bced30c admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:03:12.516866 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058e1ebd-24fe-45e0-a76e-c37c7bced30c admin admin] PATH_INFO: `/v3/users` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:03:12.517569 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058e1ebd-24fe-45e0-a76e-c37c7bced30c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:03:12.519707 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058e1ebd-24fe-45e0-a76e-c37c7bced30c admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:03:12.554865 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 18:03:12.574162 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1134/2247] 10.222.0.25 () {60 vars in 1144 bytes} [Thu Sep 15 18:03:12 2022] POST /identity/v3/users => generated 292 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 18:03:12.577567 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e59fd9-e868-4b7b-8e77-6639ac424470 admin admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:03:12.598014 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e59fd9-e868-4b7b-8e77-6639ac424470 admin admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:03:12.608042 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3ff5d2-80f6-474a-a9cc-a6512aa93854 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:03:12.608668 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3ff5d2-80f6-474a-a9cc-a6512aa93854 admin admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:03:12.608956 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3ff5d2-80f6-474a-a9cc-a6512aa93854 admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:03:12.609273 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3ff5d2-80f6-474a-a9cc-a6512aa93854 admin admin] PATH_INFO: `/v3/roles` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:03:12.610158 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a3ff5d2-80f6-474a-a9cc-a6512aa93854 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:03:12.612041 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a3ff5d2-80f6-474a-a9cc-a6512aa93854 admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:03:12.627808 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1114/2248] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Sep 15 18:03:12 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 18:03:12.632560 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058e1ebd-24fe-45e0-a76e-c37c7bced30c admin admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:03:12.650333 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058e1ebd-24fe-45e0-a76e-c37c7bced30c admin admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:03:12.656698 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe287545-14ea-41af-bff6-9267dc86ef36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:03:12.657703 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe287545-14ea-41af-bff6-9267dc86ef36 admin admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:03:12.658091 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe287545-14ea-41af-bff6-9267dc86ef36 admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:03:12.658467 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe287545-14ea-41af-bff6-9267dc86ef36 admin admin] PATH_INFO: `/v3/roles` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:03:12.659232 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe287545-14ea-41af-bff6-9267dc86ef36 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:03:12.661370 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe287545-14ea-41af-bff6-9267dc86ef36 admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:03:12.676017 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1135/2249] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Sep 15 18:03:12 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 15 18:03:12.680351 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3ff5d2-80f6-474a-a9cc-a6512aa93854 admin admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:03:12.691933 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3ff5d2-80f6-474a-a9cc-a6512aa93854 admin admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:03:12.707148 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bce1a7a-53d2-4557-ae09-1c751f040f02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:03:12.707826 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bce1a7a-53d2-4557-ae09-1c751f040f02 admin admin] REQUEST_METHOD: `PUT` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:03:12.708368 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bce1a7a-53d2-4557-ae09-1c751f040f02 admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:03:12.709801 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bce1a7a-53d2-4557-ae09-1c751f040f02 admin admin] PATH_INFO: `/v3/projects/d1625fcdfd904b6c91488a1ce6e97e3e/users/ed84a779b63149b5b53f8f2455f7b955/roles/343cc8b1bc7243eebabdf08147e8366d` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:03:12.725266 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=93,keystone:DELETE=5,keystone:INSERT=2 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 18:03:12.729335 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bce1a7a-53d2-4557-ae09-1c751f040f02 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d1625fcdfd904b6c91488a1ce6e97e3e, user_id=ed84a779b63149b5b53f8f2455f7b955, role_id=343cc8b1bc7243eebabdf08147e8366d)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:03:12.733020 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bce1a7a-53d2-4557-ae09-1c751f040f02 admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:03:12.765436 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1115/2250] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Sep 15 18:03:12 2022] PUT /identity/v3/projects/d1625fcdfd904b6c91488a1ce6e97e3e/users/ed84a779b63149b5b53f8f2455f7b955/roles/343cc8b1bc7243eebabdf08147e8366d => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 15 18:03:12.771753 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444a1ea9-6d1f-49ee-aaa9-daf798fff753 None None] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:03:12.772044 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444a1ea9-6d1f-49ee-aaa9-daf798fff753 None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:03:12.772338 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444a1ea9-6d1f-49ee-aaa9-daf798fff753 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:03:12.812747 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.auth.core [None req-444a1ea9-6d1f-49ee-aaa9-daf798fff753 None None] MFA Rules not processed for user `ed84a779b63149b5b53f8f2455f7b955`. Rule list: `[]` (Enabled: `True`). {{(pid=81593) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 18:03:12.814010 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-444a1ea9-6d1f-49ee-aaa9-daf798fff753 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:03:12.852748 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bce1a7a-53d2-4557-ae09-1c751f040f02 admin admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:03:12.856137 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-2bce1a7a-53d2-4557-ae09-1c751f040f02 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:03:12.916334 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1136/2251] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 15 18:03:12 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 18:03:12.921641 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444a1ea9-6d1f-49ee-aaa9-daf798fff753 None None] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:03:12.943014 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bce1a7a-53d2-4557-ae09-1c751f040f02 admin admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:03:12.947829 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c6294b-b153-4754-9bbf-752ff434a995 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:03:12.948459 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c6294b-b153-4754-9bbf-752ff434a995 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:03:12.948741 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c6294b-b153-4754-9bbf-752ff434a995 admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:03:12.949011 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c6294b-b153-4754-9bbf-752ff434a995 admin admin] PATH_INFO: `/v3/projects/9f15bad754cc40e3a8f843ba8bd1a727` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:03:12.950166 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c6294b-b153-4754-9bbf-752ff434a995 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9f15bad754cc40e3a8f843ba8bd1a727)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:03:12.952106 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c6294b-b153-4754-9bbf-752ff434a995 admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:03:12.989595 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444a1ea9-6d1f-49ee-aaa9-daf798fff753 None None] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:03:13.004614 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-12c6294b-b153-4754-9bbf-752ff434a995 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9f15bad754cc40e3a8f843ba8bd1a727', 'request_id': 'req-12c6294b-b153-4754-9bbf-752ff434a995'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:03:13.011947 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-12c6294b-b153-4754-9bbf-752ff434a995 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9f15bad754cc40e3a8f843ba8bd1a727', 'request_id': 'req-12c6294b-b153-4754-9bbf-752ff434a995'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:03:13.027005 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-12c6294b-b153-4754-9bbf-752ff434a995 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9f15bad754cc40e3a8f843ba8bd1a727', 'request_id': 'req-12c6294b-b153-4754-9bbf-752ff434a995'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:03:13.041288 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-12c6294b-b153-4754-9bbf-752ff434a995 admin admin] The token cache is being invalidate because project 9f15bad754cc40e3a8f843ba8bd1a727 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81592) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 18:03:13.041700 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-12c6294b-b153-4754-9bbf-752ff434a995 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:03:13.042267 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-12c6294b-b153-4754-9bbf-752ff434a995 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:03:13.048897 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1116/2252] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Sep 15 18:03:12 2022] DELETE /identity/v3/projects/9f15bad754cc40e3a8f843ba8bd1a727 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 15 18:03:13.050582 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e9998e-723b-4666-a7ac-223a4989bfd1 None None] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:03:13.051050 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e9998e-723b-4666-a7ac-223a4989bfd1 None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:03:13.051460 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e9998e-723b-4666-a7ac-223a4989bfd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:03:13.071541 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade54baf-18da-4b2d-8612-4d3b45d758b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:03:13.072321 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade54baf-18da-4b2d-8612-4d3b45d758b0 admin admin] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:03:13.072763 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade54baf-18da-4b2d-8612-4d3b45d758b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:03:13.073160 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade54baf-18da-4b2d-8612-4d3b45d758b0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:03:13.083499 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade54baf-18da-4b2d-8612-4d3b45d758b0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:03:13.083499 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade54baf-18da-4b2d-8612-4d3b45d758b0 admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:03:13.084272 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.auth.core [None req-60e9998e-723b-4666-a7ac-223a4989bfd1 None None] MFA Rules not processed for user `5cfa58ef86774ab7800bf91930bf6028`. Rule list: `[]` (Enabled: `True`). {{(pid=81592) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 18:03:13.084499 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-60e9998e-723b-4666-a7ac-223a4989bfd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:03:13.097335 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1117/2253] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 15 18:03:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 18:03:13.106420 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6114940-0ff3-4ba2-b259-3a14bd7d8c80 None None] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:03:13.109557 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6114940-0ff3-4ba2-b259-3a14bd7d8c80 None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:03:13.110227 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6114940-0ff3-4ba2-b259-3a14bd7d8c80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:03:13.135310 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.auth.core [None req-c6114940-0ff3-4ba2-b259-3a14bd7d8c80 None None] MFA Rules not processed for user `5cfa58ef86774ab7800bf91930bf6028`. Rule list: `[]` (Enabled: `True`). {{(pid=81592) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 18:03:13.137126 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-c6114940-0ff3-4ba2-b259-3a14bd7d8c80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:03:13.144872 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1137/2254] 10.222.0.25 () {60 vars in 1153 bytes} [Thu Sep 15 18:03:12 2022] POST /identity/v3/projects => generated 385 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 18:03:13.147107 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade54baf-18da-4b2d-8612-4d3b45d758b0 admin admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:03:13.149887 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-ade54baf-18da-4b2d-8612-4d3b45d758b0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:03:13.156716 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1118/2255] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 15 18:03:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 18:03:13.157997 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6114940-0ff3-4ba2-b259-3a14bd7d8c80 None None] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:03:13.174283 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6114940-0ff3-4ba2-b259-3a14bd7d8c80 None None] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:03:13.174625 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 18:03:13.261977 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a2f636-95e0-4334-be96-3f7f09987f4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:03:13.262670 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a2f636-95e0-4334-be96-3f7f09987f4b admin admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:03:13.263182 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a2f636-95e0-4334-be96-3f7f09987f4b admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:03:13.265483 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a2f636-95e0-4334-be96-3f7f09987f4b admin admin] PATH_INFO: `/v3/domains` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:03:13.265483 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a2f636-95e0-4334-be96-3f7f09987f4b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81592) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 18:03:13.265483 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a2f636-95e0-4334-be96-3f7f09987f4b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:03:13.266501 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a2f636-95e0-4334-be96-3f7f09987f4b admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:03:13.281009 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade54baf-18da-4b2d-8612-4d3b45d758b0 admin admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:03:13.284825 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1119/2256] 10.222.0.25 () {58 vars in 1153 bytes} [Thu Sep 15 18:03:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 18:03:13.286054 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a2f636-95e0-4334-be96-3f7f09987f4b admin admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:03:13.289793 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e393e43-97eb-4ecf-bfde-3ae544e8f34f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:03:13.290434 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e393e43-97eb-4ecf-bfde-3ae544e8f34f admin admin] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:03:13.290854 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e393e43-97eb-4ecf-bfde-3ae544e8f34f admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:03:13.291001 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e393e43-97eb-4ecf-bfde-3ae544e8f34f admin admin] PATH_INFO: `/v3/users` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:03:13.297564 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e393e43-97eb-4ecf-bfde-3ae544e8f34f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:03:13.297685 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 18:03:13.297786 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e393e43-97eb-4ecf-bfde-3ae544e8f34f admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:03:13.307063 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a2f636-95e0-4334-be96-3f7f09987f4b admin admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:03:13.312833 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6595cc0-b772-48b8-b80d-cb1947043783 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:03:13.313488 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6595cc0-b772-48b8-b80d-cb1947043783 admin admin] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:03:13.313765 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6595cc0-b772-48b8-b80d-cb1947043783 admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:03:13.314182 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6595cc0-b772-48b8-b80d-cb1947043783 admin admin] PATH_INFO: `/v3/projects` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:03:13.314818 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6595cc0-b772-48b8-b80d-cb1947043783 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:03:13.317872 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6595cc0-b772-48b8-b80d-cb1947043783 admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:03:13.318104 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1138/2257] 10.222.0.25 () {60 vars in 1144 bytes} [Thu Sep 15 18:03:13 2022] POST /identity/v3/users => generated 299 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 18:03:13.318214 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e393e43-97eb-4ecf-bfde-3ae544e8f34f admin admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:03:13.319806 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-5e393e43-97eb-4ecf-bfde-3ae544e8f34f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:03:13.349551 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1120/2258] 10.222.0.25 () {60 vars in 1153 bytes} [Thu Sep 15 18:03:13 2022] POST /identity/v3/projects => generated 383 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 15 18:03:13.350381 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6595cc0-b772-48b8-b80d-cb1947043783 admin admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:03:13.382388 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e393e43-97eb-4ecf-bfde-3ae544e8f34f admin admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:03:13.416854 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6595cc0-b772-48b8-b80d-cb1947043783 admin admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:03:13.421711 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba7cd93-87a4-453b-aba3-d0e2c3c16a5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:03:13.422295 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba7cd93-87a4-453b-aba3-d0e2c3c16a5b admin admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:03:13.422579 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba7cd93-87a4-453b-aba3-d0e2c3c16a5b admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:03:13.422847 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba7cd93-87a4-453b-aba3-d0e2c3c16a5b admin admin] PATH_INFO: `/v3/roles` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:03:13.423526 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba7cd93-87a4-453b-aba3-d0e2c3c16a5b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:03:13.425177 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba7cd93-87a4-453b-aba3-d0e2c3c16a5b admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:03:13.441255 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1121/2259] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Sep 15 18:03:13 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 18:03:13.441255 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba7cd93-87a4-453b-aba3-d0e2c3c16a5b admin admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:03:13.446257 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5aee15-1fb1-4403-bc23-4e58c4dcd4a5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b232e7a841145ba93c6d8462ccb751a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1213c0d1b584404ba3998e136f166e89', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:03:13.446868 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5aee15-1fb1-4403-bc23-4e58c4dcd4a5 service cinder] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:03:13.447143 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5aee15-1fb1-4403-bc23-4e58c4dcd4a5 service cinder] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:03:13.447411 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5aee15-1fb1-4403-bc23-4e58c4dcd4a5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:03:13.449154 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-bd5aee15-1fb1-4403-bc23-4e58c4dcd4a5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:03:13.449700 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba7cd93-87a4-453b-aba3-d0e2c3c16a5b admin admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:03:13.455174 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e33888a-7462-470e-89eb-98cec3488a94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:03:13.455766 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e33888a-7462-470e-89eb-98cec3488a94 admin admin] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:03:13.456047 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e33888a-7462-470e-89eb-98cec3488a94 admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:03:13.456327 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e33888a-7462-470e-89eb-98cec3488a94 admin admin] PATH_INFO: `/v3/users` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:03:13.456976 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e33888a-7462-470e-89eb-98cec3488a94 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:03:13.458919 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e33888a-7462-470e-89eb-98cec3488a94 admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:03:13.483837 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1122/2260] 10.222.0.25 () {60 vars in 1144 bytes} [Thu Sep 15 18:03:13 2022] POST /identity/v3/users => generated 292 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 18:03:13.484908 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e33888a-7462-470e-89eb-98cec3488a94 admin admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:03:13.494803 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e33888a-7462-470e-89eb-98cec3488a94 admin admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:03:13.500191 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6110a7-19d3-432b-9d17-45ab2978831d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:03:13.501090 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6110a7-19d3-432b-9d17-45ab2978831d admin admin] REQUEST_METHOD: `PUT` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:03:13.501408 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6110a7-19d3-432b-9d17-45ab2978831d admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:03:13.501681 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6110a7-19d3-432b-9d17-45ab2978831d admin admin] PATH_INFO: `/v3/projects/13c8b1aa100841cda22a4233e2aba845/users/2a7601305407452eb1fe4da2b091b2ad/roles/a9e42be86923434f8af52d3fc07fb4f7` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:03:13.519329 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6110a7-19d3-432b-9d17-45ab2978831d admin admin] RBAC: Authorizing `identity:create_grant(project_id=13c8b1aa100841cda22a4233e2aba845, user_id=2a7601305407452eb1fe4da2b091b2ad, role_id=a9e42be86923434f8af52d3fc07fb4f7)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:03:13.520975 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd5aee15-1fb1-4403-bc23-4e58c4dcd4a5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:03:13.522036 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6110a7-19d3-432b-9d17-45ab2978831d admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:03:13.523115 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd5aee15-1fb1-4403-bc23-4e58c4dcd4a5 service cinder] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:03:13.534493 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1139/2261] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 15 18:03:13 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 217 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 18:03:13.535411 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5aee15-1fb1-4403-bc23-4e58c4dcd4a5 service cinder] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:03:13.546073 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1123/2262] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Sep 15 18:03:13 2022] PUT /identity/v3/projects/13c8b1aa100841cda22a4233e2aba845/users/2a7601305407452eb1fe4da2b091b2ad/roles/a9e42be86923434f8af52d3fc07fb4f7 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 18:03:13.550582 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5aee15-1fb1-4403-bc23-4e58c4dcd4a5 service cinder] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:03:13.550716 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6110a7-19d3-432b-9d17-45ab2978831d admin admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:03:13.556569 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 18:03:13.631989 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6110a7-19d3-432b-9d17-45ab2978831d admin admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:03:13.632373 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da334f0c-b4d2-476a-a34f-2841f30c75e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:03:13.633010 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da334f0c-b4d2-476a-a34f-2841f30c75e0 admin admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:03:13.633335 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da334f0c-b4d2-476a-a34f-2841f30c75e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:03:13.633628 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da334f0c-b4d2-476a-a34f-2841f30c75e0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:03:13.634351 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da334f0c-b4d2-476a-a34f-2841f30c75e0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:03:13.636033 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da334f0c-b4d2-476a-a34f-2841f30c75e0 admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:03:13.637372 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dbcfa69-eafd-4e4f-9f54-7e5a2426cc84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:03:13.638013 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbcfa69-eafd-4e4f-9f54-7e5a2426cc84 admin admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:03:13.638293 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbcfa69-eafd-4e4f-9f54-7e5a2426cc84 admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:03:13.638625 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbcfa69-eafd-4e4f-9f54-7e5a2426cc84 admin admin] PATH_INFO: `/v3/roles` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:03:13.639276 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dbcfa69-eafd-4e4f-9f54-7e5a2426cc84 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:03:13.640864 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dbcfa69-eafd-4e4f-9f54-7e5a2426cc84 admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:03:13.650804 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1140/2263] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Sep 15 18:03:13 2022] GET /identity/v3/roles => generated 1420 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 18:03:13.653356 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1124/2264] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Sep 15 18:03:13 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 18:03:13.657711 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da334f0c-b4d2-476a-a34f-2841f30c75e0 admin admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:03:13.658705 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dbcfa69-eafd-4e4f-9f54-7e5a2426cc84 admin admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:03:13.669662 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da334f0c-b4d2-476a-a34f-2841f30c75e0 admin admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:03:13.672118 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dbcfa69-eafd-4e4f-9f54-7e5a2426cc84 admin admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:03:13.679004 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a390ebc2-8df0-4e91-82f7-9b9de79128cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:03:13.679654 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a390ebc2-8df0-4e91-82f7-9b9de79128cd admin admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:03:13.679955 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a390ebc2-8df0-4e91-82f7-9b9de79128cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:03:13.680209 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a390ebc2-8df0-4e91-82f7-9b9de79128cd admin admin] PATH_INFO: `/v3/roles` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:03:13.680862 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a390ebc2-8df0-4e91-82f7-9b9de79128cd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:03:13.682468 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3e1ee8-2ab3-46d0-ba25-61893f1ddf38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:03:13.682630 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a390ebc2-8df0-4e91-82f7-9b9de79128cd admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:03:13.682999 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3e1ee8-2ab3-46d0-ba25-61893f1ddf38 admin admin] REQUEST_METHOD: `PUT` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:03:13.683293 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3e1ee8-2ab3-46d0-ba25-61893f1ddf38 admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:03:13.683726 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3e1ee8-2ab3-46d0-ba25-61893f1ddf38 admin admin] PATH_INFO: `/v3/projects/13c8b1aa100841cda22a4233e2aba845/users/2a7601305407452eb1fe4da2b091b2ad/roles/a9e42be86923434f8af52d3fc07fb4f7` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:03:13.686614 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c3e1ee8-2ab3-46d0-ba25-61893f1ddf38 admin admin] RBAC: Authorizing `identity:create_grant(project_id=13c8b1aa100841cda22a4233e2aba845, user_id=2a7601305407452eb1fe4da2b091b2ad, role_id=a9e42be86923434f8af52d3fc07fb4f7)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:03:13.689535 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c3e1ee8-2ab3-46d0-ba25-61893f1ddf38 admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:03:13.702338 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1125/2265] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Sep 15 18:03:13 2022] PUT /identity/v3/projects/13c8b1aa100841cda22a4233e2aba845/users/2a7601305407452eb1fe4da2b091b2ad/roles/a9e42be86923434f8af52d3fc07fb4f7 => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 18:03:13.704906 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1141/2266] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Sep 15 18:03:13 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 18:03:13.709217 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3e1ee8-2ab3-46d0-ba25-61893f1ddf38 admin admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:03:13.713642 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6542c0d6-db4d-42d0-8e6e-61e370b22206 None None] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:03:13.713998 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6542c0d6-db4d-42d0-8e6e-61e370b22206 None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:03:13.714343 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6542c0d6-db4d-42d0-8e6e-61e370b22206 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:03:13.739497 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 18:03:13.753526 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.auth.core [None req-6542c0d6-db4d-42d0-8e6e-61e370b22206 None None] MFA Rules not processed for user `2a7601305407452eb1fe4da2b091b2ad`. Rule list: `[]` (Enabled: `True`). {{(pid=81593) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 18:03:13.755015 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-6542c0d6-db4d-42d0-8e6e-61e370b22206 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:03:13.845796 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3e1ee8-2ab3-46d0-ba25-61893f1ddf38 admin admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:03:13.860804 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1142/2267] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 15 18:03:13 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 18:03:13.876974 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2bffe37-c3c9-4ccb-956f-40ee743bb750 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:03:13.877709 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bffe37-c3c9-4ccb-956f-40ee743bb750 admin admin] REQUEST_METHOD: `PUT` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:03:13.877999 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bffe37-c3c9-4ccb-956f-40ee743bb750 admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:03:13.878277 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bffe37-c3c9-4ccb-956f-40ee743bb750 admin admin] PATH_INFO: `/v3/projects/c7af0dc2cf684e8d866d6e87c9f6f1a3/users/691214b96c504115af716508e3c54631/roles/343cc8b1bc7243eebabdf08147e8366d` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:03:13.910946 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2bffe37-c3c9-4ccb-956f-40ee743bb750 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c7af0dc2cf684e8d866d6e87c9f6f1a3, user_id=691214b96c504115af716508e3c54631, role_id=343cc8b1bc7243eebabdf08147e8366d)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:03:13.915087 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2bffe37-c3c9-4ccb-956f-40ee743bb750 admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:03:13.955922 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1126/2268] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Sep 15 18:03:13 2022] PUT /identity/v3/projects/c7af0dc2cf684e8d866d6e87c9f6f1a3/users/691214b96c504115af716508e3c54631/roles/343cc8b1bc7243eebabdf08147e8366d => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 15 18:03:13.966934 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5c3e7a-e5b1-4d2d-8d77-3da775152de1 None None] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:03:13.967468 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5c3e7a-e5b1-4d2d-8d77-3da775152de1 None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:03:13.967785 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5c3e7a-e5b1-4d2d-8d77-3da775152de1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:03:13.971692 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2bffe37-c3c9-4ccb-956f-40ee743bb750 admin admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:03:13.973836 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-c2bffe37-c3c9-4ccb-956f-40ee743bb750 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:03:14.015580 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.auth.core [None req-ea5c3e7a-e5b1-4d2d-8d77-3da775152de1 None None] MFA Rules not processed for user `691214b96c504115af716508e3c54631`. Rule list: `[]` (Enabled: `True`). {{(pid=81593) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 18:03:14.017381 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-ea5c3e7a-e5b1-4d2d-8d77-3da775152de1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:03:14.070707 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2bffe37-c3c9-4ccb-956f-40ee743bb750 admin admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:03:14.075197 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b34427-6fac-45ed-9770-2ef62eb88593 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b232e7a841145ba93c6d8462ccb751a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1213c0d1b584404ba3998e136f166e89', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:03:14.075961 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b34427-6fac-45ed-9770-2ef62eb88593 service cinder] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:03:14.076362 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b34427-6fac-45ed-9770-2ef62eb88593 service cinder] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:03:14.076684 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b34427-6fac-45ed-9770-2ef62eb88593 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:03:14.078622 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-63b34427-6fac-45ed-9770-2ef62eb88593 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:03:14.101141 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1143/2269] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 15 18:03:13 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 18:03:14.105741 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5c3e7a-e5b1-4d2d-8d77-3da775152de1 None None] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:03:14.117519 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 18:03:14.165037 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b34427-6fac-45ed-9770-2ef62eb88593 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:03:14.167088 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b34427-6fac-45ed-9770-2ef62eb88593 service cinder] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:03:14.180703 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1127/2270] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 15 18:03:13 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 210 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 15 18:03:14.190248 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5c3e7a-e5b1-4d2d-8d77-3da775152de1 None None] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:03:14.195285 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63f6cae-8efb-43c5-9a10-9f76a0c27109 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:03:14.195903 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63f6cae-8efb-43c5-9a10-9f76a0c27109 admin admin] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:03:14.196186 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63f6cae-8efb-43c5-9a10-9f76a0c27109 admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:03:14.196469 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63f6cae-8efb-43c5-9a10-9f76a0c27109 admin admin] PATH_INFO: `/v3/projects` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:03:14.197110 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d63f6cae-8efb-43c5-9a10-9f76a0c27109 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:03:14.199070 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d63f6cae-8efb-43c5-9a10-9f76a0c27109 admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:03:14.229840 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1144/2271] 10.222.0.25 () {60 vars in 1153 bytes} [Thu Sep 15 18:03:14 2022] POST /identity/v3/projects => generated 383 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 15 18:03:14.235517 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b34427-6fac-45ed-9770-2ef62eb88593 service cinder] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:03:14.255423 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b34427-6fac-45ed-9770-2ef62eb88593 service cinder] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:03:14.334663 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 18:03:14.353185 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57469c2-7d53-4909-bef9-4a5da8b2ac29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:03:14.353952 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57469c2-7d53-4909-bef9-4a5da8b2ac29 admin admin] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:03:14.354202 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57469c2-7d53-4909-bef9-4a5da8b2ac29 admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:03:14.354465 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57469c2-7d53-4909-bef9-4a5da8b2ac29 admin admin] PATH_INFO: `/v3/users` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:03:14.355106 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d57469c2-7d53-4909-bef9-4a5da8b2ac29 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:03:14.357607 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d57469c2-7d53-4909-bef9-4a5da8b2ac29 admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:03:14.389426 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1128/2272] 10.222.0.25 () {60 vars in 1144 bytes} [Thu Sep 15 18:03:14 2022] POST /identity/v3/users => generated 292 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 18:03:14.401339 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63f6cae-8efb-43c5-9a10-9f76a0c27109 admin admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:03:14.416469 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63f6cae-8efb-43c5-9a10-9f76a0c27109 admin admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:03:14.421631 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62013365-cd6a-4642-a72c-70aca250ae31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:03:14.422252 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62013365-cd6a-4642-a72c-70aca250ae31 admin admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:03:14.422530 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62013365-cd6a-4642-a72c-70aca250ae31 admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:03:14.422802 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62013365-cd6a-4642-a72c-70aca250ae31 admin admin] PATH_INFO: `/v3/roles` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:03:14.423459 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62013365-cd6a-4642-a72c-70aca250ae31 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:03:14.425098 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62013365-cd6a-4642-a72c-70aca250ae31 admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:03:14.436305 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1145/2273] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Sep 15 18:03:14 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 18:03:14.443350 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57469c2-7d53-4909-bef9-4a5da8b2ac29 admin admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:03:14.454578 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57469c2-7d53-4909-bef9-4a5da8b2ac29 admin admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:03:14.457352 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62013365-cd6a-4642-a72c-70aca250ae31 admin admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:03:14.460814 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e82c19-9b08-4cba-9da4-0febf2b22ef8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:03:14.461402 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e82c19-9b08-4cba-9da4-0febf2b22ef8 admin admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:03:14.461802 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e82c19-9b08-4cba-9da4-0febf2b22ef8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:03:14.462065 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e82c19-9b08-4cba-9da4-0febf2b22ef8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:03:14.463272 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e82c19-9b08-4cba-9da4-0febf2b22ef8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:03:14.465819 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e82c19-9b08-4cba-9da4-0febf2b22ef8 admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:03:14.481901 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1129/2274] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Sep 15 18:03:14 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 18:03:14.484150 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e82c19-9b08-4cba-9da4-0febf2b22ef8 admin admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:03:14.496930 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e82c19-9b08-4cba-9da4-0febf2b22ef8 admin admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:03:14.508384 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d3a77b-4e6e-40de-92db-692257565f6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:03:14.509053 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d3a77b-4e6e-40de-92db-692257565f6e admin admin] REQUEST_METHOD: `PUT` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:03:14.509357 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d3a77b-4e6e-40de-92db-692257565f6e admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:03:14.509670 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d3a77b-4e6e-40de-92db-692257565f6e admin admin] PATH_INFO: `/v3/projects/7bc958b7988d4e8bb9ca7953ea98cfce/users/f2fb8ea8058d43abbc459df6003eb31d/roles/343cc8b1bc7243eebabdf08147e8366d` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:03:14.547894 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d3a77b-4e6e-40de-92db-692257565f6e admin admin] RBAC: Authorizing `identity:create_grant(project_id=7bc958b7988d4e8bb9ca7953ea98cfce, user_id=f2fb8ea8058d43abbc459df6003eb31d, role_id=343cc8b1bc7243eebabdf08147e8366d)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:03:14.551164 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d3a77b-4e6e-40de-92db-692257565f6e admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:03:14.556529 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62013365-cd6a-4642-a72c-70aca250ae31 admin admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:03:14.560960 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d053f751-5420-40f2-8212-af7cfa79940f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b232e7a841145ba93c6d8462ccb751a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1213c0d1b584404ba3998e136f166e89', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:03:14.561700 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d053f751-5420-40f2-8212-af7cfa79940f service cinder] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:03:14.561967 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d053f751-5420-40f2-8212-af7cfa79940f service cinder] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:03:14.562224 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d053f751-5420-40f2-8212-af7cfa79940f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:03:14.564031 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-d053f751-5420-40f2-8212-af7cfa79940f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:03:14.570897 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1130/2275] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Sep 15 18:03:14 2022] PUT /identity/v3/projects/7bc958b7988d4e8bb9ca7953ea98cfce/users/f2fb8ea8058d43abbc459df6003eb31d/roles/343cc8b1bc7243eebabdf08147e8366d => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 15 18:03:14.583664 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a294bf1-24ef-4629-a406-c615b2cf0303 None None] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:03:14.583950 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a294bf1-24ef-4629-a406-c615b2cf0303 None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:03:14.584227 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a294bf1-24ef-4629-a406-c615b2cf0303 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:03:14.637342 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.auth.core [None req-8a294bf1-24ef-4629-a406-c615b2cf0303 None None] MFA Rules not processed for user `f2fb8ea8058d43abbc459df6003eb31d`. Rule list: `[]` (Enabled: `True`). {{(pid=81592) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 18:03:14.637342 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-8a294bf1-24ef-4629-a406-c615b2cf0303 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:03:14.660425 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d053f751-5420-40f2-8212-af7cfa79940f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:03:14.662371 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d053f751-5420-40f2-8212-af7cfa79940f service cinder] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:03:14.676858 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1146/2276] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 15 18:03:14 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 218 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 15 18:03:14.729766 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1131/2277] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 15 18:03:14 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 18:03:14.735651 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d053f751-5420-40f2-8212-af7cfa79940f service cinder] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:03:14.755090 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d053f751-5420-40f2-8212-af7cfa79940f service cinder] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:03:14.803294 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 18:03:14.844455 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe2e3b7-76e6-45bf-982f-755d5c6cc74d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:03:14.845100 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe2e3b7-76e6-45bf-982f-755d5c6cc74d admin admin] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:03:14.846228 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe2e3b7-76e6-45bf-982f-755d5c6cc74d admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:03:14.846228 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe2e3b7-76e6-45bf-982f-755d5c6cc74d admin admin] PATH_INFO: `/v3/projects` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:03:14.846476 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe2e3b7-76e6-45bf-982f-755d5c6cc74d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:03:14.848840 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe2e3b7-76e6-45bf-982f-755d5c6cc74d admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:03:14.896424 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1147/2278] 10.222.0.25 () {60 vars in 1153 bytes} [Thu Sep 15 18:03:14 2022] POST /identity/v3/projects => generated 385 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 18:03:14.902103 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a294bf1-24ef-4629-a406-c615b2cf0303 None None] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:03:14.919042 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a294bf1-24ef-4629-a406-c615b2cf0303 None None] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:03:15.010404 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3af9d82-f399-4550-8677-d7e663f7fd75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:03:15.011414 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3af9d82-f399-4550-8677-d7e663f7fd75 admin admin] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:03:15.011706 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3af9d82-f399-4550-8677-d7e663f7fd75 admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:03:15.012029 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3af9d82-f399-4550-8677-d7e663f7fd75 admin admin] PATH_INFO: `/v3/users` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:03:15.012681 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3af9d82-f399-4550-8677-d7e663f7fd75 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:03:15.015311 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3af9d82-f399-4550-8677-d7e663f7fd75 admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:03:15.040919 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1132/2279] 10.222.0.25 () {60 vars in 1144 bytes} [Thu Sep 15 18:03:14 2022] POST /identity/v3/users => generated 299 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 15 18:03:15.045557 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe2e3b7-76e6-45bf-982f-755d5c6cc74d admin admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:03:15.056782 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe2e3b7-76e6-45bf-982f-755d5c6cc74d admin admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:03:15.063021 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7be576-5939-4b7c-92a3-35116e9d340b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:03:15.063832 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7be576-5939-4b7c-92a3-35116e9d340b admin admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:03:15.064116 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7be576-5939-4b7c-92a3-35116e9d340b admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:03:15.064392 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7be576-5939-4b7c-92a3-35116e9d340b admin admin] PATH_INFO: `/v3/roles` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:03:15.065043 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd7be576-5939-4b7c-92a3-35116e9d340b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:03:15.067082 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd7be576-5939-4b7c-92a3-35116e9d340b admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:03:15.079907 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1148/2280] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Sep 15 18:03:15 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 18:03:15.084287 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3af9d82-f399-4550-8677-d7e663f7fd75 admin admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:03:15.096928 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3af9d82-f399-4550-8677-d7e663f7fd75 admin admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:03:15.101716 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ea2f19-484c-46b3-b7bd-61a5612b3352 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:03:15.102463 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ea2f19-484c-46b3-b7bd-61a5612b3352 admin admin] REQUEST_METHOD: `PUT` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:03:15.102774 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ea2f19-484c-46b3-b7bd-61a5612b3352 admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:03:15.103068 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ea2f19-484c-46b3-b7bd-61a5612b3352 admin admin] PATH_INFO: `/v3/projects/25e5ffb6a2304d28bdc784c41935b613/users/07700e7090ed4084a756f93d407fa037/roles/a9e42be86923434f8af52d3fc07fb4f7` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:03:15.118859 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ea2f19-484c-46b3-b7bd-61a5612b3352 admin admin] RBAC: Authorizing `identity:create_grant(project_id=25e5ffb6a2304d28bdc784c41935b613, user_id=07700e7090ed4084a756f93d407fa037, role_id=a9e42be86923434f8af52d3fc07fb4f7)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:03:15.121706 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ea2f19-484c-46b3-b7bd-61a5612b3352 admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:03:15.135523 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1133/2281] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Sep 15 18:03:15 2022] PUT /identity/v3/projects/25e5ffb6a2304d28bdc784c41935b613/users/07700e7090ed4084a756f93d407fa037/roles/a9e42be86923434f8af52d3fc07fb4f7 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 15 18:03:15.140366 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7be576-5939-4b7c-92a3-35116e9d340b admin admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:03:15.150506 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7be576-5939-4b7c-92a3-35116e9d340b admin admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:03:15.214928 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1c4f26-28fe-459f-bbb1-b3879027c700 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:03:15.216571 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1c4f26-28fe-459f-bbb1-b3879027c700 admin admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:03:15.217114 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1c4f26-28fe-459f-bbb1-b3879027c700 admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:03:15.217526 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1c4f26-28fe-459f-bbb1-b3879027c700 admin admin] PATH_INFO: `/v3/roles` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:03:15.218195 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1c4f26-28fe-459f-bbb1-b3879027c700 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:03:15.219832 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1c4f26-28fe-459f-bbb1-b3879027c700 admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:03:15.232577 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1149/2282] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Sep 15 18:03:15 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 18:03:15.237044 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ea2f19-484c-46b3-b7bd-61a5612b3352 admin admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:03:15.243984 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 18:03:15.249706 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ea2f19-484c-46b3-b7bd-61a5612b3352 admin admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:03:15.255242 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d023e52-eb60-431f-9d70-0b5c3e0e1a21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:03:15.255879 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d023e52-eb60-431f-9d70-0b5c3e0e1a21 admin admin] REQUEST_METHOD: `PUT` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:03:15.256156 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d023e52-eb60-431f-9d70-0b5c3e0e1a21 admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:03:15.256421 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d023e52-eb60-431f-9d70-0b5c3e0e1a21 admin admin] PATH_INFO: `/v3/projects/25e5ffb6a2304d28bdc784c41935b613/users/07700e7090ed4084a756f93d407fa037/roles/a9e42be86923434f8af52d3fc07fb4f7` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:03:15.258383 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d023e52-eb60-431f-9d70-0b5c3e0e1a21 admin admin] RBAC: Authorizing `identity:create_grant(project_id=25e5ffb6a2304d28bdc784c41935b613, user_id=07700e7090ed4084a756f93d407fa037, role_id=a9e42be86923434f8af52d3fc07fb4f7)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:03:15.261008 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d023e52-eb60-431f-9d70-0b5c3e0e1a21 admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:03:15.272386 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1134/2283] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Sep 15 18:03:15 2022] PUT /identity/v3/projects/25e5ffb6a2304d28bdc784c41935b613/users/07700e7090ed4084a756f93d407fa037/roles/a9e42be86923434f8af52d3fc07fb4f7 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 18:03:15.284268 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dea809b-cbe7-4f9d-962e-99cecbfe2efa None None] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:03:15.284557 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dea809b-cbe7-4f9d-962e-99cecbfe2efa None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:03:15.284837 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dea809b-cbe7-4f9d-962e-99cecbfe2efa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:03:15.313675 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.auth.core [None req-2dea809b-cbe7-4f9d-962e-99cecbfe2efa None None] MFA Rules not processed for user `07700e7090ed4084a756f93d407fa037`. Rule list: `[]` (Enabled: `True`). {{(pid=81593) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 18:03:15.314879 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-2dea809b-cbe7-4f9d-962e-99cecbfe2efa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:03:15.388548 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1150/2284] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 15 18:03:15 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 18:03:15.400349 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d023e52-eb60-431f-9d70-0b5c3e0e1a21 admin admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:03:15.462770 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d023e52-eb60-431f-9d70-0b5c3e0e1a21 admin admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:03:15.466575 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef4d030-5574-4669-a7fe-4ee01f1e340e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b232e7a841145ba93c6d8462ccb751a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1213c0d1b584404ba3998e136f166e89', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:03:15.467114 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef4d030-5574-4669-a7fe-4ee01f1e340e service cinder] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:03:15.467390 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef4d030-5574-4669-a7fe-4ee01f1e340e service cinder] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:03:15.467659 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef4d030-5574-4669-a7fe-4ee01f1e340e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:03:15.530154 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef4d030-5574-4669-a7fe-4ee01f1e340e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:03:15.531654 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef4d030-5574-4669-a7fe-4ee01f1e340e service cinder] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:03:15.540915 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1135/2285] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 15 18:03:15 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 18:03:16.887505 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dea809b-cbe7-4f9d-962e-99cecbfe2efa None None] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:03:16.898319 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dea809b-cbe7-4f9d-962e-99cecbfe2efa None None] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:03:16.901894 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57345157-88fd-45c7-87e3-bad217e87851 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b232e7a841145ba93c6d8462ccb751a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1213c0d1b584404ba3998e136f166e89', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:03:16.902512 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57345157-88fd-45c7-87e3-bad217e87851 service cinder] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:03:16.902789 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57345157-88fd-45c7-87e3-bad217e87851 service cinder] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:03:16.903059 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57345157-88fd-45c7-87e3-bad217e87851 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:03:16.904785 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-57345157-88fd-45c7-87e3-bad217e87851 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:03:16.933863 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 18:03:16.968408 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57345157-88fd-45c7-87e3-bad217e87851 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:03:16.969918 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57345157-88fd-45c7-87e3-bad217e87851 service cinder] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:03:16.978977 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1151/2286] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 15 18:03:16 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 18:03:17.987962 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef4d030-5574-4669-a7fe-4ee01f1e340e service cinder] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:03:18.006972 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef4d030-5574-4669-a7fe-4ee01f1e340e service cinder] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:03:18.011193 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5023322f-2a7e-4d4c-810c-71d3020d2fa2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b232e7a841145ba93c6d8462ccb751a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1213c0d1b584404ba3998e136f166e89', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:03:18.011972 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5023322f-2a7e-4d4c-810c-71d3020d2fa2 service cinder] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:03:18.012254 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5023322f-2a7e-4d4c-810c-71d3020d2fa2 service cinder] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:03:18.012522 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5023322f-2a7e-4d4c-810c-71d3020d2fa2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:03:18.014406 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-5023322f-2a7e-4d4c-810c-71d3020d2fa2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:03:18.099350 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5023322f-2a7e-4d4c-810c-71d3020d2fa2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:03:18.100858 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5023322f-2a7e-4d4c-810c-71d3020d2fa2 service cinder] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:03:18.123655 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1136/2287] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 15 18:03:17 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 18:03:18.318369 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57345157-88fd-45c7-87e3-bad217e87851 service cinder] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:03:18.327289 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57345157-88fd-45c7-87e3-bad217e87851 service cinder] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:03:18.333070 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250b1b64-8f8b-40c2-a717-5681633b6cbf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b232e7a841145ba93c6d8462ccb751a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1213c0d1b584404ba3998e136f166e89', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:03:18.333854 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250b1b64-8f8b-40c2-a717-5681633b6cbf service cinder] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:03:18.334135 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250b1b64-8f8b-40c2-a717-5681633b6cbf service cinder] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:03:18.334531 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250b1b64-8f8b-40c2-a717-5681633b6cbf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:03:18.409563 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250b1b64-8f8b-40c2-a717-5681633b6cbf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:03:18.411077 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250b1b64-8f8b-40c2-a717-5681633b6cbf service cinder] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:03:18.420885 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1152/2288] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 15 18:03:18 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 18:03:19.125526 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5023322f-2a7e-4d4c-810c-71d3020d2fa2 service cinder] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:03:19.136418 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5023322f-2a7e-4d4c-810c-71d3020d2fa2 service cinder] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:03:19.142228 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d013564-1c28-4fda-959c-2b8d707b2dcc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b232e7a841145ba93c6d8462ccb751a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1213c0d1b584404ba3998e136f166e89', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:03:19.143260 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d013564-1c28-4fda-959c-2b8d707b2dcc service cinder] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:03:19.143648 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d013564-1c28-4fda-959c-2b8d707b2dcc service cinder] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:03:19.143983 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d013564-1c28-4fda-959c-2b8d707b2dcc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:03:19.154121 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d013564-1c28-4fda-959c-2b8d707b2dcc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:03:19.155695 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d013564-1c28-4fda-959c-2b8d707b2dcc service cinder] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:03:19.164995 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1137/2289] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 15 18:03:19 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 18:03:19.429731 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250b1b64-8f8b-40c2-a717-5681633b6cbf service cinder] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:03:19.443690 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250b1b64-8f8b-40c2-a717-5681633b6cbf service cinder] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:03:19.448149 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd319f2-9d28-42e4-9d8d-d5ebd157f981 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b232e7a841145ba93c6d8462ccb751a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1213c0d1b584404ba3998e136f166e89', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:03:19.448945 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd319f2-9d28-42e4-9d8d-d5ebd157f981 service cinder] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:03:19.449325 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd319f2-9d28-42e4-9d8d-d5ebd157f981 service cinder] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:03:19.449693 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd319f2-9d28-42e4-9d8d-d5ebd157f981 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:03:19.530587 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd319f2-9d28-42e4-9d8d-d5ebd157f981 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:03:19.532160 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd319f2-9d28-42e4-9d8d-d5ebd157f981 service cinder] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:03:19.549818 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1153/2290] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 15 18:03:19 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 18:03:19.806170 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d013564-1c28-4fda-959c-2b8d707b2dcc service cinder] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:03:19.807862 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-6d013564-1c28-4fda-959c-2b8d707b2dcc service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:03:19.881045 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 18:03:19.941277 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d013564-1c28-4fda-959c-2b8d707b2dcc service cinder] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:03:19.946116 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647e5fd9-7214-436d-990b-c9d6e0de8ae7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:03:19.946786 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647e5fd9-7214-436d-990b-c9d6e0de8ae7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:03:19.947157 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647e5fd9-7214-436d-990b-c9d6e0de8ae7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:03:19.947436 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647e5fd9-7214-436d-990b-c9d6e0de8ae7 admin admin] PATH_INFO: `/v3/users/f0c3bb005dd64483b472b47558c3f89b` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:03:19.948662 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-647e5fd9-7214-436d-990b-c9d6e0de8ae7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f0c3bb005dd64483b472b47558c3f89b)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:03:19.951339 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-647e5fd9-7214-436d-990b-c9d6e0de8ae7 admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:03:20.017044 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-647e5fd9-7214-436d-990b-c9d6e0de8ae7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f0c3bb005dd64483b472b47558c3f89b'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:03:20.025403 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-647e5fd9-7214-436d-990b-c9d6e0de8ae7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f0c3bb005dd64483b472b47558c3f89b'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:03:20.026231 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-647e5fd9-7214-436d-990b-c9d6e0de8ae7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f0c3bb005dd64483b472b47558c3f89b'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:03:20.027192 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-647e5fd9-7214-436d-990b-c9d6e0de8ae7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f0c3bb005dd64483b472b47558c3f89b'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:03:20.034880 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-647e5fd9-7214-436d-990b-c9d6e0de8ae7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f0c3bb005dd64483b472b47558c3f89b'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:03:20.055213 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1138/2291] 10.222.0.25 () {58 vars in 1224 bytes} [Thu Sep 15 18:03:19 2022] DELETE /identity/v3/users/f0c3bb005dd64483b472b47558c3f89b => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 18:03:20.060657 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37c20f6-af11-48d5-af63-7e5f18598679 None None] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:03:20.061165 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37c20f6-af11-48d5-af63-7e5f18598679 None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:03:20.061403 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37c20f6-af11-48d5-af63-7e5f18598679 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:03:20.081712 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.auth.core [None req-f37c20f6-af11-48d5-af63-7e5f18598679 None None] MFA Rules not processed for user `5cfa58ef86774ab7800bf91930bf6028`. Rule list: `[]` (Enabled: `True`). {{(pid=81593) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 18:03:20.082929 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-f37c20f6-af11-48d5-af63-7e5f18598679 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:03:20.154800 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 18:03:20.166075 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1154/2292] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 15 18:03:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 18:03:20.177490 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647e5fd9-7214-436d-990b-c9d6e0de8ae7 admin admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:03:20.179092 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-647e5fd9-7214-436d-990b-c9d6e0de8ae7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:03:20.185826 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37c20f6-af11-48d5-af63-7e5f18598679 None None] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:03:20.187399 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-f37c20f6-af11-48d5-af63-7e5f18598679 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:03:20.200638 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37c20f6-af11-48d5-af63-7e5f18598679 None None] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:03:20.205322 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3ba867-aa6d-4cd7-8354-c07b5f0a6f90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:03:20.205965 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3ba867-aa6d-4cd7-8354-c07b5f0a6f90 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:03:20.206240 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3ba867-aa6d-4cd7-8354-c07b5f0a6f90 admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:03:20.206509 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3ba867-aa6d-4cd7-8354-c07b5f0a6f90 admin admin] PATH_INFO: `/v3/users/8ba5073dd8df48599413c76ea587bcd1` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:03:20.207645 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c3ba867-aa6d-4cd7-8354-c07b5f0a6f90 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8ba5073dd8df48599413c76ea587bcd1)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:03:20.209693 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c3ba867-aa6d-4cd7-8354-c07b5f0a6f90 admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:03:20.248260 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647e5fd9-7214-436d-990b-c9d6e0de8ae7 admin admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:03:20.253092 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88cae82-88be-454a-905f-a7c01c0954f9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a32274b4781b40fea9f28da8a9bde5ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1213c0d1b584404ba3998e136f166e89', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:03:20.254083 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88cae82-88be-454a-905f-a7c01c0954f9 service neutron] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:03:20.254727 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88cae82-88be-454a-905f-a7c01c0954f9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:03:20.255375 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88cae82-88be-454a-905f-a7c01c0954f9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:03:20.260254 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-6c3ba867-aa6d-4cd7-8354-c07b5f0a6f90 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8ba5073dd8df48599413c76ea587bcd1'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:03:20.267189 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e88cae82-88be-454a-905f-a7c01c0954f9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:03:20.268209 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-6c3ba867-aa6d-4cd7-8354-c07b5f0a6f90 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8ba5073dd8df48599413c76ea587bcd1'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:03:20.268767 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e88cae82-88be-454a-905f-a7c01c0954f9 service neutron] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:03:20.269160 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-6c3ba867-aa6d-4cd7-8354-c07b5f0a6f90 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8ba5073dd8df48599413c76ea587bcd1'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:03:20.269824 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-6c3ba867-aa6d-4cd7-8354-c07b5f0a6f90 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8ba5073dd8df48599413c76ea587bcd1'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:03:20.277281 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-6c3ba867-aa6d-4cd7-8354-c07b5f0a6f90 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8ba5073dd8df48599413c76ea587bcd1'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:03:20.278721 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1139/2293] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 15 18:03:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 18:03:20.305870 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1155/2294] 10.222.0.25 () {58 vars in 1224 bytes} [Thu Sep 15 18:03:20 2022] DELETE /identity/v3/users/8ba5073dd8df48599413c76ea587bcd1 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 15 18:03:20.316311 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a3eb3c-23fb-48cf-b4a7-3664d6bca46d None None] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:03:20.316572 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a3eb3c-23fb-48cf-b4a7-3664d6bca46d None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:03:20.317114 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a3eb3c-23fb-48cf-b4a7-3664d6bca46d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:03:20.341604 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.auth.core [None req-13a3eb3c-23fb-48cf-b4a7-3664d6bca46d None None] MFA Rules not processed for user `5cfa58ef86774ab7800bf91930bf6028`. Rule list: `[]` (Enabled: `True`). {{(pid=81592) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 18:03:20.343458 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-13a3eb3c-23fb-48cf-b4a7-3664d6bca46d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:03:20.413267 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 18:03:20.443147 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1140/2295] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 15 18:03:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 18:03:20.456317 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3ba867-aa6d-4cd7-8354-c07b5f0a6f90 admin admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:03:20.458742 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-6c3ba867-aa6d-4cd7-8354-c07b5f0a6f90 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:03:20.552069 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3ba867-aa6d-4cd7-8354-c07b5f0a6f90 admin admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:03:20.556562 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45fc80f2-ab81-49f3-85bc-aa2d4c07cdd8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a32274b4781b40fea9f28da8a9bde5ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1213c0d1b584404ba3998e136f166e89', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:03:20.557512 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fc80f2-ab81-49f3-85bc-aa2d4c07cdd8 service neutron] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:03:20.557851 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fc80f2-ab81-49f3-85bc-aa2d4c07cdd8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:03:20.558288 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fc80f2-ab81-49f3-85bc-aa2d4c07cdd8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:03:20.569711 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45fc80f2-ab81-49f3-85bc-aa2d4c07cdd8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:03:20.571280 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45fc80f2-ab81-49f3-85bc-aa2d4c07cdd8 service neutron] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:03:20.600013 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1156/2296] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 15 18:03:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 15 18:03:20.758613 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a3eb3c-23fb-48cf-b4a7-3664d6bca46d None None] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:03:20.760233 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-13a3eb3c-23fb-48cf-b4a7-3664d6bca46d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:03:20.772160 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a3eb3c-23fb-48cf-b4a7-3664d6bca46d None None] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:03:20.777603 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c74ad6-103d-46a5-9d25-a33f1ae7df6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:03:20.778954 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c74ad6-103d-46a5-9d25-a33f1ae7df6c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:03:20.779285 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c74ad6-103d-46a5-9d25-a33f1ae7df6c admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:03:20.779564 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c74ad6-103d-46a5-9d25-a33f1ae7df6c admin admin] PATH_INFO: `/v3/projects/020ee7da4b5140ab847068464de9e174` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:03:20.780863 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c74ad6-103d-46a5-9d25-a33f1ae7df6c admin admin] RBAC: Authorizing `identity:delete_project(project_id=020ee7da4b5140ab847068464de9e174)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:03:20.782999 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c74ad6-103d-46a5-9d25-a33f1ae7df6c admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:03:20.856299 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-c3c74ad6-103d-46a5-9d25-a33f1ae7df6c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '020ee7da4b5140ab847068464de9e174', 'request_id': 'req-c3c74ad6-103d-46a5-9d25-a33f1ae7df6c'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:03:20.862647 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-c3c74ad6-103d-46a5-9d25-a33f1ae7df6c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '020ee7da4b5140ab847068464de9e174', 'request_id': 'req-c3c74ad6-103d-46a5-9d25-a33f1ae7df6c'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:03:20.870836 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-c3c74ad6-103d-46a5-9d25-a33f1ae7df6c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '020ee7da4b5140ab847068464de9e174', 'request_id': 'req-c3c74ad6-103d-46a5-9d25-a33f1ae7df6c'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:03:20.884667 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-c3c74ad6-103d-46a5-9d25-a33f1ae7df6c admin admin] The token cache is being invalidate because project 020ee7da4b5140ab847068464de9e174 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81592) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 18:03:20.885056 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-c3c74ad6-103d-46a5-9d25-a33f1ae7df6c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:03:20.885794 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-c3c74ad6-103d-46a5-9d25-a33f1ae7df6c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:03:20.887436 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1141/2297] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Sep 15 18:03:20 2022] DELETE /identity/v3/projects/020ee7da4b5140ab847068464de9e174 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 18:03:20.898204 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45fc80f2-ab81-49f3-85bc-aa2d4c07cdd8 service neutron] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:03:20.923524 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45fc80f2-ab81-49f3-85bc-aa2d4c07cdd8 service neutron] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:03:20.988265 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986415dd-fc2c-4f94-93fa-1480e2fd8e0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:03:20.989130 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986415dd-fc2c-4f94-93fa-1480e2fd8e0f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:03:20.989440 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986415dd-fc2c-4f94-93fa-1480e2fd8e0f admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:03:20.989715 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986415dd-fc2c-4f94-93fa-1480e2fd8e0f admin admin] PATH_INFO: `/v3/users/adf4072e0eb1480f8dd2dfc7cea8ccf3` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:03:20.990838 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-986415dd-fc2c-4f94-93fa-1480e2fd8e0f admin admin] RBAC: Authorizing `identity:delete_user(user_id=adf4072e0eb1480f8dd2dfc7cea8ccf3)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:03:20.992982 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-986415dd-fc2c-4f94-93fa-1480e2fd8e0f admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:03:21.013378 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 18:03:21.063079 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c74ad6-103d-46a5-9d25-a33f1ae7df6c admin admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:03:21.067273 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-c3c74ad6-103d-46a5-9d25-a33f1ae7df6c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:03:21.068003 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-986415dd-fc2c-4f94-93fa-1480e2fd8e0f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'adf4072e0eb1480f8dd2dfc7cea8ccf3'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:03:21.078892 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-986415dd-fc2c-4f94-93fa-1480e2fd8e0f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'adf4072e0eb1480f8dd2dfc7cea8ccf3'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:03:21.079687 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-986415dd-fc2c-4f94-93fa-1480e2fd8e0f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'adf4072e0eb1480f8dd2dfc7cea8ccf3'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:03:21.080515 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-986415dd-fc2c-4f94-93fa-1480e2fd8e0f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'adf4072e0eb1480f8dd2dfc7cea8ccf3'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:03:21.116785 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-986415dd-fc2c-4f94-93fa-1480e2fd8e0f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'adf4072e0eb1480f8dd2dfc7cea8ccf3'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:03:21.119685 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c74ad6-103d-46a5-9d25-a33f1ae7df6c admin admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:03:21.127701 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995e67a0-c8d8-4641-aec3-19d60495eba9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:03:21.128954 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995e67a0-c8d8-4641-aec3-19d60495eba9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:03:21.131126 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995e67a0-c8d8-4641-aec3-19d60495eba9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:03:21.132259 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995e67a0-c8d8-4641-aec3-19d60495eba9 admin admin] PATH_INFO: `/v3/projects/f43d7fa6813d4a1bb56cdb3e7784e6e7` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:03:21.134581 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-995e67a0-c8d8-4641-aec3-19d60495eba9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f43d7fa6813d4a1bb56cdb3e7784e6e7)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:03:21.137165 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-995e67a0-c8d8-4641-aec3-19d60495eba9 admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:03:21.166067 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1157/2298] 10.222.0.25 () {58 vars in 1224 bytes} [Thu Sep 15 18:03:20 2022] DELETE /identity/v3/users/adf4072e0eb1480f8dd2dfc7cea8ccf3 => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 18:03:21.227650 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-995e67a0-c8d8-4641-aec3-19d60495eba9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f43d7fa6813d4a1bb56cdb3e7784e6e7', 'request_id': 'req-995e67a0-c8d8-4641-aec3-19d60495eba9'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:03:21.236466 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-995e67a0-c8d8-4641-aec3-19d60495eba9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f43d7fa6813d4a1bb56cdb3e7784e6e7', 'request_id': 'req-995e67a0-c8d8-4641-aec3-19d60495eba9'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:03:21.247507 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-995e67a0-c8d8-4641-aec3-19d60495eba9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f43d7fa6813d4a1bb56cdb3e7784e6e7', 'request_id': 'req-995e67a0-c8d8-4641-aec3-19d60495eba9'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:03:21.266991 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-995e67a0-c8d8-4641-aec3-19d60495eba9 admin admin] The token cache is being invalidate because project f43d7fa6813d4a1bb56cdb3e7784e6e7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81592) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 18:03:21.268030 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-995e67a0-c8d8-4641-aec3-19d60495eba9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:03:21.268731 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-995e67a0-c8d8-4641-aec3-19d60495eba9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:03:21.270567 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1142/2299] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Sep 15 18:03:21 2022] DELETE /identity/v3/projects/f43d7fa6813d4a1bb56cdb3e7784e6e7 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 15 18:03:21.274626 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986415dd-fc2c-4f94-93fa-1480e2fd8e0f admin admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:03:21.276373 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-986415dd-fc2c-4f94-93fa-1480e2fd8e0f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:03:21.364427 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986415dd-fc2c-4f94-93fa-1480e2fd8e0f admin admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:03:21.432304 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a25395-162d-4349-897f-3ab6b106450c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:03:21.432997 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a25395-162d-4349-897f-3ab6b106450c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:03:21.433226 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a25395-162d-4349-897f-3ab6b106450c admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:03:21.434134 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a25395-162d-4349-897f-3ab6b106450c admin admin] PATH_INFO: `/v3/users/6578746fcb4749a484930f0075ae369f` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:03:21.435588 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a25395-162d-4349-897f-3ab6b106450c admin admin] RBAC: Authorizing `identity:delete_user(user_id=6578746fcb4749a484930f0075ae369f)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:03:21.437615 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a25395-162d-4349-897f-3ab6b106450c admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:03:21.502726 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:DELETE=15,keystone:SELECT=84,keystone:INSERT=1 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 18:03:21.505872 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-34a25395-162d-4349-897f-3ab6b106450c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6578746fcb4749a484930f0075ae369f'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:03:21.518014 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-34a25395-162d-4349-897f-3ab6b106450c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6578746fcb4749a484930f0075ae369f'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:03:21.519446 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-34a25395-162d-4349-897f-3ab6b106450c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6578746fcb4749a484930f0075ae369f'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:03:21.520584 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-34a25395-162d-4349-897f-3ab6b106450c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6578746fcb4749a484930f0075ae369f'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:03:21.532763 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-34a25395-162d-4349-897f-3ab6b106450c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6578746fcb4749a484930f0075ae369f'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:03:21.567819 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1158/2300] 10.222.0.25 () {58 vars in 1224 bytes} [Thu Sep 15 18:03:21 2022] DELETE /identity/v3/users/6578746fcb4749a484930f0075ae369f => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 18:03:21.664255 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995e67a0-c8d8-4641-aec3-19d60495eba9 admin admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:03:21.666291 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-995e67a0-c8d8-4641-aec3-19d60495eba9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:03:21.719656 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995e67a0-c8d8-4641-aec3-19d60495eba9 admin admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:03:21.824914 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 18:03:21.834520 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9193117e-c87d-4c73-9fbf-78c1a3ff45f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:03:21.836543 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9193117e-c87d-4c73-9fbf-78c1a3ff45f3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:03:21.837492 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9193117e-c87d-4c73-9fbf-78c1a3ff45f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:03:21.846802 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9193117e-c87d-4c73-9fbf-78c1a3ff45f3 admin admin] PATH_INFO: `/v3/projects/dead21f9244149de969547a8ef2d4157` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:03:21.848712 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9193117e-c87d-4c73-9fbf-78c1a3ff45f3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dead21f9244149de969547a8ef2d4157)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:03:21.851849 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9193117e-c87d-4c73-9fbf-78c1a3ff45f3 admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:03:21.914574 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-9193117e-c87d-4c73-9fbf-78c1a3ff45f3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dead21f9244149de969547a8ef2d4157', 'request_id': 'req-9193117e-c87d-4c73-9fbf-78c1a3ff45f3'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:03:21.921774 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-9193117e-c87d-4c73-9fbf-78c1a3ff45f3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dead21f9244149de969547a8ef2d4157', 'request_id': 'req-9193117e-c87d-4c73-9fbf-78c1a3ff45f3'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:03:21.931750 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-9193117e-c87d-4c73-9fbf-78c1a3ff45f3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dead21f9244149de969547a8ef2d4157', 'request_id': 'req-9193117e-c87d-4c73-9fbf-78c1a3ff45f3'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:03:21.948450 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-9193117e-c87d-4c73-9fbf-78c1a3ff45f3 admin admin] The token cache is being invalidate because project dead21f9244149de969547a8ef2d4157 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81592) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 18:03:21.948824 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-9193117e-c87d-4c73-9fbf-78c1a3ff45f3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:03:21.949898 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-9193117e-c87d-4c73-9fbf-78c1a3ff45f3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:03:21.951756 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1143/2301] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Sep 15 18:03:21 2022] DELETE /identity/v3/projects/dead21f9244149de969547a8ef2d4157 => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 15 18:03:21.957038 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a25395-162d-4349-897f-3ab6b106450c admin admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:03:21.957385 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-34a25395-162d-4349-897f-3ab6b106450c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:03:21.975563 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a25395-162d-4349-897f-3ab6b106450c admin admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:03:22.003110 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9193117e-c87d-4c73-9fbf-78c1a3ff45f3 admin admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:03:22.005049 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-9193117e-c87d-4c73-9fbf-78c1a3ff45f3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:03:22.120850 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7bf8f32-540b-4e16-b1a7-fa22bc875e58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:03:22.121924 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bf8f32-540b-4e16-b1a7-fa22bc875e58 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:03:22.122303 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bf8f32-540b-4e16-b1a7-fa22bc875e58 admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:03:22.122679 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bf8f32-540b-4e16-b1a7-fa22bc875e58 admin admin] PATH_INFO: `/v3/users/40fb43567f364a5c98966b9fb738b304` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:03:22.124165 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7bf8f32-540b-4e16-b1a7-fa22bc875e58 admin admin] RBAC: Authorizing `identity:delete_user(user_id=40fb43567f364a5c98966b9fb738b304)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:03:22.126509 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7bf8f32-540b-4e16-b1a7-fa22bc875e58 admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:03:22.177115 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9193117e-c87d-4c73-9fbf-78c1a3ff45f3 admin admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:03:22.187023 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff78c23-236c-461a-abb8-d913cfba2483 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:03:22.188188 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff78c23-236c-461a-abb8-d913cfba2483 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:03:22.188962 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff78c23-236c-461a-abb8-d913cfba2483 admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:03:22.189966 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff78c23-236c-461a-abb8-d913cfba2483 admin admin] PATH_INFO: `/v3/projects/6e2a4e8ac72a4753932e5be7dc23d94e` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:03:22.192084 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff78c23-236c-461a-abb8-d913cfba2483 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6e2a4e8ac72a4753932e5be7dc23d94e)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:03:22.202435 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff78c23-236c-461a-abb8-d913cfba2483 admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:03:22.237242 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-f7bf8f32-540b-4e16-b1a7-fa22bc875e58 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '40fb43567f364a5c98966b9fb738b304'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:03:22.252437 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-f7bf8f32-540b-4e16-b1a7-fa22bc875e58 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '40fb43567f364a5c98966b9fb738b304'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:03:22.253169 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-f7bf8f32-540b-4e16-b1a7-fa22bc875e58 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '40fb43567f364a5c98966b9fb738b304'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:03:22.254036 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-f7bf8f32-540b-4e16-b1a7-fa22bc875e58 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '40fb43567f364a5c98966b9fb738b304'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:03:22.280821 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-f7bf8f32-540b-4e16-b1a7-fa22bc875e58 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '40fb43567f364a5c98966b9fb738b304'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:03:22.302812 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-eff78c23-236c-461a-abb8-d913cfba2483 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6e2a4e8ac72a4753932e5be7dc23d94e', 'request_id': 'req-eff78c23-236c-461a-abb8-d913cfba2483'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:03:22.314430 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-eff78c23-236c-461a-abb8-d913cfba2483 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6e2a4e8ac72a4753932e5be7dc23d94e', 'request_id': 'req-eff78c23-236c-461a-abb8-d913cfba2483'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:03:22.320661 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1159/2302] 10.222.0.25 () {58 vars in 1224 bytes} [Thu Sep 15 18:03:21 2022] DELETE /identity/v3/users/40fb43567f364a5c98966b9fb738b304 => generated 0 bytes in 365 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 18:03:22.330915 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-eff78c23-236c-461a-abb8-d913cfba2483 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6e2a4e8ac72a4753932e5be7dc23d94e', 'request_id': 'req-eff78c23-236c-461a-abb8-d913cfba2483'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:03:22.361840 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-eff78c23-236c-461a-abb8-d913cfba2483 admin admin] The token cache is being invalidate because project 6e2a4e8ac72a4753932e5be7dc23d94e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81592) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 18:03:22.362276 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-eff78c23-236c-461a-abb8-d913cfba2483 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:03:22.363133 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-eff78c23-236c-461a-abb8-d913cfba2483 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:03:22.369354 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1144/2303] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Sep 15 18:03:22 2022] DELETE /identity/v3/projects/6e2a4e8ac72a4753932e5be7dc23d94e => generated 0 bytes in 363 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 15 18:03:22.370412 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7bf8f32-540b-4e16-b1a7-fa22bc875e58 admin admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:03:22.372194 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-f7bf8f32-540b-4e16-b1a7-fa22bc875e58 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:03:22.430427 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:DELETE=14,keystone:SELECT=84,keystone:INSERT=2 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 18:03:22.504018 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7bf8f32-540b-4e16-b1a7-fa22bc875e58 admin admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:03:22.515921 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7221ab08-3f3c-4cfe-be04-76c05a764d6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:03:22.516838 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7221ab08-3f3c-4cfe-be04-76c05a764d6e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:03:22.517272 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7221ab08-3f3c-4cfe-be04-76c05a764d6e admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:03:22.517752 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7221ab08-3f3c-4cfe-be04-76c05a764d6e admin admin] PATH_INFO: `/v3/users/1da6bf666f104270a32ef616deff8a7d` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:03:22.520094 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7221ab08-3f3c-4cfe-be04-76c05a764d6e admin admin] RBAC: Authorizing `identity:delete_user(user_id=1da6bf666f104270a32ef616deff8a7d)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:03:22.523300 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7221ab08-3f3c-4cfe-be04-76c05a764d6e admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:03:22.622574 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-7221ab08-3f3c-4cfe-be04-76c05a764d6e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1da6bf666f104270a32ef616deff8a7d'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:03:22.633974 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-7221ab08-3f3c-4cfe-be04-76c05a764d6e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1da6bf666f104270a32ef616deff8a7d'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:03:22.634901 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-7221ab08-3f3c-4cfe-be04-76c05a764d6e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1da6bf666f104270a32ef616deff8a7d'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:03:22.636228 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-7221ab08-3f3c-4cfe-be04-76c05a764d6e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1da6bf666f104270a32ef616deff8a7d'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:03:22.646861 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-7221ab08-3f3c-4cfe-be04-76c05a764d6e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1da6bf666f104270a32ef616deff8a7d'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:03:22.680707 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1160/2304] 10.222.0.25 () {58 vars in 1224 bytes} [Thu Sep 15 18:03:22 2022] DELETE /identity/v3/users/1da6bf666f104270a32ef616deff8a7d => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 18:03:22.987482 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff78c23-236c-461a-abb8-d913cfba2483 admin admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:03:22.991007 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-eff78c23-236c-461a-abb8-d913cfba2483 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:03:23.038021 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 18:03:23.048068 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7221ab08-3f3c-4cfe-be04-76c05a764d6e admin admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:03:23.049823 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-7221ab08-3f3c-4cfe-be04-76c05a764d6e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:03:23.113215 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff78c23-236c-461a-abb8-d913cfba2483 admin admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:03:23.127941 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7221ab08-3f3c-4cfe-be04-76c05a764d6e admin admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:03:23.132648 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79372ca-e0ae-46c3-8aee-9d648e5f5fbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:03:23.133317 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79372ca-e0ae-46c3-8aee-9d648e5f5fbe admin admin] REQUEST_METHOD: `DELETE` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:03:23.133637 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79372ca-e0ae-46c3-8aee-9d648e5f5fbe admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:03:23.133911 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79372ca-e0ae-46c3-8aee-9d648e5f5fbe admin admin] PATH_INFO: `/v3/projects/c80b11ae6a324bd6b4bcd8ed9ec01745` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:03:23.135061 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f79372ca-e0ae-46c3-8aee-9d648e5f5fbe admin admin] RBAC: Authorizing `identity:delete_project(project_id=c80b11ae6a324bd6b4bcd8ed9ec01745)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:03:23.137157 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f79372ca-e0ae-46c3-8aee-9d648e5f5fbe admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:03:23.175103 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdae12b6-6fb0-4862-9b63-3cd1686e50ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:03:23.175775 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdae12b6-6fb0-4862-9b63-3cd1686e50ee admin admin] REQUEST_METHOD: `DELETE` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:03:23.176083 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdae12b6-6fb0-4862-9b63-3cd1686e50ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:03:23.176389 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdae12b6-6fb0-4862-9b63-3cd1686e50ee admin admin] PATH_INFO: `/v3/projects/5d39e7e6676547ee9be49acd49cbb08c` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:03:23.177650 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdae12b6-6fb0-4862-9b63-3cd1686e50ee admin admin] RBAC: Authorizing `identity:delete_project(project_id=5d39e7e6676547ee9be49acd49cbb08c)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:03:23.179742 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdae12b6-6fb0-4862-9b63-3cd1686e50ee admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:03:23.189017 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-f79372ca-e0ae-46c3-8aee-9d648e5f5fbe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c80b11ae6a324bd6b4bcd8ed9ec01745', 'request_id': 'req-f79372ca-e0ae-46c3-8aee-9d648e5f5fbe'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:03:23.194825 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-f79372ca-e0ae-46c3-8aee-9d648e5f5fbe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c80b11ae6a324bd6b4bcd8ed9ec01745', 'request_id': 'req-f79372ca-e0ae-46c3-8aee-9d648e5f5fbe'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:03:23.198256 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 18:03:23.206085 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-f79372ca-e0ae-46c3-8aee-9d648e5f5fbe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c80b11ae6a324bd6b4bcd8ed9ec01745', 'request_id': 'req-f79372ca-e0ae-46c3-8aee-9d648e5f5fbe'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:03:23.220277 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-f79372ca-e0ae-46c3-8aee-9d648e5f5fbe admin admin] The token cache is being invalidate because project c80b11ae6a324bd6b4bcd8ed9ec01745 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81593) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 18:03:23.220558 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-f79372ca-e0ae-46c3-8aee-9d648e5f5fbe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:03:23.222309 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-f79372ca-e0ae-46c3-8aee-9d648e5f5fbe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:03:23.224789 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1161/2305] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Sep 15 18:03:23 2022] DELETE /identity/v3/projects/c80b11ae6a324bd6b4bcd8ed9ec01745 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 18:03:23.232586 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85dd7c39-2196-48bc-90a7-25a833d48c07 None None] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:03:23.232586 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85dd7c39-2196-48bc-90a7-25a833d48c07 None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:03:23.232859 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85dd7c39-2196-48bc-90a7-25a833d48c07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:03:23.250248 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-fdae12b6-6fb0-4862-9b63-3cd1686e50ee admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5d39e7e6676547ee9be49acd49cbb08c', 'request_id': 'req-fdae12b6-6fb0-4862-9b63-3cd1686e50ee'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:03:23.255622 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.auth.core [None req-85dd7c39-2196-48bc-90a7-25a833d48c07 None None] MFA Rules not processed for user `5cfa58ef86774ab7800bf91930bf6028`. Rule list: `[]` (Enabled: `True`). {{(pid=81593) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 18:03:23.256342 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-fdae12b6-6fb0-4862-9b63-3cd1686e50ee admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5d39e7e6676547ee9be49acd49cbb08c', 'request_id': 'req-fdae12b6-6fb0-4862-9b63-3cd1686e50ee'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:03:23.256970 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-85dd7c39-2196-48bc-90a7-25a833d48c07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:03:23.265769 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-fdae12b6-6fb0-4862-9b63-3cd1686e50ee admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5d39e7e6676547ee9be49acd49cbb08c', 'request_id': 'req-fdae12b6-6fb0-4862-9b63-3cd1686e50ee'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:03:23.279145 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-fdae12b6-6fb0-4862-9b63-3cd1686e50ee admin admin] The token cache is being invalidate because project 5d39e7e6676547ee9be49acd49cbb08c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81592) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 18:03:23.279436 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-fdae12b6-6fb0-4862-9b63-3cd1686e50ee admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:03:23.280104 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-fdae12b6-6fb0-4862-9b63-3cd1686e50ee admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:03:23.285412 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1145/2306] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Sep 15 18:03:22 2022] DELETE /identity/v3/projects/5d39e7e6676547ee9be49acd49cbb08c => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 18:03:23.288332 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee49446-1306-44d3-a504-8af3207fad51 None None] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:03:23.289048 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee49446-1306-44d3-a504-8af3207fad51 None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:03:23.289767 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee49446-1306-44d3-a504-8af3207fad51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:03:23.331564 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.auth.core [None req-fee49446-1306-44d3-a504-8af3207fad51 None None] MFA Rules not processed for user `5cfa58ef86774ab7800bf91930bf6028`. Rule list: `[]` (Enabled: `True`). {{(pid=81592) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 18:03:23.333354 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-fee49446-1306-44d3-a504-8af3207fad51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:03:23.345103 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1146/2307] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 15 18:03:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 18:03:23.345530 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1162/2308] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 15 18:03:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 18:03:23.355005 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac266832-b622-432b-8ae5-d52a2c5ac502 None None] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:03:23.355300 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac266832-b622-432b-8ae5-d52a2c5ac502 None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:03:23.355563 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac266832-b622-432b-8ae5-d52a2c5ac502 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:03:23.357033 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a949315-1fc1-4943-bbe2-9a8830c65fac None None] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:03:23.357352 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a949315-1fc1-4943-bbe2-9a8830c65fac None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:03:23.357638 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a949315-1fc1-4943-bbe2-9a8830c65fac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:03:23.378038 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.auth.core [None req-ac266832-b622-432b-8ae5-d52a2c5ac502 None None] MFA Rules not processed for user `5cfa58ef86774ab7800bf91930bf6028`. Rule list: `[]` (Enabled: `True`). {{(pid=81592) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 18:03:23.382459 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-ac266832-b622-432b-8ae5-d52a2c5ac502 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:03:23.385797 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.auth.core [None req-7a949315-1fc1-4943-bbe2-9a8830c65fac None None] MFA Rules not processed for user `5cfa58ef86774ab7800bf91930bf6028`. Rule list: `[]` (Enabled: `True`). {{(pid=81593) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 18:03:23.387021 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-7a949315-1fc1-4943-bbe2-9a8830c65fac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:03:23.391515 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1147/2309] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 15 18:03:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 18:03:23.400326 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac266832-b622-432b-8ae5-d52a2c5ac502 None None] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:03:23.403770 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1163/2310] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 15 18:03:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 18:03:23.408576 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a949315-1fc1-4943-bbe2-9a8830c65fac None None] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:03:23.412222 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac266832-b622-432b-8ae5-d52a2c5ac502 None None] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:03:23.419423 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848830f2-95df-437a-a180-ed4f95ba4852 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:03:23.419859 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a949315-1fc1-4943-bbe2-9a8830c65fac None None] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:03:23.420206 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848830f2-95df-437a-a180-ed4f95ba4852 admin admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:03:23.420466 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848830f2-95df-437a-a180-ed4f95ba4852 admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:03:23.420922 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848830f2-95df-437a-a180-ed4f95ba4852 admin admin] PATH_INFO: `/v3/domains` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:03:23.421796 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848830f2-95df-437a-a180-ed4f95ba4852 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81592) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 18:03:23.422280 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848830f2-95df-437a-a180-ed4f95ba4852 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:03:23.424052 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848830f2-95df-437a-a180-ed4f95ba4852 admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:03:23.425196 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2709560-2d2b-4978-981a-b45aadee078a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:03:23.425910 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2709560-2d2b-4978-981a-b45aadee078a admin admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:03:23.426377 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2709560-2d2b-4978-981a-b45aadee078a admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:03:23.426648 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2709560-2d2b-4978-981a-b45aadee078a admin admin] PATH_INFO: `/v3/domains` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:03:23.427927 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2709560-2d2b-4978-981a-b45aadee078a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81593) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 18:03:23.428319 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2709560-2d2b-4978-981a-b45aadee078a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:03:23.430230 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2709560-2d2b-4978-981a-b45aadee078a admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:03:23.441493 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1148/2311] 10.222.0.25 () {58 vars in 1153 bytes} [Thu Sep 15 18:03:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 18:03:23.442804 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848830f2-95df-437a-a180-ed4f95ba4852 admin admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:03:23.444742 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1164/2312] 10.222.0.25 () {58 vars in 1153 bytes} [Thu Sep 15 18:03:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 18:03:23.448960 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2709560-2d2b-4978-981a-b45aadee078a admin admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:03:23.460996 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2709560-2d2b-4978-981a-b45aadee078a admin admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:03:23.461415 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848830f2-95df-437a-a180-ed4f95ba4852 admin admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:03:23.466988 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6acf44d8-ea50-47d2-b858-99da2cc1e5b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:03:23.467400 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b8ae3c-886b-4277-83a9-6d9ee58948fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:03:23.467584 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acf44d8-ea50-47d2-b858-99da2cc1e5b0 admin admin] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:03:23.468060 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acf44d8-ea50-47d2-b858-99da2cc1e5b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:03:23.468354 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b8ae3c-886b-4277-83a9-6d9ee58948fd admin admin] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:03:23.468529 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acf44d8-ea50-47d2-b858-99da2cc1e5b0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:03:23.468830 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b8ae3c-886b-4277-83a9-6d9ee58948fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:03:23.469070 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6acf44d8-ea50-47d2-b858-99da2cc1e5b0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:03:23.469217 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b8ae3c-886b-4277-83a9-6d9ee58948fd admin admin] PATH_INFO: `/v3/projects` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:03:23.474445 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b8ae3c-886b-4277-83a9-6d9ee58948fd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:03:23.474821 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6acf44d8-ea50-47d2-b858-99da2cc1e5b0 admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:03:23.474969 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b8ae3c-886b-4277-83a9-6d9ee58948fd admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:03:23.510442 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1165/2313] 10.222.0.25 () {60 vars in 1153 bytes} [Thu Sep 15 18:03:23 2022] POST /identity/v3/projects => generated 375 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 18:03:23.511357 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b8ae3c-886b-4277-83a9-6d9ee58948fd admin admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:03:23.511727 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1149/2314] 10.222.0.25 () {60 vars in 1153 bytes} [Thu Sep 15 18:03:23 2022] POST /identity/v3/projects => generated 387 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 18:03:23.513543 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-20b8ae3c-886b-4277-83a9-6d9ee58948fd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:03:23.515053 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6acf44d8-ea50-47d2-b858-99da2cc1e5b0 admin admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:03:23.520620 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 18:03:23.589623 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6acf44d8-ea50-47d2-b858-99da2cc1e5b0 admin admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:03:23.597941 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9c3651-4abe-4763-9e1f-d1a212b7df4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:03:23.598903 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9c3651-4abe-4763-9e1f-d1a212b7df4b admin admin] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:03:23.599290 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9c3651-4abe-4763-9e1f-d1a212b7df4b admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:03:23.599636 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9c3651-4abe-4763-9e1f-d1a212b7df4b admin admin] PATH_INFO: `/v3/users` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:03:23.600351 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9c3651-4abe-4763-9e1f-d1a212b7df4b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:03:23.602502 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9c3651-4abe-4763-9e1f-d1a212b7df4b admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:03:23.606806 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b8ae3c-886b-4277-83a9-6d9ee58948fd admin admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:03:23.616657 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695f9e41-219d-49fb-a131-cbfb77207a31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:03:23.617880 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695f9e41-219d-49fb-a131-cbfb77207a31 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:03:23.618382 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695f9e41-219d-49fb-a131-cbfb77207a31 admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:03:23.618472 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695f9e41-219d-49fb-a131-cbfb77207a31 admin admin] PATH_INFO: `/v3/users/691214b96c504115af716508e3c54631` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:03:23.619667 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-695f9e41-219d-49fb-a131-cbfb77207a31 admin admin] RBAC: Authorizing `identity:delete_user(user_id=691214b96c504115af716508e3c54631)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:03:23.625193 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-695f9e41-219d-49fb-a131-cbfb77207a31 admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:03:23.632794 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1150/2315] 10.222.0.25 () {60 vars in 1144 bytes} [Thu Sep 15 18:03:23 2022] POST /identity/v3/users => generated 288 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 15 18:03:23.633611 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9c3651-4abe-4763-9e1f-d1a212b7df4b admin admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:03:23.664824 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9c3651-4abe-4763-9e1f-d1a212b7df4b admin admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:03:23.677367 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9529c8cc-6ac3-402e-9ccd-805d9617d384 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:03:23.678195 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9529c8cc-6ac3-402e-9ccd-805d9617d384 admin admin] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:03:23.678659 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9529c8cc-6ac3-402e-9ccd-805d9617d384 admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:03:23.679000 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9529c8cc-6ac3-402e-9ccd-805d9617d384 admin admin] PATH_INFO: `/v3/users` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:03:23.679868 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9529c8cc-6ac3-402e-9ccd-805d9617d384 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:03:23.682260 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9529c8cc-6ac3-402e-9ccd-805d9617d384 admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:03:23.715549 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-695f9e41-219d-49fb-a131-cbfb77207a31 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '691214b96c504115af716508e3c54631'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:03:23.721140 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:DELETE=8,keystone:SELECT=90,keystone:INSERT=2 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 18:03:23.732584 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1151/2316] 10.222.0.25 () {60 vars in 1144 bytes} [Thu Sep 15 18:03:23 2022] POST /identity/v3/users => generated 294 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 18:03:23.733951 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-695f9e41-219d-49fb-a131-cbfb77207a31 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '691214b96c504115af716508e3c54631'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:03:23.736274 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-695f9e41-219d-49fb-a131-cbfb77207a31 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '691214b96c504115af716508e3c54631'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:03:23.736671 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9529c8cc-6ac3-402e-9ccd-805d9617d384 admin admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:03:23.737507 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-695f9e41-219d-49fb-a131-cbfb77207a31 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '691214b96c504115af716508e3c54631'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:03:23.740855 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-9529c8cc-6ac3-402e-9ccd-805d9617d384 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:03:23.752864 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-695f9e41-219d-49fb-a131-cbfb77207a31 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '691214b96c504115af716508e3c54631'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:03:23.760836 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9529c8cc-6ac3-402e-9ccd-805d9617d384 admin admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:03:23.768086 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e0019b-cbc5-425e-aa7a-d18545884d35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:03:23.768710 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e0019b-cbc5-425e-aa7a-d18545884d35 admin admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:03:23.768988 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e0019b-cbc5-425e-aa7a-d18545884d35 admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:03:23.769338 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e0019b-cbc5-425e-aa7a-d18545884d35 admin admin] PATH_INFO: `/v3/roles` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:03:23.770644 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e0019b-cbc5-425e-aa7a-d18545884d35 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:03:23.773124 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e0019b-cbc5-425e-aa7a-d18545884d35 admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:03:23.776482 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1166/2317] 10.222.0.25 () {58 vars in 1224 bytes} [Thu Sep 15 18:03:23 2022] DELETE /identity/v3/users/691214b96c504115af716508e3c54631 => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 18:03:23.777428 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695f9e41-219d-49fb-a131-cbfb77207a31 admin admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:03:23.778915 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-695f9e41-219d-49fb-a131-cbfb77207a31 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:03:23.787091 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1152/2318] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Sep 15 18:03:23 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 18:03:23.791808 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd1c574-d9fd-480f-b9e9-f4724a5d25ff None None] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:03:23.792098 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd1c574-d9fd-480f-b9e9-f4724a5d25ff None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:03:23.792387 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd1c574-d9fd-480f-b9e9-f4724a5d25ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:03:23.813821 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.auth.core [None req-0bd1c574-d9fd-480f-b9e9-f4724a5d25ff None None] MFA Rules not processed for user `5cfa58ef86774ab7800bf91930bf6028`. Rule list: `[]` (Enabled: `True`). {{(pid=81592) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 18:03:23.815215 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-0bd1c574-d9fd-480f-b9e9-f4724a5d25ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:03:23.883156 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695f9e41-219d-49fb-a131-cbfb77207a31 admin admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:03:23.890107 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f13155b-ef57-4856-a12a-5c65ffdac5e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:03:23.891026 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f13155b-ef57-4856-a12a-5c65ffdac5e2 admin admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:03:23.891026 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f13155b-ef57-4856-a12a-5c65ffdac5e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:03:23.891317 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f13155b-ef57-4856-a12a-5c65ffdac5e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:03:23.892042 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f13155b-ef57-4856-a12a-5c65ffdac5e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:03:23.893784 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f13155b-ef57-4856-a12a-5c65ffdac5e2 admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:03:23.905906 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1167/2319] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Sep 15 18:03:23 2022] GET /identity/v3/roles => generated 1420 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 18:03:23.912101 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f13155b-ef57-4856-a12a-5c65ffdac5e2 admin admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:03:23.933233 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f13155b-ef57-4856-a12a-5c65ffdac5e2 admin admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:03:23.940657 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1153/2320] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 15 18:03:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 18:03:23.941948 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd1c574-d9fd-480f-b9e9-f4724a5d25ff None None] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:03:23.952974 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd1c574-d9fd-480f-b9e9-f4724a5d25ff None None] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:03:23.959336 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e8a292-2151-4292-937c-dfa605421f74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:03:23.960601 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e8a292-2151-4292-937c-dfa605421f74 admin admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:03:23.960985 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e8a292-2151-4292-937c-dfa605421f74 admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:03:23.961357 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e8a292-2151-4292-937c-dfa605421f74 admin admin] PATH_INFO: `/v3/roles` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:03:23.962084 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e8a292-2151-4292-937c-dfa605421f74 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:03:23.963937 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e8a292-2151-4292-937c-dfa605421f74 admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:03:23.971751 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56e9538-f260-46b4-89de-6dac7fc3e5b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:03:23.972949 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56e9538-f260-46b4-89de-6dac7fc3e5b7 admin admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:03:23.974766 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56e9538-f260-46b4-89de-6dac7fc3e5b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:03:23.975241 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56e9538-f260-46b4-89de-6dac7fc3e5b7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:03:23.979096 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1154/2321] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Sep 15 18:03:23 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 18:03:23.979096 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e8a292-2151-4292-937c-dfa605421f74 admin admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:03:23.979349 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-48e8a292-2151-4292-937c-dfa605421f74 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:03:23.979728 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b56e9538-f260-46b4-89de-6dac7fc3e5b7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:03:23.982309 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b56e9538-f260-46b4-89de-6dac7fc3e5b7 admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:03:24.002703 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1168/2322] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Sep 15 18:03:23 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 18:03:24.004427 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56e9538-f260-46b4-89de-6dac7fc3e5b7 admin admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:03:24.022244 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56e9538-f260-46b4-89de-6dac7fc3e5b7 admin admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:03:24.029551 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88132fee-9200-432e-a8f0-e381ee49cb1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:03:24.030241 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88132fee-9200-432e-a8f0-e381ee49cb1f admin admin] REQUEST_METHOD: `PUT` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:03:24.030523 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88132fee-9200-432e-a8f0-e381ee49cb1f admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:03:24.030801 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88132fee-9200-432e-a8f0-e381ee49cb1f admin admin] PATH_INFO: `/v3/projects/ff3d7f268f0241bcb08466b80e5d4475/users/37264be5d6874d2fbac30e3a6206efa8/roles/343cc8b1bc7243eebabdf08147e8366d` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:03:24.048913 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88132fee-9200-432e-a8f0-e381ee49cb1f admin admin] RBAC: Authorizing `identity:create_grant(project_id=ff3d7f268f0241bcb08466b80e5d4475, user_id=37264be5d6874d2fbac30e3a6206efa8, role_id=343cc8b1bc7243eebabdf08147e8366d)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:03:24.051855 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88132fee-9200-432e-a8f0-e381ee49cb1f admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:03:24.064421 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e8a292-2151-4292-937c-dfa605421f74 admin admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:03:24.070093 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1169/2323] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Sep 15 18:03:24 2022] PUT /identity/v3/projects/ff3d7f268f0241bcb08466b80e5d4475/users/37264be5d6874d2fbac30e3a6206efa8/roles/343cc8b1bc7243eebabdf08147e8366d => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 18:03:24.074554 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 18:03:24.082397 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88132fee-9200-432e-a8f0-e381ee49cb1f admin admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:03:24.133762 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f72045d-9fcd-4bf2-b6f5-441b4daa8c41 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a32274b4781b40fea9f28da8a9bde5ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1213c0d1b584404ba3998e136f166e89', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:03:24.134461 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f72045d-9fcd-4bf2-b6f5-441b4daa8c41 service neutron] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:03:24.134780 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f72045d-9fcd-4bf2-b6f5-441b4daa8c41 service neutron] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:03:24.135096 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f72045d-9fcd-4bf2-b6f5-441b4daa8c41 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:03:24.164240 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88132fee-9200-432e-a8f0-e381ee49cb1f admin admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:03:24.169508 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5b44a8-b12b-4576-8f16-86193d7a5abb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:03:24.170281 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5b44a8-b12b-4576-8f16-86193d7a5abb admin admin] REQUEST_METHOD: `PUT` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:03:24.170625 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5b44a8-b12b-4576-8f16-86193d7a5abb admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:03:24.170904 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5b44a8-b12b-4576-8f16-86193d7a5abb admin admin] PATH_INFO: `/v3/projects/1df1699a598b4bc0ab44216e5bd5bb3e/users/71a704c15ca14b0999a2541c411c3ede/roles/343cc8b1bc7243eebabdf08147e8366d` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:03:24.190078 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c5b44a8-b12b-4576-8f16-86193d7a5abb admin admin] RBAC: Authorizing `identity:create_grant(project_id=1df1699a598b4bc0ab44216e5bd5bb3e, user_id=71a704c15ca14b0999a2541c411c3ede, role_id=343cc8b1bc7243eebabdf08147e8366d)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:03:24.194559 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c5b44a8-b12b-4576-8f16-86193d7a5abb admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:03:24.209820 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f72045d-9fcd-4bf2-b6f5-441b4daa8c41 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:03:24.211374 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f72045d-9fcd-4bf2-b6f5-441b4daa8c41 service neutron] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:03:24.213862 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1170/2324] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Sep 15 18:03:24 2022] PUT /identity/v3/projects/1df1699a598b4bc0ab44216e5bd5bb3e/users/71a704c15ca14b0999a2541c411c3ede/roles/343cc8b1bc7243eebabdf08147e8366d => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 18:03:24.215939 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf30b5db-8a85-43ff-8261-fede934cb991 None None] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:03:24.216519 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf30b5db-8a85-43ff-8261-fede934cb991 None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:03:24.217097 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf30b5db-8a85-43ff-8261-fede934cb991 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:03:24.225917 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1155/2325] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 15 18:03:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 249 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 18:03:24.227091 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2075907-2715-42b8-8c7b-3a47b072c312 None None] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:03:24.227374 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2075907-2715-42b8-8c7b-3a47b072c312 None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:03:24.227649 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2075907-2715-42b8-8c7b-3a47b072c312 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:03:24.243341 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:DELETE=3,keystone:SELECT=95,keystone:INSERT=2 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 18:03:24.255837 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.auth.core [None req-bf30b5db-8a85-43ff-8261-fede934cb991 None None] MFA Rules not processed for user `37264be5d6874d2fbac30e3a6206efa8`. Rule list: `[]` (Enabled: `True`). {{(pid=81593) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 18:03:24.258539 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-bf30b5db-8a85-43ff-8261-fede934cb991 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:03:24.263364 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.auth.core [None req-f2075907-2715-42b8-8c7b-3a47b072c312 None None] MFA Rules not processed for user `71a704c15ca14b0999a2541c411c3ede`. Rule list: `[]` (Enabled: `True`). {{(pid=81592) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 18:03:24.265120 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-f2075907-2715-42b8-8c7b-3a47b072c312 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:03:24.352148 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1156/2326] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 15 18:03:24 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 18:03:24.371007 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2075907-2715-42b8-8c7b-3a47b072c312 None None] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:03:24.372150 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-f2075907-2715-42b8-8c7b-3a47b072c312 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:03:24.387333 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1171/2327] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 15 18:03:24 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 18:03:24.388743 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf30b5db-8a85-43ff-8261-fede934cb991 None None] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:03:24.467470 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2075907-2715-42b8-8c7b-3a47b072c312 None None] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:03:24.475746 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9ac097-ec82-4037-b8ac-32cd49fcc700 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b232e7a841145ba93c6d8462ccb751a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1213c0d1b584404ba3998e136f166e89', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:03:24.477121 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9ac097-ec82-4037-b8ac-32cd49fcc700 service cinder] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:03:24.477121 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9ac097-ec82-4037-b8ac-32cd49fcc700 service cinder] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:03:24.477801 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9ac097-ec82-4037-b8ac-32cd49fcc700 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:03:24.490636 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 18:03:24.495062 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9ac097-ec82-4037-b8ac-32cd49fcc700 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:03:24.498342 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9ac097-ec82-4037-b8ac-32cd49fcc700 service cinder] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:03:24.521585 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1157/2328] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 15 18:03:24 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 18:03:24.559382 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf30b5db-8a85-43ff-8261-fede934cb991 None None] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:03:24.568240 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f0a1f9-db8b-4de1-9dab-7c056cf8366c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:03:24.572282 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f0a1f9-db8b-4de1-9dab-7c056cf8366c admin admin] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:03:24.572868 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f0a1f9-db8b-4de1-9dab-7c056cf8366c admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:03:24.573431 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f0a1f9-db8b-4de1-9dab-7c056cf8366c admin admin] PATH_INFO: `/v3/projects` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:03:24.574444 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f0a1f9-db8b-4de1-9dab-7c056cf8366c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:03:24.575521 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9ac097-ec82-4037-b8ac-32cd49fcc700 service cinder] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:03:24.577263 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f0a1f9-db8b-4de1-9dab-7c056cf8366c admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:03:24.579516 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-0b9ac097-ec82-4037-b8ac-32cd49fcc700 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:03:24.613889 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9ac097-ec82-4037-b8ac-32cd49fcc700 service cinder] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:03:24.623916 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a1c3c2-d12c-4b6c-96ef-9d7afdfc38d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:03:24.624597 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a1c3c2-d12c-4b6c-96ef-9d7afdfc38d5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:03:24.624830 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a1c3c2-d12c-4b6c-96ef-9d7afdfc38d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:03:24.625107 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a1c3c2-d12c-4b6c-96ef-9d7afdfc38d5 admin admin] PATH_INFO: `/v3/projects/c7af0dc2cf684e8d866d6e87c9f6f1a3` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:03:24.626436 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a1c3c2-d12c-4b6c-96ef-9d7afdfc38d5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c7af0dc2cf684e8d866d6e87c9f6f1a3)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:03:24.628402 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a1c3c2-d12c-4b6c-96ef-9d7afdfc38d5 admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:03:24.654401 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1172/2329] 10.222.0.25 () {60 vars in 1153 bytes} [Thu Sep 15 18:03:24 2022] POST /identity/v3/projects => generated 385 bytes in 263 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 18:03:24.655997 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f0a1f9-db8b-4de1-9dab-7c056cf8366c admin admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:03:24.700441 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-c9a1c3c2-d12c-4b6c-96ef-9d7afdfc38d5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c7af0dc2cf684e8d866d6e87c9f6f1a3', 'request_id': 'req-c9a1c3c2-d12c-4b6c-96ef-9d7afdfc38d5'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:03:24.707297 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-c9a1c3c2-d12c-4b6c-96ef-9d7afdfc38d5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c7af0dc2cf684e8d866d6e87c9f6f1a3', 'request_id': 'req-c9a1c3c2-d12c-4b6c-96ef-9d7afdfc38d5'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:03:24.720223 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-c9a1c3c2-d12c-4b6c-96ef-9d7afdfc38d5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c7af0dc2cf684e8d866d6e87c9f6f1a3', 'request_id': 'req-c9a1c3c2-d12c-4b6c-96ef-9d7afdfc38d5'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:03:24.738005 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-c9a1c3c2-d12c-4b6c-96ef-9d7afdfc38d5 admin admin] The token cache is being invalidate because project c7af0dc2cf684e8d866d6e87c9f6f1a3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81592) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 18:03:24.738307 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-c9a1c3c2-d12c-4b6c-96ef-9d7afdfc38d5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:03:24.739005 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-c9a1c3c2-d12c-4b6c-96ef-9d7afdfc38d5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:03:24.741015 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1158/2330] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Sep 15 18:03:24 2022] DELETE /identity/v3/projects/c7af0dc2cf684e8d866d6e87c9f6f1a3 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 18:03:24.748813 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a1c3c2-d12c-4b6c-96ef-9d7afdfc38d5 admin admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:03:24.750612 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-c9a1c3c2-d12c-4b6c-96ef-9d7afdfc38d5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:03:24.760967 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f0a1f9-db8b-4de1-9dab-7c056cf8366c admin admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:03:24.805967 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 18:03:24.844744 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a1c3c2-d12c-4b6c-96ef-9d7afdfc38d5 admin admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:03:24.852948 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed587f5-8435-4adb-94ba-c492dc50d152 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:03:24.855054 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed587f5-8435-4adb-94ba-c492dc50d152 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:03:24.855505 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed587f5-8435-4adb-94ba-c492dc50d152 admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:03:24.855976 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed587f5-8435-4adb-94ba-c492dc50d152 admin admin] PATH_INFO: `/v3/users/f2fb8ea8058d43abbc459df6003eb31d` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:03:24.860717 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed587f5-8435-4adb-94ba-c492dc50d152 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f2fb8ea8058d43abbc459df6003eb31d)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:03:24.863404 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed587f5-8435-4adb-94ba-c492dc50d152 admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:03:24.880812 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd902c71-d570-4adc-aacf-175dc930ecb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:03:24.882920 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd902c71-d570-4adc-aacf-175dc930ecb0 admin admin] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:03:24.883504 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd902c71-d570-4adc-aacf-175dc930ecb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:03:24.883888 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd902c71-d570-4adc-aacf-175dc930ecb0 admin admin] PATH_INFO: `/v3/users` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:03:24.888854 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd902c71-d570-4adc-aacf-175dc930ecb0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:03:24.891274 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd902c71-d570-4adc-aacf-175dc930ecb0 admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:03:24.934283 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1173/2331] 10.222.0.25 () {60 vars in 1144 bytes} [Thu Sep 15 18:03:24 2022] POST /identity/v3/users => generated 299 bytes in 279 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 15 18:03:24.936467 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-8ed587f5-8435-4adb-94ba-c492dc50d152 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f2fb8ea8058d43abbc459df6003eb31d'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:03:24.938364 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd902c71-d570-4adc-aacf-175dc930ecb0 admin admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:03:24.941567 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-cd902c71-d570-4adc-aacf-175dc930ecb0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:03:24.946866 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-8ed587f5-8435-4adb-94ba-c492dc50d152 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f2fb8ea8058d43abbc459df6003eb31d'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:03:24.948106 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-8ed587f5-8435-4adb-94ba-c492dc50d152 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f2fb8ea8058d43abbc459df6003eb31d'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:03:24.949021 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-8ed587f5-8435-4adb-94ba-c492dc50d152 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f2fb8ea8058d43abbc459df6003eb31d'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:03:24.963721 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-8ed587f5-8435-4adb-94ba-c492dc50d152 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f2fb8ea8058d43abbc459df6003eb31d'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:03:24.963934 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd902c71-d570-4adc-aacf-175dc930ecb0 admin admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:03:24.976593 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660c563f-d510-4305-9288-d414adb45fc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:03:24.979674 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660c563f-d510-4305-9288-d414adb45fc1 admin admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:03:24.979674 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660c563f-d510-4305-9288-d414adb45fc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:03:24.979674 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660c563f-d510-4305-9288-d414adb45fc1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:03:24.979951 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 18:03:24.980054 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-660c563f-d510-4305-9288-d414adb45fc1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:03:24.982946 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-660c563f-d510-4305-9288-d414adb45fc1 admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:03:24.990992 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1159/2332] 10.222.0.25 () {58 vars in 1224 bytes} [Thu Sep 15 18:03:24 2022] DELETE /identity/v3/users/f2fb8ea8058d43abbc459df6003eb31d => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 18:03:25.001049 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1174/2333] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Sep 15 18:03:24 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 18:03:25.002342 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed587f5-8435-4adb-94ba-c492dc50d152 admin admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:03:25.003965 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-8ed587f5-8435-4adb-94ba-c492dc50d152 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:03:25.044005 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660c563f-d510-4305-9288-d414adb45fc1 admin admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:03:25.050225 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-660c563f-d510-4305-9288-d414adb45fc1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:03:25.082861 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660c563f-d510-4305-9288-d414adb45fc1 admin admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:03:25.149169 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed587f5-8435-4adb-94ba-c492dc50d152 admin admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:03:25.155028 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964b833e-0d27-4113-9a23-2523fb13d8e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:03:25.156117 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964b833e-0d27-4113-9a23-2523fb13d8e2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:03:25.156951 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964b833e-0d27-4113-9a23-2523fb13d8e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:03:25.157422 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964b833e-0d27-4113-9a23-2523fb13d8e2 admin admin] PATH_INFO: `/v3/projects/6cb500664e9c43508b34aa8a900c6625/users/78ea951cb73749628745cb20527ea735/roles/a9e42be86923434f8af52d3fc07fb4f7` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:03:25.180857 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964b833e-0d27-4113-9a23-2523fb13d8e2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6cb500664e9c43508b34aa8a900c6625, user_id=78ea951cb73749628745cb20527ea735, role_id=a9e42be86923434f8af52d3fc07fb4f7)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:03:25.188842 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964b833e-0d27-4113-9a23-2523fb13d8e2 admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:03:25.239432 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1160/2334] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Sep 15 18:03:25 2022] PUT /identity/v3/projects/6cb500664e9c43508b34aa8a900c6625/users/78ea951cb73749628745cb20527ea735/roles/a9e42be86923434f8af52d3fc07fb4f7 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 18:03:25.240800 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964b833e-0d27-4113-9a23-2523fb13d8e2 admin admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:03:25.244291 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b032327-228e-4e3d-bb4f-6db8ef0cada8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:03:25.244948 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b032327-228e-4e3d-bb4f-6db8ef0cada8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:03:25.245237 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b032327-228e-4e3d-bb4f-6db8ef0cada8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:03:25.245549 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b032327-228e-4e3d-bb4f-6db8ef0cada8 admin admin] PATH_INFO: `/v3/users/ed84a779b63149b5b53f8f2455f7b955` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:03:25.247429 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b032327-228e-4e3d-bb4f-6db8ef0cada8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ed84a779b63149b5b53f8f2455f7b955)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:03:25.255705 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b032327-228e-4e3d-bb4f-6db8ef0cada8 admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:03:25.353069 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-8b032327-228e-4e3d-bb4f-6db8ef0cada8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ed84a779b63149b5b53f8f2455f7b955'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:03:25.368769 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-8b032327-228e-4e3d-bb4f-6db8ef0cada8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ed84a779b63149b5b53f8f2455f7b955'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:03:25.370043 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-8b032327-228e-4e3d-bb4f-6db8ef0cada8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ed84a779b63149b5b53f8f2455f7b955'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:03:25.371474 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-8b032327-228e-4e3d-bb4f-6db8ef0cada8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ed84a779b63149b5b53f8f2455f7b955'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:03:25.384843 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-8b032327-228e-4e3d-bb4f-6db8ef0cada8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ed84a779b63149b5b53f8f2455f7b955'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:03:25.408062 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964b833e-0d27-4113-9a23-2523fb13d8e2 admin admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:03:25.423282 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a36167-4d45-49f7-ad2f-214fa8e7984c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:03:25.424656 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a36167-4d45-49f7-ad2f-214fa8e7984c admin admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:03:25.425114 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a36167-4d45-49f7-ad2f-214fa8e7984c admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:03:25.425224 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1175/2335] 10.222.0.25 () {58 vars in 1224 bytes} [Thu Sep 15 18:03:25 2022] DELETE /identity/v3/users/ed84a779b63149b5b53f8f2455f7b955 => generated 0 bytes in 384 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 15 18:03:25.425654 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a36167-4d45-49f7-ad2f-214fa8e7984c admin admin] PATH_INFO: `/v3/roles` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:03:25.426328 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a36167-4d45-49f7-ad2f-214fa8e7984c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:03:25.427940 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a36167-4d45-49f7-ad2f-214fa8e7984c admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:03:25.430009 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6ab2a4-ca18-4a45-8183-3058afb26911 None None] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:03:25.432372 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6ab2a4-ca18-4a45-8183-3058afb26911 None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:03:25.432762 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6ab2a4-ca18-4a45-8183-3058afb26911 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:03:25.443204 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1161/2336] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Sep 15 18:03:25 2022] GET /identity/v3/roles => generated 1420 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 18:03:25.444967 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a36167-4d45-49f7-ad2f-214fa8e7984c admin admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:03:25.451761 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-99a36167-4d45-49f7-ad2f-214fa8e7984c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:03:25.456513 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.auth.core [None req-1f6ab2a4-ca18-4a45-8183-3058afb26911 None None] MFA Rules not processed for user `5cfa58ef86774ab7800bf91930bf6028`. Rule list: `[]` (Enabled: `True`). {{(pid=81593) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 18:03:25.457834 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-1f6ab2a4-ca18-4a45-8183-3058afb26911 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:03:25.475643 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a36167-4d45-49f7-ad2f-214fa8e7984c admin admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:03:25.499910 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 18:03:25.540010 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1176/2337] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 15 18:03:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 18:03:25.552722 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6ab2a4-ca18-4a45-8183-3058afb26911 None None] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:03:25.554744 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-1f6ab2a4-ca18-4a45-8183-3058afb26911 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:03:25.560088 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62d0e5d-83ae-42a0-b41e-02fd0d0974ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:03:25.560891 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62d0e5d-83ae-42a0-b41e-02fd0d0974ad admin admin] REQUEST_METHOD: `PUT` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:03:25.561177 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62d0e5d-83ae-42a0-b41e-02fd0d0974ad admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:03:25.561592 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62d0e5d-83ae-42a0-b41e-02fd0d0974ad admin admin] PATH_INFO: `/v3/projects/6cb500664e9c43508b34aa8a900c6625/users/78ea951cb73749628745cb20527ea735/roles/a9e42be86923434f8af52d3fc07fb4f7` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:03:25.563604 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b62d0e5d-83ae-42a0-b41e-02fd0d0974ad admin admin] RBAC: Authorizing `identity:create_grant(project_id=6cb500664e9c43508b34aa8a900c6625, user_id=78ea951cb73749628745cb20527ea735, role_id=a9e42be86923434f8af52d3fc07fb4f7)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:03:25.566313 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b62d0e5d-83ae-42a0-b41e-02fd0d0974ad admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:03:25.590376 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1162/2338] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Sep 15 18:03:25 2022] PUT /identity/v3/projects/6cb500664e9c43508b34aa8a900c6625/users/78ea951cb73749628745cb20527ea735/roles/a9e42be86923434f8af52d3fc07fb4f7 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 18:03:25.593649 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a32de93-aa3a-42cc-b957-0787a1488ea5 None None] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:03:25.594160 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a32de93-aa3a-42cc-b957-0787a1488ea5 None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:03:25.595025 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a32de93-aa3a-42cc-b957-0787a1488ea5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:03:25.633708 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 18:03:25.649987 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.auth.core [None req-9a32de93-aa3a-42cc-b957-0787a1488ea5 None None] MFA Rules not processed for user `78ea951cb73749628745cb20527ea735`. Rule list: `[]` (Enabled: `True`). {{(pid=81592) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 18:03:25.650389 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6ab2a4-ca18-4a45-8183-3058afb26911 None None] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:03:25.652638 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-9a32de93-aa3a-42cc-b957-0787a1488ea5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:03:25.727784 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d94a5d-aeed-4c3d-93c8-08a2c2213147 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a32274b4781b40fea9f28da8a9bde5ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1213c0d1b584404ba3998e136f166e89', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:03:25.728368 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d94a5d-aeed-4c3d-93c8-08a2c2213147 service neutron] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:03:25.728822 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d94a5d-aeed-4c3d-93c8-08a2c2213147 service neutron] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:03:25.728933 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d94a5d-aeed-4c3d-93c8-08a2c2213147 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:03:25.742587 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1163/2339] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 15 18:03:25 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 18:03:25.743490 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a32de93-aa3a-42cc-b957-0787a1488ea5 None None] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:03:25.747781 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-9a32de93-aa3a-42cc-b957-0787a1488ea5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:03:25.812578 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d94a5d-aeed-4c3d-93c8-08a2c2213147 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:03:25.814578 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d94a5d-aeed-4c3d-93c8-08a2c2213147 service neutron] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:03:25.824078 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a32de93-aa3a-42cc-b957-0787a1488ea5 None None] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:03:25.824906 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1177/2340] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 15 18:03:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 273 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 18:03:25.830618 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766e0e14-088e-4155-9979-4f8831bc0349 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:03:25.831446 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766e0e14-088e-4155-9979-4f8831bc0349 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:03:25.831825 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766e0e14-088e-4155-9979-4f8831bc0349 admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:03:25.832178 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766e0e14-088e-4155-9979-4f8831bc0349 admin admin] PATH_INFO: `/v3/projects/7bc958b7988d4e8bb9ca7953ea98cfce` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:03:25.833550 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d94a5d-aeed-4c3d-93c8-08a2c2213147 service neutron] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:03:25.833796 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-766e0e14-088e-4155-9979-4f8831bc0349 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7bc958b7988d4e8bb9ca7953ea98cfce)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:03:25.834936 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-68d94a5d-aeed-4c3d-93c8-08a2c2213147 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:03:25.835963 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-766e0e14-088e-4155-9979-4f8831bc0349 admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:03:25.899445 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-766e0e14-088e-4155-9979-4f8831bc0349 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7bc958b7988d4e8bb9ca7953ea98cfce', 'request_id': 'req-766e0e14-088e-4155-9979-4f8831bc0349'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:03:25.901229 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 18:03:25.907275 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-766e0e14-088e-4155-9979-4f8831bc0349 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7bc958b7988d4e8bb9ca7953ea98cfce', 'request_id': 'req-766e0e14-088e-4155-9979-4f8831bc0349'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:03:25.942758 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-766e0e14-088e-4155-9979-4f8831bc0349 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7bc958b7988d4e8bb9ca7953ea98cfce', 'request_id': 'req-766e0e14-088e-4155-9979-4f8831bc0349'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:03:25.943915 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d94a5d-aeed-4c3d-93c8-08a2c2213147 service neutron] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:03:25.962329 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-766e0e14-088e-4155-9979-4f8831bc0349 admin admin] The token cache is being invalidate because project 7bc958b7988d4e8bb9ca7953ea98cfce was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81592) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 18:03:25.962893 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-766e0e14-088e-4155-9979-4f8831bc0349 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:03:25.964054 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-766e0e14-088e-4155-9979-4f8831bc0349 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:03:25.970649 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1164/2341] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Sep 15 18:03:25 2022] DELETE /identity/v3/projects/7bc958b7988d4e8bb9ca7953ea98cfce => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 18:03:25.974688 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766e0e14-088e-4155-9979-4f8831bc0349 admin admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:03:25.976816 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-766e0e14-088e-4155-9979-4f8831bc0349 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:03:26.019067 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 18:03:26.055766 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36739544-6ce4-4aba-bbd1-d148f745e8a1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b232e7a841145ba93c6d8462ccb751a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1213c0d1b584404ba3998e136f166e89', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:03:26.056120 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36739544-6ce4-4aba-bbd1-d148f745e8a1 service cinder] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:03:26.056381 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36739544-6ce4-4aba-bbd1-d148f745e8a1 service cinder] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:03:26.056654 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36739544-6ce4-4aba-bbd1-d148f745e8a1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:03:26.058861 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-36739544-6ce4-4aba-bbd1-d148f745e8a1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:03:26.092388 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766e0e14-088e-4155-9979-4f8831bc0349 admin admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:03:26.097769 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11a00d4-e441-4048-8108-c2fbc159e342 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:03:26.098779 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11a00d4-e441-4048-8108-c2fbc159e342 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:03:26.099061 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11a00d4-e441-4048-8108-c2fbc159e342 admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:03:26.099335 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11a00d4-e441-4048-8108-c2fbc159e342 admin admin] PATH_INFO: `/v3/users/07700e7090ed4084a756f93d407fa037` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:03:26.102067 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c11a00d4-e441-4048-8108-c2fbc159e342 admin admin] RBAC: Authorizing `identity:delete_user(user_id=07700e7090ed4084a756f93d407fa037)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:03:26.103997 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c11a00d4-e441-4048-8108-c2fbc159e342 admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:03:26.139146 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36739544-6ce4-4aba-bbd1-d148f745e8a1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:03:26.140571 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36739544-6ce4-4aba-bbd1-d148f745e8a1 service cinder] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:03:26.154470 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1178/2342] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 15 18:03:25 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 18:03:26.176873 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-c11a00d4-e441-4048-8108-c2fbc159e342 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '07700e7090ed4084a756f93d407fa037'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:03:26.200841 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-c11a00d4-e441-4048-8108-c2fbc159e342 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '07700e7090ed4084a756f93d407fa037'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:03:26.203489 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-c11a00d4-e441-4048-8108-c2fbc159e342 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '07700e7090ed4084a756f93d407fa037'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:03:26.205727 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-c11a00d4-e441-4048-8108-c2fbc159e342 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '07700e7090ed4084a756f93d407fa037'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:03:26.224518 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-c11a00d4-e441-4048-8108-c2fbc159e342 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '07700e7090ed4084a756f93d407fa037'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:03:26.226954 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36739544-6ce4-4aba-bbd1-d148f745e8a1 service cinder] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:03:26.228514 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-36739544-6ce4-4aba-bbd1-d148f745e8a1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:03:26.255823 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36739544-6ce4-4aba-bbd1-d148f745e8a1 service cinder] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:03:26.271523 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1165/2343] 10.222.0.25 () {58 vars in 1224 bytes} [Thu Sep 15 18:03:25 2022] DELETE /identity/v3/users/07700e7090ed4084a756f93d407fa037 => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 18:03:26.281022 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543bbc25-1687-488d-8bf8-10ec11a346aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:03:26.281702 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543bbc25-1687-488d-8bf8-10ec11a346aa admin admin] REQUEST_METHOD: `DELETE` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:03:26.281982 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543bbc25-1687-488d-8bf8-10ec11a346aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:03:26.282256 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543bbc25-1687-488d-8bf8-10ec11a346aa admin admin] PATH_INFO: `/v3/projects/d1625fcdfd904b6c91488a1ce6e97e3e` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:03:26.283852 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-543bbc25-1687-488d-8bf8-10ec11a346aa admin admin] RBAC: Authorizing `identity:delete_project(project_id=d1625fcdfd904b6c91488a1ce6e97e3e)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:03:26.285931 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-543bbc25-1687-488d-8bf8-10ec11a346aa admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:03:26.358410 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-543bbc25-1687-488d-8bf8-10ec11a346aa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd1625fcdfd904b6c91488a1ce6e97e3e', 'request_id': 'req-543bbc25-1687-488d-8bf8-10ec11a346aa'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:03:26.367748 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-543bbc25-1687-488d-8bf8-10ec11a346aa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd1625fcdfd904b6c91488a1ce6e97e3e', 'request_id': 'req-543bbc25-1687-488d-8bf8-10ec11a346aa'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:03:26.378807 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-543bbc25-1687-488d-8bf8-10ec11a346aa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd1625fcdfd904b6c91488a1ce6e97e3e', 'request_id': 'req-543bbc25-1687-488d-8bf8-10ec11a346aa'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:03:26.405685 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-543bbc25-1687-488d-8bf8-10ec11a346aa admin admin] The token cache is being invalidate because project d1625fcdfd904b6c91488a1ce6e97e3e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81593) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 18:03:26.406160 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-543bbc25-1687-488d-8bf8-10ec11a346aa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:03:26.406851 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-543bbc25-1687-488d-8bf8-10ec11a346aa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:03:26.408727 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1179/2344] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Sep 15 18:03:26 2022] DELETE /identity/v3/projects/d1625fcdfd904b6c91488a1ce6e97e3e => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 15 18:03:26.412530 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11a00d4-e441-4048-8108-c2fbc159e342 admin admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:03:26.414151 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-c11a00d4-e441-4048-8108-c2fbc159e342 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:03:26.545908 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11a00d4-e441-4048-8108-c2fbc159e342 admin admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:03:26.636292 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 18:03:26.648398 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cea6424-9108-40a7-af2b-c36a5b5fd2e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:03:26.649105 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cea6424-9108-40a7-af2b-c36a5b5fd2e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:03:26.653624 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cea6424-9108-40a7-af2b-c36a5b5fd2e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:03:26.654784 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cea6424-9108-40a7-af2b-c36a5b5fd2e7 admin admin] PATH_INFO: `/v3/users/2a7601305407452eb1fe4da2b091b2ad` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:03:26.656389 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cea6424-9108-40a7-af2b-c36a5b5fd2e7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2a7601305407452eb1fe4da2b091b2ad)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:03:26.660273 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cea6424-9108-40a7-af2b-c36a5b5fd2e7 admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:03:26.719740 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543bbc25-1687-488d-8bf8-10ec11a346aa admin admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:03:26.721273 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-543bbc25-1687-488d-8bf8-10ec11a346aa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:03:26.771239 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543bbc25-1687-488d-8bf8-10ec11a346aa admin admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:03:26.790511 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fae7eef-cc45-4050-ba70-f9f4fd268c62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:03:26.791644 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fae7eef-cc45-4050-ba70-f9f4fd268c62 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:03:26.792025 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fae7eef-cc45-4050-ba70-f9f4fd268c62 admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:03:26.792399 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fae7eef-cc45-4050-ba70-f9f4fd268c62 admin admin] PATH_INFO: `/v3/projects/25e5ffb6a2304d28bdc784c41935b613` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:03:26.793323 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-2cea6424-9108-40a7-af2b-c36a5b5fd2e7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2a7601305407452eb1fe4da2b091b2ad'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:03:26.794703 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fae7eef-cc45-4050-ba70-f9f4fd268c62 admin admin] RBAC: Authorizing `identity:delete_project(project_id=25e5ffb6a2304d28bdc784c41935b613)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:03:26.800379 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fae7eef-cc45-4050-ba70-f9f4fd268c62 admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:03:26.803345 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-2cea6424-9108-40a7-af2b-c36a5b5fd2e7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2a7601305407452eb1fe4da2b091b2ad'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:03:26.804320 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-2cea6424-9108-40a7-af2b-c36a5b5fd2e7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2a7601305407452eb1fe4da2b091b2ad'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:03:26.805131 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-2cea6424-9108-40a7-af2b-c36a5b5fd2e7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2a7601305407452eb1fe4da2b091b2ad'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:03:26.816798 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-2cea6424-9108-40a7-af2b-c36a5b5fd2e7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2a7601305407452eb1fe4da2b091b2ad'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:03:26.840995 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 18:03:26.852500 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1166/2345] 10.222.0.25 () {58 vars in 1224 bytes} [Thu Sep 15 18:03:26 2022] DELETE /identity/v3/users/2a7601305407452eb1fe4da2b091b2ad => generated 0 bytes in 437 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 18:03:26.877984 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-2fae7eef-cc45-4050-ba70-f9f4fd268c62 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '25e5ffb6a2304d28bdc784c41935b613', 'request_id': 'req-2fae7eef-cc45-4050-ba70-f9f4fd268c62'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:03:26.891233 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-2fae7eef-cc45-4050-ba70-f9f4fd268c62 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '25e5ffb6a2304d28bdc784c41935b613', 'request_id': 'req-2fae7eef-cc45-4050-ba70-f9f4fd268c62'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:03:26.901530 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-2fae7eef-cc45-4050-ba70-f9f4fd268c62 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '25e5ffb6a2304d28bdc784c41935b613', 'request_id': 'req-2fae7eef-cc45-4050-ba70-f9f4fd268c62'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:03:26.937518 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-2fae7eef-cc45-4050-ba70-f9f4fd268c62 admin admin] The token cache is being invalidate because project 25e5ffb6a2304d28bdc784c41935b613 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81593) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 18:03:26.937923 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-2fae7eef-cc45-4050-ba70-f9f4fd268c62 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:03:26.938704 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-2fae7eef-cc45-4050-ba70-f9f4fd268c62 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:03:26.943823 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1180/2346] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Sep 15 18:03:26 2022] DELETE /identity/v3/projects/25e5ffb6a2304d28bdc784c41935b613 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 18:03:26.945683 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc0e12d-9577-48ac-880a-b3f49179970a None None] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:03:26.946034 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc0e12d-9577-48ac-880a-b3f49179970a None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:03:26.946312 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc0e12d-9577-48ac-880a-b3f49179970a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:03:26.977273 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.auth.core [None req-7dc0e12d-9577-48ac-880a-b3f49179970a None None] MFA Rules not processed for user `5cfa58ef86774ab7800bf91930bf6028`. Rule list: `[]` (Enabled: `True`). {{(pid=81592) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 18:03:26.978570 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-7dc0e12d-9577-48ac-880a-b3f49179970a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:03:27.080917 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1167/2347] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 15 18:03:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 18:03:27.089901 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56db6a0-9276-4acb-aac7-d0715cc0448f None None] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:03:27.090859 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56db6a0-9276-4acb-aac7-d0715cc0448f None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:03:27.091267 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56db6a0-9276-4acb-aac7-d0715cc0448f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:03:27.124648 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.auth.core [None req-a56db6a0-9276-4acb-aac7-d0715cc0448f None None] MFA Rules not processed for user `5cfa58ef86774ab7800bf91930bf6028`. Rule list: `[]` (Enabled: `True`). {{(pid=81593) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 18:03:27.133113 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-a56db6a0-9276-4acb-aac7-d0715cc0448f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:03:27.156969 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc0e12d-9577-48ac-880a-b3f49179970a None None] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:03:27.158909 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1181/2348] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 15 18:03:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 18:03:27.162382 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-7dc0e12d-9577-48ac-880a-b3f49179970a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:03:27.164588 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56db6a0-9276-4acb-aac7-d0715cc0448f None None] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:03:27.176907 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc0e12d-9577-48ac-880a-b3f49179970a None None] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:03:27.182165 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56db6a0-9276-4acb-aac7-d0715cc0448f None None] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:03:27.184627 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26d066a-b14c-44cc-8e4a-c3c142e5f018 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:03:27.185482 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26d066a-b14c-44cc-8e4a-c3c142e5f018 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:03:27.186415 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26d066a-b14c-44cc-8e4a-c3c142e5f018 admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:03:27.186813 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26d066a-b14c-44cc-8e4a-c3c142e5f018 admin admin] PATH_INFO: `/v3/users/37264be5d6874d2fbac30e3a6206efa8` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:03:27.188130 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e26d066a-b14c-44cc-8e4a-c3c142e5f018 admin admin] RBAC: Authorizing `identity:delete_user(user_id=37264be5d6874d2fbac30e3a6206efa8)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:03:27.188252 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8069b0a5-36de-4536-b4e4-0f4aad7e75ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:03:27.188773 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8069b0a5-36de-4536-b4e4-0f4aad7e75ed admin admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:03:27.189060 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8069b0a5-36de-4536-b4e4-0f4aad7e75ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:03:27.189632 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8069b0a5-36de-4536-b4e4-0f4aad7e75ed admin admin] PATH_INFO: `/v3/domains` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:03:27.190341 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8069b0a5-36de-4536-b4e4-0f4aad7e75ed admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81593) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 18:03:27.190650 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8069b0a5-36de-4536-b4e4-0f4aad7e75ed admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:03:27.191621 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e26d066a-b14c-44cc-8e4a-c3c142e5f018 admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:03:27.193328 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8069b0a5-36de-4536-b4e4-0f4aad7e75ed admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:03:27.210671 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1182/2349] 10.222.0.25 () {58 vars in 1153 bytes} [Thu Sep 15 18:03:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 18:03:27.217441 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8069b0a5-36de-4536-b4e4-0f4aad7e75ed admin admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:03:27.240296 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8069b0a5-36de-4536-b4e4-0f4aad7e75ed admin admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:03:27.248792 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7dce10f-e0cb-462a-898b-058eb780da09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:03:27.249624 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7dce10f-e0cb-462a-898b-058eb780da09 admin admin] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:03:27.249934 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7dce10f-e0cb-462a-898b-058eb780da09 admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:03:27.250312 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7dce10f-e0cb-462a-898b-058eb780da09 admin admin] PATH_INFO: `/v3/projects` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:03:27.251026 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7dce10f-e0cb-462a-898b-058eb780da09 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:03:27.254439 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7dce10f-e0cb-462a-898b-058eb780da09 admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:03:27.287770 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-e26d066a-b14c-44cc-8e4a-c3c142e5f018 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '37264be5d6874d2fbac30e3a6206efa8'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:03:27.304914 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-e26d066a-b14c-44cc-8e4a-c3c142e5f018 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '37264be5d6874d2fbac30e3a6206efa8'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:03:27.305194 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1183/2350] 10.222.0.25 () {60 vars in 1153 bytes} [Thu Sep 15 18:03:27 2022] POST /identity/v3/projects => generated 371 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 18:03:27.307780 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7dce10f-e0cb-462a-898b-058eb780da09 admin admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:03:27.308157 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-b7dce10f-e0cb-462a-898b-058eb780da09 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:03:27.308560 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-e26d066a-b14c-44cc-8e4a-c3c142e5f018 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '37264be5d6874d2fbac30e3a6206efa8'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:03:27.310686 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-e26d066a-b14c-44cc-8e4a-c3c142e5f018 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '37264be5d6874d2fbac30e3a6206efa8'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:03:27.324124 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-e26d066a-b14c-44cc-8e4a-c3c142e5f018 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '37264be5d6874d2fbac30e3a6206efa8'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:03:27.327428 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=80,keystone:DELETE=18,keystone:INSERT=2 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 18:03:27.366818 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1168/2351] 10.222.0.25 () {58 vars in 1224 bytes} [Thu Sep 15 18:03:27 2022] DELETE /identity/v3/users/37264be5d6874d2fbac30e3a6206efa8 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 18:03:27.367669 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26d066a-b14c-44cc-8e4a-c3c142e5f018 admin admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:03:27.369089 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-e26d066a-b14c-44cc-8e4a-c3c142e5f018 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:03:27.425845 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7dce10f-e0cb-462a-898b-058eb780da09 admin admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:03:27.477249 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26d066a-b14c-44cc-8e4a-c3c142e5f018 admin admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:03:27.484570 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec0b55e-c212-404f-b42b-c0ff5efa021b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:03:27.486589 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec0b55e-c212-404f-b42b-c0ff5efa021b admin admin] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:03:27.487719 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec0b55e-c212-404f-b42b-c0ff5efa021b admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:03:27.488267 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec0b55e-c212-404f-b42b-c0ff5efa021b admin admin] PATH_INFO: `/v3/users` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:03:27.489476 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec0b55e-c212-404f-b42b-c0ff5efa021b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:03:27.492561 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec0b55e-c212-404f-b42b-c0ff5efa021b admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:03:27.529013 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1169/2352] 10.222.0.25 () {60 vars in 1144 bytes} [Thu Sep 15 18:03:27 2022] POST /identity/v3/users => generated 286 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 18:03:27.531404 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173dbf45-4879-4c64-be5a-58cb56275014 None None] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:03:27.532090 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173dbf45-4879-4c64-be5a-58cb56275014 None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:03:27.532890 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173dbf45-4879-4c64-be5a-58cb56275014 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:03:27.537434 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d87444-807a-4ed8-a05a-7bd39ea01742 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:03:27.538095 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d87444-807a-4ed8-a05a-7bd39ea01742 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:03:27.538369 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d87444-807a-4ed8-a05a-7bd39ea01742 admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:03:27.538696 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d87444-807a-4ed8-a05a-7bd39ea01742 admin admin] PATH_INFO: `/v3/projects/13c8b1aa100841cda22a4233e2aba845` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:03:27.545205 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d87444-807a-4ed8-a05a-7bd39ea01742 admin admin] RBAC: Authorizing `identity:delete_project(project_id=13c8b1aa100841cda22a4233e2aba845)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:03:27.545205 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d87444-807a-4ed8-a05a-7bd39ea01742 admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:03:27.559397 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.auth.core [None req-173dbf45-4879-4c64-be5a-58cb56275014 None None] MFA Rules not processed for user `5cfa58ef86774ab7800bf91930bf6028`. Rule list: `[]` (Enabled: `True`). {{(pid=81592) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 18:03:27.560763 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-173dbf45-4879-4c64-be5a-58cb56275014 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:03:27.564597 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:DELETE=7,keystone:SELECT=91,keystone:INSERT=2 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 18:03:27.569095 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1170/2353] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 15 18:03:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 18:03:27.573177 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173dbf45-4879-4c64-be5a-58cb56275014 None None] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:03:27.595089 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173dbf45-4879-4c64-be5a-58cb56275014 None None] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:03:27.601907 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8afb2c1-2bba-4ceb-80a4-31e94946e513 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:03:27.602536 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8afb2c1-2bba-4ceb-80a4-31e94946e513 admin admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:03:27.602882 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8afb2c1-2bba-4ceb-80a4-31e94946e513 admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:03:27.603159 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8afb2c1-2bba-4ceb-80a4-31e94946e513 admin admin] PATH_INFO: `/v3/roles` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:03:27.603835 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8afb2c1-2bba-4ceb-80a4-31e94946e513 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:03:27.605466 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8afb2c1-2bba-4ceb-80a4-31e94946e513 admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:03:27.614588 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-66d87444-807a-4ed8-a05a-7bd39ea01742 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '13c8b1aa100841cda22a4233e2aba845', 'request_id': 'req-66d87444-807a-4ed8-a05a-7bd39ea01742'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:03:27.617599 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1171/2354] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Sep 15 18:03:27 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 18:03:27.620944 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8afb2c1-2bba-4ceb-80a4-31e94946e513 admin admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:03:27.624277 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-e8afb2c1-2bba-4ceb-80a4-31e94946e513 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:03:27.628601 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-66d87444-807a-4ed8-a05a-7bd39ea01742 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '13c8b1aa100841cda22a4233e2aba845', 'request_id': 'req-66d87444-807a-4ed8-a05a-7bd39ea01742'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:03:27.639244 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-66d87444-807a-4ed8-a05a-7bd39ea01742 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '13c8b1aa100841cda22a4233e2aba845', 'request_id': 'req-66d87444-807a-4ed8-a05a-7bd39ea01742'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:03:27.659633 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-66d87444-807a-4ed8-a05a-7bd39ea01742 admin admin] The token cache is being invalidate because project 13c8b1aa100841cda22a4233e2aba845 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81593) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 18:03:27.660132 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-66d87444-807a-4ed8-a05a-7bd39ea01742 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:03:27.660970 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-66d87444-807a-4ed8-a05a-7bd39ea01742 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:03:27.668271 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1184/2355] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Sep 15 18:03:27 2022] DELETE /identity/v3/projects/13c8b1aa100841cda22a4233e2aba845 => generated 0 bytes in 358 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 18:03:27.668271 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d87444-807a-4ed8-a05a-7bd39ea01742 admin admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:03:27.672151 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-66d87444-807a-4ed8-a05a-7bd39ea01742 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:03:27.722356 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8afb2c1-2bba-4ceb-80a4-31e94946e513 admin admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:03:27.790086 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d87444-807a-4ed8-a05a-7bd39ea01742 admin admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:03:27.796566 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1f0eb6-bd5c-42fa-83a0-070cb0b43074 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:03:27.797485 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1f0eb6-bd5c-42fa-83a0-070cb0b43074 admin admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:03:27.797862 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1f0eb6-bd5c-42fa-83a0-070cb0b43074 admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:03:27.798233 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1f0eb6-bd5c-42fa-83a0-070cb0b43074 admin admin] PATH_INFO: `/v3/roles` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:03:27.799073 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1f0eb6-bd5c-42fa-83a0-070cb0b43074 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:03:27.799539 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55cfa382-1673-457f-8540-dde94e7e1768 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a32274b4781b40fea9f28da8a9bde5ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1213c0d1b584404ba3998e136f166e89', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:03:27.800579 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cfa382-1673-457f-8540-dde94e7e1768 service neutron] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:03:27.801059 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cfa382-1673-457f-8540-dde94e7e1768 service neutron] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:03:27.801828 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cfa382-1673-457f-8540-dde94e7e1768 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:03:27.804667 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1f0eb6-bd5c-42fa-83a0-070cb0b43074 admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:03:27.808205 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-55cfa382-1673-457f-8540-dde94e7e1768 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:03:27.817682 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1185/2356] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Sep 15 18:03:27 2022] GET /identity/v3/roles => generated 1420 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 18:03:27.822374 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcdf96f-a199-449e-8b9f-074b67ef1791 None None] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:03:27.822776 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcdf96f-a199-449e-8b9f-074b67ef1791 None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:03:27.823148 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcdf96f-a199-449e-8b9f-074b67ef1791 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:03:27.841848 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55cfa382-1673-457f-8540-dde94e7e1768 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:03:27.844261 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55cfa382-1673-457f-8540-dde94e7e1768 service neutron] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:03:27.858450 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.auth.core [None req-7fcdf96f-a199-449e-8b9f-074b67ef1791 None None] MFA Rules not processed for user `5cfa58ef86774ab7800bf91930bf6028`. Rule list: `[]` (Enabled: `True`). {{(pid=81593) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 18:03:27.859988 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-7fcdf96f-a199-449e-8b9f-074b67ef1791 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:03:27.877517 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1186/2357] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 15 18:03:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 18:03:27.877517 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fcdf96f-a199-449e-8b9f-074b67ef1791 None None] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:03:27.878126 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1172/2358] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 15 18:03:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 259 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 18:03:27.884776 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e506a76-6969-48de-9f2f-465f46819640 None None] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:03:27.885227 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e506a76-6969-48de-9f2f-465f46819640 None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:03:27.885695 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e506a76-6969-48de-9f2f-465f46819640 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:03:27.900008 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fcdf96f-a199-449e-8b9f-074b67ef1791 None None] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:03:27.908129 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1db7158-78f9-4b4f-98ae-6fdb6c2cc11a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:03:27.909083 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1db7158-78f9-4b4f-98ae-6fdb6c2cc11a admin admin] REQUEST_METHOD: `PUT` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:03:27.910012 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1db7158-78f9-4b4f-98ae-6fdb6c2cc11a admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:03:27.910392 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1db7158-78f9-4b4f-98ae-6fdb6c2cc11a admin admin] PATH_INFO: `/v3/projects/fc401dbcd7ed4b828aed0d0ceeb9319a/users/35697e7417474655a739823e5c457f24/roles/343cc8b1bc7243eebabdf08147e8366d` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:03:27.942427 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.auth.core [None req-8e506a76-6969-48de-9f2f-465f46819640 None None] MFA Rules not processed for user `5cfa58ef86774ab7800bf91930bf6028`. Rule list: `[]` (Enabled: `True`). {{(pid=81592) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 18:03:27.946589 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-8e506a76-6969-48de-9f2f-465f46819640 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:03:27.954211 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1db7158-78f9-4b4f-98ae-6fdb6c2cc11a admin admin] RBAC: Authorizing `identity:create_grant(project_id=fc401dbcd7ed4b828aed0d0ceeb9319a, user_id=35697e7417474655a739823e5c457f24, role_id=343cc8b1bc7243eebabdf08147e8366d)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:03:27.957256 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1db7158-78f9-4b4f-98ae-6fdb6c2cc11a admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:03:27.973399 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1173/2359] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 15 18:03:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 18:03:27.974885 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e506a76-6969-48de-9f2f-465f46819640 None None] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:03:27.996383 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1187/2360] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Sep 15 18:03:27 2022] PUT /identity/v3/projects/fc401dbcd7ed4b828aed0d0ceeb9319a/users/35697e7417474655a739823e5c457f24/roles/343cc8b1bc7243eebabdf08147e8366d => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 18:03:28.007181 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e506a76-6969-48de-9f2f-465f46819640 None None] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:03:28.008705 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9408d44-06b2-47f0-92c5-41d00685e464 None None] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:03:28.009137 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9408d44-06b2-47f0-92c5-41d00685e464 None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:03:28.009762 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9408d44-06b2-47f0-92c5-41d00685e464 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:03:28.028285 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=95,keystone:DELETE=2,keystone:INSERT=3 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 18:03:28.079520 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.auth.core [None req-e9408d44-06b2-47f0-92c5-41d00685e464 None None] MFA Rules not processed for user `35697e7417474655a739823e5c457f24`. Rule list: `[]` (Enabled: `True`). {{(pid=81593) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 18:03:28.083710 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-e9408d44-06b2-47f0-92c5-41d00685e464 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:03:28.138305 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cac8c87-856e-4e08-8e70-f36180101b56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:03:28.139107 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cac8c87-856e-4e08-8e70-f36180101b56 admin admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:03:28.139683 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cac8c87-856e-4e08-8e70-f36180101b56 admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:03:28.140164 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cac8c87-856e-4e08-8e70-f36180101b56 admin admin] PATH_INFO: `/v3/domains` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:03:28.141157 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cac8c87-856e-4e08-8e70-f36180101b56 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81592) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 18:03:28.141863 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cac8c87-856e-4e08-8e70-f36180101b56 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:03:28.145352 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cac8c87-856e-4e08-8e70-f36180101b56 admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:03:28.160571 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1174/2361] 10.222.0.25 () {58 vars in 1153 bytes} [Thu Sep 15 18:03:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 18:03:28.165182 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cac8c87-856e-4e08-8e70-f36180101b56 admin admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:03:28.179424 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cac8c87-856e-4e08-8e70-f36180101b56 admin admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:03:28.184654 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988f3c04-340f-4184-8475-0c58b5417031 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:03:28.186220 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988f3c04-340f-4184-8475-0c58b5417031 admin admin] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:03:28.186601 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988f3c04-340f-4184-8475-0c58b5417031 admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:03:28.187001 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988f3c04-340f-4184-8475-0c58b5417031 admin admin] PATH_INFO: `/v3/projects` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:03:28.187872 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-988f3c04-340f-4184-8475-0c58b5417031 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:03:28.190451 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-988f3c04-340f-4184-8475-0c58b5417031 admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:03:28.241643 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1175/2362] 10.222.0.25 () {60 vars in 1153 bytes} [Thu Sep 15 18:03:28 2022] POST /identity/v3/projects => generated 391 bytes in 77 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 18:03:28.247483 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988f3c04-340f-4184-8475-0c58b5417031 admin admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:03:28.258988 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 18:03:28.280753 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1188/2363] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 15 18:03:28 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 270 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 18:03:28.291430 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9408d44-06b2-47f0-92c5-41d00685e464 None None] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:03:28.294139 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-e9408d44-06b2-47f0-92c5-41d00685e464 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:03:28.353105 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988f3c04-340f-4184-8475-0c58b5417031 admin admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:03:28.359683 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e354b34-bc5a-46ac-8224-183dadafa613 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:03:28.360495 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e354b34-bc5a-46ac-8224-183dadafa613 admin admin] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:03:28.360786 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e354b34-bc5a-46ac-8224-183dadafa613 admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:03:28.361161 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e354b34-bc5a-46ac-8224-183dadafa613 admin admin] PATH_INFO: `/v3/users` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:03:28.361901 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e354b34-bc5a-46ac-8224-183dadafa613 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:03:28.364019 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e354b34-bc5a-46ac-8224-183dadafa613 admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:03:28.410837 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1176/2364] 10.222.0.25 () {60 vars in 1144 bytes} [Thu Sep 15 18:03:28 2022] POST /identity/v3/users => generated 296 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 15 18:03:28.412513 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e354b34-bc5a-46ac-8224-183dadafa613 admin admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:03:28.434081 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e354b34-bc5a-46ac-8224-183dadafa613 admin admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:03:28.452533 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf36a1f-5676-4b1a-b905-c06977364759 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:03:28.453168 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf36a1f-5676-4b1a-b905-c06977364759 admin admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:03:28.453492 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf36a1f-5676-4b1a-b905-c06977364759 admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:03:28.453769 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf36a1f-5676-4b1a-b905-c06977364759 admin admin] PATH_INFO: `/v3/roles` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:03:28.454485 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf36a1f-5676-4b1a-b905-c06977364759 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:03:28.456190 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf36a1f-5676-4b1a-b905-c06977364759 admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:03:28.493992 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1177/2365] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Sep 15 18:03:28 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 18:03:28.495178 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf36a1f-5676-4b1a-b905-c06977364759 admin admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:03:28.509140 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf36a1f-5676-4b1a-b905-c06977364759 admin admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:03:28.519904 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd96ff6e-d24e-49e9-a5f5-c3eb87489ec6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:03:28.520540 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd96ff6e-d24e-49e9-a5f5-c3eb87489ec6 admin admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:03:28.520823 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd96ff6e-d24e-49e9-a5f5-c3eb87489ec6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:03:28.521097 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd96ff6e-d24e-49e9-a5f5-c3eb87489ec6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:03:28.521958 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd96ff6e-d24e-49e9-a5f5-c3eb87489ec6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:03:28.522106 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9408d44-06b2-47f0-92c5-41d00685e464 None None] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:03:28.524133 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd96ff6e-d24e-49e9-a5f5-c3eb87489ec6 admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:03:28.549737 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1178/2366] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Sep 15 18:03:28 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 18:03:28.550585 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd96ff6e-d24e-49e9-a5f5-c3eb87489ec6 admin admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:03:28.554448 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-cd96ff6e-d24e-49e9-a5f5-c3eb87489ec6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:03:28.582386 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd96ff6e-d24e-49e9-a5f5-c3eb87489ec6 admin admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:03:28.589890 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9347965f-0915-4154-878c-e9afa2042fee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:03:28.592053 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9347965f-0915-4154-878c-e9afa2042fee admin admin] REQUEST_METHOD: `DELETE` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:03:28.592348 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9347965f-0915-4154-878c-e9afa2042fee admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:03:28.592624 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9347965f-0915-4154-878c-e9afa2042fee admin admin] PATH_INFO: `/v3/projects/ff3d7f268f0241bcb08466b80e5d4475` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:03:28.593839 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9347965f-0915-4154-878c-e9afa2042fee admin admin] RBAC: Authorizing `identity:delete_project(project_id=ff3d7f268f0241bcb08466b80e5d4475)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:03:28.595799 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9347965f-0915-4154-878c-e9afa2042fee admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:03:28.621477 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51ab8a5-fed2-43be-8f02-34df584e5e7d service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c194f79928aa4a4d94619c417b4e39e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1213c0d1b584404ba3998e136f166e89', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:03:28.622322 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51ab8a5-fed2-43be-8f02-34df584e5e7d service glance] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:03:28.622737 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51ab8a5-fed2-43be-8f02-34df584e5e7d service glance] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:03:28.623336 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51ab8a5-fed2-43be-8f02-34df584e5e7d service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:03:28.665571 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=93,keystone:INSERT=4,keystone:DELETE=3 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 18:03:28.676083 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-9347965f-0915-4154-878c-e9afa2042fee admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ff3d7f268f0241bcb08466b80e5d4475', 'request_id': 'req-9347965f-0915-4154-878c-e9afa2042fee'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:03:28.682796 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-9347965f-0915-4154-878c-e9afa2042fee admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ff3d7f268f0241bcb08466b80e5d4475', 'request_id': 'req-9347965f-0915-4154-878c-e9afa2042fee'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:03:28.693499 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-9347965f-0915-4154-878c-e9afa2042fee admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ff3d7f268f0241bcb08466b80e5d4475', 'request_id': 'req-9347965f-0915-4154-878c-e9afa2042fee'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:03:28.709596 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c51ab8a5-fed2-43be-8f02-34df584e5e7d service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:03:28.711433 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c51ab8a5-fed2-43be-8f02-34df584e5e7d service glance] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:03:28.722845 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-9347965f-0915-4154-878c-e9afa2042fee admin admin] The token cache is being invalidate because project ff3d7f268f0241bcb08466b80e5d4475 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81592) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 18:03:28.723473 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-9347965f-0915-4154-878c-e9afa2042fee admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:03:28.725107 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-9347965f-0915-4154-878c-e9afa2042fee admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:03:28.725820 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1189/2367] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 15 18:03:28 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 435 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 18:03:28.726862 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51ab8a5-fed2-43be-8f02-34df584e5e7d service glance] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:03:28.742494 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1179/2368] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Sep 15 18:03:28 2022] DELETE /identity/v3/projects/ff3d7f268f0241bcb08466b80e5d4475 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 18:03:28.742748 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51ab8a5-fed2-43be-8f02-34df584e5e7d service glance] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:03:28.744404 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9347965f-0915-4154-878c-e9afa2042fee admin admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:03:28.747032 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-9347965f-0915-4154-878c-e9afa2042fee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:03:28.823085 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a54193-5cf6-4942-bb3f-2e8700b84cd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:03:28.823961 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a54193-5cf6-4942-bb3f-2e8700b84cd6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:03:28.824510 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a54193-5cf6-4942-bb3f-2e8700b84cd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:03:28.825361 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a54193-5cf6-4942-bb3f-2e8700b84cd6 admin admin] PATH_INFO: `/v3/projects/8610d7d94dbd4009b3f0eb3d9449cbcd/users/fda1ff5394044f45889267cdcd300017/roles/343cc8b1bc7243eebabdf08147e8366d` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:03:28.841495 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9347965f-0915-4154-878c-e9afa2042fee admin admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:03:28.843151 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a54193-5cf6-4942-bb3f-2e8700b84cd6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8610d7d94dbd4009b3f0eb3d9449cbcd, user_id=fda1ff5394044f45889267cdcd300017, role_id=343cc8b1bc7243eebabdf08147e8366d)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:03:28.846303 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a54193-5cf6-4942-bb3f-2e8700b84cd6 admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:03:28.847188 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f416592f-42e8-4b4e-b0c9-b8449a20512f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:03:28.847993 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f416592f-42e8-4b4e-b0c9-b8449a20512f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:03:28.848795 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 18:03:28.848931 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f416592f-42e8-4b4e-b0c9-b8449a20512f admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:03:28.849151 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f416592f-42e8-4b4e-b0c9-b8449a20512f admin admin] PATH_INFO: `/v3/users/78ea951cb73749628745cb20527ea735` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:03:28.851266 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f416592f-42e8-4b4e-b0c9-b8449a20512f admin admin] RBAC: Authorizing `identity:delete_user(user_id=78ea951cb73749628745cb20527ea735)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:03:28.853873 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f416592f-42e8-4b4e-b0c9-b8449a20512f admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:03:28.877566 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1190/2369] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Sep 15 18:03:28 2022] PUT /identity/v3/projects/8610d7d94dbd4009b3f0eb3d9449cbcd/users/fda1ff5394044f45889267cdcd300017/roles/343cc8b1bc7243eebabdf08147e8366d => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 18:03:28.879575 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86345663-5686-4a13-8482-1b986d5c5953 None None] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:03:28.879817 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86345663-5686-4a13-8482-1b986d5c5953 None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:03:28.880548 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86345663-5686-4a13-8482-1b986d5c5953 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:03:28.916228 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-f416592f-42e8-4b4e-b0c9-b8449a20512f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '78ea951cb73749628745cb20527ea735'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:03:28.921845 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.auth.core [None req-86345663-5686-4a13-8482-1b986d5c5953 None None] MFA Rules not processed for user `fda1ff5394044f45889267cdcd300017`. Rule list: `[]` (Enabled: `True`). {{(pid=81593) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 18:03:28.929844 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-86345663-5686-4a13-8482-1b986d5c5953 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:03:28.935301 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-f416592f-42e8-4b4e-b0c9-b8449a20512f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '78ea951cb73749628745cb20527ea735'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:03:28.936212 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-f416592f-42e8-4b4e-b0c9-b8449a20512f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '78ea951cb73749628745cb20527ea735'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:03:28.937155 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-f416592f-42e8-4b4e-b0c9-b8449a20512f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '78ea951cb73749628745cb20527ea735'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:03:28.948613 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-f416592f-42e8-4b4e-b0c9-b8449a20512f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '78ea951cb73749628745cb20527ea735'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:03:28.974333 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1180/2370] 10.222.0.25 () {58 vars in 1224 bytes} [Thu Sep 15 18:03:28 2022] DELETE /identity/v3/users/78ea951cb73749628745cb20527ea735 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 18:03:29.010058 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1191/2371] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 15 18:03:28 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 18:03:29.027059 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f416592f-42e8-4b4e-b0c9-b8449a20512f admin admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:03:29.028640 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-f416592f-42e8-4b4e-b0c9-b8449a20512f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:03:29.103248 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 18:03:29.111505 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f416592f-42e8-4b4e-b0c9-b8449a20512f admin admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:03:29.120844 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c329c3cb-c06b-4fb6-9312-1fbed7cc89ef service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b232e7a841145ba93c6d8462ccb751a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1213c0d1b584404ba3998e136f166e89', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:03:29.122274 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c329c3cb-c06b-4fb6-9312-1fbed7cc89ef service cinder] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:03:29.123103 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c329c3cb-c06b-4fb6-9312-1fbed7cc89ef service cinder] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:03:29.123442 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c329c3cb-c06b-4fb6-9312-1fbed7cc89ef service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:03:29.200926 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c329c3cb-c06b-4fb6-9312-1fbed7cc89ef service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:03:29.202485 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c329c3cb-c06b-4fb6-9312-1fbed7cc89ef service cinder] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:03:29.214978 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1181/2372] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 15 18:03:29 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 188 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 18:03:29.314526 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86345663-5686-4a13-8482-1b986d5c5953 None None] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:03:29.315981 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-86345663-5686-4a13-8482-1b986d5c5953 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:03:29.423878 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86345663-5686-4a13-8482-1b986d5c5953 None None] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:03:29.502926 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c003c2b2-f5e1-46bc-a1be-cecbd80b2f39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:03:29.503495 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c003c2b2-f5e1-46bc-a1be-cecbd80b2f39 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:03:29.503758 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c003c2b2-f5e1-46bc-a1be-cecbd80b2f39 admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:03:29.504030 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c003c2b2-f5e1-46bc-a1be-cecbd80b2f39 admin admin] PATH_INFO: `/v3/projects/6cb500664e9c43508b34aa8a900c6625` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:03:29.505182 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c003c2b2-f5e1-46bc-a1be-cecbd80b2f39 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6cb500664e9c43508b34aa8a900c6625)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:03:29.508414 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c003c2b2-f5e1-46bc-a1be-cecbd80b2f39 admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:03:29.564596 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:INSERT=1,keystone:SELECT=97,keystone:DELETE=2 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 18:03:29.585150 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-c003c2b2-f5e1-46bc-a1be-cecbd80b2f39 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6cb500664e9c43508b34aa8a900c6625', 'request_id': 'req-c003c2b2-f5e1-46bc-a1be-cecbd80b2f39'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:03:29.606986 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-c003c2b2-f5e1-46bc-a1be-cecbd80b2f39 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6cb500664e9c43508b34aa8a900c6625', 'request_id': 'req-c003c2b2-f5e1-46bc-a1be-cecbd80b2f39'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:03:29.626482 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-c003c2b2-f5e1-46bc-a1be-cecbd80b2f39 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6cb500664e9c43508b34aa8a900c6625', 'request_id': 'req-c003c2b2-f5e1-46bc-a1be-cecbd80b2f39'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:03:29.648127 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-c003c2b2-f5e1-46bc-a1be-cecbd80b2f39 admin admin] The token cache is being invalidate because project 6cb500664e9c43508b34aa8a900c6625 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81593) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 18:03:29.648633 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-c003c2b2-f5e1-46bc-a1be-cecbd80b2f39 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:03:29.649997 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-c003c2b2-f5e1-46bc-a1be-cecbd80b2f39 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:03:29.656414 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1192/2373] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Sep 15 18:03:29 2022] DELETE /identity/v3/projects/6cb500664e9c43508b34aa8a900c6625 => generated 0 bytes in 342 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 18:03:29.673825 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150850b7-056c-47c0-bd1c-1e611a9615ba None None] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:03:29.673825 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150850b7-056c-47c0-bd1c-1e611a9615ba None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:03:29.673825 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150850b7-056c-47c0-bd1c-1e611a9615ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:03:29.692906 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.auth.core [None req-150850b7-056c-47c0-bd1c-1e611a9615ba None None] MFA Rules not processed for user `5cfa58ef86774ab7800bf91930bf6028`. Rule list: `[]` (Enabled: `True`). {{(pid=81592) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 18:03:29.694343 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-150850b7-056c-47c0-bd1c-1e611a9615ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:03:29.779810 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1182/2374] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 15 18:03:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 18:03:29.787954 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b94e82d-3d33-4278-8260-ccdbedf83dc7 None None] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:03:29.788685 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b94e82d-3d33-4278-8260-ccdbedf83dc7 None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:03:29.788685 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b94e82d-3d33-4278-8260-ccdbedf83dc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:03:29.812477 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.auth.core [None req-0b94e82d-3d33-4278-8260-ccdbedf83dc7 None None] MFA Rules not processed for user `5cfa58ef86774ab7800bf91930bf6028`. Rule list: `[]` (Enabled: `True`). {{(pid=81593) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 18:03:29.813761 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-0b94e82d-3d33-4278-8260-ccdbedf83dc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:03:29.823234 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1193/2375] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 15 18:03:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 18:03:29.828011 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150850b7-056c-47c0-bd1c-1e611a9615ba None None] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:03:29.845001 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150850b7-056c-47c0-bd1c-1e611a9615ba None None] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:03:29.874504 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8d1046-3d68-4723-ab50-fe748ed776bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:03:29.874504 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8d1046-3d68-4723-ab50-fe748ed776bb admin admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:03:29.874504 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8d1046-3d68-4723-ab50-fe748ed776bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:03:29.874504 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8d1046-3d68-4723-ab50-fe748ed776bb admin admin] PATH_INFO: `/v3/domains` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:03:29.875271 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d8d1046-3d68-4723-ab50-fe748ed776bb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81592) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 18:03:29.875271 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d8d1046-3d68-4723-ab50-fe748ed776bb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:03:29.876696 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d8d1046-3d68-4723-ab50-fe748ed776bb admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:03:29.901665 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1183/2376] 10.222.0.25 () {58 vars in 1153 bytes} [Thu Sep 15 18:03:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 18:03:29.904603 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b94e82d-3d33-4278-8260-ccdbedf83dc7 None None] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:03:29.922305 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b94e82d-3d33-4278-8260-ccdbedf83dc7 None None] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:03:29.940380 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b39a10-c479-433e-b346-6f67fa0a8152 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:03:29.943424 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b39a10-c479-433e-b346-6f67fa0a8152 admin admin] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:03:29.944146 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b39a10-c479-433e-b346-6f67fa0a8152 admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:03:29.945138 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b39a10-c479-433e-b346-6f67fa0a8152 admin admin] PATH_INFO: `/v3/projects` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:03:29.946226 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b39a10-c479-433e-b346-6f67fa0a8152 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:03:29.954662 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b39a10-c479-433e-b346-6f67fa0a8152 admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:03:30.031333 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1194/2377] 10.222.0.25 () {60 vars in 1153 bytes} [Thu Sep 15 18:03:29 2022] POST /identity/v3/projects => generated 383 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 18:03:30.035632 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8d1046-3d68-4723-ab50-fe748ed776bb admin admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:03:30.046048 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8d1046-3d68-4723-ab50-fe748ed776bb admin admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:03:30.108056 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-accb8655-349f-4661-8aec-024464c4de4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:03:30.109164 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accb8655-349f-4661-8aec-024464c4de4c admin admin] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:03:30.109632 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accb8655-349f-4661-8aec-024464c4de4c admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:03:30.109908 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accb8655-349f-4661-8aec-024464c4de4c admin admin] PATH_INFO: `/v3/users` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:03:30.110542 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-accb8655-349f-4661-8aec-024464c4de4c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:03:30.112510 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-accb8655-349f-4661-8aec-024464c4de4c admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:03:30.134759 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1184/2378] 10.222.0.25 () {60 vars in 1144 bytes} [Thu Sep 15 18:03:30 2022] POST /identity/v3/users => generated 292 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 18:03:30.145090 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b39a10-c479-433e-b346-6f67fa0a8152 admin admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:03:30.150023 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b39a10-c479-433e-b346-6f67fa0a8152 admin admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:03:30.155873 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6292cf8b-9074-4ebb-a366-1bcac00a4419 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:03:30.156482 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6292cf8b-9074-4ebb-a366-1bcac00a4419 admin admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:03:30.156756 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6292cf8b-9074-4ebb-a366-1bcac00a4419 admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:03:30.157030 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6292cf8b-9074-4ebb-a366-1bcac00a4419 admin admin] PATH_INFO: `/v3/roles` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:03:30.157715 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6292cf8b-9074-4ebb-a366-1bcac00a4419 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:03:30.159466 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6292cf8b-9074-4ebb-a366-1bcac00a4419 admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:03:30.170400 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1195/2379] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Sep 15 18:03:30 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 15 18:03:30.174749 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-accb8655-349f-4661-8aec-024464c4de4c admin admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:03:30.185646 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-accb8655-349f-4661-8aec-024464c4de4c admin admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:03:30.190662 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964591a3-8a03-4a97-a9ee-4ce020ee4506 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:03:30.191396 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964591a3-8a03-4a97-a9ee-4ce020ee4506 admin admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:03:30.191733 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964591a3-8a03-4a97-a9ee-4ce020ee4506 admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:03:30.192141 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964591a3-8a03-4a97-a9ee-4ce020ee4506 admin admin] PATH_INFO: `/v3/roles` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:03:30.192865 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964591a3-8a03-4a97-a9ee-4ce020ee4506 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:03:30.194636 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964591a3-8a03-4a97-a9ee-4ce020ee4506 admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:03:30.206412 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1185/2380] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Sep 15 18:03:30 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 18:03:30.210742 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6292cf8b-9074-4ebb-a366-1bcac00a4419 admin admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:03:30.222043 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6292cf8b-9074-4ebb-a366-1bcac00a4419 admin admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:03:30.227463 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e068b4-3815-4da8-9dcc-cb7f6baa3a8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:03:30.228057 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e068b4-3815-4da8-9dcc-cb7f6baa3a8c admin admin] REQUEST_METHOD: `PUT` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:03:30.228548 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e068b4-3815-4da8-9dcc-cb7f6baa3a8c admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:03:30.228801 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e068b4-3815-4da8-9dcc-cb7f6baa3a8c admin admin] PATH_INFO: `/v3/projects/3d8d0252cc654fdba38e1e3063b001de/users/26076205214644fc803c5fecf47d8cd2/roles/343cc8b1bc7243eebabdf08147e8366d` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:03:30.245956 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e068b4-3815-4da8-9dcc-cb7f6baa3a8c admin admin] RBAC: Authorizing `identity:create_grant(project_id=3d8d0252cc654fdba38e1e3063b001de, user_id=26076205214644fc803c5fecf47d8cd2, role_id=343cc8b1bc7243eebabdf08147e8366d)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:03:30.249034 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e068b4-3815-4da8-9dcc-cb7f6baa3a8c admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:03:30.262861 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1196/2381] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Sep 15 18:03:30 2022] PUT /identity/v3/projects/3d8d0252cc654fdba38e1e3063b001de/users/26076205214644fc803c5fecf47d8cd2/roles/343cc8b1bc7243eebabdf08147e8366d => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 18:03:30.273716 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba284bf-9880-4399-b84d-3fef920fe8fd None None] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:03:30.273986 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba284bf-9880-4399-b84d-3fef920fe8fd None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:03:30.274241 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba284bf-9880-4399-b84d-3fef920fe8fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:03:30.295167 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 18:03:30.306011 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.auth.core [None req-bba284bf-9880-4399-b84d-3fef920fe8fd None None] MFA Rules not processed for user `26076205214644fc803c5fecf47d8cd2`. Rule list: `[]` (Enabled: `True`). {{(pid=81592) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 18:03:30.307243 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-bba284bf-9880-4399-b84d-3fef920fe8fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:03:30.380970 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1186/2382] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 15 18:03:30 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 18:03:30.393658 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e068b4-3815-4da8-9dcc-cb7f6baa3a8c admin admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:03:30.395470 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-97e068b4-3815-4da8-9dcc-cb7f6baa3a8c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:03:30.471738 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e068b4-3815-4da8-9dcc-cb7f6baa3a8c admin admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:03:30.476032 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f1a04b-14df-4df3-bff3-084186b57b6c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b232e7a841145ba93c6d8462ccb751a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1213c0d1b584404ba3998e136f166e89', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:03:30.476647 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f1a04b-14df-4df3-bff3-084186b57b6c service cinder] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:03:30.476906 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f1a04b-14df-4df3-bff3-084186b57b6c service cinder] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:03:30.477177 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f1a04b-14df-4df3-bff3-084186b57b6c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:03:30.487348 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f1a04b-14df-4df3-bff3-084186b57b6c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:03:30.489139 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f1a04b-14df-4df3-bff3-084186b57b6c service cinder] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:03:30.499970 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1197/2383] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 15 18:03:30 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 18:03:33.267863 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba284bf-9880-4399-b84d-3fef920fe8fd None None] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:03:33.339367 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba284bf-9880-4399-b84d-3fef920fe8fd None None] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:03:33.345143 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbcabd41-6ba0-47ed-a673-bd0b0dcd8221 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:03:33.345880 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcabd41-6ba0-47ed-a673-bd0b0dcd8221 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:03:33.346190 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcabd41-6ba0-47ed-a673-bd0b0dcd8221 admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:03:33.346444 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcabd41-6ba0-47ed-a673-bd0b0dcd8221 admin admin] PATH_INFO: `/v3/users/26076205214644fc803c5fecf47d8cd2` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:03:33.347591 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbcabd41-6ba0-47ed-a673-bd0b0dcd8221 admin admin] RBAC: Authorizing `identity:delete_user(user_id=26076205214644fc803c5fecf47d8cd2)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:03:33.350005 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbcabd41-6ba0-47ed-a673-bd0b0dcd8221 admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:03:33.400543 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-cbcabd41-6ba0-47ed-a673-bd0b0dcd8221 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '26076205214644fc803c5fecf47d8cd2'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:03:33.410916 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-cbcabd41-6ba0-47ed-a673-bd0b0dcd8221 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '26076205214644fc803c5fecf47d8cd2'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:03:33.412128 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-cbcabd41-6ba0-47ed-a673-bd0b0dcd8221 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '26076205214644fc803c5fecf47d8cd2'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:03:33.412905 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-cbcabd41-6ba0-47ed-a673-bd0b0dcd8221 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '26076205214644fc803c5fecf47d8cd2'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:03:33.424617 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-cbcabd41-6ba0-47ed-a673-bd0b0dcd8221 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '26076205214644fc803c5fecf47d8cd2'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:03:33.445319 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1187/2384] 10.222.0.25 () {58 vars in 1224 bytes} [Thu Sep 15 18:03:33 2022] DELETE /identity/v3/users/26076205214644fc803c5fecf47d8cd2 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 18:03:33.451529 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8aa8cf-0d9e-4c13-94a7-d44b03ffbffe None None] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:03:33.452628 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8aa8cf-0d9e-4c13-94a7-d44b03ffbffe None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:03:33.453843 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8aa8cf-0d9e-4c13-94a7-d44b03ffbffe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:03:33.484576 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.auth.core [None req-7a8aa8cf-0d9e-4c13-94a7-d44b03ffbffe None None] MFA Rules not processed for user `5cfa58ef86774ab7800bf91930bf6028`. Rule list: `[]` (Enabled: `True`). {{(pid=81593) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 18:03:33.486258 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-7a8aa8cf-0d9e-4c13-94a7-d44b03ffbffe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:03:33.572737 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=92,keystone:DELETE=5,keystone:INSERT=3 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 18:03:33.593618 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1198/2385] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 15 18:03:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 18:03:33.606511 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbcabd41-6ba0-47ed-a673-bd0b0dcd8221 admin admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:03:33.607909 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-cbcabd41-6ba0-47ed-a673-bd0b0dcd8221 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:03:33.640125 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 18:03:33.706961 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbcabd41-6ba0-47ed-a673-bd0b0dcd8221 admin admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:03:33.710593 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f797c44c-3caa-40b8-80b2-d249b0001091 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a32274b4781b40fea9f28da8a9bde5ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1213c0d1b584404ba3998e136f166e89', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:03:33.711199 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f797c44c-3caa-40b8-80b2-d249b0001091 service neutron] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:03:33.711510 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f797c44c-3caa-40b8-80b2-d249b0001091 service neutron] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:03:33.711782 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f797c44c-3caa-40b8-80b2-d249b0001091 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:03:33.721065 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f797c44c-3caa-40b8-80b2-d249b0001091 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:03:33.722691 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f797c44c-3caa-40b8-80b2-d249b0001091 service neutron] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:03:33.733437 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1188/2386] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 15 18:03:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 15 18:03:34.044947 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8aa8cf-0d9e-4c13-94a7-d44b03ffbffe None None] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:03:34.046472 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-7a8aa8cf-0d9e-4c13-94a7-d44b03ffbffe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:03:34.061016 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8aa8cf-0d9e-4c13-94a7-d44b03ffbffe None None] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:03:34.086761 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14dde280-5429-4623-919b-dd901b66588a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:03:34.087576 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14dde280-5429-4623-919b-dd901b66588a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:03:34.087680 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14dde280-5429-4623-919b-dd901b66588a admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:03:34.087959 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14dde280-5429-4623-919b-dd901b66588a admin admin] PATH_INFO: `/v3/projects/3d8d0252cc654fdba38e1e3063b001de` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:03:34.091512 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14dde280-5429-4623-919b-dd901b66588a admin admin] RBAC: Authorizing `identity:delete_project(project_id=3d8d0252cc654fdba38e1e3063b001de)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:03:34.093875 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14dde280-5429-4623-919b-dd901b66588a admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:03:34.167606 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-14dde280-5429-4623-919b-dd901b66588a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3d8d0252cc654fdba38e1e3063b001de', 'request_id': 'req-14dde280-5429-4623-919b-dd901b66588a'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:03:34.180059 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-14dde280-5429-4623-919b-dd901b66588a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3d8d0252cc654fdba38e1e3063b001de', 'request_id': 'req-14dde280-5429-4623-919b-dd901b66588a'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:03:34.201166 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-14dde280-5429-4623-919b-dd901b66588a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3d8d0252cc654fdba38e1e3063b001de', 'request_id': 'req-14dde280-5429-4623-919b-dd901b66588a'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:03:34.228575 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-14dde280-5429-4623-919b-dd901b66588a admin admin] The token cache is being invalidate because project 3d8d0252cc654fdba38e1e3063b001de was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81593) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 18:03:34.228900 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-14dde280-5429-4623-919b-dd901b66588a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:03:34.229785 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-14dde280-5429-4623-919b-dd901b66588a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:03:34.231696 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1199/2387] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Sep 15 18:03:34 2022] DELETE /identity/v3/projects/3d8d0252cc654fdba38e1e3063b001de => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 15 18:03:36.672063 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f797c44c-3caa-40b8-80b2-d249b0001091 service neutron] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:03:36.674491 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-f797c44c-3caa-40b8-80b2-d249b0001091 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:03:36.696269 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f797c44c-3caa-40b8-80b2-d249b0001091 service neutron] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:03:36.777931 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41dd505b-c158-42ca-a963-5b54ec29f5a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:03:36.778905 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41dd505b-c158-42ca-a963-5b54ec29f5a7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:03:36.779390 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41dd505b-c158-42ca-a963-5b54ec29f5a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:03:36.779848 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41dd505b-c158-42ca-a963-5b54ec29f5a7 admin admin] PATH_INFO: `/v3/users/71a704c15ca14b0999a2541c411c3ede` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:03:36.781810 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41dd505b-c158-42ca-a963-5b54ec29f5a7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=71a704c15ca14b0999a2541c411c3ede)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:03:36.785391 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41dd505b-c158-42ca-a963-5b54ec29f5a7 admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:03:36.846570 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-41dd505b-c158-42ca-a963-5b54ec29f5a7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '71a704c15ca14b0999a2541c411c3ede'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:03:36.856640 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-41dd505b-c158-42ca-a963-5b54ec29f5a7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '71a704c15ca14b0999a2541c411c3ede'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:03:36.857283 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-41dd505b-c158-42ca-a963-5b54ec29f5a7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '71a704c15ca14b0999a2541c411c3ede'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:03:36.857956 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-41dd505b-c158-42ca-a963-5b54ec29f5a7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '71a704c15ca14b0999a2541c411c3ede'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:03:36.865394 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-41dd505b-c158-42ca-a963-5b54ec29f5a7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '71a704c15ca14b0999a2541c411c3ede'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:03:36.892197 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1189/2388] 10.222.0.25 () {58 vars in 1224 bytes} [Thu Sep 15 18:03:36 2022] DELETE /identity/v3/users/71a704c15ca14b0999a2541c411c3ede => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 18:03:36.894051 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693280bb-3640-4e19-9f90-0c8b1fe84da0 None None] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:03:36.894675 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693280bb-3640-4e19-9f90-0c8b1fe84da0 None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:03:36.894675 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693280bb-3640-4e19-9f90-0c8b1fe84da0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:03:36.947519 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.auth.core [None req-693280bb-3640-4e19-9f90-0c8b1fe84da0 None None] MFA Rules not processed for user `5cfa58ef86774ab7800bf91930bf6028`. Rule list: `[]` (Enabled: `True`). {{(pid=81593) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 18:03:36.948886 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-693280bb-3640-4e19-9f90-0c8b1fe84da0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:03:37.036200 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1200/2389] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 15 18:03:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 18:03:37.047219 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41dd505b-c158-42ca-a963-5b54ec29f5a7 admin admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:03:37.049526 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-41dd505b-c158-42ca-a963-5b54ec29f5a7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:03:37.134093 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 18:03:37.156777 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41dd505b-c158-42ca-a963-5b54ec29f5a7 admin admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:03:37.161148 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c82be3-c7ba-49ae-81a8-b156e0e9d13a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a32274b4781b40fea9f28da8a9bde5ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1213c0d1b584404ba3998e136f166e89', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:03:37.161858 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c82be3-c7ba-49ae-81a8-b156e0e9d13a service neutron] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:03:37.162088 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c82be3-c7ba-49ae-81a8-b156e0e9d13a service neutron] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:03:37.162480 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c82be3-c7ba-49ae-81a8-b156e0e9d13a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:03:37.181509 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c82be3-c7ba-49ae-81a8-b156e0e9d13a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:03:37.183399 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c82be3-c7ba-49ae-81a8-b156e0e9d13a service neutron] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:03:37.199338 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1190/2390] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 15 18:03:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 18:03:37.594018 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693280bb-3640-4e19-9f90-0c8b1fe84da0 None None] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:03:37.594925 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-693280bb-3640-4e19-9f90-0c8b1fe84da0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:03:37.607684 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693280bb-3640-4e19-9f90-0c8b1fe84da0 None None] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:03:37.612485 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12795c0-d5b9-4214-b3cc-94bbb1c888a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:03:37.613101 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12795c0-d5b9-4214-b3cc-94bbb1c888a7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:03:37.613405 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12795c0-d5b9-4214-b3cc-94bbb1c888a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:03:37.613675 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12795c0-d5b9-4214-b3cc-94bbb1c888a7 admin admin] PATH_INFO: `/v3/projects/1df1699a598b4bc0ab44216e5bd5bb3e` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:03:37.614837 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e12795c0-d5b9-4214-b3cc-94bbb1c888a7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1df1699a598b4bc0ab44216e5bd5bb3e)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:03:37.617064 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e12795c0-d5b9-4214-b3cc-94bbb1c888a7 admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:03:37.665583 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-e12795c0-d5b9-4214-b3cc-94bbb1c888a7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1df1699a598b4bc0ab44216e5bd5bb3e', 'request_id': 'req-e12795c0-d5b9-4214-b3cc-94bbb1c888a7'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:03:37.671954 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-e12795c0-d5b9-4214-b3cc-94bbb1c888a7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1df1699a598b4bc0ab44216e5bd5bb3e', 'request_id': 'req-e12795c0-d5b9-4214-b3cc-94bbb1c888a7'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:03:37.683404 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-e12795c0-d5b9-4214-b3cc-94bbb1c888a7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1df1699a598b4bc0ab44216e5bd5bb3e', 'request_id': 'req-e12795c0-d5b9-4214-b3cc-94bbb1c888a7'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:03:37.695037 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-e12795c0-d5b9-4214-b3cc-94bbb1c888a7 admin admin] The token cache is being invalidate because project 1df1699a598b4bc0ab44216e5bd5bb3e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81593) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 18:03:37.695330 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-e12795c0-d5b9-4214-b3cc-94bbb1c888a7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:03:37.696218 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-e12795c0-d5b9-4214-b3cc-94bbb1c888a7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:03:37.698158 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1201/2391] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Sep 15 18:03:37 2022] DELETE /identity/v3/projects/1df1699a598b4bc0ab44216e5bd5bb3e => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 18:03:37.705854 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631239ae-2afa-42e4-bd5f-b1f52118f05f None None] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:03:37.706627 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631239ae-2afa-42e4-bd5f-b1f52118f05f None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:03:37.706983 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631239ae-2afa-42e4-bd5f-b1f52118f05f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:03:37.730234 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.auth.core [None req-631239ae-2afa-42e4-bd5f-b1f52118f05f None None] MFA Rules not processed for user `5cfa58ef86774ab7800bf91930bf6028`. Rule list: `[]` (Enabled: `True`). {{(pid=81592) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 18:03:37.731429 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-631239ae-2afa-42e4-bd5f-b1f52118f05f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:03:37.805432 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1191/2392] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 15 18:03:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 18:03:37.813415 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc39b51b-9c47-4a3e-82cf-727730f8bc2d None None] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:03:37.813920 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc39b51b-9c47-4a3e-82cf-727730f8bc2d None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:03:37.814261 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc39b51b-9c47-4a3e-82cf-727730f8bc2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:03:37.829399 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 18:03:37.835406 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.auth.core [None req-bc39b51b-9c47-4a3e-82cf-727730f8bc2d None None] MFA Rules not processed for user `5cfa58ef86774ab7800bf91930bf6028`. Rule list: `[]` (Enabled: `True`). {{(pid=81593) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 18:03:37.837636 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-bc39b51b-9c47-4a3e-82cf-727730f8bc2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:03:37.851211 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1202/2393] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 15 18:03:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 18:03:37.856192 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631239ae-2afa-42e4-bd5f-b1f52118f05f None None] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:03:37.867843 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631239ae-2afa-42e4-bd5f-b1f52118f05f None None] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:03:37.873161 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb5bd65-07ca-4818-b34e-39f7a49b18b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:03:37.874165 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb5bd65-07ca-4818-b34e-39f7a49b18b6 admin admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:03:37.874165 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb5bd65-07ca-4818-b34e-39f7a49b18b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:03:37.874362 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb5bd65-07ca-4818-b34e-39f7a49b18b6 admin admin] PATH_INFO: `/v3/domains` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:03:37.874979 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb5bd65-07ca-4818-b34e-39f7a49b18b6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81592) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 18:03:37.875286 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb5bd65-07ca-4818-b34e-39f7a49b18b6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:03:37.877131 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb5bd65-07ca-4818-b34e-39f7a49b18b6 admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:03:37.890832 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1192/2394] 10.222.0.25 () {58 vars in 1153 bytes} [Thu Sep 15 18:03:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 18:03:37.895250 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc39b51b-9c47-4a3e-82cf-727730f8bc2d None None] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:03:37.905719 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc39b51b-9c47-4a3e-82cf-727730f8bc2d None None] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:03:37.910690 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6831106d-b3a5-478f-ad6d-d9762f0ab708 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:03:37.911310 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6831106d-b3a5-478f-ad6d-d9762f0ab708 admin admin] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:03:37.911595 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6831106d-b3a5-478f-ad6d-d9762f0ab708 admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:03:37.911875 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6831106d-b3a5-478f-ad6d-d9762f0ab708 admin admin] PATH_INFO: `/v3/projects` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:03:37.912541 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6831106d-b3a5-478f-ad6d-d9762f0ab708 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:03:37.914506 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6831106d-b3a5-478f-ad6d-d9762f0ab708 admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:03:37.943673 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1203/2395] 10.222.0.25 () {60 vars in 1153 bytes} [Thu Sep 15 18:03:37 2022] POST /identity/v3/projects => generated 375 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 15 18:03:37.949994 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb5bd65-07ca-4818-b34e-39f7a49b18b6 admin admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:03:37.966416 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb5bd65-07ca-4818-b34e-39f7a49b18b6 admin admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:03:38.030647 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c016ed-2044-4a37-86e9-b5f6f3b9e666 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:03:38.031501 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c016ed-2044-4a37-86e9-b5f6f3b9e666 admin admin] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:03:38.031922 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c016ed-2044-4a37-86e9-b5f6f3b9e666 admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:03:38.032383 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c016ed-2044-4a37-86e9-b5f6f3b9e666 admin admin] PATH_INFO: `/v3/users` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:03:38.033516 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c016ed-2044-4a37-86e9-b5f6f3b9e666 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:03:38.037056 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c016ed-2044-4a37-86e9-b5f6f3b9e666 admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:03:38.069235 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1193/2396] 10.222.0.25 () {60 vars in 1144 bytes} [Thu Sep 15 18:03:37 2022] POST /identity/v3/users => generated 288 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 18:03:38.074956 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6831106d-b3a5-478f-ad6d-d9762f0ab708 admin admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:03:38.099213 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6831106d-b3a5-478f-ad6d-d9762f0ab708 admin admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:03:38.113246 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02923006-afdf-442b-8737-371525d2fd5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:03:38.114298 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02923006-afdf-442b-8737-371525d2fd5e admin admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:03:38.114790 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02923006-afdf-442b-8737-371525d2fd5e admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:03:38.115309 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02923006-afdf-442b-8737-371525d2fd5e admin admin] PATH_INFO: `/v3/roles` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:03:38.116476 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02923006-afdf-442b-8737-371525d2fd5e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:03:38.119721 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02923006-afdf-442b-8737-371525d2fd5e admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:03:38.137183 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1204/2397] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Sep 15 18:03:38 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 18:03:38.143178 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c016ed-2044-4a37-86e9-b5f6f3b9e666 admin admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:03:38.156099 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c016ed-2044-4a37-86e9-b5f6f3b9e666 admin admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:03:38.164401 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22b301d-42ed-4f38-afa4-cd2d1458001f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:03:38.165513 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22b301d-42ed-4f38-afa4-cd2d1458001f admin admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:03:38.166028 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22b301d-42ed-4f38-afa4-cd2d1458001f admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:03:38.166535 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22b301d-42ed-4f38-afa4-cd2d1458001f admin admin] PATH_INFO: `/v3/roles` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:03:38.167808 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d22b301d-42ed-4f38-afa4-cd2d1458001f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:03:38.170991 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d22b301d-42ed-4f38-afa4-cd2d1458001f admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:03:38.190508 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1194/2398] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Sep 15 18:03:38 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 15 18:03:38.194922 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02923006-afdf-442b-8737-371525d2fd5e admin admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:03:38.208544 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02923006-afdf-442b-8737-371525d2fd5e admin admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:03:38.213244 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0893ffee-1667-4c01-aa77-cc24361408fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:03:38.213938 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0893ffee-1667-4c01-aa77-cc24361408fc admin admin] REQUEST_METHOD: `PUT` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:03:38.214218 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0893ffee-1667-4c01-aa77-cc24361408fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:03:38.214520 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0893ffee-1667-4c01-aa77-cc24361408fc admin admin] PATH_INFO: `/v3/projects/71d3d8e06a774f82bb5e56fcd87adc15/users/e642b00e7c754d6eb0533c5e60e592c0/roles/343cc8b1bc7243eebabdf08147e8366d` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:03:38.230778 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0893ffee-1667-4c01-aa77-cc24361408fc admin admin] RBAC: Authorizing `identity:create_grant(project_id=71d3d8e06a774f82bb5e56fcd87adc15, user_id=e642b00e7c754d6eb0533c5e60e592c0, role_id=343cc8b1bc7243eebabdf08147e8366d)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:03:38.234239 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0893ffee-1667-4c01-aa77-cc24361408fc admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:03:38.249765 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1205/2399] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Sep 15 18:03:38 2022] PUT /identity/v3/projects/71d3d8e06a774f82bb5e56fcd87adc15/users/e642b00e7c754d6eb0533c5e60e592c0/roles/343cc8b1bc7243eebabdf08147e8366d => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 18:03:38.261808 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e923cf-1668-4fbb-8995-95822a47ef60 None None] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:03:38.262409 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e923cf-1668-4fbb-8995-95822a47ef60 None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:03:38.263052 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e923cf-1668-4fbb-8995-95822a47ef60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:03:38.292126 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.auth.core [None req-52e923cf-1668-4fbb-8995-95822a47ef60 None None] MFA Rules not processed for user `e642b00e7c754d6eb0533c5e60e592c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81592) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 18:03:38.293919 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-52e923cf-1668-4fbb-8995-95822a47ef60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:03:38.338185 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 18:03:38.370589 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1195/2400] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 15 18:03:38 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 18:03:38.383252 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0893ffee-1667-4c01-aa77-cc24361408fc admin admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:03:38.385583 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-0893ffee-1667-4c01-aa77-cc24361408fc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:03:38.459618 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0893ffee-1667-4c01-aa77-cc24361408fc admin admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:03:38.469089 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2487ec28-0a96-453c-a6d3-1c9d6e6f9d26 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b232e7a841145ba93c6d8462ccb751a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1213c0d1b584404ba3998e136f166e89', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:03:38.470394 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2487ec28-0a96-453c-a6d3-1c9d6e6f9d26 service cinder] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:03:38.470751 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2487ec28-0a96-453c-a6d3-1c9d6e6f9d26 service cinder] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:03:38.471107 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2487ec28-0a96-453c-a6d3-1c9d6e6f9d26 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:03:38.490253 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2487ec28-0a96-453c-a6d3-1c9d6e6f9d26 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:03:38.492825 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2487ec28-0a96-453c-a6d3-1c9d6e6f9d26 service cinder] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:03:38.509377 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1206/2401] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 15 18:03:38 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 18:03:40.004268 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01490e3a-f397-4ab4-8e73-a80989100284 None None] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:03:40.004835 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01490e3a-f397-4ab4-8e73-a80989100284 None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:03:40.004835 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01490e3a-f397-4ab4-8e73-a80989100284 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:03:40.026273 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.auth.core [None req-01490e3a-f397-4ab4-8e73-a80989100284 None None] MFA Rules not processed for user `e642b00e7c754d6eb0533c5e60e592c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81592) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 18:03:40.027565 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-01490e3a-f397-4ab4-8e73-a80989100284 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:03:40.034415 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1196/2402] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 15 18:03:40 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 18:03:40.080698 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2487ec28-0a96-453c-a6d3-1c9d6e6f9d26 service cinder] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:03:40.082274 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-2487ec28-0a96-453c-a6d3-1c9d6e6f9d26 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:03:40.154974 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2487ec28-0a96-453c-a6d3-1c9d6e6f9d26 service cinder] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:03:40.162454 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7da209-5be2-4ec4-8f3e-24e001372644 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:03:40.162454 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7da209-5be2-4ec4-8f3e-24e001372644 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:03:40.162454 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7da209-5be2-4ec4-8f3e-24e001372644 admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:03:40.162454 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7da209-5be2-4ec4-8f3e-24e001372644 admin admin] PATH_INFO: `/v3/users/fda1ff5394044f45889267cdcd300017` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:03:40.163573 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f7da209-5be2-4ec4-8f3e-24e001372644 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fda1ff5394044f45889267cdcd300017)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:03:40.165568 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f7da209-5be2-4ec4-8f3e-24e001372644 admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:03:40.230687 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-2f7da209-5be2-4ec4-8f3e-24e001372644 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fda1ff5394044f45889267cdcd300017'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:03:40.232693 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 18:03:40.242100 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-2f7da209-5be2-4ec4-8f3e-24e001372644 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fda1ff5394044f45889267cdcd300017'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:03:40.243347 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-2f7da209-5be2-4ec4-8f3e-24e001372644 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fda1ff5394044f45889267cdcd300017'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:03:40.244309 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-2f7da209-5be2-4ec4-8f3e-24e001372644 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fda1ff5394044f45889267cdcd300017'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:03:40.269869 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-2f7da209-5be2-4ec4-8f3e-24e001372644 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fda1ff5394044f45889267cdcd300017'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:03:40.315767 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1207/2403] 10.222.0.25 () {58 vars in 1224 bytes} [Thu Sep 15 18:03:40 2022] DELETE /identity/v3/users/fda1ff5394044f45889267cdcd300017 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 15 18:03:40.315974 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb8aa35-706c-48ac-a7c7-065a05fdd83f None None] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:03:40.315974 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb8aa35-706c-48ac-a7c7-065a05fdd83f None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:03:40.315974 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb8aa35-706c-48ac-a7c7-065a05fdd83f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:03:40.350607 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.auth.core [None req-0cb8aa35-706c-48ac-a7c7-065a05fdd83f None None] MFA Rules not processed for user `5cfa58ef86774ab7800bf91930bf6028`. Rule list: `[]` (Enabled: `True`). {{(pid=81592) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 18:03:40.352594 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-0cb8aa35-706c-48ac-a7c7-065a05fdd83f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:03:40.456453 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1197/2404] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 15 18:03:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 18:03:40.474084 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7da209-5be2-4ec4-8f3e-24e001372644 admin admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:03:40.476011 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-2f7da209-5be2-4ec4-8f3e-24e001372644 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:03:40.646193 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7da209-5be2-4ec4-8f3e-24e001372644 admin admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:03:40.651402 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d1d78f-88e8-410b-83fc-8c063b0f8e86 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a32274b4781b40fea9f28da8a9bde5ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1213c0d1b584404ba3998e136f166e89', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:03:40.652966 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d1d78f-88e8-410b-83fc-8c063b0f8e86 service neutron] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:03:40.653502 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d1d78f-88e8-410b-83fc-8c063b0f8e86 service neutron] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:03:40.653990 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d1d78f-88e8-410b-83fc-8c063b0f8e86 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:03:40.670961 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d1d78f-88e8-410b-83fc-8c063b0f8e86 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:03:40.673830 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d1d78f-88e8-410b-83fc-8c063b0f8e86 service neutron] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:03:40.698067 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1208/2405] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 15 18:03:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 226 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 18:03:41.171783 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb8aa35-706c-48ac-a7c7-065a05fdd83f None None] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:03:41.174291 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-0cb8aa35-706c-48ac-a7c7-065a05fdd83f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:03:41.202187 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb8aa35-706c-48ac-a7c7-065a05fdd83f None None] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:03:41.218097 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197bd703-a59b-4ea8-93c2-675360f2139f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:03:41.220304 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197bd703-a59b-4ea8-93c2-675360f2139f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:03:41.222106 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197bd703-a59b-4ea8-93c2-675360f2139f admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:03:41.223045 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197bd703-a59b-4ea8-93c2-675360f2139f admin admin] PATH_INFO: `/v3/projects/8610d7d94dbd4009b3f0eb3d9449cbcd` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:03:41.225494 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-197bd703-a59b-4ea8-93c2-675360f2139f admin admin] RBAC: Authorizing `identity:delete_project(project_id=8610d7d94dbd4009b3f0eb3d9449cbcd)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:03:41.229200 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-197bd703-a59b-4ea8-93c2-675360f2139f admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:03:41.293032 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-197bd703-a59b-4ea8-93c2-675360f2139f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8610d7d94dbd4009b3f0eb3d9449cbcd', 'request_id': 'req-197bd703-a59b-4ea8-93c2-675360f2139f'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:03:41.299100 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-197bd703-a59b-4ea8-93c2-675360f2139f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8610d7d94dbd4009b3f0eb3d9449cbcd', 'request_id': 'req-197bd703-a59b-4ea8-93c2-675360f2139f'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:03:41.307341 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-197bd703-a59b-4ea8-93c2-675360f2139f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8610d7d94dbd4009b3f0eb3d9449cbcd', 'request_id': 'req-197bd703-a59b-4ea8-93c2-675360f2139f'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:03:41.318850 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-197bd703-a59b-4ea8-93c2-675360f2139f admin admin] The token cache is being invalidate because project 8610d7d94dbd4009b3f0eb3d9449cbcd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81592) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 18:03:41.319203 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-197bd703-a59b-4ea8-93c2-675360f2139f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:03:41.319855 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-197bd703-a59b-4ea8-93c2-675360f2139f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:03:41.321436 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1198/2406] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Sep 15 18:03:41 2022] DELETE /identity/v3/projects/8610d7d94dbd4009b3f0eb3d9449cbcd => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 18:03:41.332396 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa53dcc-f58b-433f-bf03-fe7e8286e8db None None] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:03:41.333226 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa53dcc-f58b-433f-bf03-fe7e8286e8db None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:03:41.333536 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa53dcc-f58b-433f-bf03-fe7e8286e8db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:03:41.354928 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.auth.core [None req-caa53dcc-f58b-433f-bf03-fe7e8286e8db None None] MFA Rules not processed for user `5cfa58ef86774ab7800bf91930bf6028`. Rule list: `[]` (Enabled: `True`). {{(pid=81593) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 18:03:41.356937 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-caa53dcc-f58b-433f-bf03-fe7e8286e8db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:03:41.435287 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1209/2407] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 15 18:03:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 18:03:41.443778 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e19afb-8341-40c3-9686-8517efbfd881 None None] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:03:41.444239 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e19afb-8341-40c3-9686-8517efbfd881 None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:03:41.444604 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e19afb-8341-40c3-9686-8517efbfd881 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:03:41.467653 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.auth.core [None req-02e19afb-8341-40c3-9686-8517efbfd881 None None] MFA Rules not processed for user `5cfa58ef86774ab7800bf91930bf6028`. Rule list: `[]` (Enabled: `True`). {{(pid=81592) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 18:03:41.468889 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-02e19afb-8341-40c3-9686-8517efbfd881 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:03:41.477808 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1199/2408] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 15 18:03:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 18:03:41.482960 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa53dcc-f58b-433f-bf03-fe7e8286e8db None None] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:03:41.495265 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa53dcc-f58b-433f-bf03-fe7e8286e8db None None] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:03:41.501063 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945aa98c-2373-4fd9-8d4b-021eda8949ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:03:41.501871 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945aa98c-2373-4fd9-8d4b-021eda8949ca admin admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:03:41.502356 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945aa98c-2373-4fd9-8d4b-021eda8949ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:03:41.502702 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945aa98c-2373-4fd9-8d4b-021eda8949ca admin admin] PATH_INFO: `/v3/domains` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:03:41.503666 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945aa98c-2373-4fd9-8d4b-021eda8949ca admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81593) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 18:03:41.504204 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945aa98c-2373-4fd9-8d4b-021eda8949ca admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:03:41.506348 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945aa98c-2373-4fd9-8d4b-021eda8949ca admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:03:41.529223 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1210/2409] 10.222.0.25 () {58 vars in 1153 bytes} [Thu Sep 15 18:03:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 18:03:41.530713 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e19afb-8341-40c3-9686-8517efbfd881 None None] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:03:41.540594 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e19afb-8341-40c3-9686-8517efbfd881 None None] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:03:41.547008 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f933bdf-4862-45ff-aacd-434f5f335a23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:03:41.548437 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f933bdf-4862-45ff-aacd-434f5f335a23 admin admin] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:03:41.548734 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f933bdf-4862-45ff-aacd-434f5f335a23 admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:03:41.549015 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f933bdf-4862-45ff-aacd-434f5f335a23 admin admin] PATH_INFO: `/v3/projects` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:03:41.549752 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f933bdf-4862-45ff-aacd-434f5f335a23 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:03:41.551745 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f933bdf-4862-45ff-aacd-434f5f335a23 admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:03:41.582835 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1200/2410] 10.222.0.25 () {60 vars in 1153 bytes} [Thu Sep 15 18:03:41 2022] POST /identity/v3/projects => generated 373 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 15 18:03:41.587764 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945aa98c-2373-4fd9-8d4b-021eda8949ca admin admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:03:41.599513 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945aa98c-2373-4fd9-8d4b-021eda8949ca admin admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:03:41.670529 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:INSERT=1,keystone:DELETE=3,keystone:SELECT=96 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 18:03:41.686601 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecfd9d62-5e44-4381-8c1b-1aa0ffb64fad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:03:41.689438 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfd9d62-5e44-4381-8c1b-1aa0ffb64fad admin admin] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:03:41.690134 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfd9d62-5e44-4381-8c1b-1aa0ffb64fad admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:03:41.691064 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfd9d62-5e44-4381-8c1b-1aa0ffb64fad admin admin] PATH_INFO: `/v3/users` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:03:41.692555 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecfd9d62-5e44-4381-8c1b-1aa0ffb64fad admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:03:41.697011 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecfd9d62-5e44-4381-8c1b-1aa0ffb64fad admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:03:41.734003 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1211/2411] 10.222.0.25 () {60 vars in 1144 bytes} [Thu Sep 15 18:03:41 2022] POST /identity/v3/users => generated 287 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 18:03:41.739213 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f933bdf-4862-45ff-aacd-434f5f335a23 admin admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:03:41.757779 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f933bdf-4862-45ff-aacd-434f5f335a23 admin admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:03:41.767738 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442a6b93-7f68-4be5-af6c-09547637ab36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:03:41.768969 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442a6b93-7f68-4be5-af6c-09547637ab36 admin admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:03:41.769760 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442a6b93-7f68-4be5-af6c-09547637ab36 admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:03:41.770313 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442a6b93-7f68-4be5-af6c-09547637ab36 admin admin] PATH_INFO: `/v3/roles` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:03:41.771562 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-442a6b93-7f68-4be5-af6c-09547637ab36 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:03:41.774779 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-442a6b93-7f68-4be5-af6c-09547637ab36 admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:03:41.798872 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1201/2412] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Sep 15 18:03:41 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 18:03:41.801643 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecfd9d62-5e44-4381-8c1b-1aa0ffb64fad admin admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:03:41.819133 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecfd9d62-5e44-4381-8c1b-1aa0ffb64fad admin admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:03:41.827606 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b737a92-7fbd-43ac-8831-2e87dffd390a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:03:41.827606 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b737a92-7fbd-43ac-8831-2e87dffd390a admin admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:03:41.827606 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b737a92-7fbd-43ac-8831-2e87dffd390a admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:03:41.827606 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b737a92-7fbd-43ac-8831-2e87dffd390a admin admin] PATH_INFO: `/v3/roles` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:03:41.828027 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b737a92-7fbd-43ac-8831-2e87dffd390a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:03:41.829885 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b737a92-7fbd-43ac-8831-2e87dffd390a admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:03:41.842244 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1212/2413] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Sep 15 18:03:41 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 18:03:41.846882 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442a6b93-7f68-4be5-af6c-09547637ab36 admin admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:03:41.861031 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442a6b93-7f68-4be5-af6c-09547637ab36 admin admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:03:41.865838 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf9f9a2-d2c4-49dc-8cc2-f0c2d1105243 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:03:41.866489 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf9f9a2-d2c4-49dc-8cc2-f0c2d1105243 admin admin] REQUEST_METHOD: `PUT` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:03:41.866771 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf9f9a2-d2c4-49dc-8cc2-f0c2d1105243 admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:03:41.867054 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf9f9a2-d2c4-49dc-8cc2-f0c2d1105243 admin admin] PATH_INFO: `/v3/projects/a11adea5f21c48eb91e2c8f88f8c3349/users/efc008db667e47f99a998d08438ddaf1/roles/343cc8b1bc7243eebabdf08147e8366d` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:03:41.880834 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 18:03:41.887547 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf9f9a2-d2c4-49dc-8cc2-f0c2d1105243 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a11adea5f21c48eb91e2c8f88f8c3349, user_id=efc008db667e47f99a998d08438ddaf1, role_id=343cc8b1bc7243eebabdf08147e8366d)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:03:41.891244 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf9f9a2-d2c4-49dc-8cc2-f0c2d1105243 admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:03:41.914873 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1202/2414] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Sep 15 18:03:41 2022] PUT /identity/v3/projects/a11adea5f21c48eb91e2c8f88f8c3349/users/efc008db667e47f99a998d08438ddaf1/roles/343cc8b1bc7243eebabdf08147e8366d => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 18:03:41.919467 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac5b6fd-cb18-4e24-9059-f747627da749 None None] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:03:41.920218 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac5b6fd-cb18-4e24-9059-f747627da749 None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:03:41.920671 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac5b6fd-cb18-4e24-9059-f747627da749 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:03:41.968428 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.auth.core [None req-5ac5b6fd-cb18-4e24-9059-f747627da749 None None] MFA Rules not processed for user `5cfa58ef86774ab7800bf91930bf6028`. Rule list: `[]` (Enabled: `True`). {{(pid=81593) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 18:03:41.969904 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-5ac5b6fd-cb18-4e24-9059-f747627da749 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:03:42.063706 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1213/2415] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 15 18:03:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 18:03:42.074514 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf9f9a2-d2c4-49dc-8cc2-f0c2d1105243 admin admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:03:42.077545 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-5cf9f9a2-d2c4-49dc-8cc2-f0c2d1105243 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:03:42.172441 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf9f9a2-d2c4-49dc-8cc2-f0c2d1105243 admin admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:03:42.178644 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f7958a-c8f4-4f8d-b1e1-83caa04bd3e3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a32274b4781b40fea9f28da8a9bde5ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1213c0d1b584404ba3998e136f166e89', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:03:42.179680 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f7958a-c8f4-4f8d-b1e1-83caa04bd3e3 service neutron] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:03:42.180176 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f7958a-c8f4-4f8d-b1e1-83caa04bd3e3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:03:42.180734 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f7958a-c8f4-4f8d-b1e1-83caa04bd3e3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:03:42.207915 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f7958a-c8f4-4f8d-b1e1-83caa04bd3e3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:03:42.210727 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f7958a-c8f4-4f8d-b1e1-83caa04bd3e3 service neutron] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:03:42.232168 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1203/2416] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 15 18:03:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 15 18:03:44.720528 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac5b6fd-cb18-4e24-9059-f747627da749 None None] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:03:44.728331 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-5ac5b6fd-cb18-4e24-9059-f747627da749 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:03:44.744712 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac5b6fd-cb18-4e24-9059-f747627da749 None None] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:03:44.766110 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f85652e-796b-4855-991f-d4b72734ece2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:03:44.767356 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f85652e-796b-4855-991f-d4b72734ece2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:03:44.767874 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f85652e-796b-4855-991f-d4b72734ece2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:03:44.768444 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f85652e-796b-4855-991f-d4b72734ece2 admin admin] PATH_INFO: `/v3/users/867f28c48d594d5fb593dd9fa0c80558` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:03:44.770042 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f85652e-796b-4855-991f-d4b72734ece2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=867f28c48d594d5fb593dd9fa0c80558)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:03:44.772450 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f85652e-796b-4855-991f-d4b72734ece2 admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:03:44.928707 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-1f85652e-796b-4855-991f-d4b72734ece2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '867f28c48d594d5fb593dd9fa0c80558'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:03:44.945902 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-1f85652e-796b-4855-991f-d4b72734ece2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '867f28c48d594d5fb593dd9fa0c80558'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:03:44.946538 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-1f85652e-796b-4855-991f-d4b72734ece2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '867f28c48d594d5fb593dd9fa0c80558'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:03:44.947242 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-1f85652e-796b-4855-991f-d4b72734ece2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '867f28c48d594d5fb593dd9fa0c80558'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:03:44.965132 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-1f85652e-796b-4855-991f-d4b72734ece2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '867f28c48d594d5fb593dd9fa0c80558'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:03:45.030104 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1214/2417] 10.222.0.25 () {58 vars in 1224 bytes} [Thu Sep 15 18:03:44 2022] DELETE /identity/v3/users/867f28c48d594d5fb593dd9fa0c80558 => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 18:03:45.514500 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f7958a-c8f4-4f8d-b1e1-83caa04bd3e3 service neutron] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:03:45.527737 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f7958a-c8f4-4f8d-b1e1-83caa04bd3e3 service neutron] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:03:45.817103 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71522ebf-afaa-40ba-a689-faca1346cf6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:03:45.817103 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71522ebf-afaa-40ba-a689-faca1346cf6c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:03:45.817103 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71522ebf-afaa-40ba-a689-faca1346cf6c admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:03:45.817103 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71522ebf-afaa-40ba-a689-faca1346cf6c admin admin] PATH_INFO: `/v3/projects/9673492fe688478095ce771a47bf18eb` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:03:45.819659 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71522ebf-afaa-40ba-a689-faca1346cf6c admin admin] RBAC: Authorizing `identity:delete_project(project_id=9673492fe688478095ce771a47bf18eb)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:03:45.825404 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71522ebf-afaa-40ba-a689-faca1346cf6c admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:03:45.912566 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-71522ebf-afaa-40ba-a689-faca1346cf6c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9673492fe688478095ce771a47bf18eb', 'request_id': 'req-71522ebf-afaa-40ba-a689-faca1346cf6c'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:03:45.922664 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-71522ebf-afaa-40ba-a689-faca1346cf6c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9673492fe688478095ce771a47bf18eb', 'request_id': 'req-71522ebf-afaa-40ba-a689-faca1346cf6c'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:03:45.937170 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-71522ebf-afaa-40ba-a689-faca1346cf6c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9673492fe688478095ce771a47bf18eb', 'request_id': 'req-71522ebf-afaa-40ba-a689-faca1346cf6c'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:03:45.983215 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-71522ebf-afaa-40ba-a689-faca1346cf6c admin admin] The token cache is being invalidate because project 9673492fe688478095ce771a47bf18eb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81592) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 18:03:45.983747 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-71522ebf-afaa-40ba-a689-faca1346cf6c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:03:45.985427 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-71522ebf-afaa-40ba-a689-faca1346cf6c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:03:45.993403 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1204/2418] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Sep 15 18:03:45 2022] DELETE /identity/v3/projects/9673492fe688478095ce771a47bf18eb => generated 0 bytes in 477 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 18:03:45.997894 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f85652e-796b-4855-991f-d4b72734ece2 admin admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:03:46.000478 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-1f85652e-796b-4855-991f-d4b72734ece2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:03:46.026583 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f85652e-796b-4855-991f-d4b72734ece2 admin admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:03:46.133736 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 18:03:46.203112 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30bd1ae2-bacd-46c5-a1c7-c25283b226a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:03:46.203928 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bd1ae2-bacd-46c5-a1c7-c25283b226a7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:03:46.204203 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bd1ae2-bacd-46c5-a1c7-c25283b226a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:03:46.205655 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bd1ae2-bacd-46c5-a1c7-c25283b226a7 admin admin] PATH_INFO: `/v3/users/c195c04969624c10a7c662800e75a6a1` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:03:46.207300 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30bd1ae2-bacd-46c5-a1c7-c25283b226a7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c195c04969624c10a7c662800e75a6a1)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:03:46.219061 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30bd1ae2-bacd-46c5-a1c7-c25283b226a7 admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:03:46.331419 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-30bd1ae2-bacd-46c5-a1c7-c25283b226a7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c195c04969624c10a7c662800e75a6a1'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:03:46.352980 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-30bd1ae2-bacd-46c5-a1c7-c25283b226a7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c195c04969624c10a7c662800e75a6a1'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:03:46.354069 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-30bd1ae2-bacd-46c5-a1c7-c25283b226a7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c195c04969624c10a7c662800e75a6a1'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:03:46.355644 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-30bd1ae2-bacd-46c5-a1c7-c25283b226a7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c195c04969624c10a7c662800e75a6a1'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:03:46.399469 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-30bd1ae2-bacd-46c5-a1c7-c25283b226a7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c195c04969624c10a7c662800e75a6a1'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:03:46.457432 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1215/2419] 10.222.0.25 () {58 vars in 1224 bytes} [Thu Sep 15 18:03:45 2022] DELETE /identity/v3/users/c195c04969624c10a7c662800e75a6a1 => generated 0 bytes in 461 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 15 18:03:47.106541 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71522ebf-afaa-40ba-a689-faca1346cf6c admin admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:03:47.116699 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-71522ebf-afaa-40ba-a689-faca1346cf6c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:03:47.189413 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71522ebf-afaa-40ba-a689-faca1346cf6c admin admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:03:47.234833 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 18:03:47.317475 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86159cdc-8177-4a64-92f0-a38fc3535a98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:03:47.319463 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86159cdc-8177-4a64-92f0-a38fc3535a98 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:03:47.320136 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86159cdc-8177-4a64-92f0-a38fc3535a98 admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:03:47.320776 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86159cdc-8177-4a64-92f0-a38fc3535a98 admin admin] PATH_INFO: `/v3/projects/202dad0b25d644cfb02cff78c3d5cd81` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:03:47.323260 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86159cdc-8177-4a64-92f0-a38fc3535a98 admin admin] RBAC: Authorizing `identity:delete_project(project_id=202dad0b25d644cfb02cff78c3d5cd81)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:03:47.327743 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86159cdc-8177-4a64-92f0-a38fc3535a98 admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:03:47.442992 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-86159cdc-8177-4a64-92f0-a38fc3535a98 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '202dad0b25d644cfb02cff78c3d5cd81', 'request_id': 'req-86159cdc-8177-4a64-92f0-a38fc3535a98'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:03:47.455432 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-86159cdc-8177-4a64-92f0-a38fc3535a98 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '202dad0b25d644cfb02cff78c3d5cd81', 'request_id': 'req-86159cdc-8177-4a64-92f0-a38fc3535a98'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:03:47.481859 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-86159cdc-8177-4a64-92f0-a38fc3535a98 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '202dad0b25d644cfb02cff78c3d5cd81', 'request_id': 'req-86159cdc-8177-4a64-92f0-a38fc3535a98'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:03:47.504647 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-86159cdc-8177-4a64-92f0-a38fc3535a98 admin admin] The token cache is being invalidate because project 202dad0b25d644cfb02cff78c3d5cd81 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81592) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 18:03:47.505794 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-86159cdc-8177-4a64-92f0-a38fc3535a98 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:03:47.509574 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-86159cdc-8177-4a64-92f0-a38fc3535a98 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:03:47.512072 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1205/2420] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Sep 15 18:03:47 2022] DELETE /identity/v3/projects/202dad0b25d644cfb02cff78c3d5cd81 => generated 0 bytes in 415 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 18:03:47.519210 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b420717-39fe-4125-823e-f3e52484da0e None None] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:03:47.519917 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b420717-39fe-4125-823e-f3e52484da0e None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:03:47.520158 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b420717-39fe-4125-823e-f3e52484da0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:03:47.574478 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.auth.core [None req-2b420717-39fe-4125-823e-f3e52484da0e None None] MFA Rules not processed for user `5cfa58ef86774ab7800bf91930bf6028`. Rule list: `[]` (Enabled: `True`). {{(pid=81593) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 18:03:47.578590 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-2b420717-39fe-4125-823e-f3e52484da0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:03:47.750634 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1216/2421] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 15 18:03:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 18:03:47.763062 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c768b130-1960-4a4d-ba98-3fa819a0183d None None] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:03:47.763552 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c768b130-1960-4a4d-ba98-3fa819a0183d None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:03:47.764037 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c768b130-1960-4a4d-ba98-3fa819a0183d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:03:47.798909 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.auth.core [None req-c768b130-1960-4a4d-ba98-3fa819a0183d None None] MFA Rules not processed for user `5cfa58ef86774ab7800bf91930bf6028`. Rule list: `[]` (Enabled: `True`). {{(pid=81592) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 18:03:47.800729 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-c768b130-1960-4a4d-ba98-3fa819a0183d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:03:47.816220 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1206/2422] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 15 18:03:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 18:03:47.821429 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b420717-39fe-4125-823e-f3e52484da0e None None] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:03:47.846986 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b420717-39fe-4125-823e-f3e52484da0e None None] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:03:47.858133 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b93ecb5-e413-423b-8073-08eae4b3726d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:03:47.858893 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b93ecb5-e413-423b-8073-08eae4b3726d admin admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:03:47.859613 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b93ecb5-e413-423b-8073-08eae4b3726d admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:03:47.859613 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b93ecb5-e413-423b-8073-08eae4b3726d admin admin] PATH_INFO: `/v3/domains` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:03:47.860200 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b93ecb5-e413-423b-8073-08eae4b3726d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81593) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 18:03:47.866915 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b93ecb5-e413-423b-8073-08eae4b3726d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:03:47.869147 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b93ecb5-e413-423b-8073-08eae4b3726d admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:03:47.892710 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1217/2423] 10.222.0.25 () {58 vars in 1153 bytes} [Thu Sep 15 18:03:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 18:03:47.906536 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c768b130-1960-4a4d-ba98-3fa819a0183d None None] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:03:47.931156 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c768b130-1960-4a4d-ba98-3fa819a0183d None None] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:03:47.955584 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4315c6-bdfc-443f-8427-fde1828badeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:03:47.959104 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4315c6-bdfc-443f-8427-fde1828badeb admin admin] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:03:47.959948 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4315c6-bdfc-443f-8427-fde1828badeb admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:03:47.960481 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4315c6-bdfc-443f-8427-fde1828badeb admin admin] PATH_INFO: `/v3/projects` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:03:47.961890 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4315c6-bdfc-443f-8427-fde1828badeb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:03:47.968189 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4315c6-bdfc-443f-8427-fde1828badeb admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:03:48.118217 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1207/2424] 10.222.0.25 () {60 vars in 1153 bytes} [Thu Sep 15 18:03:47 2022] POST /identity/v3/projects => generated 383 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 18:03:48.124463 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b93ecb5-e413-423b-8073-08eae4b3726d admin admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:03:48.138165 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b93ecb5-e413-423b-8073-08eae4b3726d admin admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:03:48.239034 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 18:03:48.253961 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0302f332-5cad-496c-916c-50c39c93d674 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:03:48.254615 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0302f332-5cad-496c-916c-50c39c93d674 admin admin] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:03:48.255479 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0302f332-5cad-496c-916c-50c39c93d674 admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:03:48.256051 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0302f332-5cad-496c-916c-50c39c93d674 admin admin] PATH_INFO: `/v3/users` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:03:48.258360 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0302f332-5cad-496c-916c-50c39c93d674 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:03:48.263070 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0302f332-5cad-496c-916c-50c39c93d674 admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:03:48.342072 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1218/2425] 10.222.0.25 () {60 vars in 1144 bytes} [Thu Sep 15 18:03:48 2022] POST /identity/v3/users => generated 292 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 18:03:48.349981 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4315c6-bdfc-443f-8427-fde1828badeb admin admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:03:48.387899 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4315c6-bdfc-443f-8427-fde1828badeb admin admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:03:48.406146 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55858241-9aa3-42a2-8b69-00fb2876f39d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:03:48.406854 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55858241-9aa3-42a2-8b69-00fb2876f39d admin admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:03:48.407296 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55858241-9aa3-42a2-8b69-00fb2876f39d admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:03:48.407617 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55858241-9aa3-42a2-8b69-00fb2876f39d admin admin] PATH_INFO: `/v3/roles` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:03:48.408481 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55858241-9aa3-42a2-8b69-00fb2876f39d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:03:48.410529 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55858241-9aa3-42a2-8b69-00fb2876f39d admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:03:48.441204 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1208/2426] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Sep 15 18:03:48 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 18:03:48.446895 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0302f332-5cad-496c-916c-50c39c93d674 admin admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:03:48.466797 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0302f332-5cad-496c-916c-50c39c93d674 admin admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:03:48.486309 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d68181-4def-4866-98fe-e621be6a8989 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:03:48.486613 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d68181-4def-4866-98fe-e621be6a8989 admin admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:03:48.486900 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d68181-4def-4866-98fe-e621be6a8989 admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:03:48.487320 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d68181-4def-4866-98fe-e621be6a8989 admin admin] PATH_INFO: `/v3/roles` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:03:48.487998 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d68181-4def-4866-98fe-e621be6a8989 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:03:48.490706 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d68181-4def-4866-98fe-e621be6a8989 admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:03:48.531247 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1219/2427] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Sep 15 18:03:48 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 18:03:48.537763 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55858241-9aa3-42a2-8b69-00fb2876f39d admin admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:03:48.561058 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55858241-9aa3-42a2-8b69-00fb2876f39d admin admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:03:48.570656 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2501bc-09e1-4871-a713-7ce05a849958 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:03:48.572046 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2501bc-09e1-4871-a713-7ce05a849958 admin admin] REQUEST_METHOD: `PUT` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:03:48.572711 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2501bc-09e1-4871-a713-7ce05a849958 admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:03:48.573395 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2501bc-09e1-4871-a713-7ce05a849958 admin admin] PATH_INFO: `/v3/projects/370ce9b66d8a435394073e611b707f61/users/ddcc5e4b35204f8c84b3ec905b9e644b/roles/343cc8b1bc7243eebabdf08147e8366d` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:03:48.604991 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d2501bc-09e1-4871-a713-7ce05a849958 admin admin] RBAC: Authorizing `identity:create_grant(project_id=370ce9b66d8a435394073e611b707f61, user_id=ddcc5e4b35204f8c84b3ec905b9e644b, role_id=343cc8b1bc7243eebabdf08147e8366d)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:03:48.615018 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d2501bc-09e1-4871-a713-7ce05a849958 admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:03:48.654820 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1209/2428] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Sep 15 18:03:48 2022] PUT /identity/v3/projects/370ce9b66d8a435394073e611b707f61/users/ddcc5e4b35204f8c84b3ec905b9e644b/roles/343cc8b1bc7243eebabdf08147e8366d => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 15 18:03:48.666439 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d582555-39d1-48b7-a8bc-a6b7292b6195 None None] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:03:48.666991 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d582555-39d1-48b7-a8bc-a6b7292b6195 None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:03:48.667984 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d582555-39d1-48b7-a8bc-a6b7292b6195 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:03:48.755461 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.auth.core [None req-7d582555-39d1-48b7-a8bc-a6b7292b6195 None None] MFA Rules not processed for user `ddcc5e4b35204f8c84b3ec905b9e644b`. Rule list: `[]` (Enabled: `True`). {{(pid=81593) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 18:03:48.756917 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-7d582555-39d1-48b7-a8bc-a6b7292b6195 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:03:48.873569 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1220/2429] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 15 18:03:48 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 18:03:48.884859 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2501bc-09e1-4871-a713-7ce05a849958 admin admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:03:48.887113 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-9d2501bc-09e1-4871-a713-7ce05a849958 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:03:49.037418 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2501bc-09e1-4871-a713-7ce05a849958 admin admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:03:49.042931 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd83bd1a-6231-401a-abaf-f1d6677c3113 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b232e7a841145ba93c6d8462ccb751a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1213c0d1b584404ba3998e136f166e89', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:03:49.044197 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd83bd1a-6231-401a-abaf-f1d6677c3113 service cinder] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:03:49.044197 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd83bd1a-6231-401a-abaf-f1d6677c3113 service cinder] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:03:49.044465 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd83bd1a-6231-401a-abaf-f1d6677c3113 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:03:49.050672 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 18:03:49.057078 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd83bd1a-6231-401a-abaf-f1d6677c3113 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:03:49.059264 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd83bd1a-6231-401a-abaf-f1d6677c3113 service cinder] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:03:49.076041 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1210/2430] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 15 18:03:48 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 18:03:49.101834 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d582555-39d1-48b7-a8bc-a6b7292b6195 None None] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:03:49.215572 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d582555-39d1-48b7-a8bc-a6b7292b6195 None None] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:03:49.220922 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ae6cc4-2304-4c02-a885-4d28f185b479 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:03:49.221708 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ae6cc4-2304-4c02-a885-4d28f185b479 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:03:49.222491 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ae6cc4-2304-4c02-a885-4d28f185b479 admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:03:49.222491 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ae6cc4-2304-4c02-a885-4d28f185b479 admin admin] PATH_INFO: `/v3/users/ddcc5e4b35204f8c84b3ec905b9e644b` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:03:49.224108 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ae6cc4-2304-4c02-a885-4d28f185b479 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ddcc5e4b35204f8c84b3ec905b9e644b)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:03:49.226268 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ae6cc4-2304-4c02-a885-4d28f185b479 admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:03:49.334265 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-14ae6cc4-2304-4c02-a885-4d28f185b479 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ddcc5e4b35204f8c84b3ec905b9e644b'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:03:49.363284 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-14ae6cc4-2304-4c02-a885-4d28f185b479 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ddcc5e4b35204f8c84b3ec905b9e644b'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:03:49.364074 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-14ae6cc4-2304-4c02-a885-4d28f185b479 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ddcc5e4b35204f8c84b3ec905b9e644b'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:03:49.365660 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-14ae6cc4-2304-4c02-a885-4d28f185b479 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ddcc5e4b35204f8c84b3ec905b9e644b'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:03:49.396198 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-14ae6cc4-2304-4c02-a885-4d28f185b479 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ddcc5e4b35204f8c84b3ec905b9e644b'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:03:49.404201 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=88,keystone:INSERT=4,keystone:DELETE=8 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 18:03:49.477452 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1221/2431] 10.222.0.25 () {58 vars in 1224 bytes} [Thu Sep 15 18:03:49 2022] DELETE /identity/v3/users/ddcc5e4b35204f8c84b3ec905b9e644b => generated 0 bytes in 377 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 18:03:49.482534 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8284892-a811-4e58-91b3-f769570f4eb5 None None] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:03:49.483039 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8284892-a811-4e58-91b3-f769570f4eb5 None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:03:49.483150 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8284892-a811-4e58-91b3-f769570f4eb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:03:49.522151 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.auth.core [None req-a8284892-a811-4e58-91b3-f769570f4eb5 None None] MFA Rules not processed for user `5cfa58ef86774ab7800bf91930bf6028`. Rule list: `[]` (Enabled: `True`). {{(pid=81592) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 18:03:49.524034 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-a8284892-a811-4e58-91b3-f769570f4eb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:03:49.609775 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1211/2432] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 15 18:03:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 18:03:49.618665 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ae6cc4-2304-4c02-a885-4d28f185b479 admin admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:03:49.621331 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-14ae6cc4-2304-4c02-a885-4d28f185b479 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:03:49.714143 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ae6cc4-2304-4c02-a885-4d28f185b479 admin admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:03:49.721102 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30679057-8904-4282-80e7-72f49791efec service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a32274b4781b40fea9f28da8a9bde5ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1213c0d1b584404ba3998e136f166e89', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:03:49.721906 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30679057-8904-4282-80e7-72f49791efec service neutron] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:03:49.722040 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30679057-8904-4282-80e7-72f49791efec service neutron] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:03:49.722303 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30679057-8904-4282-80e7-72f49791efec service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:03:49.739557 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30679057-8904-4282-80e7-72f49791efec service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:03:49.742189 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30679057-8904-4282-80e7-72f49791efec service neutron] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:03:49.780640 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1222/2433] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 15 18:03:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 18:03:50.287782 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8284892-a811-4e58-91b3-f769570f4eb5 None None] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:03:50.289517 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-a8284892-a811-4e58-91b3-f769570f4eb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:03:50.305010 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8284892-a811-4e58-91b3-f769570f4eb5 None None] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:03:50.314675 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3c6395-cdb5-45cd-96c4-e247a03dec9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:03:50.315814 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3c6395-cdb5-45cd-96c4-e247a03dec9f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:03:50.316557 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3c6395-cdb5-45cd-96c4-e247a03dec9f admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:03:50.316723 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3c6395-cdb5-45cd-96c4-e247a03dec9f admin admin] PATH_INFO: `/v3/projects/370ce9b66d8a435394073e611b707f61` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:03:50.319175 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e3c6395-cdb5-45cd-96c4-e247a03dec9f admin admin] RBAC: Authorizing `identity:delete_project(project_id=370ce9b66d8a435394073e611b707f61)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:03:50.322265 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e3c6395-cdb5-45cd-96c4-e247a03dec9f admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:03:50.394835 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-9e3c6395-cdb5-45cd-96c4-e247a03dec9f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '370ce9b66d8a435394073e611b707f61', 'request_id': 'req-9e3c6395-cdb5-45cd-96c4-e247a03dec9f'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:03:50.402340 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-9e3c6395-cdb5-45cd-96c4-e247a03dec9f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '370ce9b66d8a435394073e611b707f61', 'request_id': 'req-9e3c6395-cdb5-45cd-96c4-e247a03dec9f'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:03:50.412734 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-9e3c6395-cdb5-45cd-96c4-e247a03dec9f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '370ce9b66d8a435394073e611b707f61', 'request_id': 'req-9e3c6395-cdb5-45cd-96c4-e247a03dec9f'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:03:50.431280 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-9e3c6395-cdb5-45cd-96c4-e247a03dec9f admin admin] The token cache is being invalidate because project 370ce9b66d8a435394073e611b707f61 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81592) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 18:03:50.432103 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-9e3c6395-cdb5-45cd-96c4-e247a03dec9f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:03:50.433328 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-9e3c6395-cdb5-45cd-96c4-e247a03dec9f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:03:50.436202 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1212/2434] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Sep 15 18:03:50 2022] DELETE /identity/v3/projects/370ce9b66d8a435394073e611b707f61 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 18:03:50.441097 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a394bf74-e201-485e-a6d4-0a2939867e44 None None] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:03:50.441461 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a394bf74-e201-485e-a6d4-0a2939867e44 None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:03:50.441740 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a394bf74-e201-485e-a6d4-0a2939867e44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:03:50.466524 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.auth.core [None req-a394bf74-e201-485e-a6d4-0a2939867e44 None None] MFA Rules not processed for user `5cfa58ef86774ab7800bf91930bf6028`. Rule list: `[]` (Enabled: `True`). {{(pid=81593) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 18:03:50.468057 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-a394bf74-e201-485e-a6d4-0a2939867e44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:03:50.592005 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1223/2435] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 15 18:03:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 18:03:50.599463 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa1871b-bb14-474b-9957-e6d7eead9190 None None] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:03:50.600400 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa1871b-bb14-474b-9957-e6d7eead9190 None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:03:50.600835 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa1871b-bb14-474b-9957-e6d7eead9190 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:03:50.628925 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.auth.core [None req-caa1871b-bb14-474b-9957-e6d7eead9190 None None] MFA Rules not processed for user `5cfa58ef86774ab7800bf91930bf6028`. Rule list: `[]` (Enabled: `True`). {{(pid=81592) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 18:03:50.630709 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-caa1871b-bb14-474b-9957-e6d7eead9190 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:03:50.653148 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1213/2436] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 15 18:03:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 18:03:50.657189 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a394bf74-e201-485e-a6d4-0a2939867e44 None None] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:03:50.668373 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a394bf74-e201-485e-a6d4-0a2939867e44 None None] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:03:50.673747 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3679712e-cad9-46b7-9472-96391f9016a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:03:50.674751 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3679712e-cad9-46b7-9472-96391f9016a2 admin admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:03:50.675447 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3679712e-cad9-46b7-9472-96391f9016a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:03:50.676288 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3679712e-cad9-46b7-9472-96391f9016a2 admin admin] PATH_INFO: `/v3/domains` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:03:50.677593 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3679712e-cad9-46b7-9472-96391f9016a2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81593) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 18:03:50.678107 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3679712e-cad9-46b7-9472-96391f9016a2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:03:50.679964 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3679712e-cad9-46b7-9472-96391f9016a2 admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:03:50.699690 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1224/2437] 10.222.0.25 () {58 vars in 1153 bytes} [Thu Sep 15 18:03:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 18:03:50.703838 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa1871b-bb14-474b-9957-e6d7eead9190 None None] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:03:50.715792 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa1871b-bb14-474b-9957-e6d7eead9190 None None] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:03:50.721935 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b81b284-2946-4ce4-a15d-2592b69169c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:03:50.724332 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b81b284-2946-4ce4-a15d-2592b69169c3 admin admin] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:03:50.724839 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b81b284-2946-4ce4-a15d-2592b69169c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:03:50.725539 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b81b284-2946-4ce4-a15d-2592b69169c3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:03:50.726627 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b81b284-2946-4ce4-a15d-2592b69169c3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:03:50.729164 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b81b284-2946-4ce4-a15d-2592b69169c3 admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:03:50.771347 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3679712e-cad9-46b7-9472-96391f9016a2 admin admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:03:50.771628 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1214/2438] 10.222.0.25 () {60 vars in 1153 bytes} [Thu Sep 15 18:03:50 2022] POST /identity/v3/projects => generated 377 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 15 18:03:50.799421 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3679712e-cad9-46b7-9472-96391f9016a2 admin admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:03:50.970985 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6046bbfb-875a-4e6a-b579-31f936140470 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:03:50.971789 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6046bbfb-875a-4e6a-b579-31f936140470 admin admin] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:03:50.972072 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6046bbfb-875a-4e6a-b579-31f936140470 admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:03:50.972373 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6046bbfb-875a-4e6a-b579-31f936140470 admin admin] PATH_INFO: `/v3/users` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:03:50.973394 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6046bbfb-875a-4e6a-b579-31f936140470 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:03:50.977122 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6046bbfb-875a-4e6a-b579-31f936140470 admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:03:50.998303 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=95,keystone:DELETE=2,keystone:INSERT=3 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 18:03:51.012975 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1225/2439] 10.222.0.25 () {60 vars in 1144 bytes} [Thu Sep 15 18:03:50 2022] POST /identity/v3/users => generated 289 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 18:03:51.014785 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b81b284-2946-4ce4-a15d-2592b69169c3 admin admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:03:51.028813 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b81b284-2946-4ce4-a15d-2592b69169c3 admin admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:03:51.035702 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9afdca1b-428e-4abf-b157-8d90e927d387 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:03:51.036622 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afdca1b-428e-4abf-b157-8d90e927d387 admin admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:03:51.037176 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afdca1b-428e-4abf-b157-8d90e927d387 admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:03:51.037874 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afdca1b-428e-4abf-b157-8d90e927d387 admin admin] PATH_INFO: `/v3/roles` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:03:51.038737 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9afdca1b-428e-4abf-b157-8d90e927d387 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:03:51.041033 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9afdca1b-428e-4abf-b157-8d90e927d387 admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:03:51.062110 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1215/2440] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Sep 15 18:03:51 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 18:03:51.062344 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6046bbfb-875a-4e6a-b579-31f936140470 admin admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:03:51.076424 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6046bbfb-875a-4e6a-b579-31f936140470 admin admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:03:51.092844 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb75742-2f5d-4acd-8f70-ec521e223e38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:03:51.093928 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb75742-2f5d-4acd-8f70-ec521e223e38 admin admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:03:51.094486 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb75742-2f5d-4acd-8f70-ec521e223e38 admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:03:51.094917 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb75742-2f5d-4acd-8f70-ec521e223e38 admin admin] PATH_INFO: `/v3/roles` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:03:51.095742 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb75742-2f5d-4acd-8f70-ec521e223e38 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:03:51.098040 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb75742-2f5d-4acd-8f70-ec521e223e38 admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:03:51.111400 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1226/2441] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Sep 15 18:03:51 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 15 18:03:51.116388 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9afdca1b-428e-4abf-b157-8d90e927d387 admin admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:03:51.130227 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9afdca1b-428e-4abf-b157-8d90e927d387 admin admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:03:51.136524 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2db05c-2f7a-4879-8dab-7f45d2ff5797 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:03:51.138394 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2db05c-2f7a-4879-8dab-7f45d2ff5797 admin admin] REQUEST_METHOD: `PUT` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:03:51.138877 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2db05c-2f7a-4879-8dab-7f45d2ff5797 admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:03:51.139311 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2db05c-2f7a-4879-8dab-7f45d2ff5797 admin admin] PATH_INFO: `/v3/projects/85bd288851fb4d069555dd203cc3d1b9/users/f79687ee41ea459c85eff11440a126fe/roles/343cc8b1bc7243eebabdf08147e8366d` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:03:51.175228 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2db05c-2f7a-4879-8dab-7f45d2ff5797 admin admin] RBAC: Authorizing `identity:create_grant(project_id=85bd288851fb4d069555dd203cc3d1b9, user_id=f79687ee41ea459c85eff11440a126fe, role_id=343cc8b1bc7243eebabdf08147e8366d)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:03:51.179680 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2db05c-2f7a-4879-8dab-7f45d2ff5797 admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:03:51.214989 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1216/2442] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Sep 15 18:03:51 2022] PUT /identity/v3/projects/85bd288851fb4d069555dd203cc3d1b9/users/f79687ee41ea459c85eff11440a126fe/roles/343cc8b1bc7243eebabdf08147e8366d => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 15 18:03:51.219706 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1a6d73-474f-486b-86f4-70f3f71dee3b None None] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:03:51.219706 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1a6d73-474f-486b-86f4-70f3f71dee3b None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:03:51.219706 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1a6d73-474f-486b-86f4-70f3f71dee3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:03:51.266363 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.auth.core [None req-5b1a6d73-474f-486b-86f4-70f3f71dee3b None None] MFA Rules not processed for user `f79687ee41ea459c85eff11440a126fe`. Rule list: `[]` (Enabled: `True`). {{(pid=81593) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 18:03:51.266363 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-5b1a6d73-474f-486b-86f4-70f3f71dee3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:03:51.477718 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1227/2443] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 15 18:03:51 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 260 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 18:03:51.495981 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2db05c-2f7a-4879-8dab-7f45d2ff5797 admin admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:03:51.499509 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-3a2db05c-2f7a-4879-8dab-7f45d2ff5797 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:03:51.543807 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 18:03:51.631754 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2db05c-2f7a-4879-8dab-7f45d2ff5797 admin admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:03:51.642334 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a82810-a12d-4389-87d4-d472bc550b59 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b232e7a841145ba93c6d8462ccb751a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1213c0d1b584404ba3998e136f166e89', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:03:51.642969 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a82810-a12d-4389-87d4-d472bc550b59 service cinder] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:03:51.643248 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a82810-a12d-4389-87d4-d472bc550b59 service cinder] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:03:51.643525 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a82810-a12d-4389-87d4-d472bc550b59 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:03:51.659353 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a82810-a12d-4389-87d4-d472bc550b59 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:03:51.661688 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a82810-a12d-4389-87d4-d472bc550b59 service cinder] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:03:51.688634 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1217/2444] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 15 18:03:51 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 18:03:52.446544 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e733a37f-a880-4d2d-b56e-61d359b39252 None None] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:03:52.447456 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e733a37f-a880-4d2d-b56e-61d359b39252 None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:03:52.447894 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e733a37f-a880-4d2d-b56e-61d359b39252 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:03:52.502479 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.auth.core [None req-e733a37f-a880-4d2d-b56e-61d359b39252 None None] MFA Rules not processed for user `efc008db667e47f99a998d08438ddaf1`. Rule list: `[]` (Enabled: `True`). {{(pid=81593) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 18:03:52.505104 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-e733a37f-a880-4d2d-b56e-61d359b39252 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:03:52.595649 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1228/2445] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 15 18:03:52 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 18:03:52.600181 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a82810-a12d-4389-87d4-d472bc550b59 service cinder] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:03:52.602149 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-41a82810-a12d-4389-87d4-d472bc550b59 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:03:52.689106 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a82810-a12d-4389-87d4-d472bc550b59 service cinder] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:03:52.693966 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f54a00-daec-4c31-b054-5d7335cf9892 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:03:52.695392 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f54a00-daec-4c31-b054-5d7335cf9892 admin admin] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:03:52.695392 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f54a00-daec-4c31-b054-5d7335cf9892 admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:03:52.695740 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f54a00-daec-4c31-b054-5d7335cf9892 admin admin] PATH_INFO: `/v3/projects` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:03:52.696812 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f54a00-daec-4c31-b054-5d7335cf9892 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:03:52.699863 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f54a00-daec-4c31-b054-5d7335cf9892 admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:03:52.742255 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1218/2446] 10.222.0.25 () {60 vars in 1153 bytes} [Thu Sep 15 18:03:52 2022] POST /identity/v3/projects => generated 371 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 15 18:03:52.746065 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e733a37f-a880-4d2d-b56e-61d359b39252 None None] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:03:52.764258 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e733a37f-a880-4d2d-b56e-61d359b39252 None None] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:03:52.866441 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cfd6572-163e-40db-b1f8-05ab5479d915 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:03:52.867162 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfd6572-163e-40db-b1f8-05ab5479d915 admin admin] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:03:52.867547 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfd6572-163e-40db-b1f8-05ab5479d915 admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:03:52.867980 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfd6572-163e-40db-b1f8-05ab5479d915 admin admin] PATH_INFO: `/v3/users` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:03:52.868774 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cfd6572-163e-40db-b1f8-05ab5479d915 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:03:52.871369 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cfd6572-163e-40db-b1f8-05ab5479d915 admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:03:52.909712 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 18:03:52.940937 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f54a00-daec-4c31-b054-5d7335cf9892 admin admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:03:52.949638 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1229/2447] 10.222.0.25 () {60 vars in 1144 bytes} [Thu Sep 15 18:03:52 2022] POST /identity/v3/users => generated 292 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 18:03:52.957137 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f54a00-daec-4c31-b054-5d7335cf9892 admin admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:03:52.963541 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6ac876-cd55-4b75-b935-24f583c94154 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:03:52.964862 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6ac876-cd55-4b75-b935-24f583c94154 admin admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:03:52.965372 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6ac876-cd55-4b75-b935-24f583c94154 admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:03:52.965836 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6ac876-cd55-4b75-b935-24f583c94154 admin admin] PATH_INFO: `/v3/roles` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:03:52.966937 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6ac876-cd55-4b75-b935-24f583c94154 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:03:52.968897 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6ac876-cd55-4b75-b935-24f583c94154 admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:03:52.997364 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cfd6572-163e-40db-b1f8-05ab5479d915 admin admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:03:53.005645 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1219/2448] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Sep 15 18:03:52 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 18:03:53.010125 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cfd6572-163e-40db-b1f8-05ab5479d915 admin admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:03:53.016596 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00125f86-03c3-4ecd-b5ee-d09211017a7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:03:53.017560 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00125f86-03c3-4ecd-b5ee-d09211017a7e admin admin] REQUEST_METHOD: `PUT` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:03:53.017929 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00125f86-03c3-4ecd-b5ee-d09211017a7e admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:03:53.018298 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00125f86-03c3-4ecd-b5ee-d09211017a7e admin admin] PATH_INFO: `/v3/projects/e9edbab6d90c4bc5b2e38b4e7d46818f/users/e7ddb90f8cf5486d872a156df1f29ee5/roles/a9e42be86923434f8af52d3fc07fb4f7` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:03:53.035856 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00125f86-03c3-4ecd-b5ee-d09211017a7e admin admin] RBAC: Authorizing `identity:create_grant(project_id=e9edbab6d90c4bc5b2e38b4e7d46818f, user_id=e7ddb90f8cf5486d872a156df1f29ee5, role_id=a9e42be86923434f8af52d3fc07fb4f7)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:03:53.038766 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00125f86-03c3-4ecd-b5ee-d09211017a7e admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:03:53.056420 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1230/2449] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Sep 15 18:03:52 2022] PUT /identity/v3/projects/e9edbab6d90c4bc5b2e38b4e7d46818f/users/e7ddb90f8cf5486d872a156df1f29ee5/roles/a9e42be86923434f8af52d3fc07fb4f7 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 18:03:53.061115 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6ac876-cd55-4b75-b935-24f583c94154 admin admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:03:53.080949 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6ac876-cd55-4b75-b935-24f583c94154 admin admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:03:53.184581 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc44c7f-b631-490a-9851-604afe1a95d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:03:53.185198 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc44c7f-b631-490a-9851-604afe1a95d5 admin admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:03:53.185502 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc44c7f-b631-490a-9851-604afe1a95d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:03:53.185774 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc44c7f-b631-490a-9851-604afe1a95d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:03:53.186415 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc44c7f-b631-490a-9851-604afe1a95d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:03:53.187996 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc44c7f-b631-490a-9851-604afe1a95d5 admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:03:53.204160 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1220/2450] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Sep 15 18:03:53 2022] GET /identity/v3/roles => generated 1420 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 18:03:53.207301 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00125f86-03c3-4ecd-b5ee-d09211017a7e admin admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:03:53.219911 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00125f86-03c3-4ecd-b5ee-d09211017a7e admin admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:03:53.225044 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34a54b9-fda9-4c50-a65d-eac2a508a546 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:03:53.225736 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34a54b9-fda9-4c50-a65d-eac2a508a546 admin admin] REQUEST_METHOD: `PUT` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:03:53.226015 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34a54b9-fda9-4c50-a65d-eac2a508a546 admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:03:53.226303 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34a54b9-fda9-4c50-a65d-eac2a508a546 admin admin] PATH_INFO: `/v3/projects/e9edbab6d90c4bc5b2e38b4e7d46818f/users/e7ddb90f8cf5486d872a156df1f29ee5/roles/a9e42be86923434f8af52d3fc07fb4f7` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:03:53.228269 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34a54b9-fda9-4c50-a65d-eac2a508a546 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e9edbab6d90c4bc5b2e38b4e7d46818f, user_id=e7ddb90f8cf5486d872a156df1f29ee5, role_id=a9e42be86923434f8af52d3fc07fb4f7)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:03:53.231528 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34a54b9-fda9-4c50-a65d-eac2a508a546 admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:03:53.242633 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1231/2451] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Sep 15 18:03:53 2022] PUT /identity/v3/projects/e9edbab6d90c4bc5b2e38b4e7d46818f/users/e7ddb90f8cf5486d872a156df1f29ee5/roles/a9e42be86923434f8af52d3fc07fb4f7 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 18:03:55.938316 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc44c7f-b631-490a-9851-604afe1a95d5 admin admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:03:55.940970 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-ffc44c7f-b631-490a-9851-604afe1a95d5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:03:55.957993 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc44c7f-b631-490a-9851-604afe1a95d5 admin admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:03:56.021073 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 18:03:56.134839 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6565bfed-a278-45a0-b3dc-61feed48b05e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:03:56.136813 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6565bfed-a278-45a0-b3dc-61feed48b05e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:03:56.137330 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6565bfed-a278-45a0-b3dc-61feed48b05e admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:03:56.137904 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6565bfed-a278-45a0-b3dc-61feed48b05e admin admin] PATH_INFO: `/v3/users/7f53142e42414b6d8b1f5a399c3f4e80` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:03:56.140104 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6565bfed-a278-45a0-b3dc-61feed48b05e admin admin] RBAC: Authorizing `identity:delete_user(user_id=7f53142e42414b6d8b1f5a399c3f4e80)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:03:56.144721 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6565bfed-a278-45a0-b3dc-61feed48b05e admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:03:56.273991 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-6565bfed-a278-45a0-b3dc-61feed48b05e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7f53142e42414b6d8b1f5a399c3f4e80'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:03:56.294250 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-6565bfed-a278-45a0-b3dc-61feed48b05e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7f53142e42414b6d8b1f5a399c3f4e80'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:03:56.295589 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-6565bfed-a278-45a0-b3dc-61feed48b05e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7f53142e42414b6d8b1f5a399c3f4e80'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:03:56.297416 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-6565bfed-a278-45a0-b3dc-61feed48b05e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7f53142e42414b6d8b1f5a399c3f4e80'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:03:56.325109 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-6565bfed-a278-45a0-b3dc-61feed48b05e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7f53142e42414b6d8b1f5a399c3f4e80'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:03:56.379755 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68353757-1646-4574-a0f1-1ef2cdbc3ab3 None None] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:03:56.380343 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68353757-1646-4574-a0f1-1ef2cdbc3ab3 None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:03:56.380343 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68353757-1646-4574-a0f1-1ef2cdbc3ab3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:03:56.404895 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1221/2452] 10.222.0.25 () {58 vars in 1224 bytes} [Thu Sep 15 18:03:55 2022] DELETE /identity/v3/users/7f53142e42414b6d8b1f5a399c3f4e80 => generated 0 bytes in 437 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 18:03:56.422525 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.auth.core [None req-68353757-1646-4574-a0f1-1ef2cdbc3ab3 None None] MFA Rules not processed for user `5cfa58ef86774ab7800bf91930bf6028`. Rule list: `[]` (Enabled: `True`). {{(pid=81593) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 18:03:56.423926 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-68353757-1646-4574-a0f1-1ef2cdbc3ab3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:03:56.611697 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6565bfed-a278-45a0-b3dc-61feed48b05e admin admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:03:56.613620 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-6565bfed-a278-45a0-b3dc-61feed48b05e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:03:56.620889 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1232/2453] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 15 18:03:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 18:03:56.803625 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6565bfed-a278-45a0-b3dc-61feed48b05e admin admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:03:56.824708 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a54b47f-840b-42fc-9b30-7a5a5961f4a6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a32274b4781b40fea9f28da8a9bde5ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1213c0d1b584404ba3998e136f166e89', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:03:56.825760 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a54b47f-840b-42fc-9b30-7a5a5961f4a6 service neutron] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:03:56.826413 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a54b47f-840b-42fc-9b30-7a5a5961f4a6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:03:56.826692 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a54b47f-840b-42fc-9b30-7a5a5961f4a6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:03:56.886496 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a54b47f-840b-42fc-9b30-7a5a5961f4a6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:03:56.887891 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a54b47f-840b-42fc-9b30-7a5a5961f4a6 service neutron] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:03:56.936966 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1222/2454] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 15 18:03:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 15 18:03:57.631903 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68353757-1646-4574-a0f1-1ef2cdbc3ab3 None None] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:03:57.642093 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-68353757-1646-4574-a0f1-1ef2cdbc3ab3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:03:57.691721 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68353757-1646-4574-a0f1-1ef2cdbc3ab3 None None] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:03:57.703332 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109c0c9a-d4da-4623-8532-4d9e4e32beaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:03:57.704544 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109c0c9a-d4da-4623-8532-4d9e4e32beaf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:03:57.705103 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109c0c9a-d4da-4623-8532-4d9e4e32beaf admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:03:57.705639 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109c0c9a-d4da-4623-8532-4d9e4e32beaf admin admin] PATH_INFO: `/v3/projects/c0d9937e354a4d7595db38d336d37d28` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:03:57.708196 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109c0c9a-d4da-4623-8532-4d9e4e32beaf admin admin] RBAC: Authorizing `identity:delete_project(project_id=c0d9937e354a4d7595db38d336d37d28)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:03:57.716871 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109c0c9a-d4da-4623-8532-4d9e4e32beaf admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:03:57.856008 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-109c0c9a-d4da-4623-8532-4d9e4e32beaf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c0d9937e354a4d7595db38d336d37d28', 'request_id': 'req-109c0c9a-d4da-4623-8532-4d9e4e32beaf'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:03:57.865591 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-109c0c9a-d4da-4623-8532-4d9e4e32beaf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c0d9937e354a4d7595db38d336d37d28', 'request_id': 'req-109c0c9a-d4da-4623-8532-4d9e4e32beaf'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:03:57.877909 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-109c0c9a-d4da-4623-8532-4d9e4e32beaf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c0d9937e354a4d7595db38d336d37d28', 'request_id': 'req-109c0c9a-d4da-4623-8532-4d9e4e32beaf'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:03:57.904518 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-109c0c9a-d4da-4623-8532-4d9e4e32beaf admin admin] The token cache is being invalidate because project c0d9937e354a4d7595db38d336d37d28 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81593) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 18:03:57.905070 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-109c0c9a-d4da-4623-8532-4d9e4e32beaf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:03:57.906271 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-109c0c9a-d4da-4623-8532-4d9e4e32beaf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:03:57.908593 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1233/2455] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Sep 15 18:03:57 2022] DELETE /identity/v3/projects/c0d9937e354a4d7595db38d336d37d28 => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 18:03:57.913886 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a47f0b9-3353-4601-b777-15cb82d8ec03 None None] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:03:57.914686 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a47f0b9-3353-4601-b777-15cb82d8ec03 None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:03:57.914686 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a47f0b9-3353-4601-b777-15cb82d8ec03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:03:57.969961 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.auth.core [None req-2a47f0b9-3353-4601-b777-15cb82d8ec03 None None] MFA Rules not processed for user `5cfa58ef86774ab7800bf91930bf6028`. Rule list: `[]` (Enabled: `True`). {{(pid=81592) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 18:03:57.972870 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-2a47f0b9-3353-4601-b777-15cb82d8ec03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:03:58.121549 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 18:03:58.161760 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1223/2456] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 15 18:03:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 249 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 18:03:58.170562 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f44822e-4bed-4c4c-b047-99584d13e691 None None] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:03:58.170857 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f44822e-4bed-4c4c-b047-99584d13e691 None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:03:58.171136 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f44822e-4bed-4c4c-b047-99584d13e691 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:03:58.215482 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.auth.core [None req-6f44822e-4bed-4c4c-b047-99584d13e691 None None] MFA Rules not processed for user `5cfa58ef86774ab7800bf91930bf6028`. Rule list: `[]` (Enabled: `True`). {{(pid=81593) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 18:03:58.217024 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-6f44822e-4bed-4c4c-b047-99584d13e691 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:03:58.228995 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1234/2457] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 15 18:03:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 18:03:58.234292 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a47f0b9-3353-4601-b777-15cb82d8ec03 None None] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:03:58.247868 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a47f0b9-3353-4601-b777-15cb82d8ec03 None None] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:03:58.259993 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed1ffc4-b2fd-4c5d-a919-4ae920f9bd60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:03:58.261687 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed1ffc4-b2fd-4c5d-a919-4ae920f9bd60 admin admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:03:58.261969 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed1ffc4-b2fd-4c5d-a919-4ae920f9bd60 admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:03:58.262237 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed1ffc4-b2fd-4c5d-a919-4ae920f9bd60 admin admin] PATH_INFO: `/v3/domains` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:03:58.262961 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed1ffc4-b2fd-4c5d-a919-4ae920f9bd60 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81592) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 18:03:58.263209 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed1ffc4-b2fd-4c5d-a919-4ae920f9bd60 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:03:58.264811 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed1ffc4-b2fd-4c5d-a919-4ae920f9bd60 admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:03:58.280290 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1224/2458] 10.222.0.25 () {58 vars in 1153 bytes} [Thu Sep 15 18:03:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 18:03:58.284880 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f44822e-4bed-4c4c-b047-99584d13e691 None None] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:03:58.299571 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f44822e-4bed-4c4c-b047-99584d13e691 None None] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:03:58.309630 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6571b09-3f81-4d87-95fe-e7e16fdab4c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:03:58.310681 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6571b09-3f81-4d87-95fe-e7e16fdab4c6 admin admin] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:03:58.310946 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6571b09-3f81-4d87-95fe-e7e16fdab4c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:03:58.311258 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6571b09-3f81-4d87-95fe-e7e16fdab4c6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:03:58.311992 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6571b09-3f81-4d87-95fe-e7e16fdab4c6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:03:58.326007 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6571b09-3f81-4d87-95fe-e7e16fdab4c6 admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:03:58.391268 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1235/2459] 10.222.0.25 () {60 vars in 1153 bytes} [Thu Sep 15 18:03:58 2022] POST /identity/v3/projects => generated 363 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 18:03:58.395794 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed1ffc4-b2fd-4c5d-a919-4ae920f9bd60 admin admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:03:58.417197 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed1ffc4-b2fd-4c5d-a919-4ae920f9bd60 admin admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:03:58.543402 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b670c9d9-5b4b-47d4-84f6-65cec7a2dc45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:03:58.544042 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b670c9d9-5b4b-47d4-84f6-65cec7a2dc45 admin admin] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:03:58.544316 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b670c9d9-5b4b-47d4-84f6-65cec7a2dc45 admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:03:58.544597 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b670c9d9-5b4b-47d4-84f6-65cec7a2dc45 admin admin] PATH_INFO: `/v3/users` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:03:58.545240 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b670c9d9-5b4b-47d4-84f6-65cec7a2dc45 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:03:58.547205 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b670c9d9-5b4b-47d4-84f6-65cec7a2dc45 admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:03:58.595828 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1225/2460] 10.222.0.25 () {60 vars in 1144 bytes} [Thu Sep 15 18:03:58 2022] POST /identity/v3/users => generated 282 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 18:03:58.600270 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6571b09-3f81-4d87-95fe-e7e16fdab4c6 admin admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:03:58.615639 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6571b09-3f81-4d87-95fe-e7e16fdab4c6 admin admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:03:58.624226 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4d949f-005c-448b-b0bd-c8d9db1e71a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:03:58.624819 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4d949f-005c-448b-b0bd-c8d9db1e71a4 admin admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:03:58.624819 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4d949f-005c-448b-b0bd-c8d9db1e71a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:03:58.625380 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4d949f-005c-448b-b0bd-c8d9db1e71a4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:03:58.625782 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d4d949f-005c-448b-b0bd-c8d9db1e71a4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:03:58.627506 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d4d949f-005c-448b-b0bd-c8d9db1e71a4 admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:03:58.646583 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1236/2461] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Sep 15 18:03:58 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 18:03:58.650852 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b670c9d9-5b4b-47d4-84f6-65cec7a2dc45 admin admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:03:58.695895 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b670c9d9-5b4b-47d4-84f6-65cec7a2dc45 admin admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:03:58.720684 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c5c17f-0701-46e0-b5db-8c7e42c94735 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:03:58.721566 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c5c17f-0701-46e0-b5db-8c7e42c94735 admin admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:03:58.721992 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c5c17f-0701-46e0-b5db-8c7e42c94735 admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:03:58.723085 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c5c17f-0701-46e0-b5db-8c7e42c94735 admin admin] PATH_INFO: `/v3/roles` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:03:58.724062 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c5c17f-0701-46e0-b5db-8c7e42c94735 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:03:58.725880 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c5c17f-0701-46e0-b5db-8c7e42c94735 admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:03:58.755720 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1226/2462] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Sep 15 18:03:58 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 18:03:58.760619 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4d949f-005c-448b-b0bd-c8d9db1e71a4 admin admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:03:58.768659 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 18:03:58.778893 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4d949f-005c-448b-b0bd-c8d9db1e71a4 admin admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:03:58.787153 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c0c353-0062-4a34-83ce-f2aa9f5d4752 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:03:58.788232 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c0c353-0062-4a34-83ce-f2aa9f5d4752 admin admin] REQUEST_METHOD: `PUT` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:03:58.788521 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c0c353-0062-4a34-83ce-f2aa9f5d4752 admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:03:58.788798 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c0c353-0062-4a34-83ce-f2aa9f5d4752 admin admin] PATH_INFO: `/v3/projects/15ea67be7bbc4d6d860485d51a10f63c/users/fbdd61a9bfa64796a650f4e1e1c74ec1/roles/343cc8b1bc7243eebabdf08147e8366d` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:03:58.811642 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c0c353-0062-4a34-83ce-f2aa9f5d4752 admin admin] RBAC: Authorizing `identity:create_grant(project_id=15ea67be7bbc4d6d860485d51a10f63c, user_id=fbdd61a9bfa64796a650f4e1e1c74ec1, role_id=343cc8b1bc7243eebabdf08147e8366d)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:03:58.816134 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c0c353-0062-4a34-83ce-f2aa9f5d4752 admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:03:58.848056 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1237/2463] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Sep 15 18:03:58 2022] PUT /identity/v3/projects/15ea67be7bbc4d6d860485d51a10f63c/users/fbdd61a9bfa64796a650f4e1e1c74ec1/roles/343cc8b1bc7243eebabdf08147e8366d => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 18:03:58.862059 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07765533-119e-41eb-9c06-6620b3abc133 None None] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:03:58.862629 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07765533-119e-41eb-9c06-6620b3abc133 None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:03:58.863018 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07765533-119e-41eb-9c06-6620b3abc133 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:03:58.914522 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.auth.core [None req-07765533-119e-41eb-9c06-6620b3abc133 None None] MFA Rules not processed for user `fbdd61a9bfa64796a650f4e1e1c74ec1`. Rule list: `[]` (Enabled: `True`). {{(pid=81592) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 18:03:58.918673 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-07765533-119e-41eb-9c06-6620b3abc133 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:03:59.019532 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1227/2464] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 15 18:03:58 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 18:03:59.045077 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c0c353-0062-4a34-83ce-f2aa9f5d4752 admin admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:03:59.047477 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-16c0c353-0062-4a34-83ce-f2aa9f5d4752 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:03:59.160946 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c0c353-0062-4a34-83ce-f2aa9f5d4752 admin admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:03:59.170258 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87dde8a-8021-4953-b5b5-c4039101fd68 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b232e7a841145ba93c6d8462ccb751a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1213c0d1b584404ba3998e136f166e89', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:03:59.171255 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87dde8a-8021-4953-b5b5-c4039101fd68 service cinder] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:03:59.171532 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87dde8a-8021-4953-b5b5-c4039101fd68 service cinder] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:03:59.171798 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87dde8a-8021-4953-b5b5-c4039101fd68 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:03:59.184624 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87dde8a-8021-4953-b5b5-c4039101fd68 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:03:59.186362 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87dde8a-8021-4953-b5b5-c4039101fd68 service cinder] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:03:59.204633 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1238/2465] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 15 18:03:59 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 18:04:01.331533 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22d8d57-d5be-4438-801f-ea0be2191c87 None None] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:04:01.332469 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22d8d57-d5be-4438-801f-ea0be2191c87 None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:04:01.332898 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22d8d57-d5be-4438-801f-ea0be2191c87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:04:01.376664 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.auth.core [None req-c22d8d57-d5be-4438-801f-ea0be2191c87 None None] MFA Rules not processed for user `db4da97ae9284046b5d1667bee32f821`. Rule list: `[]` (Enabled: `True`). {{(pid=81592) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 18:04:01.378224 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-c22d8d57-d5be-4438-801f-ea0be2191c87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:04:01.517315 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 18:04:01.591188 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1228/2466] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 15 18:04:01 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 260 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 18:04:02.429898 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c96a6d4-d35b-45b9-8c0f-eff9ccebc8ef None None] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:04:02.430375 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c96a6d4-d35b-45b9-8c0f-eff9ccebc8ef None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:04:02.430484 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c96a6d4-d35b-45b9-8c0f-eff9ccebc8ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:04:02.530062 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.auth.core [None req-6c96a6d4-d35b-45b9-8c0f-eff9ccebc8ef None None] MFA Rules not processed for user `e7ddb90f8cf5486d872a156df1f29ee5`. Rule list: `[]` (Enabled: `True`). {{(pid=81593) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 18:04:02.531642 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-6c96a6d4-d35b-45b9-8c0f-eff9ccebc8ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:04:02.843761 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1239/2467] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 15 18:04:02 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 415 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 18:04:02.862038 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22d8d57-d5be-4438-801f-ea0be2191c87 None None] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:04:02.864300 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-c22d8d57-d5be-4438-801f-ea0be2191c87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:04:02.985051 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22d8d57-d5be-4438-801f-ea0be2191c87 None None] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:04:02.991113 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac4bf94-a789-4f13-96c9-890452439de6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe2244818e4d4dca9c424cd078653e6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1213c0d1b584404ba3998e136f166e89', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:04:02.991723 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac4bf94-a789-4f13-96c9-890452439de6 service nova] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:04:02.992011 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac4bf94-a789-4f13-96c9-890452439de6 service nova] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:04:02.992288 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac4bf94-a789-4f13-96c9-890452439de6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:04:02.994271 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-3ac4bf94-a789-4f13-96c9-890452439de6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:04:03.065365 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac4bf94-a789-4f13-96c9-890452439de6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:04:03.067110 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac4bf94-a789-4f13-96c9-890452439de6 service nova] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:04:03.078106 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1229/2468] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 15 18:04:02 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 217 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 18:04:03.753393 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d746d3-40b6-4c58-9f69-8436a22dcaa5 None None] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:04:03.753879 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d746d3-40b6-4c58-9f69-8436a22dcaa5 None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:04:03.754047 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d746d3-40b6-4c58-9f69-8436a22dcaa5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:04:03.805007 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.auth.core [None req-b5d746d3-40b6-4c58-9f69-8436a22dcaa5 None None] MFA Rules not processed for user `d899ec4fcbeb4de382c7f0a779ca8ed5`. Rule list: `[]` (Enabled: `True`). {{(pid=81593) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 18:04:03.806133 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-b5d746d3-40b6-4c58-9f69-8436a22dcaa5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:04:03.931704 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac4bf94-a789-4f13-96c9-890452439de6 service nova] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:04:03.934438 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-3ac4bf94-a789-4f13-96c9-890452439de6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:04:03.979260 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1240/2469] 10.222.0.25 () {58 vars in 1009 bytes} [Thu Sep 15 18:04:03 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 18:04:04.039007 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d746d3-40b6-4c58-9f69-8436a22dcaa5 None None] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:04:04.044167 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-b5d746d3-40b6-4c58-9f69-8436a22dcaa5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:04:04.066767 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 18:04:04.148216 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac4bf94-a789-4f13-96c9-890452439de6 service nova] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:04:04.170145 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7026422d-49fd-4061-8d98-1b62aac196c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:04:04.171608 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7026422d-49fd-4061-8d98-1b62aac196c6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:04:04.172020 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7026422d-49fd-4061-8d98-1b62aac196c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:04:04.172351 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7026422d-49fd-4061-8d98-1b62aac196c6 admin admin] PATH_INFO: `/v3/users/35697e7417474655a739823e5c457f24` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:04:04.178141 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7026422d-49fd-4061-8d98-1b62aac196c6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=35697e7417474655a739823e5c457f24)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:04:04.182527 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7026422d-49fd-4061-8d98-1b62aac196c6 admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:04:04.283004 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d746d3-40b6-4c58-9f69-8436a22dcaa5 None None] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:04:04.295266 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 18:04:04.302460 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed3cf63-32b4-4ad0-a0c3-7e5f844ebdb5 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '685f7ad4c6fe4c878d542dddd6d81593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1213c0d1b584404ba3998e136f166e89', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:04:04.312943 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed3cf63-32b4-4ad0-a0c3-7e5f844ebdb5 service swift] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:04:04.313367 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed3cf63-32b4-4ad0-a0c3-7e5f844ebdb5 service swift] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:04:04.313655 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed3cf63-32b4-4ad0-a0c3-7e5f844ebdb5 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:04:04.341588 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed3cf63-32b4-4ad0-a0c3-7e5f844ebdb5 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:04:04.347047 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed3cf63-32b4-4ad0-a0c3-7e5f844ebdb5 service swift] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:04:04.366034 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-7026422d-49fd-4061-8d98-1b62aac196c6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '35697e7417474655a739823e5c457f24'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:04:04.372166 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1241/2470] 10.222.0.25 () {60 vars in 1384 bytes} [Thu Sep 15 18:04:04 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Sep 15 18:04:04.431272 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-7026422d-49fd-4061-8d98-1b62aac196c6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '35697e7417474655a739823e5c457f24'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:04:04.431272 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-7026422d-49fd-4061-8d98-1b62aac196c6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '35697e7417474655a739823e5c457f24'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:04:04.431272 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-7026422d-49fd-4061-8d98-1b62aac196c6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '35697e7417474655a739823e5c457f24'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:04:04.433789 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-7026422d-49fd-4061-8d98-1b62aac196c6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '35697e7417474655a739823e5c457f24'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:04:04.459746 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1230/2471] 10.222.0.25 () {58 vars in 1224 bytes} [Thu Sep 15 18:04:03 2022] DELETE /identity/v3/users/35697e7417474655a739823e5c457f24 => generated 0 bytes in 537 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 18:04:04.464634 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f78d94a-8d62-4727-81a0-2f8a00b6492d None None] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:04:04.464948 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f78d94a-8d62-4727-81a0-2f8a00b6492d None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:04:04.465325 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f78d94a-8d62-4727-81a0-2f8a00b6492d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:04:04.496192 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.auth.core [None req-2f78d94a-8d62-4727-81a0-2f8a00b6492d None None] MFA Rules not processed for user `5cfa58ef86774ab7800bf91930bf6028`. Rule list: `[]` (Enabled: `True`). {{(pid=81593) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 18:04:04.498110 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-2f78d94a-8d62-4727-81a0-2f8a00b6492d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:04:04.643497 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1242/2472] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 15 18:04:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 18:04:04.652151 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7026422d-49fd-4061-8d98-1b62aac196c6 admin admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:04:04.656829 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-7026422d-49fd-4061-8d98-1b62aac196c6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:04:04.775175 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7026422d-49fd-4061-8d98-1b62aac196c6 admin admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:04:04.779989 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230d5014-2c16-472e-b6e5-7485bce94696 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a32274b4781b40fea9f28da8a9bde5ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1213c0d1b584404ba3998e136f166e89', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:04:04.781066 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230d5014-2c16-472e-b6e5-7485bce94696 service neutron] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:04:04.781186 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230d5014-2c16-472e-b6e5-7485bce94696 service neutron] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:04:04.781797 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230d5014-2c16-472e-b6e5-7485bce94696 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:04:04.793604 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-230d5014-2c16-472e-b6e5-7485bce94696 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:04:04.795558 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-230d5014-2c16-472e-b6e5-7485bce94696 service neutron] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:04:04.812352 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1231/2473] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 15 18:04:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 18:04:05.072495 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468b472c-105a-49ce-b45c-2e5485b7f264 None None] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:04:05.073775 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468b472c-105a-49ce-b45c-2e5485b7f264 None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:04:05.074079 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468b472c-105a-49ce-b45c-2e5485b7f264 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:04:05.098668 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.auth.core [None req-468b472c-105a-49ce-b45c-2e5485b7f264 None None] MFA Rules not processed for user `efc008db667e47f99a998d08438ddaf1`. Rule list: `[]` (Enabled: `True`). {{(pid=81593) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 18:04:05.100084 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-468b472c-105a-49ce-b45c-2e5485b7f264 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:04:05.233106 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1243/2474] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 15 18:04:05 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 18:04:05.312680 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a623482e-1541-41a2-b706-c3615fc609fa None None] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:04:05.313999 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a623482e-1541-41a2-b706-c3615fc609fa None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:04:05.314479 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a623482e-1541-41a2-b706-c3615fc609fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:04:05.327636 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468b472c-105a-49ce-b45c-2e5485b7f264 None None] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:04:05.329471 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-468b472c-105a-49ce-b45c-2e5485b7f264 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:04:05.352011 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468b472c-105a-49ce-b45c-2e5485b7f264 None None] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:04:05.364119 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec1bba2-4b02-4477-bf53-1a520e49c39a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:04:05.365359 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec1bba2-4b02-4477-bf53-1a520e49c39a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:04:05.366027 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec1bba2-4b02-4477-bf53-1a520e49c39a admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:04:05.366436 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec1bba2-4b02-4477-bf53-1a520e49c39a admin admin] PATH_INFO: `/v3/projects/fc401dbcd7ed4b828aed0d0ceeb9319a` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:04:05.368144 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec1bba2-4b02-4477-bf53-1a520e49c39a admin admin] RBAC: Authorizing `identity:delete_project(project_id=fc401dbcd7ed4b828aed0d0ceeb9319a)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:04:05.368771 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.auth.core [None req-a623482e-1541-41a2-b706-c3615fc609fa None None] MFA Rules not processed for user `d899ec4fcbeb4de382c7f0a779ca8ed5`. Rule list: `[]` (Enabled: `True`). {{(pid=81592) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 18:04:05.370561 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec1bba2-4b02-4477-bf53-1a520e49c39a admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:04:05.408026 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-a623482e-1541-41a2-b706-c3615fc609fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:04:05.485663 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 18:04:05.492103 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-8ec1bba2-4b02-4477-bf53-1a520e49c39a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fc401dbcd7ed4b828aed0d0ceeb9319a', 'request_id': 'req-8ec1bba2-4b02-4477-bf53-1a520e49c39a'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:04:05.501218 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-8ec1bba2-4b02-4477-bf53-1a520e49c39a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fc401dbcd7ed4b828aed0d0ceeb9319a', 'request_id': 'req-8ec1bba2-4b02-4477-bf53-1a520e49c39a'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:04:05.514173 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-8ec1bba2-4b02-4477-bf53-1a520e49c39a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fc401dbcd7ed4b828aed0d0ceeb9319a', 'request_id': 'req-8ec1bba2-4b02-4477-bf53-1a520e49c39a'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:04:05.546844 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-8ec1bba2-4b02-4477-bf53-1a520e49c39a admin admin] The token cache is being invalidate because project fc401dbcd7ed4b828aed0d0ceeb9319a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81593) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 18:04:05.547792 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-8ec1bba2-4b02-4477-bf53-1a520e49c39a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:04:05.552599 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-8ec1bba2-4b02-4477-bf53-1a520e49c39a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:04:05.555396 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1244/2475] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Sep 15 18:04:05 2022] DELETE /identity/v3/projects/fc401dbcd7ed4b828aed0d0ceeb9319a => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 18:04:05.584810 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1232/2476] 10.222.0.25 () {58 vars in 967 bytes} [Thu Sep 15 18:04:05 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 279 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 18:04:05.605709 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec1bba2-4b02-4477-bf53-1a520e49c39a admin admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:04:05.611085 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-8ec1bba2-4b02-4477-bf53-1a520e49c39a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:04:05.865905 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec1bba2-4b02-4477-bf53-1a520e49c39a admin admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:04:05.877027 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50899d86-2567-45d4-9a78-0d518fcbaa38 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '685f7ad4c6fe4c878d542dddd6d81593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1213c0d1b584404ba3998e136f166e89', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:04:05.877925 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50899d86-2567-45d4-9a78-0d518fcbaa38 service swift] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:04:05.878440 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50899d86-2567-45d4-9a78-0d518fcbaa38 service swift] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:04:05.878965 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50899d86-2567-45d4-9a78-0d518fcbaa38 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:04:05.998390 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50899d86-2567-45d4-9a78-0d518fcbaa38 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:04:06.000931 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50899d86-2567-45d4-9a78-0d518fcbaa38 service swift] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:04:06.018577 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1245/2477] 10.222.0.25 () {60 vars in 1384 bytes} [Thu Sep 15 18:04:05 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 415 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 15 18:04:06.559442 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0627dd7-8232-4199-b91f-99a381efa0bf None None] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:04:06.559989 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0627dd7-8232-4199-b91f-99a381efa0bf None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:04:06.560303 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0627dd7-8232-4199-b91f-99a381efa0bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:04:06.602780 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.auth.core [None req-f0627dd7-8232-4199-b91f-99a381efa0bf None None] MFA Rules not processed for user `d899ec4fcbeb4de382c7f0a779ca8ed5`. Rule list: `[]` (Enabled: `True`). {{(pid=81592) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 18:04:06.604725 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-f0627dd7-8232-4199-b91f-99a381efa0bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:04:06.614505 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1233/2478] 10.222.0.25 () {58 vars in 1009 bytes} [Thu Sep 15 18:04:06 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 18:04:06.629278 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50899d86-2567-45d4-9a78-0d518fcbaa38 service swift] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:04:06.660009 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50899d86-2567-45d4-9a78-0d518fcbaa38 service swift] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:04:06.668256 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f24b14-3f57-4f27-8b49-86f87075087d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '685f7ad4c6fe4c878d542dddd6d81593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1213c0d1b584404ba3998e136f166e89', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:04:06.668955 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f24b14-3f57-4f27-8b49-86f87075087d service swift] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:04:06.669322 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f24b14-3f57-4f27-8b49-86f87075087d service swift] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:04:06.669759 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f24b14-3f57-4f27-8b49-86f87075087d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:04:06.680270 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f24b14-3f57-4f27-8b49-86f87075087d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:04:06.682869 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f24b14-3f57-4f27-8b49-86f87075087d service swift] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:04:06.703295 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1246/2479] 10.222.0.25 () {60 vars in 1384 bytes} [Thu Sep 15 18:04:06 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 75 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Sep 15 18:04:07.036863 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0627dd7-8232-4199-b91f-99a381efa0bf None None] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:04:07.039379 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-f0627dd7-8232-4199-b91f-99a381efa0bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:04:07.173003 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 18:04:07.210076 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0627dd7-8232-4199-b91f-99a381efa0bf None None] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:04:07.216859 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0aef460-84fa-4c35-bb1b-c41e74f88520 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:04:07.217507 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0aef460-84fa-4c35-bb1b-c41e74f88520 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:04:07.218078 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0aef460-84fa-4c35-bb1b-c41e74f88520 admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:04:07.218545 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0aef460-84fa-4c35-bb1b-c41e74f88520 admin admin] PATH_INFO: `/v3/users/f79687ee41ea459c85eff11440a126fe` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:04:07.226460 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0aef460-84fa-4c35-bb1b-c41e74f88520 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f79687ee41ea459c85eff11440a126fe)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:04:07.229885 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0aef460-84fa-4c35-bb1b-c41e74f88520 admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:04:07.337000 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-a0aef460-84fa-4c35-bb1b-c41e74f88520 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f79687ee41ea459c85eff11440a126fe'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:04:07.361693 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-a0aef460-84fa-4c35-bb1b-c41e74f88520 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f79687ee41ea459c85eff11440a126fe'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:04:07.362670 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-a0aef460-84fa-4c35-bb1b-c41e74f88520 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f79687ee41ea459c85eff11440a126fe'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:04:07.363519 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-a0aef460-84fa-4c35-bb1b-c41e74f88520 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f79687ee41ea459c85eff11440a126fe'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:04:07.380089 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-a0aef460-84fa-4c35-bb1b-c41e74f88520 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f79687ee41ea459c85eff11440a126fe'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:04:07.427683 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1234/2480] 10.222.0.25 () {58 vars in 1224 bytes} [Thu Sep 15 18:04:07 2022] DELETE /identity/v3/users/f79687ee41ea459c85eff11440a126fe => generated 0 bytes in 389 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 15 18:04:07.429065 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0d4b95-0f2b-4548-beae-e061b6319b50 None None] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:04:07.430238 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0d4b95-0f2b-4548-beae-e061b6319b50 None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:04:07.430531 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0d4b95-0f2b-4548-beae-e061b6319b50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:04:07.439290 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37632cce-a5bd-41b1-96fb-92c886d39d80 None None] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:04:07.440157 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37632cce-a5bd-41b1-96fb-92c886d39d80 None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:04:07.440906 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37632cce-a5bd-41b1-96fb-92c886d39d80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:04:07.487802 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.auth.core [None req-be0d4b95-0f2b-4548-beae-e061b6319b50 None None] MFA Rules not processed for user `5cfa58ef86774ab7800bf91930bf6028`. Rule list: `[]` (Enabled: `True`). {{(pid=81593) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 18:04:07.489577 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-be0d4b95-0f2b-4548-beae-e061b6319b50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:04:07.490394 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.auth.core [None req-37632cce-a5bd-41b1-96fb-92c886d39d80 None None] MFA Rules not processed for user `d899ec4fcbeb4de382c7f0a779ca8ed5`. Rule list: `[]` (Enabled: `True`). {{(pid=81592) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 18:04:07.491592 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-37632cce-a5bd-41b1-96fb-92c886d39d80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:04:07.622669 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 18:04:07.636957 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1235/2481] 10.222.0.25 () {58 vars in 967 bytes} [Thu Sep 15 18:04:07 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 18:04:07.642580 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1247/2482] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 15 18:04:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 18:04:07.652560 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37632cce-a5bd-41b1-96fb-92c886d39d80 None None] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:04:07.654639 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-37632cce-a5bd-41b1-96fb-92c886d39d80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:04:07.658384 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0d4b95-0f2b-4548-beae-e061b6319b50 None None] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:04:07.662708 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-be0d4b95-0f2b-4548-beae-e061b6319b50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:04:07.763171 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0d4b95-0f2b-4548-beae-e061b6319b50 None None] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:04:07.771941 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af818355-4bc2-4089-8a00-6e24bb47f6b9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a32274b4781b40fea9f28da8a9bde5ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1213c0d1b584404ba3998e136f166e89', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:04:07.774250 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af818355-4bc2-4089-8a00-6e24bb47f6b9 service neutron] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:04:07.775584 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af818355-4bc2-4089-8a00-6e24bb47f6b9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:04:07.777665 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af818355-4bc2-4089-8a00-6e24bb47f6b9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:04:07.806152 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af818355-4bc2-4089-8a00-6e24bb47f6b9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:04:07.808611 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af818355-4bc2-4089-8a00-6e24bb47f6b9 service neutron] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:04:07.815985 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37632cce-a5bd-41b1-96fb-92c886d39d80 None None] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:04:07.827177 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0013a1-20c8-4a11-bcaf-8119bf82c51f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '685f7ad4c6fe4c878d542dddd6d81593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1213c0d1b584404ba3998e136f166e89', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:04:07.829036 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1248/2483] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 15 18:04:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 18:04:07.829699 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0013a1-20c8-4a11-bcaf-8119bf82c51f service swift] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:04:07.830173 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0013a1-20c8-4a11-bcaf-8119bf82c51f service swift] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:04:07.830705 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0013a1-20c8-4a11-bcaf-8119bf82c51f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:04:07.845773 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa0013a1-20c8-4a11-bcaf-8119bf82c51f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:04:07.849713 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa0013a1-20c8-4a11-bcaf-8119bf82c51f service swift] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:04:07.860557 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 18:04:07.870465 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1236/2484] 10.222.0.25 () {60 vars in 1384 bytes} [Thu Sep 15 18:04:07 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 218 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 15 18:04:08.631824 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af818355-4bc2-4089-8a00-6e24bb47f6b9 service neutron] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:04:08.635063 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-af818355-4bc2-4089-8a00-6e24bb47f6b9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:04:08.669758 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af818355-4bc2-4089-8a00-6e24bb47f6b9 service neutron] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:04:08.685021 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1671ed9d-97b8-4678-8292-48d381010ff6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:04:08.685861 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1671ed9d-97b8-4678-8292-48d381010ff6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:04:08.686155 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1671ed9d-97b8-4678-8292-48d381010ff6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:04:08.686430 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1671ed9d-97b8-4678-8292-48d381010ff6 admin admin] PATH_INFO: `/v3/projects/85bd288851fb4d069555dd203cc3d1b9` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:04:08.699851 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1671ed9d-97b8-4678-8292-48d381010ff6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=85bd288851fb4d069555dd203cc3d1b9)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:04:08.701895 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1671ed9d-97b8-4678-8292-48d381010ff6 admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:04:08.789107 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-1671ed9d-97b8-4678-8292-48d381010ff6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '85bd288851fb4d069555dd203cc3d1b9', 'request_id': 'req-1671ed9d-97b8-4678-8292-48d381010ff6'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:04:08.802736 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-1671ed9d-97b8-4678-8292-48d381010ff6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '85bd288851fb4d069555dd203cc3d1b9', 'request_id': 'req-1671ed9d-97b8-4678-8292-48d381010ff6'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:04:08.814461 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-1671ed9d-97b8-4678-8292-48d381010ff6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '85bd288851fb4d069555dd203cc3d1b9', 'request_id': 'req-1671ed9d-97b8-4678-8292-48d381010ff6'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:04:08.831374 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-1671ed9d-97b8-4678-8292-48d381010ff6 admin admin] The token cache is being invalidate because project 85bd288851fb4d069555dd203cc3d1b9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81593) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 18:04:08.831779 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-1671ed9d-97b8-4678-8292-48d381010ff6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:04:08.832473 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-1671ed9d-97b8-4678-8292-48d381010ff6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:04:08.834169 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1249/2485] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Sep 15 18:04:08 2022] DELETE /identity/v3/projects/85bd288851fb4d069555dd203cc3d1b9 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 15 18:04:08.839040 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca38a99d-bffd-4501-9194-3671e8051843 None None] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:04:08.840495 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca38a99d-bffd-4501-9194-3671e8051843 None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:04:08.841007 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca38a99d-bffd-4501-9194-3671e8051843 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:04:08.867543 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.auth.core [None req-ca38a99d-bffd-4501-9194-3671e8051843 None None] MFA Rules not processed for user `5cfa58ef86774ab7800bf91930bf6028`. Rule list: `[]` (Enabled: `True`). {{(pid=81592) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 18:04:08.869677 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-ca38a99d-bffd-4501-9194-3671e8051843 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:04:08.981880 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1237/2486] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 15 18:04:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 18:04:08.988098 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2040f126-8932-4597-916c-73088aeafd6f None None] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:04:08.988388 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2040f126-8932-4597-916c-73088aeafd6f None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:04:08.988669 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2040f126-8932-4597-916c-73088aeafd6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:04:09.010955 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.auth.core [None req-2040f126-8932-4597-916c-73088aeafd6f None None] MFA Rules not processed for user `5cfa58ef86774ab7800bf91930bf6028`. Rule list: `[]` (Enabled: `True`). {{(pid=81593) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 18:04:09.012635 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-2040f126-8932-4597-916c-73088aeafd6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:04:09.026593 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1250/2487] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 15 18:04:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 18:04:09.028661 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca38a99d-bffd-4501-9194-3671e8051843 None None] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:04:09.045653 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca38a99d-bffd-4501-9194-3671e8051843 None None] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:04:09.052928 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19544358-0a8e-47df-8ebb-5d018fc6fc39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:04:09.053859 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19544358-0a8e-47df-8ebb-5d018fc6fc39 admin admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:04:09.054397 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19544358-0a8e-47df-8ebb-5d018fc6fc39 admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:04:09.055133 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19544358-0a8e-47df-8ebb-5d018fc6fc39 admin admin] PATH_INFO: `/v3/domains` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:04:09.056032 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19544358-0a8e-47df-8ebb-5d018fc6fc39 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81592) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 18:04:09.057102 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19544358-0a8e-47df-8ebb-5d018fc6fc39 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:04:09.059616 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19544358-0a8e-47df-8ebb-5d018fc6fc39 admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:04:09.076221 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1238/2488] 10.222.0.25 () {58 vars in 1153 bytes} [Thu Sep 15 18:04:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 18:04:09.080625 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2040f126-8932-4597-916c-73088aeafd6f None None] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:04:09.091845 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2040f126-8932-4597-916c-73088aeafd6f None None] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:04:09.110363 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df2ca7b-31ad-45a5-983c-77dcc2b9f26d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:04:09.111109 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df2ca7b-31ad-45a5-983c-77dcc2b9f26d admin admin] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:04:09.111393 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df2ca7b-31ad-45a5-983c-77dcc2b9f26d admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:04:09.111725 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df2ca7b-31ad-45a5-983c-77dcc2b9f26d admin admin] PATH_INFO: `/v3/projects` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:04:09.112382 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df2ca7b-31ad-45a5-983c-77dcc2b9f26d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:04:09.115193 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df2ca7b-31ad-45a5-983c-77dcc2b9f26d admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:04:09.170553 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19544358-0a8e-47df-8ebb-5d018fc6fc39 admin admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:04:09.171666 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1251/2489] 10.222.0.25 () {60 vars in 1153 bytes} [Thu Sep 15 18:04:09 2022] POST /identity/v3/projects => generated 373 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 18:04:09.193620 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19544358-0a8e-47df-8ebb-5d018fc6fc39 admin admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:04:09.282021 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4fbd6d-4961-4b55-9eb6-6b24bb77f54c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:04:09.282676 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4fbd6d-4961-4b55-9eb6-6b24bb77f54c admin admin] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:04:09.283023 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4fbd6d-4961-4b55-9eb6-6b24bb77f54c admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:04:09.283396 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4fbd6d-4961-4b55-9eb6-6b24bb77f54c admin admin] PATH_INFO: `/v3/users` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:04:09.284271 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de4fbd6d-4961-4b55-9eb6-6b24bb77f54c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:04:09.286687 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de4fbd6d-4961-4b55-9eb6-6b24bb77f54c admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:04:09.340665 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1239/2490] 10.222.0.25 () {60 vars in 1144 bytes} [Thu Sep 15 18:04:09 2022] POST /identity/v3/users => generated 287 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 15 18:04:09.342628 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df2ca7b-31ad-45a5-983c-77dcc2b9f26d admin admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:04:09.358260 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df2ca7b-31ad-45a5-983c-77dcc2b9f26d admin admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:04:09.371788 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de8312c-bc13-48af-a2d1-d67090e7bd42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:04:09.372641 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de8312c-bc13-48af-a2d1-d67090e7bd42 admin admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:04:09.373035 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de8312c-bc13-48af-a2d1-d67090e7bd42 admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:04:09.373469 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de8312c-bc13-48af-a2d1-d67090e7bd42 admin admin] PATH_INFO: `/v3/roles` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:04:09.374464 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de8312c-bc13-48af-a2d1-d67090e7bd42 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:04:09.376904 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de8312c-bc13-48af-a2d1-d67090e7bd42 admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:04:09.412252 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1252/2491] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Sep 15 18:04:09 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 18:04:09.417149 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4fbd6d-4961-4b55-9eb6-6b24bb77f54c admin admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:04:09.430882 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4fbd6d-4961-4b55-9eb6-6b24bb77f54c admin admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:04:09.444956 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d2f3c9-f786-4ed9-960b-107cb974cb03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:04:09.445856 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d2f3c9-f786-4ed9-960b-107cb974cb03 admin admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:04:09.446320 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d2f3c9-f786-4ed9-960b-107cb974cb03 admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:04:09.448474 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d2f3c9-f786-4ed9-960b-107cb974cb03 admin admin] PATH_INFO: `/v3/roles` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:04:09.449427 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d2f3c9-f786-4ed9-960b-107cb974cb03 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:04:09.452573 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d2f3c9-f786-4ed9-960b-107cb974cb03 admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:04:09.477347 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1240/2492] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Sep 15 18:04:09 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 18:04:09.482379 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de8312c-bc13-48af-a2d1-d67090e7bd42 admin admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:04:09.515408 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de8312c-bc13-48af-a2d1-d67090e7bd42 admin admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:04:09.521513 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06fa4044-98c7-41de-abd9-6be3fd2a2718 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:04:09.522654 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fa4044-98c7-41de-abd9-6be3fd2a2718 admin admin] REQUEST_METHOD: `PUT` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:04:09.523005 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fa4044-98c7-41de-abd9-6be3fd2a2718 admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:04:09.523467 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fa4044-98c7-41de-abd9-6be3fd2a2718 admin admin] PATH_INFO: `/v3/projects/629aeae088a64c56a27cfc9e9ae7a90b/users/86aa7d2824214d8aba3ce3fe468153cb/roles/343cc8b1bc7243eebabdf08147e8366d` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:04:09.575453 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06fa4044-98c7-41de-abd9-6be3fd2a2718 admin admin] RBAC: Authorizing `identity:create_grant(project_id=629aeae088a64c56a27cfc9e9ae7a90b, user_id=86aa7d2824214d8aba3ce3fe468153cb, role_id=343cc8b1bc7243eebabdf08147e8366d)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:04:09.582736 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06fa4044-98c7-41de-abd9-6be3fd2a2718 admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:04:09.613351 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1253/2493] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Sep 15 18:04:09 2022] PUT /identity/v3/projects/629aeae088a64c56a27cfc9e9ae7a90b/users/86aa7d2824214d8aba3ce3fe468153cb/roles/343cc8b1bc7243eebabdf08147e8366d => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 18:04:09.624377 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ab08f2-0492-450b-b785-be30839b6db6 None None] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:04:09.624720 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ab08f2-0492-450b-b785-be30839b6db6 None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:04:09.624975 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ab08f2-0492-450b-b785-be30839b6db6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:04:09.706212 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.auth.core [None req-43ab08f2-0492-450b-b785-be30839b6db6 None None] MFA Rules not processed for user `86aa7d2824214d8aba3ce3fe468153cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81592) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 18:04:09.707640 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-43ab08f2-0492-450b-b785-be30839b6db6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:04:09.838090 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 18:04:09.870274 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1241/2494] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 15 18:04:09 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 248 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 18:04:09.884234 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06fa4044-98c7-41de-abd9-6be3fd2a2718 admin admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:04:09.886267 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-06fa4044-98c7-41de-abd9-6be3fd2a2718 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:04:09.932658 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 18:04:09.972903 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06fa4044-98c7-41de-abd9-6be3fd2a2718 admin admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:04:09.988449 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e747b8-f222-49c5-950f-01c6b18e0dae service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b232e7a841145ba93c6d8462ccb751a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1213c0d1b584404ba3998e136f166e89', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:04:09.989384 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e747b8-f222-49c5-950f-01c6b18e0dae service cinder] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:04:09.989748 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e747b8-f222-49c5-950f-01c6b18e0dae service cinder] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:04:09.990382 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e747b8-f222-49c5-950f-01c6b18e0dae service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:04:10.001045 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e747b8-f222-49c5-950f-01c6b18e0dae service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:04:10.002568 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e747b8-f222-49c5-950f-01c6b18e0dae service cinder] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:04:10.012650 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1254/2495] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 15 18:04:09 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 18:04:10.042919 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ab08f2-0492-450b-b785-be30839b6db6 None None] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:04:10.136397 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ab08f2-0492-450b-b785-be30839b6db6 None None] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:04:10.142403 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb928b6-7148-4033-b1ae-4d97474ab1bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:04:10.143164 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb928b6-7148-4033-b1ae-4d97474ab1bc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:04:10.143592 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb928b6-7148-4033-b1ae-4d97474ab1bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:04:10.143906 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb928b6-7148-4033-b1ae-4d97474ab1bc admin admin] PATH_INFO: `/v3/users/86aa7d2824214d8aba3ce3fe468153cb` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:04:10.145765 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb928b6-7148-4033-b1ae-4d97474ab1bc admin admin] RBAC: Authorizing `identity:delete_user(user_id=86aa7d2824214d8aba3ce3fe468153cb)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:04:10.149758 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb928b6-7148-4033-b1ae-4d97474ab1bc admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:04:10.220646 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-dcb928b6-7148-4033-b1ae-4d97474ab1bc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '86aa7d2824214d8aba3ce3fe468153cb'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:04:10.230878 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-dcb928b6-7148-4033-b1ae-4d97474ab1bc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '86aa7d2824214d8aba3ce3fe468153cb'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:04:10.231630 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-dcb928b6-7148-4033-b1ae-4d97474ab1bc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '86aa7d2824214d8aba3ce3fe468153cb'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:04:10.232360 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-dcb928b6-7148-4033-b1ae-4d97474ab1bc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '86aa7d2824214d8aba3ce3fe468153cb'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:04:10.240747 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-dcb928b6-7148-4033-b1ae-4d97474ab1bc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '86aa7d2824214d8aba3ce3fe468153cb'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:04:10.260984 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1242/2496] 10.222.0.25 () {58 vars in 1224 bytes} [Thu Sep 15 18:04:10 2022] DELETE /identity/v3/users/86aa7d2824214d8aba3ce3fe468153cb => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 18:04:10.266018 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea9fa9a-d44c-425e-a347-34846c8ffabd None None] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:04:10.266304 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea9fa9a-d44c-425e-a347-34846c8ffabd None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:04:10.266584 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea9fa9a-d44c-425e-a347-34846c8ffabd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:04:10.298537 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.auth.core [None req-5ea9fa9a-d44c-425e-a347-34846c8ffabd None None] MFA Rules not processed for user `5cfa58ef86774ab7800bf91930bf6028`. Rule list: `[]` (Enabled: `True`). {{(pid=81593) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 18:04:10.299743 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-5ea9fa9a-d44c-425e-a347-34846c8ffabd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:04:10.371283 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1255/2497] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 15 18:04:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 18:04:10.382087 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb928b6-7148-4033-b1ae-4d97474ab1bc admin admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:04:10.383941 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-dcb928b6-7148-4033-b1ae-4d97474ab1bc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:04:10.450597 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb928b6-7148-4033-b1ae-4d97474ab1bc admin admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:04:10.454635 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc180f0b-3246-4e37-8af9-a8381109a4f7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a32274b4781b40fea9f28da8a9bde5ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1213c0d1b584404ba3998e136f166e89', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:04:10.455326 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc180f0b-3246-4e37-8af9-a8381109a4f7 service neutron] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:04:10.455641 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc180f0b-3246-4e37-8af9-a8381109a4f7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:04:10.455880 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc180f0b-3246-4e37-8af9-a8381109a4f7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:04:10.466613 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc180f0b-3246-4e37-8af9-a8381109a4f7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:04:10.468084 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc180f0b-3246-4e37-8af9-a8381109a4f7 service neutron] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:04:10.479349 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1243/2498] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 15 18:04:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 15 18:04:10.811773 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea9fa9a-d44c-425e-a347-34846c8ffabd None None] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:04:10.813877 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-5ea9fa9a-d44c-425e-a347-34846c8ffabd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:04:10.831780 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea9fa9a-d44c-425e-a347-34846c8ffabd None None] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:04:10.852070 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff30649-86d4-45b5-b3b2-19aaf6eecbe0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:04:10.852652 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff30649-86d4-45b5-b3b2-19aaf6eecbe0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:04:10.853019 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff30649-86d4-45b5-b3b2-19aaf6eecbe0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:04:10.853349 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff30649-86d4-45b5-b3b2-19aaf6eecbe0 admin admin] PATH_INFO: `/v3/projects/629aeae088a64c56a27cfc9e9ae7a90b` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:04:10.854881 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff30649-86d4-45b5-b3b2-19aaf6eecbe0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=629aeae088a64c56a27cfc9e9ae7a90b)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:04:10.857098 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff30649-86d4-45b5-b3b2-19aaf6eecbe0 admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:04:10.888258 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc180f0b-3246-4e37-8af9-a8381109a4f7 service neutron] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:04:10.890670 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-fc180f0b-3246-4e37-8af9-a8381109a4f7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:04:10.912804 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc180f0b-3246-4e37-8af9-a8381109a4f7 service neutron] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:04:10.929159 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 18:04:10.951265 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-bff30649-86d4-45b5-b3b2-19aaf6eecbe0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '629aeae088a64c56a27cfc9e9ae7a90b', 'request_id': 'req-bff30649-86d4-45b5-b3b2-19aaf6eecbe0'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:04:10.958311 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-bff30649-86d4-45b5-b3b2-19aaf6eecbe0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '629aeae088a64c56a27cfc9e9ae7a90b', 'request_id': 'req-bff30649-86d4-45b5-b3b2-19aaf6eecbe0'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:04:10.966404 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-bff30649-86d4-45b5-b3b2-19aaf6eecbe0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '629aeae088a64c56a27cfc9e9ae7a90b', 'request_id': 'req-bff30649-86d4-45b5-b3b2-19aaf6eecbe0'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:04:10.980163 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-bff30649-86d4-45b5-b3b2-19aaf6eecbe0 admin admin] The token cache is being invalidate because project 629aeae088a64c56a27cfc9e9ae7a90b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81593) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 18:04:10.980547 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-bff30649-86d4-45b5-b3b2-19aaf6eecbe0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:04:10.981453 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-bff30649-86d4-45b5-b3b2-19aaf6eecbe0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:04:10.983312 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1256/2499] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Sep 15 18:04:10 2022] DELETE /identity/v3/projects/629aeae088a64c56a27cfc9e9ae7a90b => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 15 18:04:10.987801 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6c6e47-b652-424d-9b35-2f69a2c5e2f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:04:10.988454 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6c6e47-b652-424d-9b35-2f69a2c5e2f8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:04:10.988729 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6c6e47-b652-424d-9b35-2f69a2c5e2f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:04:10.989000 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6c6e47-b652-424d-9b35-2f69a2c5e2f8 admin admin] PATH_INFO: `/v3/users/e642b00e7c754d6eb0533c5e60e592c0` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:04:10.990328 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6c6e47-b652-424d-9b35-2f69a2c5e2f8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e642b00e7c754d6eb0533c5e60e592c0)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:04:10.992337 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6c6e47-b652-424d-9b35-2f69a2c5e2f8 admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:04:11.069653 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-bf6c6e47-b652-424d-9b35-2f69a2c5e2f8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e642b00e7c754d6eb0533c5e60e592c0'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:04:11.080284 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-bf6c6e47-b652-424d-9b35-2f69a2c5e2f8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e642b00e7c754d6eb0533c5e60e592c0'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:04:11.080995 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-bf6c6e47-b652-424d-9b35-2f69a2c5e2f8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e642b00e7c754d6eb0533c5e60e592c0'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:04:11.081891 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-bf6c6e47-b652-424d-9b35-2f69a2c5e2f8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e642b00e7c754d6eb0533c5e60e592c0'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:04:11.091053 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-bf6c6e47-b652-424d-9b35-2f69a2c5e2f8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e642b00e7c754d6eb0533c5e60e592c0'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:04:11.117362 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1244/2500] 10.222.0.25 () {58 vars in 1224 bytes} [Thu Sep 15 18:04:10 2022] DELETE /identity/v3/users/e642b00e7c754d6eb0533c5e60e592c0 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 15 18:04:11.121874 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c973421-0796-4bd5-a675-b5e8514836f1 None None] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:04:11.122232 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c973421-0796-4bd5-a675-b5e8514836f1 None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:04:11.123637 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c973421-0796-4bd5-a675-b5e8514836f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:04:11.160393 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.auth.core [None req-5c973421-0796-4bd5-a675-b5e8514836f1 None None] MFA Rules not processed for user `5cfa58ef86774ab7800bf91930bf6028`. Rule list: `[]` (Enabled: `True`). {{(pid=81593) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 18:04:11.162037 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-5c973421-0796-4bd5-a675-b5e8514836f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:04:11.239682 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 18:04:11.261535 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1257/2501] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 15 18:04:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 18:04:11.271164 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6c6e47-b652-424d-9b35-2f69a2c5e2f8 admin admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:04:11.272906 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-bf6c6e47-b652-424d-9b35-2f69a2c5e2f8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:04:11.340259 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6c6e47-b652-424d-9b35-2f69a2c5e2f8 admin admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:04:11.350469 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee0873a-5be7-4786-88ca-77e89610e1ac service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a32274b4781b40fea9f28da8a9bde5ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1213c0d1b584404ba3998e136f166e89', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:04:11.351167 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee0873a-5be7-4786-88ca-77e89610e1ac service neutron] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:04:11.351447 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee0873a-5be7-4786-88ca-77e89610e1ac service neutron] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:04:11.351720 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee0873a-5be7-4786-88ca-77e89610e1ac service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:04:11.363292 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee0873a-5be7-4786-88ca-77e89610e1ac service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:04:11.365273 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee0873a-5be7-4786-88ca-77e89610e1ac service neutron] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:04:11.379929 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1245/2502] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 15 18:04:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 18:04:11.555138 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c973421-0796-4bd5-a675-b5e8514836f1 None None] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:04:11.557598 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-5c973421-0796-4bd5-a675-b5e8514836f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:04:11.578353 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c973421-0796-4bd5-a675-b5e8514836f1 None None] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:04:11.584168 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc53230-12c6-4290-b205-819483397195 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:04:11.584866 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc53230-12c6-4290-b205-819483397195 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:04:11.585150 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc53230-12c6-4290-b205-819483397195 admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:04:11.585465 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc53230-12c6-4290-b205-819483397195 admin admin] PATH_INFO: `/v3/projects/71d3d8e06a774f82bb5e56fcd87adc15` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:04:11.586624 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc53230-12c6-4290-b205-819483397195 admin admin] RBAC: Authorizing `identity:delete_project(project_id=71d3d8e06a774f82bb5e56fcd87adc15)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:04:11.589126 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc53230-12c6-4290-b205-819483397195 admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:04:11.639547 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-0bc53230-12c6-4290-b205-819483397195 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '71d3d8e06a774f82bb5e56fcd87adc15', 'request_id': 'req-0bc53230-12c6-4290-b205-819483397195'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:04:11.646609 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-0bc53230-12c6-4290-b205-819483397195 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '71d3d8e06a774f82bb5e56fcd87adc15', 'request_id': 'req-0bc53230-12c6-4290-b205-819483397195'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:04:11.655492 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-0bc53230-12c6-4290-b205-819483397195 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '71d3d8e06a774f82bb5e56fcd87adc15', 'request_id': 'req-0bc53230-12c6-4290-b205-819483397195'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:04:11.667596 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-0bc53230-12c6-4290-b205-819483397195 admin admin] The token cache is being invalidate because project 71d3d8e06a774f82bb5e56fcd87adc15 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81593) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 18:04:11.667924 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-0bc53230-12c6-4290-b205-819483397195 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:04:11.668593 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-0bc53230-12c6-4290-b205-819483397195 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:04:11.670141 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1258/2503] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Sep 15 18:04:11 2022] DELETE /identity/v3/projects/71d3d8e06a774f82bb5e56fcd87adc15 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 18:04:11.675058 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93c1eb0-32a2-4de9-b508-73e40deeb0f4 None None] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:04:11.675389 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93c1eb0-32a2-4de9-b508-73e40deeb0f4 None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:04:11.675629 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93c1eb0-32a2-4de9-b508-73e40deeb0f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:04:11.697331 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.auth.core [None req-e93c1eb0-32a2-4de9-b508-73e40deeb0f4 None None] MFA Rules not processed for user `5cfa58ef86774ab7800bf91930bf6028`. Rule list: `[]` (Enabled: `True`). {{(pid=81592) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 18:04:11.698557 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-e93c1eb0-32a2-4de9-b508-73e40deeb0f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:04:11.736284 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 18:04:11.766975 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1246/2504] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 15 18:04:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 18:04:11.775709 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e13307-c773-4bb1-8bac-955b4a462793 None None] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:04:11.775911 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e13307-c773-4bb1-8bac-955b4a462793 None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:04:11.776190 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e13307-c773-4bb1-8bac-955b4a462793 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:04:11.808767 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.auth.core [None req-82e13307-c773-4bb1-8bac-955b4a462793 None None] MFA Rules not processed for user `5cfa58ef86774ab7800bf91930bf6028`. Rule list: `[]` (Enabled: `True`). {{(pid=81593) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 18:04:11.810138 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-82e13307-c773-4bb1-8bac-955b4a462793 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:04:11.818951 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1259/2505] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 15 18:04:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 18:04:11.825575 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93c1eb0-32a2-4de9-b508-73e40deeb0f4 None None] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:04:11.834556 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93c1eb0-32a2-4de9-b508-73e40deeb0f4 None None] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:04:11.840011 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc70079d-f6a4-472f-9b57-b28be255ccc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:04:11.840619 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc70079d-f6a4-472f-9b57-b28be255ccc7 admin admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:04:11.841053 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc70079d-f6a4-472f-9b57-b28be255ccc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:04:11.841350 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc70079d-f6a4-472f-9b57-b28be255ccc7 admin admin] PATH_INFO: `/v3/domains` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:04:11.842004 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc70079d-f6a4-472f-9b57-b28be255ccc7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81592) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 18:04:11.842301 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc70079d-f6a4-472f-9b57-b28be255ccc7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:04:11.843896 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc70079d-f6a4-472f-9b57-b28be255ccc7 admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:04:11.857838 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1247/2506] 10.222.0.25 () {58 vars in 1153 bytes} [Thu Sep 15 18:04:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 18:04:11.862673 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e13307-c773-4bb1-8bac-955b4a462793 None None] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:04:11.873018 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e13307-c773-4bb1-8bac-955b4a462793 None None] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:04:11.878270 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a92143-dc7f-476a-9fad-b2bdd2174063 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:04:11.878877 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a92143-dc7f-476a-9fad-b2bdd2174063 admin admin] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:04:11.879156 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a92143-dc7f-476a-9fad-b2bdd2174063 admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:04:11.879428 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a92143-dc7f-476a-9fad-b2bdd2174063 admin admin] PATH_INFO: `/v3/projects` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:04:11.880059 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a92143-dc7f-476a-9fad-b2bdd2174063 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:04:11.882064 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a92143-dc7f-476a-9fad-b2bdd2174063 admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:04:11.913550 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1260/2507] 10.222.0.25 () {60 vars in 1153 bytes} [Thu Sep 15 18:04:11 2022] POST /identity/v3/projects => generated 395 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 18:04:11.914972 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc70079d-f6a4-472f-9b57-b28be255ccc7 admin admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:04:11.926087 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc70079d-f6a4-472f-9b57-b28be255ccc7 admin admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:04:11.993237 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f1a2aa-cdb7-49b2-8548-ead5707979a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:04:11.993902 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f1a2aa-cdb7-49b2-8548-ead5707979a9 admin admin] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:04:11.994180 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f1a2aa-cdb7-49b2-8548-ead5707979a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:04:11.994452 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f1a2aa-cdb7-49b2-8548-ead5707979a9 admin admin] PATH_INFO: `/v3/users` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:04:11.995254 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f1a2aa-cdb7-49b2-8548-ead5707979a9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:04:11.997150 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f1a2aa-cdb7-49b2-8548-ead5707979a9 admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:04:12.018460 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1248/2508] 10.222.0.25 () {60 vars in 1144 bytes} [Thu Sep 15 18:04:11 2022] POST /identity/v3/users => generated 298 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 18:04:12.022910 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a92143-dc7f-476a-9fad-b2bdd2174063 admin admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:04:12.035419 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a92143-dc7f-476a-9fad-b2bdd2174063 admin admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:04:12.040085 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c076d8-0c1e-4d34-ab81-e34bf05ff3d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:04:12.040693 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c076d8-0c1e-4d34-ab81-e34bf05ff3d6 admin admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:04:12.040970 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c076d8-0c1e-4d34-ab81-e34bf05ff3d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:04:12.041244 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c076d8-0c1e-4d34-ab81-e34bf05ff3d6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:04:12.041919 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c076d8-0c1e-4d34-ab81-e34bf05ff3d6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:04:12.043527 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c076d8-0c1e-4d34-ab81-e34bf05ff3d6 admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:04:12.053877 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1261/2509] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Sep 15 18:04:12 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 18:04:12.058229 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f1a2aa-cdb7-49b2-8548-ead5707979a9 admin admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:04:12.068172 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f1a2aa-cdb7-49b2-8548-ead5707979a9 admin admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:04:12.073675 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9aabbb2-3ef6-40f4-830d-779e43b00c30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:04:12.074257 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9aabbb2-3ef6-40f4-830d-779e43b00c30 admin admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:04:12.074536 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9aabbb2-3ef6-40f4-830d-779e43b00c30 admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:04:12.074802 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9aabbb2-3ef6-40f4-830d-779e43b00c30 admin admin] PATH_INFO: `/v3/roles` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:04:12.075432 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9aabbb2-3ef6-40f4-830d-779e43b00c30 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:04:12.077015 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9aabbb2-3ef6-40f4-830d-779e43b00c30 admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:04:12.087758 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1249/2510] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Sep 15 18:04:12 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 18:04:12.091635 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c076d8-0c1e-4d34-ab81-e34bf05ff3d6 admin admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:04:12.102475 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c076d8-0c1e-4d34-ab81-e34bf05ff3d6 admin admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:04:12.107755 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12d73c2-08ac-4b43-a4d3-5b56c1e30a21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:04:12.108399 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12d73c2-08ac-4b43-a4d3-5b56c1e30a21 admin admin] REQUEST_METHOD: `PUT` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:04:12.108692 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12d73c2-08ac-4b43-a4d3-5b56c1e30a21 admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:04:12.108962 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12d73c2-08ac-4b43-a4d3-5b56c1e30a21 admin admin] PATH_INFO: `/v3/projects/06d7f7b6263d498e8188bb6e8a1692c4/users/ca27afea82f64b3783b58f4c61c416fe/roles/343cc8b1bc7243eebabdf08147e8366d` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:04:12.124941 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12d73c2-08ac-4b43-a4d3-5b56c1e30a21 admin admin] RBAC: Authorizing `identity:create_grant(project_id=06d7f7b6263d498e8188bb6e8a1692c4, user_id=ca27afea82f64b3783b58f4c61c416fe, role_id=343cc8b1bc7243eebabdf08147e8366d)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:04:12.127737 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12d73c2-08ac-4b43-a4d3-5b56c1e30a21 admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:04:12.141622 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1262/2511] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Sep 15 18:04:12 2022] PUT /identity/v3/projects/06d7f7b6263d498e8188bb6e8a1692c4/users/ca27afea82f64b3783b58f4c61c416fe/roles/343cc8b1bc7243eebabdf08147e8366d => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 15 18:04:12.153460 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51eb3adc-3d92-4896-9301-5970daec228d None None] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:04:12.153750 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51eb3adc-3d92-4896-9301-5970daec228d None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:04:12.154029 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51eb3adc-3d92-4896-9301-5970daec228d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:04:12.182099 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.auth.core [None req-51eb3adc-3d92-4896-9301-5970daec228d None None] MFA Rules not processed for user `ca27afea82f64b3783b58f4c61c416fe`. Rule list: `[]` (Enabled: `True`). {{(pid=81592) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 18:04:12.183236 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-51eb3adc-3d92-4896-9301-5970daec228d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:04:12.261944 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1250/2512] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 15 18:04:12 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 18:04:12.273053 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12d73c2-08ac-4b43-a4d3-5b56c1e30a21 admin admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:04:12.276173 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-c12d73c2-08ac-4b43-a4d3-5b56c1e30a21 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:04:12.344134 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12d73c2-08ac-4b43-a4d3-5b56c1e30a21 admin admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:04:12.348765 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32dd2a5-cbe2-49d1-8b3a-2c00cc79aecb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b232e7a841145ba93c6d8462ccb751a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1213c0d1b584404ba3998e136f166e89', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:04:12.349484 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32dd2a5-cbe2-49d1-8b3a-2c00cc79aecb service cinder] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:04:12.349829 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32dd2a5-cbe2-49d1-8b3a-2c00cc79aecb service cinder] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:04:12.350189 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32dd2a5-cbe2-49d1-8b3a-2c00cc79aecb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:04:12.359569 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f32dd2a5-cbe2-49d1-8b3a-2c00cc79aecb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:04:12.361128 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f32dd2a5-cbe2-49d1-8b3a-2c00cc79aecb service cinder] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:04:12.371537 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1263/2513] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 15 18:04:12 2022] GET /identity/v3/auth/tokens => generated 3272 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 18:04:17.493231 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51eb3adc-3d92-4896-9301-5970daec228d None None] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:04:17.541046 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 18:04:17.570116 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51eb3adc-3d92-4896-9301-5970daec228d None None] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:04:17.581975 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22be70cc-6504-4ab3-a4e5-0991a71506bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:04:17.585087 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22be70cc-6504-4ab3-a4e5-0991a71506bc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:04:17.585087 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22be70cc-6504-4ab3-a4e5-0991a71506bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:04:17.585087 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22be70cc-6504-4ab3-a4e5-0991a71506bc admin admin] PATH_INFO: `/v3/users/ca27afea82f64b3783b58f4c61c416fe` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:04:17.589349 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22be70cc-6504-4ab3-a4e5-0991a71506bc admin admin] RBAC: Authorizing `identity:delete_user(user_id=ca27afea82f64b3783b58f4c61c416fe)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:04:17.599605 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22be70cc-6504-4ab3-a4e5-0991a71506bc admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:04:17.648329 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-22be70cc-6504-4ab3-a4e5-0991a71506bc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ca27afea82f64b3783b58f4c61c416fe'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:04:17.658080 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-22be70cc-6504-4ab3-a4e5-0991a71506bc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ca27afea82f64b3783b58f4c61c416fe'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:04:17.658880 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-22be70cc-6504-4ab3-a4e5-0991a71506bc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ca27afea82f64b3783b58f4c61c416fe'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:04:17.659498 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-22be70cc-6504-4ab3-a4e5-0991a71506bc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ca27afea82f64b3783b58f4c61c416fe'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:04:17.669878 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-22be70cc-6504-4ab3-a4e5-0991a71506bc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ca27afea82f64b3783b58f4c61c416fe'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:04:17.699458 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1251/2514] 10.222.0.25 () {58 vars in 1224 bytes} [Thu Sep 15 18:04:17 2022] DELETE /identity/v3/users/ca27afea82f64b3783b58f4c61c416fe => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 18:04:17.701583 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3712af22-0630-440a-ac04-98b15279be2f None None] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:04:17.702099 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3712af22-0630-440a-ac04-98b15279be2f None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:04:17.702099 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3712af22-0630-440a-ac04-98b15279be2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:04:17.725628 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.auth.core [None req-3712af22-0630-440a-ac04-98b15279be2f None None] MFA Rules not processed for user `5cfa58ef86774ab7800bf91930bf6028`. Rule list: `[]` (Enabled: `True`). {{(pid=81593) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 18:04:17.726895 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-3712af22-0630-440a-ac04-98b15279be2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:04:17.733176 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 18:04:17.802109 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1264/2515] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 15 18:04:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 18:04:17.812639 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22be70cc-6504-4ab3-a4e5-0991a71506bc admin admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:04:17.817619 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-22be70cc-6504-4ab3-a4e5-0991a71506bc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:04:17.888872 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22be70cc-6504-4ab3-a4e5-0991a71506bc admin admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:04:17.893015 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3110454e-beaa-417c-9a2b-18c15f9aff9d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a32274b4781b40fea9f28da8a9bde5ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1213c0d1b584404ba3998e136f166e89', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:04:17.893856 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3110454e-beaa-417c-9a2b-18c15f9aff9d service neutron] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:04:17.894143 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3110454e-beaa-417c-9a2b-18c15f9aff9d service neutron] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:04:17.894483 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3110454e-beaa-417c-9a2b-18c15f9aff9d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:04:17.907481 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3110454e-beaa-417c-9a2b-18c15f9aff9d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:04:17.910179 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3110454e-beaa-417c-9a2b-18c15f9aff9d service neutron] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:04:17.924014 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1252/2516] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 15 18:04:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 18:04:18.381874 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3712af22-0630-440a-ac04-98b15279be2f None None] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:04:18.383357 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-3712af22-0630-440a-ac04-98b15279be2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:04:18.396621 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3712af22-0630-440a-ac04-98b15279be2f None None] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:04:18.402449 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e439de21-ac73-4523-a7d6-a451ceb5a389 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:04:18.403202 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e439de21-ac73-4523-a7d6-a451ceb5a389 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:04:18.403668 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e439de21-ac73-4523-a7d6-a451ceb5a389 admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:04:18.404070 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e439de21-ac73-4523-a7d6-a451ceb5a389 admin admin] PATH_INFO: `/v3/projects/06d7f7b6263d498e8188bb6e8a1692c4` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:04:18.405417 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e439de21-ac73-4523-a7d6-a451ceb5a389 admin admin] RBAC: Authorizing `identity:delete_project(project_id=06d7f7b6263d498e8188bb6e8a1692c4)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:04:18.407633 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e439de21-ac73-4523-a7d6-a451ceb5a389 admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:04:18.474740 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-e439de21-ac73-4523-a7d6-a451ceb5a389 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '06d7f7b6263d498e8188bb6e8a1692c4', 'request_id': 'req-e439de21-ac73-4523-a7d6-a451ceb5a389'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:04:18.482938 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-e439de21-ac73-4523-a7d6-a451ceb5a389 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '06d7f7b6263d498e8188bb6e8a1692c4', 'request_id': 'req-e439de21-ac73-4523-a7d6-a451ceb5a389'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:04:18.492986 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-e439de21-ac73-4523-a7d6-a451ceb5a389 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '06d7f7b6263d498e8188bb6e8a1692c4', 'request_id': 'req-e439de21-ac73-4523-a7d6-a451ceb5a389'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:04:18.506591 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-e439de21-ac73-4523-a7d6-a451ceb5a389 admin admin] The token cache is being invalidate because project 06d7f7b6263d498e8188bb6e8a1692c4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81593) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 18:04:18.507500 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-e439de21-ac73-4523-a7d6-a451ceb5a389 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:04:18.507717 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-e439de21-ac73-4523-a7d6-a451ceb5a389 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:04:18.510094 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1265/2517] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Sep 15 18:04:18 2022] DELETE /identity/v3/projects/06d7f7b6263d498e8188bb6e8a1692c4 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 15 18:04:18.515039 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f679b853-4edc-4e54-9ba0-6ad6b8a7e0ca None None] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:04:18.515827 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f679b853-4edc-4e54-9ba0-6ad6b8a7e0ca None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:04:18.515827 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f679b853-4edc-4e54-9ba0-6ad6b8a7e0ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:04:18.537348 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.auth.core [None req-f679b853-4edc-4e54-9ba0-6ad6b8a7e0ca None None] MFA Rules not processed for user `5cfa58ef86774ab7800bf91930bf6028`. Rule list: `[]` (Enabled: `True`). {{(pid=81592) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 18:04:18.538682 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-f679b853-4edc-4e54-9ba0-6ad6b8a7e0ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:04:18.609930 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 18:04:18.622285 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1253/2518] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 15 18:04:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 18:04:18.630853 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7318dc-ef48-4d85-a92e-d86d401cf2e4 None None] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:04:18.631026 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7318dc-ef48-4d85-a92e-d86d401cf2e4 None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:04:18.631310 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7318dc-ef48-4d85-a92e-d86d401cf2e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:04:18.656037 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.auth.core [None req-8c7318dc-ef48-4d85-a92e-d86d401cf2e4 None None] MFA Rules not processed for user `5cfa58ef86774ab7800bf91930bf6028`. Rule list: `[]` (Enabled: `True`). {{(pid=81593) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 18:04:18.657279 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-8c7318dc-ef48-4d85-a92e-d86d401cf2e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:04:18.665551 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1266/2519] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 15 18:04:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 18:04:18.670076 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f679b853-4edc-4e54-9ba0-6ad6b8a7e0ca None None] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:04:18.683805 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f679b853-4edc-4e54-9ba0-6ad6b8a7e0ca None None] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:04:18.689954 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95aea8dd-9165-4f32-bdf4-afdd246e0917 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:04:18.690506 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95aea8dd-9165-4f32-bdf4-afdd246e0917 admin admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:04:18.690783 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95aea8dd-9165-4f32-bdf4-afdd246e0917 admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:04:18.691052 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95aea8dd-9165-4f32-bdf4-afdd246e0917 admin admin] PATH_INFO: `/v3/domains` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:04:18.691710 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95aea8dd-9165-4f32-bdf4-afdd246e0917 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81592) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 18:04:18.692011 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95aea8dd-9165-4f32-bdf4-afdd246e0917 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:04:18.693684 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95aea8dd-9165-4f32-bdf4-afdd246e0917 admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:04:18.707516 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1254/2520] 10.222.0.25 () {58 vars in 1153 bytes} [Thu Sep 15 18:04:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 18:04:18.712079 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7318dc-ef48-4d85-a92e-d86d401cf2e4 None None] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:04:18.721745 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7318dc-ef48-4d85-a92e-d86d401cf2e4 None None] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:04:18.726881 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ce1d3f-ad9b-4443-8d28-b4d49d87ce99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:04:18.727515 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ce1d3f-ad9b-4443-8d28-b4d49d87ce99 admin admin] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:04:18.728285 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ce1d3f-ad9b-4443-8d28-b4d49d87ce99 admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:04:18.728562 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ce1d3f-ad9b-4443-8d28-b4d49d87ce99 admin admin] PATH_INFO: `/v3/projects` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:04:18.729216 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ce1d3f-ad9b-4443-8d28-b4d49d87ce99 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:04:18.731203 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ce1d3f-ad9b-4443-8d28-b4d49d87ce99 admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:04:18.761531 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1267/2521] 10.222.0.25 () {60 vars in 1153 bytes} [Thu Sep 15 18:04:18 2022] POST /identity/v3/projects => generated 385 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 18:04:18.766159 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95aea8dd-9165-4f32-bdf4-afdd246e0917 admin admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:04:18.783430 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95aea8dd-9165-4f32-bdf4-afdd246e0917 admin admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:04:18.845438 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2d8b2c-7f62-47eb-938a-fda4b14d7474 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:04:18.846226 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2d8b2c-7f62-47eb-938a-fda4b14d7474 admin admin] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:04:18.846613 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2d8b2c-7f62-47eb-938a-fda4b14d7474 admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:04:18.847270 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2d8b2c-7f62-47eb-938a-fda4b14d7474 admin admin] PATH_INFO: `/v3/users` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:04:18.848366 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be2d8b2c-7f62-47eb-938a-fda4b14d7474 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:04:18.850708 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be2d8b2c-7f62-47eb-938a-fda4b14d7474 admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:04:18.875007 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1255/2522] 10.222.0.25 () {60 vars in 1144 bytes} [Thu Sep 15 18:04:18 2022] POST /identity/v3/users => generated 293 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 18:04:18.879888 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ce1d3f-ad9b-4443-8d28-b4d49d87ce99 admin admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:04:18.903492 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ce1d3f-ad9b-4443-8d28-b4d49d87ce99 admin admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:04:18.913731 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fcdb693-81f8-4594-bd11-3a49a8bfeba9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:04:18.914532 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcdb693-81f8-4594-bd11-3a49a8bfeba9 admin admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:04:18.915044 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcdb693-81f8-4594-bd11-3a49a8bfeba9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:04:18.915900 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcdb693-81f8-4594-bd11-3a49a8bfeba9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:04:18.916658 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fcdb693-81f8-4594-bd11-3a49a8bfeba9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:04:18.918411 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fcdb693-81f8-4594-bd11-3a49a8bfeba9 admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:04:18.935937 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1268/2523] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Sep 15 18:04:18 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 15 18:04:18.940297 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2d8b2c-7f62-47eb-938a-fda4b14d7474 admin admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:04:18.953844 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2d8b2c-7f62-47eb-938a-fda4b14d7474 admin admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:04:18.961884 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf5c684-2157-41d5-a359-de5119f2b158 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:04:18.962908 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf5c684-2157-41d5-a359-de5119f2b158 admin admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:04:18.963389 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf5c684-2157-41d5-a359-de5119f2b158 admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:04:18.963882 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf5c684-2157-41d5-a359-de5119f2b158 admin admin] PATH_INFO: `/v3/roles` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:04:18.964938 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf5c684-2157-41d5-a359-de5119f2b158 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:04:18.967648 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf5c684-2157-41d5-a359-de5119f2b158 admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:04:18.982593 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1256/2524] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Sep 15 18:04:18 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 18:04:18.986869 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fcdb693-81f8-4594-bd11-3a49a8bfeba9 admin admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:04:18.997712 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fcdb693-81f8-4594-bd11-3a49a8bfeba9 admin admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:04:19.014800 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada9907a-66db-4667-8f20-50b54215f285 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:04:19.018954 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada9907a-66db-4667-8f20-50b54215f285 admin admin] REQUEST_METHOD: `PUT` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:04:19.019333 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada9907a-66db-4667-8f20-50b54215f285 admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:04:19.019692 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada9907a-66db-4667-8f20-50b54215f285 admin admin] PATH_INFO: `/v3/projects/e9678d09acd84e6d9cfe552488860ff7/users/c5fe602d6d8d4bcb8dbf24612435ba5d/roles/343cc8b1bc7243eebabdf08147e8366d` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:04:19.044198 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada9907a-66db-4667-8f20-50b54215f285 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e9678d09acd84e6d9cfe552488860ff7, user_id=c5fe602d6d8d4bcb8dbf24612435ba5d, role_id=343cc8b1bc7243eebabdf08147e8366d)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:04:19.047058 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada9907a-66db-4667-8f20-50b54215f285 admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:04:19.062870 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1269/2525] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Sep 15 18:04:18 2022] PUT /identity/v3/projects/e9678d09acd84e6d9cfe552488860ff7/users/c5fe602d6d8d4bcb8dbf24612435ba5d/roles/343cc8b1bc7243eebabdf08147e8366d => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 15 18:04:19.068226 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efd7158-6244-4ef9-839a-4352f4b0abbe None None] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:04:19.068512 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efd7158-6244-4ef9-839a-4352f4b0abbe None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:04:19.068784 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efd7158-6244-4ef9-839a-4352f4b0abbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:04:19.097672 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.auth.core [None req-7efd7158-6244-4ef9-839a-4352f4b0abbe None None] MFA Rules not processed for user `5cfa58ef86774ab7800bf91930bf6028`. Rule list: `[]` (Enabled: `True`). {{(pid=81592) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 18:04:19.098901 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-7efd7158-6244-4ef9-839a-4352f4b0abbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:04:19.159353 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1257/2526] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 15 18:04:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 18:04:19.169967 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada9907a-66db-4667-8f20-50b54215f285 admin admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:04:19.172904 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-ada9907a-66db-4667-8f20-50b54215f285 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:04:19.207924 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 18:04:19.245037 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada9907a-66db-4667-8f20-50b54215f285 admin admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:04:19.254487 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8541c5-50bf-4ba4-8c08-044ba0979e81 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a32274b4781b40fea9f28da8a9bde5ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1213c0d1b584404ba3998e136f166e89', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:04:19.255109 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8541c5-50bf-4ba4-8c08-044ba0979e81 service neutron] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:04:19.255388 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8541c5-50bf-4ba4-8c08-044ba0979e81 service neutron] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:04:19.255660 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8541c5-50bf-4ba4-8c08-044ba0979e81 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:04:19.265542 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd8541c5-50bf-4ba4-8c08-044ba0979e81 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:04:19.266987 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd8541c5-50bf-4ba4-8c08-044ba0979e81 service neutron] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:04:19.277501 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1270/2527] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 15 18:04:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 18:04:23.606500 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c214f3c-26d2-4803-95af-f8844d707ca1 None None] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:04:23.607040 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c214f3c-26d2-4803-95af-f8844d707ca1 None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:04:23.607040 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c214f3c-26d2-4803-95af-f8844d707ca1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:04:23.645260 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.auth.core [None req-0c214f3c-26d2-4803-95af-f8844d707ca1 None None] MFA Rules not processed for user `c5fe602d6d8d4bcb8dbf24612435ba5d`. Rule list: `[]` (Enabled: `True`). {{(pid=81592) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 18:04:23.646837 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-0c214f3c-26d2-4803-95af-f8844d707ca1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:04:23.717531 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 18:04:23.731921 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1258/2528] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 15 18:04:23 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 18:04:23.736534 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8541c5-50bf-4ba4-8c08-044ba0979e81 service neutron] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:04:23.751762 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8541c5-50bf-4ba4-8c08-044ba0979e81 service neutron] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:04:23.779311 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8731150f-e1bf-4ddf-b6c8-43b14fd3e38d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:04:23.779861 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8731150f-e1bf-4ddf-b6c8-43b14fd3e38d admin admin] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:04:23.780149 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8731150f-e1bf-4ddf-b6c8-43b14fd3e38d admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:04:23.780428 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8731150f-e1bf-4ddf-b6c8-43b14fd3e38d admin admin] PATH_INFO: `/v3/projects` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:04:23.781077 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8731150f-e1bf-4ddf-b6c8-43b14fd3e38d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:04:23.783045 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8731150f-e1bf-4ddf-b6c8-43b14fd3e38d admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:04:23.817727 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1271/2529] 10.222.0.25 () {60 vars in 1153 bytes} [Thu Sep 15 18:04:23 2022] POST /identity/v3/projects => generated 383 bytes in 82 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 18:04:23.821824 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c214f3c-26d2-4803-95af-f8844d707ca1 None None] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:04:23.833031 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c214f3c-26d2-4803-95af-f8844d707ca1 None None] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:04:23.901693 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592b4e10-476d-495c-b6fd-00f63b07924d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:04:23.902320 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592b4e10-476d-495c-b6fd-00f63b07924d admin admin] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:04:23.902602 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592b4e10-476d-495c-b6fd-00f63b07924d admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:04:23.902877 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592b4e10-476d-495c-b6fd-00f63b07924d admin admin] PATH_INFO: `/v3/users` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:04:23.903534 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592b4e10-476d-495c-b6fd-00f63b07924d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:04:23.905495 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592b4e10-476d-495c-b6fd-00f63b07924d admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:04:23.937664 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1259/2530] 10.222.0.25 () {60 vars in 1144 bytes} [Thu Sep 15 18:04:23 2022] POST /identity/v3/users => generated 298 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 18:04:23.941662 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8731150f-e1bf-4ddf-b6c8-43b14fd3e38d admin admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:04:23.954762 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8731150f-e1bf-4ddf-b6c8-43b14fd3e38d admin admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:04:23.959639 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a90fce7-3f1c-4b0b-a481-293f19c9c881 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:04:23.960305 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a90fce7-3f1c-4b0b-a481-293f19c9c881 admin admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:04:23.960574 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a90fce7-3f1c-4b0b-a481-293f19c9c881 admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:04:23.960882 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a90fce7-3f1c-4b0b-a481-293f19c9c881 admin admin] PATH_INFO: `/v3/roles` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:04:23.961587 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a90fce7-3f1c-4b0b-a481-293f19c9c881 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:04:23.963872 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a90fce7-3f1c-4b0b-a481-293f19c9c881 admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:04:23.975580 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1272/2531] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Sep 15 18:04:23 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 18:04:23.980343 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592b4e10-476d-495c-b6fd-00f63b07924d admin admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:04:23.991852 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592b4e10-476d-495c-b6fd-00f63b07924d admin admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:04:23.997066 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22e32d2-d686-4028-a69f-1cfa9fc6ff0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:04:23.997824 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22e32d2-d686-4028-a69f-1cfa9fc6ff0f admin admin] REQUEST_METHOD: `PUT` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:04:23.998106 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22e32d2-d686-4028-a69f-1cfa9fc6ff0f admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:04:23.998385 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22e32d2-d686-4028-a69f-1cfa9fc6ff0f admin admin] PATH_INFO: `/v3/projects/72373775279d4e33872f59119a0c50be/users/b9a100b22ed34c1bb118b3b873d07561/roles/a9e42be86923434f8af52d3fc07fb4f7` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:04:24.015095 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22e32d2-d686-4028-a69f-1cfa9fc6ff0f admin admin] RBAC: Authorizing `identity:create_grant(project_id=72373775279d4e33872f59119a0c50be, user_id=b9a100b22ed34c1bb118b3b873d07561, role_id=a9e42be86923434f8af52d3fc07fb4f7)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:04:24.017892 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22e32d2-d686-4028-a69f-1cfa9fc6ff0f admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:04:24.033186 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1260/2532] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Sep 15 18:04:23 2022] PUT /identity/v3/projects/72373775279d4e33872f59119a0c50be/users/b9a100b22ed34c1bb118b3b873d07561/roles/a9e42be86923434f8af52d3fc07fb4f7 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 18:04:24.037210 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a90fce7-3f1c-4b0b-a481-293f19c9c881 admin admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:04:24.049231 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a90fce7-3f1c-4b0b-a481-293f19c9c881 admin admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:04:24.113961 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b44e6c-7b9e-4e0f-886c-a96159ea8eee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:04:24.114962 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b44e6c-7b9e-4e0f-886c-a96159ea8eee admin admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:04:24.115681 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b44e6c-7b9e-4e0f-886c-a96159ea8eee admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:04:24.116193 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b44e6c-7b9e-4e0f-886c-a96159ea8eee admin admin] PATH_INFO: `/v3/roles` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:04:24.117114 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b44e6c-7b9e-4e0f-886c-a96159ea8eee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:04:24.119628 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b44e6c-7b9e-4e0f-886c-a96159ea8eee admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:04:24.140685 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1273/2533] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Sep 15 18:04:24 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 18:04:24.142201 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22e32d2-d686-4028-a69f-1cfa9fc6ff0f admin admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:04:24.153027 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22e32d2-d686-4028-a69f-1cfa9fc6ff0f admin admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:04:24.158081 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d63279-7c84-438b-8951-9239509c592a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:04:24.158777 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d63279-7c84-438b-8951-9239509c592a admin admin] REQUEST_METHOD: `PUT` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:04:24.159055 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d63279-7c84-438b-8951-9239509c592a admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:04:24.159588 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d63279-7c84-438b-8951-9239509c592a admin admin] PATH_INFO: `/v3/projects/72373775279d4e33872f59119a0c50be/users/b9a100b22ed34c1bb118b3b873d07561/roles/a9e42be86923434f8af52d3fc07fb4f7` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:04:24.161319 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d63279-7c84-438b-8951-9239509c592a admin admin] RBAC: Authorizing `identity:create_grant(project_id=72373775279d4e33872f59119a0c50be, user_id=b9a100b22ed34c1bb118b3b873d07561, role_id=a9e42be86923434f8af52d3fc07fb4f7)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:04:24.164164 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d63279-7c84-438b-8951-9239509c592a admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:04:24.176792 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1261/2534] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Sep 15 18:04:24 2022] PUT /identity/v3/projects/72373775279d4e33872f59119a0c50be/users/b9a100b22ed34c1bb118b3b873d07561/roles/a9e42be86923434f8af52d3fc07fb4f7 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 18:04:29.178929 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047ae3d0-2d21-4ea0-9563-beff0c3edb44 None None] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:04:29.179366 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047ae3d0-2d21-4ea0-9563-beff0c3edb44 None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:04:29.179366 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047ae3d0-2d21-4ea0-9563-beff0c3edb44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:04:29.224135 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.auth.core [None req-047ae3d0-2d21-4ea0-9563-beff0c3edb44 None None] MFA Rules not processed for user `b9a100b22ed34c1bb118b3b873d07561`. Rule list: `[]` (Enabled: `True`). {{(pid=81593) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 18:04:29.226099 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-047ae3d0-2d21-4ea0-9563-beff0c3edb44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:04:29.322227 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1274/2535] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 15 18:04:29 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 18:04:29.341037 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d63279-7c84-438b-8951-9239509c592a admin admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:04:29.351092 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-23d63279-7c84-438b-8951-9239509c592a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:04:29.442381 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d63279-7c84-438b-8951-9239509c592a admin admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:04:29.446567 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0ce966-b2e9-4e7f-afa1-8192ec309eb9 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c194f79928aa4a4d94619c417b4e39e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1213c0d1b584404ba3998e136f166e89', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:04:29.447205 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0ce966-b2e9-4e7f-afa1-8192ec309eb9 service glance] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:04:29.447488 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0ce966-b2e9-4e7f-afa1-8192ec309eb9 service glance] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:04:29.447764 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0ce966-b2e9-4e7f-afa1-8192ec309eb9 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:04:29.546443 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d0ce966-b2e9-4e7f-afa1-8192ec309eb9 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:04:29.551172 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d0ce966-b2e9-4e7f-afa1-8192ec309eb9 service glance] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:04:29.558662 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 18:04:29.573606 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1262/2536] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 15 18:04:29 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 233 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 18:04:29.745451 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693f13d5-95ed-40de-a240-0cb2d78fbe76 None None] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:04:29.745919 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693f13d5-95ed-40de-a240-0cb2d78fbe76 None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:04:29.746400 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693f13d5-95ed-40de-a240-0cb2d78fbe76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:04:29.772186 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.auth.core [None req-693f13d5-95ed-40de-a240-0cb2d78fbe76 None None] MFA Rules not processed for user `d899ec4fcbeb4de382c7f0a779ca8ed5`. Rule list: `[]` (Enabled: `True`). {{(pid=81593) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 18:04:29.773527 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-693f13d5-95ed-40de-a240-0cb2d78fbe76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:04:29.793965 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 18:04:29.847668 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1275/2537] 10.222.0.25 () {58 vars in 1009 bytes} [Thu Sep 15 18:04:29 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 18:04:29.860546 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0ce966-b2e9-4e7f-afa1-8192ec309eb9 service glance] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:04:29.862475 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-8d0ce966-b2e9-4e7f-afa1-8192ec309eb9 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:04:29.962289 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0ce966-b2e9-4e7f-afa1-8192ec309eb9 service glance] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:04:29.967645 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60cef37-6456-49fe-9050-e54428fe3b10 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '685f7ad4c6fe4c878d542dddd6d81593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1213c0d1b584404ba3998e136f166e89', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:04:29.968276 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60cef37-6456-49fe-9050-e54428fe3b10 service swift] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:04:29.968560 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60cef37-6456-49fe-9050-e54428fe3b10 service swift] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:04:29.968838 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60cef37-6456-49fe-9050-e54428fe3b10 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:04:29.993920 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e60cef37-6456-49fe-9050-e54428fe3b10 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:04:29.997120 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e60cef37-6456-49fe-9050-e54428fe3b10 service swift] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:04:30.017585 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1263/2538] 10.222.0.25 () {60 vars in 1384 bytes} [Thu Sep 15 18:04:29 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 15 18:04:39.120753 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693f13d5-95ed-40de-a240-0cb2d78fbe76 None None] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:04:39.123044 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-693f13d5-95ed-40de-a240-0cb2d78fbe76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:04:39.215631 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693f13d5-95ed-40de-a240-0cb2d78fbe76 None None] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:04:39.220280 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8249a67d-1d3d-41a1-ae39-d5910178ee05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:04:39.220982 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8249a67d-1d3d-41a1-ae39-d5910178ee05 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:04:39.221262 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8249a67d-1d3d-41a1-ae39-d5910178ee05 admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:04:39.221820 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8249a67d-1d3d-41a1-ae39-d5910178ee05 admin admin] PATH_INFO: `/v3/users/fbdd61a9bfa64796a650f4e1e1c74ec1` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:04:39.223024 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8249a67d-1d3d-41a1-ae39-d5910178ee05 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fbdd61a9bfa64796a650f4e1e1c74ec1)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:04:39.224984 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8249a67d-1d3d-41a1-ae39-d5910178ee05 admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:04:39.284708 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-8249a67d-1d3d-41a1-ae39-d5910178ee05 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fbdd61a9bfa64796a650f4e1e1c74ec1'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:04:39.302881 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-8249a67d-1d3d-41a1-ae39-d5910178ee05 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fbdd61a9bfa64796a650f4e1e1c74ec1'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:04:39.303514 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-8249a67d-1d3d-41a1-ae39-d5910178ee05 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fbdd61a9bfa64796a650f4e1e1c74ec1'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:04:39.304128 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-8249a67d-1d3d-41a1-ae39-d5910178ee05 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fbdd61a9bfa64796a650f4e1e1c74ec1'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:04:39.314844 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-8249a67d-1d3d-41a1-ae39-d5910178ee05 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fbdd61a9bfa64796a650f4e1e1c74ec1'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:04:39.339449 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1276/2539] 10.222.0.25 () {58 vars in 1224 bytes} [Thu Sep 15 18:04:39 2022] DELETE /identity/v3/users/fbdd61a9bfa64796a650f4e1e1c74ec1 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 18:04:39.345953 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96474b0-d4cf-4637-9faf-d9136fb68efa None None] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:04:39.346924 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96474b0-d4cf-4637-9faf-d9136fb68efa None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:04:39.346924 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96474b0-d4cf-4637-9faf-d9136fb68efa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:04:39.366616 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.auth.core [None req-b96474b0-d4cf-4637-9faf-d9136fb68efa None None] MFA Rules not processed for user `5cfa58ef86774ab7800bf91930bf6028`. Rule list: `[]` (Enabled: `True`). {{(pid=81592) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 18:04:39.368396 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-b96474b0-d4cf-4637-9faf-d9136fb68efa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:04:39.449472 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1264/2540] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 15 18:04:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 18:04:39.455749 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8249a67d-1d3d-41a1-ae39-d5910178ee05 admin admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:04:39.457306 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-8249a67d-1d3d-41a1-ae39-d5910178ee05 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:04:39.535298 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 18:04:39.545340 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8249a67d-1d3d-41a1-ae39-d5910178ee05 admin admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:04:39.559575 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25eddb98-9724-4bd8-adfe-00ef8fbb27ee service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a32274b4781b40fea9f28da8a9bde5ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1213c0d1b584404ba3998e136f166e89', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:04:39.560681 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25eddb98-9724-4bd8-adfe-00ef8fbb27ee service neutron] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:04:39.562063 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25eddb98-9724-4bd8-adfe-00ef8fbb27ee service neutron] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:04:39.562369 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25eddb98-9724-4bd8-adfe-00ef8fbb27ee service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:04:39.578892 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25eddb98-9724-4bd8-adfe-00ef8fbb27ee service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:04:39.580360 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25eddb98-9724-4bd8-adfe-00ef8fbb27ee service neutron] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:04:39.591127 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1277/2541] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 15 18:04:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 18:04:39.952027 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96474b0-d4cf-4637-9faf-d9136fb68efa None None] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:04:39.953601 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-b96474b0-d4cf-4637-9faf-d9136fb68efa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:04:39.979439 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96474b0-d4cf-4637-9faf-d9136fb68efa None None] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:04:39.986255 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7007f20-5c07-44a5-94e5-461a509fb9bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:04:39.987228 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7007f20-5c07-44a5-94e5-461a509fb9bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:04:39.987852 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7007f20-5c07-44a5-94e5-461a509fb9bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:04:39.988389 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7007f20-5c07-44a5-94e5-461a509fb9bd admin admin] PATH_INFO: `/v3/projects/15ea67be7bbc4d6d860485d51a10f63c` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:04:39.989885 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7007f20-5c07-44a5-94e5-461a509fb9bd admin admin] RBAC: Authorizing `identity:delete_project(project_id=15ea67be7bbc4d6d860485d51a10f63c)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:04:39.992277 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7007f20-5c07-44a5-94e5-461a509fb9bd admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:04:40.099463 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-d7007f20-5c07-44a5-94e5-461a509fb9bd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '15ea67be7bbc4d6d860485d51a10f63c', 'request_id': 'req-d7007f20-5c07-44a5-94e5-461a509fb9bd'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:04:40.120490 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-d7007f20-5c07-44a5-94e5-461a509fb9bd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '15ea67be7bbc4d6d860485d51a10f63c', 'request_id': 'req-d7007f20-5c07-44a5-94e5-461a509fb9bd'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:04:40.133645 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-d7007f20-5c07-44a5-94e5-461a509fb9bd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '15ea67be7bbc4d6d860485d51a10f63c', 'request_id': 'req-d7007f20-5c07-44a5-94e5-461a509fb9bd'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:04:40.146014 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-d7007f20-5c07-44a5-94e5-461a509fb9bd admin admin] The token cache is being invalidate because project 15ea67be7bbc4d6d860485d51a10f63c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81592) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 18:04:40.146319 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-d7007f20-5c07-44a5-94e5-461a509fb9bd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:04:40.147077 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-d7007f20-5c07-44a5-94e5-461a509fb9bd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:04:40.157559 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1265/2542] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Sep 15 18:04:39 2022] DELETE /identity/v3/projects/15ea67be7bbc4d6d860485d51a10f63c => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 18:04:41.053757 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1547865-8822-4a50-bd32-3b3a0800bc24 None None] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:04:41.054398 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1547865-8822-4a50-bd32-3b3a0800bc24 None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:04:41.054497 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1547865-8822-4a50-bd32-3b3a0800bc24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:04:41.075863 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.auth.core [None req-d1547865-8822-4a50-bd32-3b3a0800bc24 None None] MFA Rules not processed for user `c5fe602d6d8d4bcb8dbf24612435ba5d`. Rule list: `[]` (Enabled: `True`). {{(pid=81593) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 18:04:41.077068 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-d1547865-8822-4a50-bd32-3b3a0800bc24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:04:41.142522 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1278/2543] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 15 18:04:41 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 18:04:43.066679 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7007f20-5c07-44a5-94e5-461a509fb9bd admin admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:04:43.068221 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-d7007f20-5c07-44a5-94e5-461a509fb9bd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:04:43.082532 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 18:04:43.257700 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7007f20-5c07-44a5-94e5-461a509fb9bd admin admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:04:43.261261 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebd5383-adc9-4031-bd9c-ef912f210d56 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a32274b4781b40fea9f28da8a9bde5ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1213c0d1b584404ba3998e136f166e89', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:04:43.261973 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebd5383-adc9-4031-bd9c-ef912f210d56 service neutron] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:04:43.262255 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebd5383-adc9-4031-bd9c-ef912f210d56 service neutron] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:04:43.262532 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebd5383-adc9-4031-bd9c-ef912f210d56 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:04:43.264349 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-2ebd5383-adc9-4031-bd9c-ef912f210d56 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:04:43.362548 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ebd5383-adc9-4031-bd9c-ef912f210d56 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:04:43.364038 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ebd5383-adc9-4031-bd9c-ef912f210d56 service neutron] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:04:43.375340 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1266/2544] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 15 18:04:43 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 18:04:43.631587 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90dfe958-9f19-41e3-9d7a-23af6f292085 None None] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:04:43.632155 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90dfe958-9f19-41e3-9d7a-23af6f292085 None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:04:43.632347 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90dfe958-9f19-41e3-9d7a-23af6f292085 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:04:43.661179 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.auth.core [None req-90dfe958-9f19-41e3-9d7a-23af6f292085 None None] MFA Rules not processed for user `d899ec4fcbeb4de382c7f0a779ca8ed5`. Rule list: `[]` (Enabled: `True`). {{(pid=81593) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 18:04:43.663144 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-90dfe958-9f19-41e3-9d7a-23af6f292085 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:04:43.732633 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1279/2545] 10.222.0.25 () {58 vars in 1009 bytes} [Thu Sep 15 18:04:43 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 18:04:43.748281 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebd5383-adc9-4031-bd9c-ef912f210d56 service neutron] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:04:43.750585 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-2ebd5383-adc9-4031-bd9c-ef912f210d56 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:04:43.832460 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebd5383-adc9-4031-bd9c-ef912f210d56 service neutron] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:04:43.838774 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb95a8a-b088-439d-a811-43bb5cf92c64 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '685f7ad4c6fe4c878d542dddd6d81593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1213c0d1b584404ba3998e136f166e89', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:04:43.839548 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb95a8a-b088-439d-a811-43bb5cf92c64 service swift] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:04:43.839689 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb95a8a-b088-439d-a811-43bb5cf92c64 service swift] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:04:43.840115 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb95a8a-b088-439d-a811-43bb5cf92c64 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:04:43.853197 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb95a8a-b088-439d-a811-43bb5cf92c64 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:04:43.855748 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb95a8a-b088-439d-a811-43bb5cf92c64 service swift] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:04:43.865862 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1267/2546] 10.222.0.25 () {60 vars in 1384 bytes} [Thu Sep 15 18:04:43 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 15 18:04:53.724728 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=55 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 18:04:53.861723 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=76 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 18:05:08.617738 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90dfe958-9f19-41e3-9d7a-23af6f292085 None None] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:05:08.619173 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-90dfe958-9f19-41e3-9d7a-23af6f292085 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:05:08.630425 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90dfe958-9f19-41e3-9d7a-23af6f292085 None None] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:05:08.634058 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbcd615-299f-4fe7-89b7-481a97398224 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a32274b4781b40fea9f28da8a9bde5ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1213c0d1b584404ba3998e136f166e89', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:05:08.634657 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbcd615-299f-4fe7-89b7-481a97398224 service neutron] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:05:08.634934 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbcd615-299f-4fe7-89b7-481a97398224 service neutron] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:05:08.635203 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbcd615-299f-4fe7-89b7-481a97398224 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:05:08.636850 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-1bbcd615-299f-4fe7-89b7-481a97398224 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:05:08.697800 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bbcd615-299f-4fe7-89b7-481a97398224 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:05:08.699240 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bbcd615-299f-4fe7-89b7-481a97398224 service neutron] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:05:08.708555 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1280/2547] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 15 18:05:08 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 18:05:18.704539 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=30 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 18:05:28.916849 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f617d2d8-4db7-46c9-9e5f-77cffa2e6bee None None] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:05:28.917423 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f617d2d8-4db7-46c9-9e5f-77cffa2e6bee None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:05:28.917423 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f617d2d8-4db7-46c9-9e5f-77cffa2e6bee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:05:28.937475 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.auth.core [None req-f617d2d8-4db7-46c9-9e5f-77cffa2e6bee None None] MFA Rules not processed for user `db4da97ae9284046b5d1667bee32f821`. Rule list: `[]` (Enabled: `True`). {{(pid=81592) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 18:05:28.938669 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-f617d2d8-4db7-46c9-9e5f-77cffa2e6bee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:05:28.991693 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1268/2548] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 15 18:05:28 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 18:05:38.985314 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=25 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 18:05:50.564097 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbcd615-299f-4fe7-89b7-481a97398224 service neutron] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:05:50.566658 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-1bbcd615-299f-4fe7-89b7-481a97398224 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:05:50.658422 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbcd615-299f-4fe7-89b7-481a97398224 service neutron] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:05:50.664386 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d5b6a9-d4e6-46ce-bf55-35c571d2a494 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10af119bd39841ed8163993676230fca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1213c0d1b584404ba3998e136f166e89', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:05:50.665010 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d5b6a9-d4e6-46ce-bf55-35c571d2a494 service placement] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:05:50.665331 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d5b6a9-d4e6-46ce-bf55-35c571d2a494 service placement] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:05:50.665629 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d5b6a9-d4e6-46ce-bf55-35c571d2a494 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:05:50.667458 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-c6d5b6a9-d4e6-46ce-bf55-35c571d2a494 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:05:50.680006 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d5b6a9-d4e6-46ce-bf55-35c571d2a494 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:05:50.681980 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d5b6a9-d4e6-46ce-bf55-35c571d2a494 service placement] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:05:50.693473 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1281/2549] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 15 18:05:50 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 18:05:55.462877 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8a8fb8-7e24-4a10-9ceb-fb97792c0ed7 None None] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:05:55.463427 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8a8fb8-7e24-4a10-9ceb-fb97792c0ed7 None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:05:55.463427 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8a8fb8-7e24-4a10-9ceb-fb97792c0ed7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:05:55.482691 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.auth.core [None req-3a8a8fb8-7e24-4a10-9ceb-fb97792c0ed7 None None] MFA Rules not processed for user `49761e1a87dc495eae27fe1b8f509ae7`. Rule list: `[]` (Enabled: `True`). {{(pid=81592) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 18:05:55.483881 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-3a8a8fb8-7e24-4a10-9ceb-fb97792c0ed7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:05:55.546511 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1269/2550] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 15 18:05:55 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 18:06:00.688402 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=32 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 18:06:05.539895 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=25 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 18:06:36.476036 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d5b6a9-d4e6-46ce-bf55-35c571d2a494 service placement] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:06:36.477511 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-c6d5b6a9-d4e6-46ce-bf55-35c571d2a494 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:06:36.543508 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d5b6a9-d4e6-46ce-bf55-35c571d2a494 service placement] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:06:36.548062 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af50434-3a19-4fe5-8fa3-987341dcfe3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:06:36.548688 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af50434-3a19-4fe5-8fa3-987341dcfe3c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:06:36.548966 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af50434-3a19-4fe5-8fa3-987341dcfe3c admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:06:36.549240 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af50434-3a19-4fe5-8fa3-987341dcfe3c admin admin] PATH_INFO: `/v3/users/db4da97ae9284046b5d1667bee32f821` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:06:36.550382 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af50434-3a19-4fe5-8fa3-987341dcfe3c admin admin] RBAC: Authorizing `identity:delete_user(user_id=db4da97ae9284046b5d1667bee32f821)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:06:36.552407 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af50434-3a19-4fe5-8fa3-987341dcfe3c admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:06:36.598875 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-0af50434-3a19-4fe5-8fa3-987341dcfe3c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'db4da97ae9284046b5d1667bee32f821'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:06:36.606033 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-0af50434-3a19-4fe5-8fa3-987341dcfe3c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'db4da97ae9284046b5d1667bee32f821'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:06:36.606656 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-0af50434-3a19-4fe5-8fa3-987341dcfe3c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'db4da97ae9284046b5d1667bee32f821'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:06:36.607326 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-0af50434-3a19-4fe5-8fa3-987341dcfe3c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'db4da97ae9284046b5d1667bee32f821'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:06:36.614335 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-0af50434-3a19-4fe5-8fa3-987341dcfe3c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'db4da97ae9284046b5d1667bee32f821'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:06:36.635117 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1282/2551] 10.222.0.25 () {58 vars in 1224 bytes} [Thu Sep 15 18:06:36 2022] DELETE /identity/v3/users/db4da97ae9284046b5d1667bee32f821 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 18:06:36.803222 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8a8fb8-7e24-4a10-9ceb-fb97792c0ed7 None None] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:06:36.817370 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8a8fb8-7e24-4a10-9ceb-fb97792c0ed7 None None] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:06:36.880870 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f1c904-c9e1-465e-ab3d-15dc58c85d97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:06:36.881540 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f1c904-c9e1-465e-ab3d-15dc58c85d97 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:06:36.881819 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f1c904-c9e1-465e-ab3d-15dc58c85d97 admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:06:36.882117 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f1c904-c9e1-465e-ab3d-15dc58c85d97 admin admin] PATH_INFO: `/v3/projects/646252485a394aff93dd855c977cc609` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:06:36.883272 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f1c904-c9e1-465e-ab3d-15dc58c85d97 admin admin] RBAC: Authorizing `identity:delete_project(project_id=646252485a394aff93dd855c977cc609)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:06:36.885158 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f1c904-c9e1-465e-ab3d-15dc58c85d97 admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:06:36.932622 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-63f1c904-c9e1-465e-ab3d-15dc58c85d97 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '646252485a394aff93dd855c977cc609', 'request_id': 'req-63f1c904-c9e1-465e-ab3d-15dc58c85d97'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:06:36.938976 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-63f1c904-c9e1-465e-ab3d-15dc58c85d97 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '646252485a394aff93dd855c977cc609', 'request_id': 'req-63f1c904-c9e1-465e-ab3d-15dc58c85d97'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:06:36.951827 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-63f1c904-c9e1-465e-ab3d-15dc58c85d97 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '646252485a394aff93dd855c977cc609', 'request_id': 'req-63f1c904-c9e1-465e-ab3d-15dc58c85d97'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:06:36.963239 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-63f1c904-c9e1-465e-ab3d-15dc58c85d97 admin admin] The token cache is being invalidate because project 646252485a394aff93dd855c977cc609 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81592) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 18:06:36.963531 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-63f1c904-c9e1-465e-ab3d-15dc58c85d97 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:06:36.964172 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-63f1c904-c9e1-465e-ab3d-15dc58c85d97 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:06:36.965666 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1270/2552] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Sep 15 18:06:36 2022] DELETE /identity/v3/projects/646252485a394aff93dd855c977cc609 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 18:06:36.970893 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc06f37e-4133-49aa-a0be-c24be24867c7 None None] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:06:36.971226 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc06f37e-4133-49aa-a0be-c24be24867c7 None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:06:36.971505 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc06f37e-4133-49aa-a0be-c24be24867c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:06:36.994484 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.auth.core [None req-dc06f37e-4133-49aa-a0be-c24be24867c7 None None] MFA Rules not processed for user `5cfa58ef86774ab7800bf91930bf6028`. Rule list: `[]` (Enabled: `True`). {{(pid=81593) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 18:06:36.995711 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-dc06f37e-4133-49aa-a0be-c24be24867c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:06:37.055186 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1283/2553] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 15 18:06:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 18:06:37.062934 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f26561b-6fb5-4f85-bfda-4d3c8055868f None None] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:06:37.063266 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f26561b-6fb5-4f85-bfda-4d3c8055868f None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:06:37.064059 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f26561b-6fb5-4f85-bfda-4d3c8055868f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:06:37.084157 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.auth.core [None req-5f26561b-6fb5-4f85-bfda-4d3c8055868f None None] MFA Rules not processed for user `5cfa58ef86774ab7800bf91930bf6028`. Rule list: `[]` (Enabled: `True`). {{(pid=81592) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 18:06:37.085410 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-5f26561b-6fb5-4f85-bfda-4d3c8055868f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:06:37.093495 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1271/2554] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 15 18:06:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 18:06:37.098522 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc06f37e-4133-49aa-a0be-c24be24867c7 None None] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:06:37.108739 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc06f37e-4133-49aa-a0be-c24be24867c7 None None] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:06:37.115270 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab668c5-e366-4494-ac6d-f38d9178300f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:06:37.115873 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab668c5-e366-4494-ac6d-f38d9178300f admin admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:06:37.116153 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab668c5-e366-4494-ac6d-f38d9178300f admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:06:37.116428 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab668c5-e366-4494-ac6d-f38d9178300f admin admin] PATH_INFO: `/v3/domains` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:06:37.117086 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab668c5-e366-4494-ac6d-f38d9178300f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81593) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 18:06:37.117421 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab668c5-e366-4494-ac6d-f38d9178300f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:06:37.119049 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab668c5-e366-4494-ac6d-f38d9178300f admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:06:37.131169 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1284/2555] 10.222.0.25 () {58 vars in 1153 bytes} [Thu Sep 15 18:06:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 18:06:37.135544 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f26561b-6fb5-4f85-bfda-4d3c8055868f None None] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:06:37.144789 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f26561b-6fb5-4f85-bfda-4d3c8055868f None None] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:06:37.149455 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d271b841-20df-426c-a4c8-f5ee3810612d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:06:37.150050 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d271b841-20df-426c-a4c8-f5ee3810612d admin admin] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:06:37.150330 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d271b841-20df-426c-a4c8-f5ee3810612d admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:06:37.150599 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d271b841-20df-426c-a4c8-f5ee3810612d admin admin] PATH_INFO: `/v3/projects` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:06:37.151226 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d271b841-20df-426c-a4c8-f5ee3810612d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:06:37.153145 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d271b841-20df-426c-a4c8-f5ee3810612d admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:06:37.180874 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1272/2556] 10.222.0.25 () {60 vars in 1153 bytes} [Thu Sep 15 18:06:37 2022] POST /identity/v3/projects => generated 387 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 18:06:37.184824 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab668c5-e366-4494-ac6d-f38d9178300f admin admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:06:37.195179 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab668c5-e366-4494-ac6d-f38d9178300f admin admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:06:37.198922 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 18:06:37.264126 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6ef294-64c2-4aca-894e-cdf5fc62c578 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:06:37.264732 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6ef294-64c2-4aca-894e-cdf5fc62c578 admin admin] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:06:37.265011 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6ef294-64c2-4aca-894e-cdf5fc62c578 admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:06:37.265276 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6ef294-64c2-4aca-894e-cdf5fc62c578 admin admin] PATH_INFO: `/v3/users` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:06:37.265932 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6ef294-64c2-4aca-894e-cdf5fc62c578 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:06:37.267915 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6ef294-64c2-4aca-894e-cdf5fc62c578 admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:06:37.290515 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1285/2557] 10.222.0.25 () {60 vars in 1144 bytes} [Thu Sep 15 18:06:37 2022] POST /identity/v3/users => generated 294 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 15 18:06:37.295014 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d271b841-20df-426c-a4c8-f5ee3810612d admin admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:06:37.305846 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d271b841-20df-426c-a4c8-f5ee3810612d admin admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:06:37.310881 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d238e98b-0a52-4cfc-8a6d-43ecdf9fc39a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:06:37.311479 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d238e98b-0a52-4cfc-8a6d-43ecdf9fc39a admin admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:06:37.311963 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d238e98b-0a52-4cfc-8a6d-43ecdf9fc39a admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:06:37.312106 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d238e98b-0a52-4cfc-8a6d-43ecdf9fc39a admin admin] PATH_INFO: `/v3/roles` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:06:37.312659 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d238e98b-0a52-4cfc-8a6d-43ecdf9fc39a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:06:37.314323 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d238e98b-0a52-4cfc-8a6d-43ecdf9fc39a admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:06:37.324436 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1273/2558] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Sep 15 18:06:37 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 18:06:37.328501 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6ef294-64c2-4aca-894e-cdf5fc62c578 admin admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:06:37.338618 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6ef294-64c2-4aca-894e-cdf5fc62c578 admin admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:06:37.343228 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491b41c9-988c-4788-bbf8-1a31a8971c83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:06:37.344078 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491b41c9-988c-4788-bbf8-1a31a8971c83 admin admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:06:37.344349 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491b41c9-988c-4788-bbf8-1a31a8971c83 admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:06:37.345120 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491b41c9-988c-4788-bbf8-1a31a8971c83 admin admin] PATH_INFO: `/v3/roles` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:06:37.345778 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491b41c9-988c-4788-bbf8-1a31a8971c83 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:06:37.347376 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491b41c9-988c-4788-bbf8-1a31a8971c83 admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:06:37.358125 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1286/2559] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Sep 15 18:06:37 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 18:06:37.362993 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d238e98b-0a52-4cfc-8a6d-43ecdf9fc39a admin admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:06:37.372961 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d238e98b-0a52-4cfc-8a6d-43ecdf9fc39a admin admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:06:37.377597 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b07783-0dfe-433d-8edc-1a03048d194d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:06:37.378232 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b07783-0dfe-433d-8edc-1a03048d194d admin admin] REQUEST_METHOD: `PUT` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:06:37.378511 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b07783-0dfe-433d-8edc-1a03048d194d admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:06:37.378783 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b07783-0dfe-433d-8edc-1a03048d194d admin admin] PATH_INFO: `/v3/projects/dda6be1ed33a44979aae8cd74d60cb93/users/88fc4ef6c85141db8b552441da6c5af1/roles/343cc8b1bc7243eebabdf08147e8366d` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:06:37.393810 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b07783-0dfe-433d-8edc-1a03048d194d admin admin] RBAC: Authorizing `identity:create_grant(project_id=dda6be1ed33a44979aae8cd74d60cb93, user_id=88fc4ef6c85141db8b552441da6c5af1, role_id=343cc8b1bc7243eebabdf08147e8366d)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:06:37.396436 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b07783-0dfe-433d-8edc-1a03048d194d admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:06:37.409703 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1274/2560] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Sep 15 18:06:37 2022] PUT /identity/v3/projects/dda6be1ed33a44979aae8cd74d60cb93/users/88fc4ef6c85141db8b552441da6c5af1/roles/343cc8b1bc7243eebabdf08147e8366d => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 18:06:37.416543 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd9d265-b5ae-40ab-bc35-f619c8d779d4 None None] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:06:37.416830 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd9d265-b5ae-40ab-bc35-f619c8d779d4 None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:06:37.417109 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd9d265-b5ae-40ab-bc35-f619c8d779d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:06:37.437019 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.auth.core [None req-9fd9d265-b5ae-40ab-bc35-f619c8d779d4 None None] MFA Rules not processed for user `5cfa58ef86774ab7800bf91930bf6028`. Rule list: `[]` (Enabled: `True`). {{(pid=81593) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 18:06:37.438191 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-9fd9d265-b5ae-40ab-bc35-f619c8d779d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:06:37.497927 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1287/2561] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 15 18:06:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 18:06:37.507769 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b07783-0dfe-433d-8edc-1a03048d194d admin admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:06:37.509536 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-85b07783-0dfe-433d-8edc-1a03048d194d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:06:37.545379 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 18:06:37.580182 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b07783-0dfe-433d-8edc-1a03048d194d admin admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:06:37.583842 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1e724c-0869-40bc-9172-454811eaba12 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a32274b4781b40fea9f28da8a9bde5ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1213c0d1b584404ba3998e136f166e89', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:06:37.584518 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1e724c-0869-40bc-9172-454811eaba12 service neutron] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:06:37.584724 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1e724c-0869-40bc-9172-454811eaba12 service neutron] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:06:37.584990 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1e724c-0869-40bc-9172-454811eaba12 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:06:37.595087 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1e724c-0869-40bc-9172-454811eaba12 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:06:37.596515 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1e724c-0869-40bc-9172-454811eaba12 service neutron] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:06:37.606463 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1275/2562] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 15 18:06:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 18:06:41.632055 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18d9592-0436-4d4a-8d78-4f494cf3b5f2 None None] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:06:41.632580 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18d9592-0436-4d4a-8d78-4f494cf3b5f2 None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:06:41.632831 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18d9592-0436-4d4a-8d78-4f494cf3b5f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:06:41.669226 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.auth.core [None req-e18d9592-0436-4d4a-8d78-4f494cf3b5f2 None None] MFA Rules not processed for user `88fc4ef6c85141db8b552441da6c5af1`. Rule list: `[]` (Enabled: `True`). {{(pid=81593) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 18:06:41.670499 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-e18d9592-0436-4d4a-8d78-4f494cf3b5f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:06:41.746359 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1288/2563] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 15 18:06:41 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 18:06:41.761386 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1e724c-0869-40bc-9172-454811eaba12 service neutron] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:06:41.762825 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-0c1e724c-0869-40bc-9172-454811eaba12 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:06:41.849927 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1e724c-0869-40bc-9172-454811eaba12 service neutron] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:06:41.858841 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f31034f-e411-4019-967b-d8fd07d420a6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe2244818e4d4dca9c424cd078653e6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1213c0d1b584404ba3998e136f166e89', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:06:41.859562 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f31034f-e411-4019-967b-d8fd07d420a6 service nova] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:06:41.860474 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f31034f-e411-4019-967b-d8fd07d420a6 service nova] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:06:41.860743 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f31034f-e411-4019-967b-d8fd07d420a6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:06:41.869187 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f31034f-e411-4019-967b-d8fd07d420a6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:06:41.870797 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f31034f-e411-4019-967b-d8fd07d420a6 service nova] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:06:41.881522 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1276/2564] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 15 18:06:41 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 18:06:43.249755 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb607d3-3f78-45be-a56c-e4fc810b1810 None None] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:06:43.250266 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb607d3-3f78-45be-a56c-e4fc810b1810 None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:06:43.250266 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb607d3-3f78-45be-a56c-e4fc810b1810 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:06:43.270898 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.auth.core [None req-fbb607d3-3f78-45be-a56c-e4fc810b1810 None None] MFA Rules not processed for user `88fc4ef6c85141db8b552441da6c5af1`. Rule list: `[]` (Enabled: `True`). {{(pid=81593) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 18:06:43.272201 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-fbb607d3-3f78-45be-a56c-e4fc810b1810 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:06:43.278929 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1289/2565] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 15 18:06:43 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 18:06:49.906391 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f31034f-e411-4019-967b-d8fd07d420a6 service nova] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:06:49.916539 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f31034f-e411-4019-967b-d8fd07d420a6 service nova] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:06:49.920284 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606cd3ae-ec74-4916-b479-96ee58a63575 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a32274b4781b40fea9f28da8a9bde5ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1213c0d1b584404ba3998e136f166e89', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:06:49.920973 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606cd3ae-ec74-4916-b479-96ee58a63575 service neutron] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:06:49.921278 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606cd3ae-ec74-4916-b479-96ee58a63575 service neutron] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:06:49.921586 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606cd3ae-ec74-4916-b479-96ee58a63575 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:06:49.926300 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-606cd3ae-ec74-4916-b479-96ee58a63575 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:06:49.941392 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-606cd3ae-ec74-4916-b479-96ee58a63575 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:06:49.943020 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-606cd3ae-ec74-4916-b479-96ee58a63575 service neutron] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:06:49.959596 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1277/2566] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 15 18:06:49 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 18:06:49.996150 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb607d3-3f78-45be-a56c-e4fc810b1810 None None] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:06:50.010826 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb607d3-3f78-45be-a56c-e4fc810b1810 None None] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:06:50.015315 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0524e4a1-dd2c-4d34-b182-7e2d6002da1b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a32274b4781b40fea9f28da8a9bde5ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1213c0d1b584404ba3998e136f166e89', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:06:50.016800 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0524e4a1-dd2c-4d34-b182-7e2d6002da1b service neutron] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:06:50.017243 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0524e4a1-dd2c-4d34-b182-7e2d6002da1b service neutron] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:06:50.017709 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0524e4a1-dd2c-4d34-b182-7e2d6002da1b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:06:50.019719 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-0524e4a1-dd2c-4d34-b182-7e2d6002da1b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:06:50.032941 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 18:06:50.038596 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0524e4a1-dd2c-4d34-b182-7e2d6002da1b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:06:50.042293 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0524e4a1-dd2c-4d34-b182-7e2d6002da1b service neutron] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:06:50.057157 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1290/2567] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 15 18:06:49 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 18:06:57.604121 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba17d75e-23bd-44a2-887a-f0022b3f349b None None] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:06:57.604747 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba17d75e-23bd-44a2-887a-f0022b3f349b None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:06:57.604858 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba17d75e-23bd-44a2-887a-f0022b3f349b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:06:57.625563 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.auth.core [None req-ba17d75e-23bd-44a2-887a-f0022b3f349b None None] MFA Rules not processed for user `d899ec4fcbeb4de382c7f0a779ca8ed5`. Rule list: `[]` (Enabled: `True`). {{(pid=81592) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 18:06:57.626783 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-ba17d75e-23bd-44a2-887a-f0022b3f349b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:06:57.723542 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1278/2568] 10.222.0.25 () {58 vars in 967 bytes} [Thu Sep 15 18:06:57 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 18:06:57.784133 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0524e4a1-dd2c-4d34-b182-7e2d6002da1b service neutron] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:06:57.787810 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-0524e4a1-dd2c-4d34-b182-7e2d6002da1b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:06:57.900528 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0524e4a1-dd2c-4d34-b182-7e2d6002da1b service neutron] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:06:57.906680 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c060ff90-cc97-45c2-8d6c-f270302a3507 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '685f7ad4c6fe4c878d542dddd6d81593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1213c0d1b584404ba3998e136f166e89', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:06:57.907313 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c060ff90-cc97-45c2-8d6c-f270302a3507 service swift] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:06:57.907597 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c060ff90-cc97-45c2-8d6c-f270302a3507 service swift] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:06:57.908002 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c060ff90-cc97-45c2-8d6c-f270302a3507 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:06:57.925108 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c060ff90-cc97-45c2-8d6c-f270302a3507 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:06:57.927716 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c060ff90-cc97-45c2-8d6c-f270302a3507 service swift] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:06:57.940499 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1291/2569] 10.222.0.25 () {60 vars in 1384 bytes} [Thu Sep 15 18:06:57 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 15 18:07:00.315335 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baebf69f-7368-4741-a67d-5c678deed651 None None] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:07:00.316517 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baebf69f-7368-4741-a67d-5c678deed651 None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:07:00.318048 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baebf69f-7368-4741-a67d-5c678deed651 None None] PATH_INFO: `/` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:07:00.320799 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1279/2570] 10.222.0.25 () {54 vars in 921 bytes} [Thu Sep 15 18:07:00 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 18:07:00.328864 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c38bad-dfbf-43b2-bfc8-9f4a65a2f002 None None] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:07:00.329511 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c38bad-dfbf-43b2-bfc8-9f4a65a2f002 None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:07:00.329889 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c38bad-dfbf-43b2-bfc8-9f4a65a2f002 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:07:00.353995 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.auth.core [None req-42c38bad-dfbf-43b2-bfc8-9f4a65a2f002 None None] MFA Rules not processed for user `a32274b4781b40fea9f28da8a9bde5ca`. Rule list: `[]` (Enabled: `True`). {{(pid=81593) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 18:07:00.355141 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-42c38bad-dfbf-43b2-bfc8-9f4a65a2f002 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:07:00.363933 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1292/2571] 10.222.0.25 () {58 vars in 1018 bytes} [Thu Sep 15 18:07:00 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 18:07:00.379766 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baebf69f-7368-4741-a67d-5c678deed651 None None] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:07:00.381661 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-baebf69f-7368-4741-a67d-5c678deed651 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:07:00.400255 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baebf69f-7368-4741-a67d-5c678deed651 None None] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:07:00.405349 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2a8a69-f467-4cc7-9480-3c331f22248b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a32274b4781b40fea9f28da8a9bde5ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1213c0d1b584404ba3998e136f166e89', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:07:00.406001 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2a8a69-f467-4cc7-9480-3c331f22248b service neutron] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:07:00.406281 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2a8a69-f467-4cc7-9480-3c331f22248b service neutron] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:07:00.406554 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2a8a69-f467-4cc7-9480-3c331f22248b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:07:00.414977 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca2a8a69-f467-4cc7-9480-3c331f22248b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:07:00.416465 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca2a8a69-f467-4cc7-9480-3c331f22248b service neutron] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:07:00.425154 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1280/2572] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 15 18:07:00 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 18:07:00.571015 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8d1698-165d-4646-bf8e-ceb8168d46a4 None None] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:07:00.571367 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8d1698-165d-4646-bf8e-ceb8168d46a4 None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:07:00.571968 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8d1698-165d-4646-bf8e-ceb8168d46a4 None None] PATH_INFO: `/` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:07:00.573984 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1293/2573] 10.222.0.25 () {54 vars in 921 bytes} [Thu Sep 15 18:07:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 18:07:00.584078 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2169f25c-92be-4bba-8051-d082ebe6fdef None None] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:07:00.584733 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2169f25c-92be-4bba-8051-d082ebe6fdef None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:07:00.585202 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2169f25c-92be-4bba-8051-d082ebe6fdef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:07:00.625948 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8d1698-165d-4646-bf8e-ceb8168d46a4 None None] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:07:00.628191 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-8c8d1698-165d-4646-bf8e-ceb8168d46a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:07:00.642002 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.auth.core [None req-2169f25c-92be-4bba-8051-d082ebe6fdef None None] MFA Rules not processed for user `fe2244818e4d4dca9c424cd078653e6a`. Rule list: `[]` (Enabled: `True`). {{(pid=81592) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 18:07:00.644228 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-2169f25c-92be-4bba-8051-d082ebe6fdef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:07:00.672721 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1281/2574] 10.222.0.25 () {58 vars in 1018 bytes} [Thu Sep 15 18:07:00 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 18:07:00.689657 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2169f25c-92be-4bba-8051-d082ebe6fdef None None] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:07:00.703472 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2169f25c-92be-4bba-8051-d082ebe6fdef None None] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:07:00.711598 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4a9a62-9700-4ea1-b97e-561d23546fc6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a32274b4781b40fea9f28da8a9bde5ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1213c0d1b584404ba3998e136f166e89', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:07:00.712607 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4a9a62-9700-4ea1-b97e-561d23546fc6 service neutron] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:07:00.713128 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4a9a62-9700-4ea1-b97e-561d23546fc6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:07:00.713639 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4a9a62-9700-4ea1-b97e-561d23546fc6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:07:00.726166 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f4a9a62-9700-4ea1-b97e-561d23546fc6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:07:00.729001 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f4a9a62-9700-4ea1-b97e-561d23546fc6 service neutron] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:07:00.742893 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1282/2575] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 15 18:07:00 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 18:07:00.767964 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8d1698-165d-4646-bf8e-ceb8168d46a4 None None] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:07:00.777676 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc52f67a-20e6-40d2-afc9-91882077a6fa service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b232e7a841145ba93c6d8462ccb751a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1213c0d1b584404ba3998e136f166e89', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:07:00.778737 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc52f67a-20e6-40d2-afc9-91882077a6fa service cinder] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:07:00.779234 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc52f67a-20e6-40d2-afc9-91882077a6fa service cinder] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:07:00.779603 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc52f67a-20e6-40d2-afc9-91882077a6fa service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:07:00.781707 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-dc52f67a-20e6-40d2-afc9-91882077a6fa service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:07:00.860510 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4a9a62-9700-4ea1-b97e-561d23546fc6 service neutron] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:07:00.861870 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-1f4a9a62-9700-4ea1-b97e-561d23546fc6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:07:00.866934 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc52f67a-20e6-40d2-afc9-91882077a6fa service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:07:00.869745 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc52f67a-20e6-40d2-afc9-91882077a6fa service cinder] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:07:00.880718 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 18:07:00.897139 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1294/2576] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 15 18:07:00 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 270 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 18:07:00.988526 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4a9a62-9700-4ea1-b97e-561d23546fc6 service neutron] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:07:00.994922 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a93ffca-f620-4928-9c4c-819315b48f55 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10af119bd39841ed8163993676230fca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1213c0d1b584404ba3998e136f166e89', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:07:00.995648 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a93ffca-f620-4928-9c4c-819315b48f55 service placement] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:07:00.995923 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a93ffca-f620-4928-9c4c-819315b48f55 service placement] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:07:00.996181 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a93ffca-f620-4928-9c4c-819315b48f55 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:07:00.998032 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-0a93ffca-f620-4928-9c4c-819315b48f55 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:07:01.017927 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a93ffca-f620-4928-9c4c-819315b48f55 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:07:01.019539 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a93ffca-f620-4928-9c4c-819315b48f55 service placement] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:07:01.033161 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1283/2577] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 15 18:07:00 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 15 18:07:06.780796 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc52f67a-20e6-40d2-afc9-91882077a6fa service cinder] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:07:06.789615 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-dc52f67a-20e6-40d2-afc9-91882077a6fa service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:07:06.809144 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc52f67a-20e6-40d2-afc9-91882077a6fa service cinder] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:07:06.816703 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc7266f-c6dc-47df-8578-f082b45c9255 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:07:06.817804 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc7266f-c6dc-47df-8578-f082b45c9255 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:07:06.818274 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc7266f-c6dc-47df-8578-f082b45c9255 admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:07:06.819224 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc7266f-c6dc-47df-8578-f082b45c9255 admin admin] PATH_INFO: `/v3/users/c5fe602d6d8d4bcb8dbf24612435ba5d` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:07:06.820688 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc7266f-c6dc-47df-8578-f082b45c9255 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c5fe602d6d8d4bcb8dbf24612435ba5d)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:07:06.822831 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc7266f-c6dc-47df-8578-f082b45c9255 admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:07:06.874203 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 18:07:06.908102 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-fcc7266f-c6dc-47df-8578-f082b45c9255 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c5fe602d6d8d4bcb8dbf24612435ba5d'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:07:06.925646 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-fcc7266f-c6dc-47df-8578-f082b45c9255 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c5fe602d6d8d4bcb8dbf24612435ba5d'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:07:06.926531 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-fcc7266f-c6dc-47df-8578-f082b45c9255 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c5fe602d6d8d4bcb8dbf24612435ba5d'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:07:06.927162 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-fcc7266f-c6dc-47df-8578-f082b45c9255 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c5fe602d6d8d4bcb8dbf24612435ba5d'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:07:06.959172 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-fcc7266f-c6dc-47df-8578-f082b45c9255 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c5fe602d6d8d4bcb8dbf24612435ba5d'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:07:07.006101 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1295/2578] 10.222.0.25 () {58 vars in 1224 bytes} [Thu Sep 15 18:07:06 2022] DELETE /identity/v3/users/c5fe602d6d8d4bcb8dbf24612435ba5d => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 18:07:07.224915 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a93ffca-f620-4928-9c4c-819315b48f55 service placement] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:07:07.243236 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a93ffca-f620-4928-9c4c-819315b48f55 service placement] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:07:07.318779 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4222c08-64ac-470c-bdf2-2774101797ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:07:07.319421 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4222c08-64ac-470c-bdf2-2774101797ec admin admin] REQUEST_METHOD: `DELETE` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:07:07.319698 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4222c08-64ac-470c-bdf2-2774101797ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:07:07.319972 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4222c08-64ac-470c-bdf2-2774101797ec admin admin] PATH_INFO: `/v3/projects/e9678d09acd84e6d9cfe552488860ff7` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:07:07.321119 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4222c08-64ac-470c-bdf2-2774101797ec admin admin] RBAC: Authorizing `identity:delete_project(project_id=e9678d09acd84e6d9cfe552488860ff7)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:07:07.323104 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4222c08-64ac-470c-bdf2-2774101797ec admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:07:07.373090 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-b4222c08-64ac-470c-bdf2-2774101797ec admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e9678d09acd84e6d9cfe552488860ff7', 'request_id': 'req-b4222c08-64ac-470c-bdf2-2774101797ec'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:07:07.380777 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-b4222c08-64ac-470c-bdf2-2774101797ec admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e9678d09acd84e6d9cfe552488860ff7', 'request_id': 'req-b4222c08-64ac-470c-bdf2-2774101797ec'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:07:07.390546 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-b4222c08-64ac-470c-bdf2-2774101797ec admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e9678d09acd84e6d9cfe552488860ff7', 'request_id': 'req-b4222c08-64ac-470c-bdf2-2774101797ec'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:07:07.410326 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-b4222c08-64ac-470c-bdf2-2774101797ec admin admin] The token cache is being invalidate because project e9678d09acd84e6d9cfe552488860ff7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81592) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 18:07:07.410849 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-b4222c08-64ac-470c-bdf2-2774101797ec admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:07:07.411930 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-b4222c08-64ac-470c-bdf2-2774101797ec admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:07:07.414908 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1284/2579] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Sep 15 18:07:07 2022] DELETE /identity/v3/projects/e9678d09acd84e6d9cfe552488860ff7 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 18:07:07.419237 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc7266f-c6dc-47df-8578-f082b45c9255 admin admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:07:07.421810 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-fcc7266f-c6dc-47df-8578-f082b45c9255 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:07:07.435452 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc7266f-c6dc-47df-8578-f082b45c9255 admin admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:07:07.504634 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0f1dd9-3d5c-4093-a7a9-6107d3bb6341 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:07:07.505412 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0f1dd9-3d5c-4093-a7a9-6107d3bb6341 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:07:07.505695 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0f1dd9-3d5c-4093-a7a9-6107d3bb6341 admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:07:07.506016 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0f1dd9-3d5c-4093-a7a9-6107d3bb6341 admin admin] PATH_INFO: `/v3/users/b9a100b22ed34c1bb118b3b873d07561` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:07:07.507174 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe0f1dd9-3d5c-4093-a7a9-6107d3bb6341 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b9a100b22ed34c1bb118b3b873d07561)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:07:07.509143 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe0f1dd9-3d5c-4093-a7a9-6107d3bb6341 admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:07:07.569093 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-fe0f1dd9-3d5c-4093-a7a9-6107d3bb6341 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b9a100b22ed34c1bb118b3b873d07561'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:07:07.580671 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-fe0f1dd9-3d5c-4093-a7a9-6107d3bb6341 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b9a100b22ed34c1bb118b3b873d07561'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:07:07.581343 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-fe0f1dd9-3d5c-4093-a7a9-6107d3bb6341 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b9a100b22ed34c1bb118b3b873d07561'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:07:07.581979 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-fe0f1dd9-3d5c-4093-a7a9-6107d3bb6341 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b9a100b22ed34c1bb118b3b873d07561'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:07:07.592207 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-fe0f1dd9-3d5c-4093-a7a9-6107d3bb6341 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b9a100b22ed34c1bb118b3b873d07561'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:07:07.630012 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1296/2580] 10.222.0.25 () {58 vars in 1224 bytes} [Thu Sep 15 18:07:07 2022] DELETE /identity/v3/users/b9a100b22ed34c1bb118b3b873d07561 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 15 18:07:07.825347 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4222c08-64ac-470c-bdf2-2774101797ec admin admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:07:07.827337 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-b4222c08-64ac-470c-bdf2-2774101797ec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:07:07.840279 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4222c08-64ac-470c-bdf2-2774101797ec admin admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:07:07.872945 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 18:07:07.916747 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65198110-5642-49b2-82a1-c96a99aac146 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:07:07.917781 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65198110-5642-49b2-82a1-c96a99aac146 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:07:07.918238 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65198110-5642-49b2-82a1-c96a99aac146 admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:07:07.918695 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65198110-5642-49b2-82a1-c96a99aac146 admin admin] PATH_INFO: `/v3/projects/72373775279d4e33872f59119a0c50be` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:07:07.920523 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65198110-5642-49b2-82a1-c96a99aac146 admin admin] RBAC: Authorizing `identity:delete_project(project_id=72373775279d4e33872f59119a0c50be)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:07:07.923852 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65198110-5642-49b2-82a1-c96a99aac146 admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:07:07.989246 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-65198110-5642-49b2-82a1-c96a99aac146 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '72373775279d4e33872f59119a0c50be', 'request_id': 'req-65198110-5642-49b2-82a1-c96a99aac146'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:07:07.994926 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-65198110-5642-49b2-82a1-c96a99aac146 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '72373775279d4e33872f59119a0c50be', 'request_id': 'req-65198110-5642-49b2-82a1-c96a99aac146'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:07:08.002773 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-65198110-5642-49b2-82a1-c96a99aac146 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '72373775279d4e33872f59119a0c50be', 'request_id': 'req-65198110-5642-49b2-82a1-c96a99aac146'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:07:08.014150 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-65198110-5642-49b2-82a1-c96a99aac146 admin admin] The token cache is being invalidate because project 72373775279d4e33872f59119a0c50be was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81592) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 18:07:08.015000 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-65198110-5642-49b2-82a1-c96a99aac146 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:07:08.015661 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-65198110-5642-49b2-82a1-c96a99aac146 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:07:08.017157 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1285/2581] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Sep 15 18:07:07 2022] DELETE /identity/v3/projects/72373775279d4e33872f59119a0c50be => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 18:07:16.139147 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0f1dd9-3d5c-4093-a7a9-6107d3bb6341 admin admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:07:16.140745 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-fe0f1dd9-3d5c-4093-a7a9-6107d3bb6341 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:07:16.172036 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 18:07:16.211128 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0f1dd9-3d5c-4093-a7a9-6107d3bb6341 admin admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:07:16.262613 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b53c6a3-d29a-424d-962a-6aeec66b7687 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a32274b4781b40fea9f28da8a9bde5ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1213c0d1b584404ba3998e136f166e89', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:07:16.263259 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b53c6a3-d29a-424d-962a-6aeec66b7687 service neutron] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:07:16.263539 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b53c6a3-d29a-424d-962a-6aeec66b7687 service neutron] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:07:16.263908 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b53c6a3-d29a-424d-962a-6aeec66b7687 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:07:16.265778 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-3b53c6a3-d29a-424d-962a-6aeec66b7687 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:07:16.335281 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b53c6a3-d29a-424d-962a-6aeec66b7687 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:07:16.337751 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b53c6a3-d29a-424d-962a-6aeec66b7687 service neutron] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:07:16.354035 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1297/2582] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 15 18:07:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 215 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 18:07:18.011131 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=36,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 18:07:19.774651 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65198110-5642-49b2-82a1-c96a99aac146 admin admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:07:19.776389 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-65198110-5642-49b2-82a1-c96a99aac146 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:07:19.796659 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65198110-5642-49b2-82a1-c96a99aac146 admin admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:07:19.804474 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f311555-8272-4a75-8e32-fe4d09a4b233 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:07:19.804474 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f311555-8272-4a75-8e32-fe4d09a4b233 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:07:19.804474 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f311555-8272-4a75-8e32-fe4d09a4b233 admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:07:19.804474 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f311555-8272-4a75-8e32-fe4d09a4b233 admin admin] PATH_INFO: `/v3/users/49761e1a87dc495eae27fe1b8f509ae7` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:07:19.805794 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f311555-8272-4a75-8e32-fe4d09a4b233 admin admin] RBAC: Authorizing `identity:delete_user(user_id=49761e1a87dc495eae27fe1b8f509ae7)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:07:19.806140 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f311555-8272-4a75-8e32-fe4d09a4b233 admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:07:19.856721 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-3f311555-8272-4a75-8e32-fe4d09a4b233 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '49761e1a87dc495eae27fe1b8f509ae7'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:07:19.866055 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-3f311555-8272-4a75-8e32-fe4d09a4b233 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '49761e1a87dc495eae27fe1b8f509ae7'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:07:19.866666 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-3f311555-8272-4a75-8e32-fe4d09a4b233 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '49761e1a87dc495eae27fe1b8f509ae7'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:07:19.867289 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-3f311555-8272-4a75-8e32-fe4d09a4b233 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '49761e1a87dc495eae27fe1b8f509ae7'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:07:19.875350 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-3f311555-8272-4a75-8e32-fe4d09a4b233 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '49761e1a87dc495eae27fe1b8f509ae7'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:07:19.895198 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1286/2583] 10.222.0.25 () {58 vars in 1224 bytes} [Thu Sep 15 18:07:19 2022] DELETE /identity/v3/users/49761e1a87dc495eae27fe1b8f509ae7 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 18:07:20.091598 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b53c6a3-d29a-424d-962a-6aeec66b7687 service neutron] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:07:20.103331 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b53c6a3-d29a-424d-962a-6aeec66b7687 service neutron] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:07:20.167573 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5486a897-12df-4bfa-8fe6-a275cd7bb50c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:07:20.168214 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5486a897-12df-4bfa-8fe6-a275cd7bb50c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:07:20.168494 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5486a897-12df-4bfa-8fe6-a275cd7bb50c admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:07:20.168769 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5486a897-12df-4bfa-8fe6-a275cd7bb50c admin admin] PATH_INFO: `/v3/projects/d0c00ad55eda4d7f8a0370359478f2df` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:07:20.170496 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5486a897-12df-4bfa-8fe6-a275cd7bb50c admin admin] RBAC: Authorizing `identity:delete_project(project_id=d0c00ad55eda4d7f8a0370359478f2df)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:07:20.172511 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5486a897-12df-4bfa-8fe6-a275cd7bb50c admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:07:20.218720 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 18:07:20.232385 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-5486a897-12df-4bfa-8fe6-a275cd7bb50c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd0c00ad55eda4d7f8a0370359478f2df', 'request_id': 'req-5486a897-12df-4bfa-8fe6-a275cd7bb50c'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:07:20.238014 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-5486a897-12df-4bfa-8fe6-a275cd7bb50c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd0c00ad55eda4d7f8a0370359478f2df', 'request_id': 'req-5486a897-12df-4bfa-8fe6-a275cd7bb50c'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:07:20.246344 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-5486a897-12df-4bfa-8fe6-a275cd7bb50c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd0c00ad55eda4d7f8a0370359478f2df', 'request_id': 'req-5486a897-12df-4bfa-8fe6-a275cd7bb50c'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:07:20.258103 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-5486a897-12df-4bfa-8fe6-a275cd7bb50c admin admin] The token cache is being invalidate because project d0c00ad55eda4d7f8a0370359478f2df was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81593) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 18:07:20.258405 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-5486a897-12df-4bfa-8fe6-a275cd7bb50c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:07:20.259079 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-5486a897-12df-4bfa-8fe6-a275cd7bb50c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:07:20.260591 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1298/2584] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Sep 15 18:07:20 2022] DELETE /identity/v3/projects/d0c00ad55eda4d7f8a0370359478f2df => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 18:07:20.266271 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edf4bf0-0024-4bdc-87a1-b86ef18b03e3 None None] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:07:20.266618 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edf4bf0-0024-4bdc-87a1-b86ef18b03e3 None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:07:20.266912 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edf4bf0-0024-4bdc-87a1-b86ef18b03e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:07:20.289123 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.auth.core [None req-5edf4bf0-0024-4bdc-87a1-b86ef18b03e3 None None] MFA Rules not processed for user `5cfa58ef86774ab7800bf91930bf6028`. Rule list: `[]` (Enabled: `True`). {{(pid=81592) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 18:07:20.290392 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-5edf4bf0-0024-4bdc-87a1-b86ef18b03e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:07:20.358617 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1287/2585] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 15 18:07:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 18:07:20.366698 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0679b8db-504c-4061-99e9-c234b120d02f None None] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:07:20.366986 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0679b8db-504c-4061-99e9-c234b120d02f None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:07:20.367287 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0679b8db-504c-4061-99e9-c234b120d02f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:07:20.387861 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.auth.core [None req-0679b8db-504c-4061-99e9-c234b120d02f None None] MFA Rules not processed for user `5cfa58ef86774ab7800bf91930bf6028`. Rule list: `[]` (Enabled: `True`). {{(pid=81593) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 18:07:20.389545 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-0679b8db-504c-4061-99e9-c234b120d02f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:07:20.397471 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1299/2586] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 15 18:07:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 18:07:20.401883 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5edf4bf0-0024-4bdc-87a1-b86ef18b03e3 None None] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:07:20.413420 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5edf4bf0-0024-4bdc-87a1-b86ef18b03e3 None None] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:07:20.418460 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45a1667-d3ed-4749-ae71-9fed9333efd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:07:20.419080 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45a1667-d3ed-4749-ae71-9fed9333efd6 admin admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:07:20.419366 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45a1667-d3ed-4749-ae71-9fed9333efd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:07:20.419715 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45a1667-d3ed-4749-ae71-9fed9333efd6 admin admin] PATH_INFO: `/v3/domains` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:07:20.420376 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d45a1667-d3ed-4749-ae71-9fed9333efd6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81592) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 18:07:20.420670 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d45a1667-d3ed-4749-ae71-9fed9333efd6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:07:20.422440 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d45a1667-d3ed-4749-ae71-9fed9333efd6 admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:07:20.436101 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1288/2587] 10.222.0.25 () {58 vars in 1153 bytes} [Thu Sep 15 18:07:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 18:07:20.440588 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0679b8db-504c-4061-99e9-c234b120d02f None None] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:07:20.450692 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0679b8db-504c-4061-99e9-c234b120d02f None None] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:07:20.462210 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd98e84-2c5e-4143-a4c2-b02b875b3adf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:07:20.462843 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd98e84-2c5e-4143-a4c2-b02b875b3adf admin admin] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:07:20.463126 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd98e84-2c5e-4143-a4c2-b02b875b3adf admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:07:20.463400 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd98e84-2c5e-4143-a4c2-b02b875b3adf admin admin] PATH_INFO: `/v3/projects` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:07:20.464107 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd98e84-2c5e-4143-a4c2-b02b875b3adf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:07:20.466184 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd98e84-2c5e-4143-a4c2-b02b875b3adf admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:07:20.496021 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1300/2588] 10.222.0.25 () {60 vars in 1153 bytes} [Thu Sep 15 18:07:20 2022] POST /identity/v3/projects => generated 385 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 15 18:07:20.500256 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45a1667-d3ed-4749-ae71-9fed9333efd6 admin admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:07:20.510482 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45a1667-d3ed-4749-ae71-9fed9333efd6 admin admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:07:20.570365 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b781ea6-926f-433e-9daa-74c8d0d2b6eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:07:20.570979 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b781ea6-926f-433e-9daa-74c8d0d2b6eb admin admin] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:07:20.571254 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b781ea6-926f-433e-9daa-74c8d0d2b6eb admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:07:20.571521 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b781ea6-926f-433e-9daa-74c8d0d2b6eb admin admin] PATH_INFO: `/v3/users` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:07:20.572155 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b781ea6-926f-433e-9daa-74c8d0d2b6eb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:07:20.574141 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b781ea6-926f-433e-9daa-74c8d0d2b6eb admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:07:20.582964 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 18:07:20.606165 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1289/2589] 10.222.0.25 () {60 vars in 1144 bytes} [Thu Sep 15 18:07:20 2022] POST /identity/v3/users => generated 293 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 18:07:20.607215 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd98e84-2c5e-4143-a4c2-b02b875b3adf admin admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:07:20.617974 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd98e84-2c5e-4143-a4c2-b02b875b3adf admin admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:07:20.623430 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e55b049-6b58-4829-8e04-7536e58d4976 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:07:20.624034 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e55b049-6b58-4829-8e04-7536e58d4976 admin admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:07:20.624317 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e55b049-6b58-4829-8e04-7536e58d4976 admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:07:20.624586 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e55b049-6b58-4829-8e04-7536e58d4976 admin admin] PATH_INFO: `/v3/roles` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:07:20.625233 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e55b049-6b58-4829-8e04-7536e58d4976 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:07:20.626990 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e55b049-6b58-4829-8e04-7536e58d4976 admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:07:20.637695 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1301/2590] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Sep 15 18:07:20 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 15 18:07:20.642444 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b781ea6-926f-433e-9daa-74c8d0d2b6eb admin admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:07:20.652904 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b781ea6-926f-433e-9daa-74c8d0d2b6eb admin admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:07:20.657865 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c18391b-ff1b-44b5-92a1-9a960cc45aaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:07:20.658473 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c18391b-ff1b-44b5-92a1-9a960cc45aaa admin admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:07:20.658752 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c18391b-ff1b-44b5-92a1-9a960cc45aaa admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:07:20.659024 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c18391b-ff1b-44b5-92a1-9a960cc45aaa admin admin] PATH_INFO: `/v3/roles` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:07:20.659674 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c18391b-ff1b-44b5-92a1-9a960cc45aaa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:07:20.661262 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c18391b-ff1b-44b5-92a1-9a960cc45aaa admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:07:20.672739 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1290/2591] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Sep 15 18:07:20 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 18:07:20.677388 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e55b049-6b58-4829-8e04-7536e58d4976 admin admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:07:20.688161 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e55b049-6b58-4829-8e04-7536e58d4976 admin admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:07:20.692982 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4493db-a590-4910-8256-4e2bdc798187 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:07:20.693679 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4493db-a590-4910-8256-4e2bdc798187 admin admin] REQUEST_METHOD: `PUT` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:07:20.693976 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4493db-a590-4910-8256-4e2bdc798187 admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:07:20.694233 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4493db-a590-4910-8256-4e2bdc798187 admin admin] PATH_INFO: `/v3/projects/57eda6ece5ca41a592f43ffe27372b28/users/f9e92c9c725e4b76b0422fc6f86d6631/roles/343cc8b1bc7243eebabdf08147e8366d` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:07:20.710763 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac4493db-a590-4910-8256-4e2bdc798187 admin admin] RBAC: Authorizing `identity:create_grant(project_id=57eda6ece5ca41a592f43ffe27372b28, user_id=f9e92c9c725e4b76b0422fc6f86d6631, role_id=343cc8b1bc7243eebabdf08147e8366d)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:07:20.713497 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac4493db-a590-4910-8256-4e2bdc798187 admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:07:20.727633 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1302/2592] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Sep 15 18:07:20 2022] PUT /identity/v3/projects/57eda6ece5ca41a592f43ffe27372b28/users/f9e92c9c725e4b76b0422fc6f86d6631/roles/343cc8b1bc7243eebabdf08147e8366d => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 18:07:20.733018 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b62aa9-a254-47f2-9067-4b9e321175a0 None None] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:07:20.733318 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b62aa9-a254-47f2-9067-4b9e321175a0 None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:07:20.733610 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b62aa9-a254-47f2-9067-4b9e321175a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:07:20.757697 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.auth.core [None req-70b62aa9-a254-47f2-9067-4b9e321175a0 None None] MFA Rules not processed for user `5cfa58ef86774ab7800bf91930bf6028`. Rule list: `[]` (Enabled: `True`). {{(pid=81592) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 18:07:20.759072 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-70b62aa9-a254-47f2-9067-4b9e321175a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:07:20.819566 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1291/2593] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 15 18:07:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 18:07:20.830077 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4493db-a590-4910-8256-4e2bdc798187 admin admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:07:20.831862 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-ac4493db-a590-4910-8256-4e2bdc798187 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:07:20.892895 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4493db-a590-4910-8256-4e2bdc798187 admin admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:07:20.896455 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9eb8be9-5cc9-4db7-be24-2f41d3b1a59f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a32274b4781b40fea9f28da8a9bde5ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1213c0d1b584404ba3998e136f166e89', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:07:20.897063 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9eb8be9-5cc9-4db7-be24-2f41d3b1a59f service neutron] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:07:20.897357 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9eb8be9-5cc9-4db7-be24-2f41d3b1a59f service neutron] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:07:20.897622 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9eb8be9-5cc9-4db7-be24-2f41d3b1a59f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:07:20.907547 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9eb8be9-5cc9-4db7-be24-2f41d3b1a59f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:07:20.908994 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9eb8be9-5cc9-4db7-be24-2f41d3b1a59f service neutron] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:07:20.919569 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1303/2594] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 15 18:07:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 18:07:25.255431 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd8c1b5-ee7a-419d-9681-f439fe37601e None None] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:07:25.256021 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd8c1b5-ee7a-419d-9681-f439fe37601e None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:07:25.256021 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd8c1b5-ee7a-419d-9681-f439fe37601e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:07:25.291659 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.auth.core [None req-4dd8c1b5-ee7a-419d-9681-f439fe37601e None None] MFA Rules not processed for user `f9e92c9c725e4b76b0422fc6f86d6631`. Rule list: `[]` (Enabled: `True`). {{(pid=81592) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 18:07:25.292955 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-4dd8c1b5-ee7a-419d-9681-f439fe37601e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:07:25.366883 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1292/2595] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 15 18:07:25 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 18:07:25.383247 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9eb8be9-5cc9-4db7-be24-2f41d3b1a59f service neutron] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:07:25.384856 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-a9eb8be9-5cc9-4db7-be24-2f41d3b1a59f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:07:25.447632 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=92,keystone:DELETE=5,keystone:INSERT=3 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 18:07:25.474316 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9eb8be9-5cc9-4db7-be24-2f41d3b1a59f service neutron] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:07:25.480105 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8f1a9f-47ab-471d-a316-b569ad2c4edf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe2244818e4d4dca9c424cd078653e6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1213c0d1b584404ba3998e136f166e89', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:07:25.480743 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8f1a9f-47ab-471d-a316-b569ad2c4edf service nova] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:07:25.481026 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8f1a9f-47ab-471d-a316-b569ad2c4edf service nova] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:07:25.481336 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8f1a9f-47ab-471d-a316-b569ad2c4edf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:07:25.490672 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8f1a9f-47ab-471d-a316-b569ad2c4edf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:07:25.492310 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8f1a9f-47ab-471d-a316-b569ad2c4edf service nova] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:07:25.502922 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1304/2596] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 15 18:07:25 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 18:07:26.958700 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40df784-3167-4c9e-a755-f7f3d0339c1f None None] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:07:26.959249 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40df784-3167-4c9e-a755-f7f3d0339c1f None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:07:26.959347 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40df784-3167-4c9e-a755-f7f3d0339c1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:07:26.982267 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.auth.core [None req-e40df784-3167-4c9e-a755-f7f3d0339c1f None None] MFA Rules not processed for user `f9e92c9c725e4b76b0422fc6f86d6631`. Rule list: `[]` (Enabled: `True`). {{(pid=81592) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 18:07:26.983503 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-e40df784-3167-4c9e-a755-f7f3d0339c1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:07:26.994762 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1293/2597] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 15 18:07:26 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 18:07:27.347495 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8f1a9f-47ab-471d-a316-b569ad2c4edf service nova] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:07:27.357608 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8f1a9f-47ab-471d-a316-b569ad2c4edf service nova] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:07:27.361162 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f767322-885e-4dfb-a6b8-2c06056d9a70 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a32274b4781b40fea9f28da8a9bde5ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1213c0d1b584404ba3998e136f166e89', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:07:27.361807 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f767322-885e-4dfb-a6b8-2c06056d9a70 service neutron] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:07:27.362085 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f767322-885e-4dfb-a6b8-2c06056d9a70 service neutron] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:07:27.362355 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f767322-885e-4dfb-a6b8-2c06056d9a70 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:07:27.364124 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-9f767322-885e-4dfb-a6b8-2c06056d9a70 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:07:27.374730 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f767322-885e-4dfb-a6b8-2c06056d9a70 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:07:27.376190 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f767322-885e-4dfb-a6b8-2c06056d9a70 service neutron] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:07:27.385354 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1305/2598] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 15 18:07:27 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 18:07:30.135093 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40df784-3167-4c9e-a755-f7f3d0339c1f None None] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:07:30.136530 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-e40df784-3167-4c9e-a755-f7f3d0339c1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:07:30.151208 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40df784-3167-4c9e-a755-f7f3d0339c1f None None] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:07:30.156781 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97fa830-0762-4439-8fec-6710b0441b0c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a32274b4781b40fea9f28da8a9bde5ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1213c0d1b584404ba3998e136f166e89', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:07:30.157852 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97fa830-0762-4439-8fec-6710b0441b0c service neutron] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:07:30.158188 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97fa830-0762-4439-8fec-6710b0441b0c service neutron] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:07:30.158521 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97fa830-0762-4439-8fec-6710b0441b0c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:07:30.160576 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-a97fa830-0762-4439-8fec-6710b0441b0c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:07:30.171778 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97fa830-0762-4439-8fec-6710b0441b0c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:07:30.173277 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97fa830-0762-4439-8fec-6710b0441b0c service neutron] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:07:30.182580 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1294/2599] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 15 18:07:30 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 18:07:30.907553 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f767322-885e-4dfb-a6b8-2c06056d9a70 service neutron] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:07:30.910492 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-9f767322-885e-4dfb-a6b8-2c06056d9a70 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:07:30.936417 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f767322-885e-4dfb-a6b8-2c06056d9a70 service neutron] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:07:30.945165 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67650c1c-dc41-4886-95e4-99f8065dc5f8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe2244818e4d4dca9c424cd078653e6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1213c0d1b584404ba3998e136f166e89', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:07:30.945843 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67650c1c-dc41-4886-95e4-99f8065dc5f8 service nova] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:07:30.946122 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67650c1c-dc41-4886-95e4-99f8065dc5f8 service nova] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:07:30.946395 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67650c1c-dc41-4886-95e4-99f8065dc5f8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:07:30.948469 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-67650c1c-dc41-4886-95e4-99f8065dc5f8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:07:30.961748 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67650c1c-dc41-4886-95e4-99f8065dc5f8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:07:30.963381 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67650c1c-dc41-4886-95e4-99f8065dc5f8 service nova] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:07:30.976620 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1306/2600] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 15 18:07:30 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 70 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 15 18:07:34.866302 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97fa830-0762-4439-8fec-6710b0441b0c service neutron] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:07:34.882524 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97fa830-0762-4439-8fec-6710b0441b0c service neutron] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:07:34.894169 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7b0aa7-aef7-471d-ae81-f7c5d929802c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe2244818e4d4dca9c424cd078653e6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1213c0d1b584404ba3998e136f166e89', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:07:34.895453 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7b0aa7-aef7-471d-ae81-f7c5d929802c service nova] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:07:34.895976 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7b0aa7-aef7-471d-ae81-f7c5d929802c service nova] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:07:34.896613 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7b0aa7-aef7-471d-ae81-f7c5d929802c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:07:34.899262 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-0b7b0aa7-aef7-471d-ae81-f7c5d929802c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:07:34.922412 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7b0aa7-aef7-471d-ae81-f7c5d929802c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:07:34.924988 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7b0aa7-aef7-471d-ae81-f7c5d929802c service nova] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:07:34.944827 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1295/2601] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 15 18:07:34 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 79 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 18:07:38.753068 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67650c1c-dc41-4886-95e4-99f8065dc5f8 service nova] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:07:38.757598 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67650c1c-dc41-4886-95e4-99f8065dc5f8 service nova] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:07:38.763903 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e297809c-9aeb-42b9-8fab-6a2bafe2d993 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe2244818e4d4dca9c424cd078653e6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1213c0d1b584404ba3998e136f166e89', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:07:38.764523 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e297809c-9aeb-42b9-8fab-6a2bafe2d993 service nova] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:07:38.764798 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e297809c-9aeb-42b9-8fab-6a2bafe2d993 service nova] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:07:38.765069 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e297809c-9aeb-42b9-8fab-6a2bafe2d993 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:07:38.766874 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-e297809c-9aeb-42b9-8fab-6a2bafe2d993 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:07:38.786196 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e297809c-9aeb-42b9-8fab-6a2bafe2d993 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:07:38.787858 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e297809c-9aeb-42b9-8fab-6a2bafe2d993 service nova] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:07:38.799946 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1307/2602] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 15 18:07:38 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 18:07:44.935437 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:INSERT=3,keystone:SELECT=81 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 18:07:48.794844 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=25 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 18:08:01.767570 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea050b8-a180-4822-abf2-05a3aab1c417 None None] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:08:01.768143 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea050b8-a180-4822-abf2-05a3aab1c417 None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:08:01.768143 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea050b8-a180-4822-abf2-05a3aab1c417 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:08:01.790263 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.auth.core [None req-7ea050b8-a180-4822-abf2-05a3aab1c417 None None] MFA Rules not processed for user `d899ec4fcbeb4de382c7f0a779ca8ed5`. Rule list: `[]` (Enabled: `True`). {{(pid=81592) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 18:08:01.791789 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-7ea050b8-a180-4822-abf2-05a3aab1c417 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:08:01.852999 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1296/2603] 10.222.0.25 () {58 vars in 1009 bytes} [Thu Sep 15 18:08:01 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 18:08:01.907671 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e297809c-9aeb-42b9-8fab-6a2bafe2d993 service nova] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:08:01.910009 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-e297809c-9aeb-42b9-8fab-6a2bafe2d993 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:08:01.989224 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e297809c-9aeb-42b9-8fab-6a2bafe2d993 service nova] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:08:01.994315 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec0777d-5f0e-4678-99eb-987e322fe146 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '685f7ad4c6fe4c878d542dddd6d81593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1213c0d1b584404ba3998e136f166e89', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:08:01.994925 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec0777d-5f0e-4678-99eb-987e322fe146 service swift] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:08:01.995207 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec0777d-5f0e-4678-99eb-987e322fe146 service swift] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:08:01.995481 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec0777d-5f0e-4678-99eb-987e322fe146 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:08:02.004023 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec0777d-5f0e-4678-99eb-987e322fe146 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:08:02.005681 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec0777d-5f0e-4678-99eb-987e322fe146 service swift] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:08:02.018621 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1308/2604] 10.222.0.25 () {60 vars in 1384 bytes} [Thu Sep 15 18:08:01 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Sep 15 18:08:11.846070 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=25 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 18:08:12.010811 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=32 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 18:08:15.930197 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77388390-0bfe-4cb2-bb26-45d46f990903 None None] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:08:15.930699 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77388390-0bfe-4cb2-bb26-45d46f990903 None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:08:15.931283 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77388390-0bfe-4cb2-bb26-45d46f990903 None None] PATH_INFO: `/` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:08:15.932159 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1297/2605] 10.222.0.25 () {54 vars in 921 bytes} [Thu Sep 15 18:08:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 18:08:15.937521 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7b2004-348f-4046-a22f-97af7d9a1e1f None None] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:08:15.938048 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7b2004-348f-4046-a22f-97af7d9a1e1f None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:08:15.938155 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7b2004-348f-4046-a22f-97af7d9a1e1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:08:15.959472 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.auth.core [None req-fa7b2004-348f-4046-a22f-97af7d9a1e1f None None] MFA Rules not processed for user `fe2244818e4d4dca9c424cd078653e6a`. Rule list: `[]` (Enabled: `True`). {{(pid=81593) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 18:08:15.960646 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-fa7b2004-348f-4046-a22f-97af7d9a1e1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:08:15.971481 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1309/2606] 10.222.0.25 () {58 vars in 1018 bytes} [Thu Sep 15 18:08:15 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 18:08:15.983694 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77388390-0bfe-4cb2-bb26-45d46f990903 None None] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:08:15.985531 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-77388390-0bfe-4cb2-bb26-45d46f990903 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:08:16.052233 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77388390-0bfe-4cb2-bb26-45d46f990903 None None] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:08:16.056566 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f1c097-2fad-4fab-8c5d-1943365fc5bd service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c194f79928aa4a4d94619c417b4e39e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1213c0d1b584404ba3998e136f166e89', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:08:16.057457 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f1c097-2fad-4fab-8c5d-1943365fc5bd service glance] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:08:16.058031 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f1c097-2fad-4fab-8c5d-1943365fc5bd service glance] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:08:16.058441 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f1c097-2fad-4fab-8c5d-1943365fc5bd service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:08:16.073016 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f1c097-2fad-4fab-8c5d-1943365fc5bd service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:08:16.074763 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f1c097-2fad-4fab-8c5d-1943365fc5bd service glance] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:08:16.086769 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1298/2607] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 15 18:08:15 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 18:08:18.749808 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90d1273-b703-49e1-838b-970aa6215f8e None None] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:08:18.750325 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90d1273-b703-49e1-838b-970aa6215f8e None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:08:18.750451 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90d1273-b703-49e1-838b-970aa6215f8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:08:18.771997 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.auth.core [None req-a90d1273-b703-49e1-838b-970aa6215f8e None None] MFA Rules not processed for user `d899ec4fcbeb4de382c7f0a779ca8ed5`. Rule list: `[]` (Enabled: `True`). {{(pid=81593) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 18:08:18.774017 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-a90d1273-b703-49e1-838b-970aa6215f8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:08:18.783597 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1310/2608] 10.222.0.25 () {58 vars in 1009 bytes} [Thu Sep 15 18:08:18 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 18:08:18.796158 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f1c097-2fad-4fab-8c5d-1943365fc5bd service glance] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:08:18.808635 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f1c097-2fad-4fab-8c5d-1943365fc5bd service glance] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:08:18.814674 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d385d79-6b13-481f-a0fa-b86237d70946 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '685f7ad4c6fe4c878d542dddd6d81593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1213c0d1b584404ba3998e136f166e89', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:08:18.815282 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d385d79-6b13-481f-a0fa-b86237d70946 service swift] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:08:18.815561 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d385d79-6b13-481f-a0fa-b86237d70946 service swift] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:08:18.815856 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d385d79-6b13-481f-a0fa-b86237d70946 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:08:18.824742 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d385d79-6b13-481f-a0fa-b86237d70946 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:08:18.826375 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d385d79-6b13-481f-a0fa-b86237d70946 service swift] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:08:18.834864 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1299/2609] 10.222.0.25 () {60 vars in 1384 bytes} [Thu Sep 15 18:08:18 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 15 18:08:28.764985 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=6 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 18:08:28.831484 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=32 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 18:08:33.777516 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6e8969-0430-4369-9d01-947b5386782a None None] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:08:33.778054 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6e8969-0430-4369-9d01-947b5386782a None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:08:33.778054 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6e8969-0430-4369-9d01-947b5386782a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:08:33.801429 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.auth.core [None req-7c6e8969-0430-4369-9d01-947b5386782a None None] MFA Rules not processed for user `f9e92c9c725e4b76b0422fc6f86d6631`. Rule list: `[]` (Enabled: `True`). {{(pid=81593) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 18:08:33.802628 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-7c6e8969-0430-4369-9d01-947b5386782a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:08:33.810266 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1311/2610] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 15 18:08:33 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 18:08:34.162370 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51497ef1-381e-4fff-8f47-ef3a58ccc4bb None None] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:08:34.162931 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51497ef1-381e-4fff-8f47-ef3a58ccc4bb None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:08:34.163037 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51497ef1-381e-4fff-8f47-ef3a58ccc4bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:08:34.185170 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.auth.core [None req-51497ef1-381e-4fff-8f47-ef3a58ccc4bb None None] MFA Rules not processed for user `d899ec4fcbeb4de382c7f0a779ca8ed5`. Rule list: `[]` (Enabled: `True`). {{(pid=81592) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 18:08:34.186969 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-51497ef1-381e-4fff-8f47-ef3a58ccc4bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:08:34.197010 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1300/2611] 10.222.0.25 () {58 vars in 967 bytes} [Thu Sep 15 18:08:34 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 18:08:34.212810 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6e8969-0430-4369-9d01-947b5386782a None None] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:08:34.228963 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6e8969-0430-4369-9d01-947b5386782a None None] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:08:34.234877 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ec9bd7-5e45-46c2-a737-7c734edf7e8a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '685f7ad4c6fe4c878d542dddd6d81593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1213c0d1b584404ba3998e136f166e89', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:08:34.235956 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ec9bd7-5e45-46c2-a737-7c734edf7e8a service swift] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:08:34.236237 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ec9bd7-5e45-46c2-a737-7c734edf7e8a service swift] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:08:34.236507 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ec9bd7-5e45-46c2-a737-7c734edf7e8a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:08:34.245797 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ec9bd7-5e45-46c2-a737-7c734edf7e8a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:08:34.247439 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ec9bd7-5e45-46c2-a737-7c734edf7e8a service swift] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:08:34.257001 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1312/2612] 10.222.0.25 () {60 vars in 1384 bytes} [Thu Sep 15 18:08:34 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 15 18:08:39.003495 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51497ef1-381e-4fff-8f47-ef3a58ccc4bb None None] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:08:39.005209 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-51497ef1-381e-4fff-8f47-ef3a58ccc4bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:08:39.097157 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51497ef1-381e-4fff-8f47-ef3a58ccc4bb None None] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:08:39.102470 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4d0234-f3e5-4263-b872-f259c5add210 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10af119bd39841ed8163993676230fca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1213c0d1b584404ba3998e136f166e89', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:08:39.103086 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4d0234-f3e5-4263-b872-f259c5add210 service placement] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:08:39.103404 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4d0234-f3e5-4263-b872-f259c5add210 service placement] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:08:39.103744 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4d0234-f3e5-4263-b872-f259c5add210 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:08:39.105733 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-2b4d0234-f3e5-4263-b872-f259c5add210 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:08:39.120194 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b4d0234-f3e5-4263-b872-f259c5add210 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:08:39.122152 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b4d0234-f3e5-4263-b872-f259c5add210 service placement] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:08:39.132570 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1301/2613] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 15 18:08:39 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 15 18:08:42.582277 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ec9bd7-5e45-46c2-a737-7c734edf7e8a service swift] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:08:42.583809 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-67ec9bd7-5e45-46c2-a737-7c734edf7e8a service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:08:42.602388 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ec9bd7-5e45-46c2-a737-7c734edf7e8a service swift] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:08:42.607330 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84d96b2-0814-473a-bb9f-693bc53c6a36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:08:42.607972 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84d96b2-0814-473a-bb9f-693bc53c6a36 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:08:42.608283 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84d96b2-0814-473a-bb9f-693bc53c6a36 admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:08:42.608558 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84d96b2-0814-473a-bb9f-693bc53c6a36 admin admin] PATH_INFO: `/v3/users/efc008db667e47f99a998d08438ddaf1` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:08:42.609770 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84d96b2-0814-473a-bb9f-693bc53c6a36 admin admin] RBAC: Authorizing `identity:delete_user(user_id=efc008db667e47f99a998d08438ddaf1)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:08:42.611764 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84d96b2-0814-473a-bb9f-693bc53c6a36 admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:08:42.664412 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-e84d96b2-0814-473a-bb9f-693bc53c6a36 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'efc008db667e47f99a998d08438ddaf1'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:08:42.673448 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-e84d96b2-0814-473a-bb9f-693bc53c6a36 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'efc008db667e47f99a998d08438ddaf1'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:08:42.674083 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-e84d96b2-0814-473a-bb9f-693bc53c6a36 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'efc008db667e47f99a998d08438ddaf1'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:08:42.674691 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-e84d96b2-0814-473a-bb9f-693bc53c6a36 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'efc008db667e47f99a998d08438ddaf1'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:08:42.683365 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-e84d96b2-0814-473a-bb9f-693bc53c6a36 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'efc008db667e47f99a998d08438ddaf1'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:08:42.701828 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1313/2614] 10.222.0.25 () {58 vars in 1224 bytes} [Thu Sep 15 18:08:42 2022] DELETE /identity/v3/users/efc008db667e47f99a998d08438ddaf1 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 18:08:42.713242 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4d0234-f3e5-4263-b872-f259c5add210 service placement] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:08:42.724125 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4d0234-f3e5-4263-b872-f259c5add210 service placement] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:08:42.776329 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52f83b1-00a7-42a9-b224-aac4c21bb397 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a32274b4781b40fea9f28da8a9bde5ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1213c0d1b584404ba3998e136f166e89', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:08:42.776934 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52f83b1-00a7-42a9-b224-aac4c21bb397 service neutron] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:08:42.777211 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52f83b1-00a7-42a9-b224-aac4c21bb397 service neutron] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:08:42.777509 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52f83b1-00a7-42a9-b224-aac4c21bb397 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:08:42.779281 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-c52f83b1-00a7-42a9-b224-aac4c21bb397 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:08:42.841393 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52f83b1-00a7-42a9-b224-aac4c21bb397 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:08:42.842826 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52f83b1-00a7-42a9-b224-aac4c21bb397 service neutron] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:08:42.853152 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1302/2615] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 15 18:08:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 18:08:43.036978 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84d96b2-0814-473a-bb9f-693bc53c6a36 admin admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:08:43.038520 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-e84d96b2-0814-473a-bb9f-693bc53c6a36 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:08:43.054613 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84d96b2-0814-473a-bb9f-693bc53c6a36 admin admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:08:43.060663 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdaa52af-4329-435e-b7bb-39daae229c14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:08:43.061477 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdaa52af-4329-435e-b7bb-39daae229c14 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:08:43.061912 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdaa52af-4329-435e-b7bb-39daae229c14 admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:08:43.062179 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdaa52af-4329-435e-b7bb-39daae229c14 admin admin] PATH_INFO: `/v3/projects/a11adea5f21c48eb91e2c8f88f8c3349` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:08:43.063589 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdaa52af-4329-435e-b7bb-39daae229c14 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a11adea5f21c48eb91e2c8f88f8c3349)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:08:43.066243 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdaa52af-4329-435e-b7bb-39daae229c14 admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:08:43.119599 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-cdaa52af-4329-435e-b7bb-39daae229c14 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a11adea5f21c48eb91e2c8f88f8c3349', 'request_id': 'req-cdaa52af-4329-435e-b7bb-39daae229c14'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:08:43.126225 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-cdaa52af-4329-435e-b7bb-39daae229c14 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a11adea5f21c48eb91e2c8f88f8c3349', 'request_id': 'req-cdaa52af-4329-435e-b7bb-39daae229c14'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:08:43.135270 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-cdaa52af-4329-435e-b7bb-39daae229c14 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a11adea5f21c48eb91e2c8f88f8c3349', 'request_id': 'req-cdaa52af-4329-435e-b7bb-39daae229c14'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:08:43.147217 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-cdaa52af-4329-435e-b7bb-39daae229c14 admin admin] The token cache is being invalidate because project a11adea5f21c48eb91e2c8f88f8c3349 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81593) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 18:08:43.147563 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-cdaa52af-4329-435e-b7bb-39daae229c14 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:08:43.148216 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-cdaa52af-4329-435e-b7bb-39daae229c14 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:08:43.150285 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1314/2616] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Sep 15 18:08:43 2022] DELETE /identity/v3/projects/a11adea5f21c48eb91e2c8f88f8c3349 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 18:08:43.155552 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52f83b1-00a7-42a9-b224-aac4c21bb397 service neutron] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:08:43.172903 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52f83b1-00a7-42a9-b224-aac4c21bb397 service neutron] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:08:43.226524 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 18:08:43.276764 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c030483-d71a-441f-b61f-497050b8de78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:08:43.278057 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c030483-d71a-441f-b61f-497050b8de78 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:08:43.278467 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c030483-d71a-441f-b61f-497050b8de78 admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:08:43.278925 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c030483-d71a-441f-b61f-497050b8de78 admin admin] PATH_INFO: `/v3/users/e7ddb90f8cf5486d872a156df1f29ee5` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:08:43.280506 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c030483-d71a-441f-b61f-497050b8de78 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e7ddb90f8cf5486d872a156df1f29ee5)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:08:43.284673 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c030483-d71a-441f-b61f-497050b8de78 admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:08:43.359306 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-9c030483-d71a-441f-b61f-497050b8de78 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e7ddb90f8cf5486d872a156df1f29ee5'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:08:43.368529 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-9c030483-d71a-441f-b61f-497050b8de78 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e7ddb90f8cf5486d872a156df1f29ee5'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:08:43.369216 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-9c030483-d71a-441f-b61f-497050b8de78 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e7ddb90f8cf5486d872a156df1f29ee5'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:08:43.369889 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-9c030483-d71a-441f-b61f-497050b8de78 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e7ddb90f8cf5486d872a156df1f29ee5'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:08:43.378244 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-9c030483-d71a-441f-b61f-497050b8de78 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e7ddb90f8cf5486d872a156df1f29ee5'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:08:43.398087 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1303/2617] 10.222.0.25 () {58 vars in 1224 bytes} [Thu Sep 15 18:08:43 2022] DELETE /identity/v3/users/e7ddb90f8cf5486d872a156df1f29ee5 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 18:08:43.646728 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdaa52af-4329-435e-b7bb-39daae229c14 admin admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:08:43.648205 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-cdaa52af-4329-435e-b7bb-39daae229c14 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:08:43.662082 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdaa52af-4329-435e-b7bb-39daae229c14 admin admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:08:43.701614 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 18:08:43.729188 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2192c9b4-cecb-4798-be9e-7d7d317679c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:08:43.729775 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2192c9b4-cecb-4798-be9e-7d7d317679c7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:08:43.730060 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2192c9b4-cecb-4798-be9e-7d7d317679c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:08:43.730332 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2192c9b4-cecb-4798-be9e-7d7d317679c7 admin admin] PATH_INFO: `/v3/projects/e9edbab6d90c4bc5b2e38b4e7d46818f` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:08:43.731459 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2192c9b4-cecb-4798-be9e-7d7d317679c7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e9edbab6d90c4bc5b2e38b4e7d46818f)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:08:43.733399 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2192c9b4-cecb-4798-be9e-7d7d317679c7 admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:08:43.780945 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-2192c9b4-cecb-4798-be9e-7d7d317679c7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e9edbab6d90c4bc5b2e38b4e7d46818f', 'request_id': 'req-2192c9b4-cecb-4798-be9e-7d7d317679c7'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:08:43.786628 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-2192c9b4-cecb-4798-be9e-7d7d317679c7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e9edbab6d90c4bc5b2e38b4e7d46818f', 'request_id': 'req-2192c9b4-cecb-4798-be9e-7d7d317679c7'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:08:43.794859 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-2192c9b4-cecb-4798-be9e-7d7d317679c7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e9edbab6d90c4bc5b2e38b4e7d46818f', 'request_id': 'req-2192c9b4-cecb-4798-be9e-7d7d317679c7'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:08:43.806320 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-2192c9b4-cecb-4798-be9e-7d7d317679c7 admin admin] The token cache is being invalidate because project e9edbab6d90c4bc5b2e38b4e7d46818f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81593) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 18:08:43.806736 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-2192c9b4-cecb-4798-be9e-7d7d317679c7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:08:43.807381 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-2192c9b4-cecb-4798-be9e-7d7d317679c7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:08:43.808860 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1315/2618] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Sep 15 18:08:43 2022] DELETE /identity/v3/projects/e9edbab6d90c4bc5b2e38b4e7d46818f => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 18:08:53.394283 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=38,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 18:08:53.803098 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=35,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 18:09:16.719622 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528a149e-e6f1-48a0-8ca5-35f1e1652913 None None] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:09:16.720238 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528a149e-e6f1-48a0-8ca5-35f1e1652913 None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:09:16.720238 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528a149e-e6f1-48a0-8ca5-35f1e1652913 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:09:16.740030 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.auth.core [None req-528a149e-e6f1-48a0-8ca5-35f1e1652913 None None] MFA Rules not processed for user `88fc4ef6c85141db8b552441da6c5af1`. Rule list: `[]` (Enabled: `True`). {{(pid=81592) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 18:09:16.741246 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-528a149e-e6f1-48a0-8ca5-35f1e1652913 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:09:16.804035 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1304/2619] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 15 18:09:16 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 18:09:26.797444 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=25 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 18:09:37.280680 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8697e6-96a1-4d82-9519-62d64921e52f None None] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:09:37.281359 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8697e6-96a1-4d82-9519-62d64921e52f None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:09:37.281359 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8697e6-96a1-4d82-9519-62d64921e52f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:09:37.302731 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.auth.core [None req-df8697e6-96a1-4d82-9519-62d64921e52f None None] MFA Rules not processed for user `f9e92c9c725e4b76b0422fc6f86d6631`. Rule list: `[]` (Enabled: `True`). {{(pid=81593) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 18:09:37.304080 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-df8697e6-96a1-4d82-9519-62d64921e52f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:09:37.361888 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1316/2620] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 15 18:09:37 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 18:09:37.693869 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528a149e-e6f1-48a0-8ca5-35f1e1652913 None None] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:09:37.695890 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-528a149e-e6f1-48a0-8ca5-35f1e1652913 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:09:37.755734 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528a149e-e6f1-48a0-8ca5-35f1e1652913 None None] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:09:37.759810 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a196d21-025c-46a7-9111-9f74236506e8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a32274b4781b40fea9f28da8a9bde5ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1213c0d1b584404ba3998e136f166e89', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:09:37.760424 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a196d21-025c-46a7-9111-9f74236506e8 service neutron] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:09:37.760700 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a196d21-025c-46a7-9111-9f74236506e8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:09:37.760971 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a196d21-025c-46a7-9111-9f74236506e8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:09:37.763005 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-5a196d21-025c-46a7-9111-9f74236506e8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:09:37.773683 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a196d21-025c-46a7-9111-9f74236506e8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:09:37.775141 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a196d21-025c-46a7-9111-9f74236506e8 service neutron] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:09:37.783731 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1305/2621] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 15 18:09:37 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 18:09:47.354852 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=25 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 18:09:47.780249 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=26 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 18:10:24.724585 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d900d0-c4e6-4ad8-b1e6-9110f16d367f None None] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:10:24.725408 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d900d0-c4e6-4ad8-b1e6-9110f16d367f None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:10:24.725408 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d900d0-c4e6-4ad8-b1e6-9110f16d367f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:10:24.776034 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.auth.core [None req-64d900d0-c4e6-4ad8-b1e6-9110f16d367f None None] MFA Rules not processed for user `d899ec4fcbeb4de382c7f0a779ca8ed5`. Rule list: `[]` (Enabled: `True`). {{(pid=81593) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 18:10:24.777409 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-64d900d0-c4e6-4ad8-b1e6-9110f16d367f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:10:24.865602 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1317/2622] 10.222.0.25 () {58 vars in 1009 bytes} [Thu Sep 15 18:10:24 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 18:10:24.917564 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a196d21-025c-46a7-9111-9f74236506e8 service neutron] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:10:24.919245 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-5a196d21-025c-46a7-9111-9f74236506e8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:10:25.040371 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a196d21-025c-46a7-9111-9f74236506e8 service neutron] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:10:25.045490 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acbfc1d9-4524-4b1c-8087-682bc28f529f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '685f7ad4c6fe4c878d542dddd6d81593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1213c0d1b584404ba3998e136f166e89', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:10:25.046098 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbfc1d9-4524-4b1c-8087-682bc28f529f service swift] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:10:25.046378 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbfc1d9-4524-4b1c-8087-682bc28f529f service swift] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:10:25.046649 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbfc1d9-4524-4b1c-8087-682bc28f529f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:10:25.055169 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acbfc1d9-4524-4b1c-8087-682bc28f529f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:10:25.056843 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acbfc1d9-4524-4b1c-8087-682bc28f529f service swift] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:10:25.065111 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1306/2623] 10.222.0.25 () {60 vars in 1384 bytes} [Thu Sep 15 18:10:24 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 15 18:10:34.873968 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=45 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 18:10:35.061767 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=54 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 18:10:37.975624 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae6f89c-c605-4d6d-a77a-b236ffbdaf05 None None] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:10:37.976149 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae6f89c-c605-4d6d-a77a-b236ffbdaf05 None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:10:37.976286 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae6f89c-c605-4d6d-a77a-b236ffbdaf05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:10:37.996317 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.auth.core [None req-2ae6f89c-c605-4d6d-a77a-b236ffbdaf05 None None] MFA Rules not processed for user `f9e92c9c725e4b76b0422fc6f86d6631`. Rule list: `[]` (Enabled: `True`). {{(pid=81593) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 18:10:37.997571 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-2ae6f89c-c605-4d6d-a77a-b236ffbdaf05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:10:38.006849 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1318/2624] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 15 18:10:37 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 18:10:39.348280 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a2c54b-b8d3-4c22-a92a-e17532faaf28 None None] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:10:39.348830 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a2c54b-b8d3-4c22-a92a-e17532faaf28 None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:10:39.349026 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a2c54b-b8d3-4c22-a92a-e17532faaf28 None None] PATH_INFO: `/` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:10:39.350472 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1307/2625] 10.222.0.25 () {54 vars in 921 bytes} [Thu Sep 15 18:10:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 18:10:39.357105 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e5a4d0-c2a3-46b1-a123-e1afba29dc1f None None] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:10:39.357546 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e5a4d0-c2a3-46b1-a123-e1afba29dc1f None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:10:39.357644 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e5a4d0-c2a3-46b1-a123-e1afba29dc1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:10:39.401119 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.auth.core [None req-39e5a4d0-c2a3-46b1-a123-e1afba29dc1f None None] MFA Rules not processed for user `fe2244818e4d4dca9c424cd078653e6a`. Rule list: `[]` (Enabled: `True`). {{(pid=81593) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 18:10:39.402374 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-39e5a4d0-c2a3-46b1-a123-e1afba29dc1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:10:39.496724 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1319/2626] 10.222.0.25 () {58 vars in 1018 bytes} [Thu Sep 15 18:10:39 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 18:10:39.510535 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a2c54b-b8d3-4c22-a92a-e17532faaf28 None None] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:10:39.512263 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-b8a2c54b-b8d3-4c22-a92a-e17532faaf28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:10:39.582237 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a2c54b-b8d3-4c22-a92a-e17532faaf28 None None] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:10:39.585806 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321a7718-78b3-4331-a658-a25f20f5f0cb service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c194f79928aa4a4d94619c417b4e39e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1213c0d1b584404ba3998e136f166e89', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:10:39.586434 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321a7718-78b3-4331-a658-a25f20f5f0cb service glance] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:10:39.586709 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321a7718-78b3-4331-a658-a25f20f5f0cb service glance] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:10:39.587861 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321a7718-78b3-4331-a658-a25f20f5f0cb service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:10:39.604036 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-321a7718-78b3-4331-a658-a25f20f5f0cb service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:10:39.605494 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-321a7718-78b3-4331-a658-a25f20f5f0cb service glance] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:10:39.617444 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1308/2627] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 15 18:10:39 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 15 18:10:39.689799 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a64539d-020e-4dfa-a3e5-e2f9c02cae1b None None] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:10:39.690013 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a64539d-020e-4dfa-a3e5-e2f9c02cae1b None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:10:39.690270 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a64539d-020e-4dfa-a3e5-e2f9c02cae1b None None] PATH_INFO: `/` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:10:39.691680 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1320/2628] 10.222.0.25 () {54 vars in 921 bytes} [Thu Sep 15 18:10:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 18:10:39.696526 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54660660-99d8-4a57-893d-3969e9383eff None None] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:10:39.696809 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54660660-99d8-4a57-893d-3969e9383eff None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:10:39.697081 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54660660-99d8-4a57-893d-3969e9383eff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:10:39.733486 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.auth.core [None req-54660660-99d8-4a57-893d-3969e9383eff None None] MFA Rules not processed for user `a32274b4781b40fea9f28da8a9bde5ca`. Rule list: `[]` (Enabled: `True`). {{(pid=81592) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 18:10:39.734713 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-54660660-99d8-4a57-893d-3969e9383eff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:10:39.751232 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1309/2629] 10.222.0.25 () {58 vars in 1018 bytes} [Thu Sep 15 18:10:39 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 18:10:39.763390 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a64539d-020e-4dfa-a3e5-e2f9c02cae1b None None] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:10:39.765156 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-2a64539d-020e-4dfa-a3e5-e2f9c02cae1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:10:39.782908 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a64539d-020e-4dfa-a3e5-e2f9c02cae1b None None] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:10:39.787219 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378adcda-635d-4ca6-b737-2cdd4613dce1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a32274b4781b40fea9f28da8a9bde5ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1213c0d1b584404ba3998e136f166e89', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:10:39.787833 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378adcda-635d-4ca6-b737-2cdd4613dce1 service neutron] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:10:39.788116 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378adcda-635d-4ca6-b737-2cdd4613dce1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:10:39.788397 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378adcda-635d-4ca6-b737-2cdd4613dce1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:10:39.796455 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378adcda-635d-4ca6-b737-2cdd4613dce1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:10:39.797958 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378adcda-635d-4ca6-b737-2cdd4613dce1 service neutron] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:10:39.806014 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1321/2630] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 15 18:10:39 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 18:10:39.890104 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410a6809-8f3b-4583-a161-6406e0d367b7 None None] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:10:39.890389 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410a6809-8f3b-4583-a161-6406e0d367b7 None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:10:39.890661 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410a6809-8f3b-4583-a161-6406e0d367b7 None None] PATH_INFO: `/` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:10:39.891994 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1310/2631] 10.222.0.25 () {54 vars in 921 bytes} [Thu Sep 15 18:10:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 18:10:39.898620 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cddf36-deaa-4d85-878c-db3fbb49abcd None None] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:10:39.899220 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cddf36-deaa-4d85-878c-db3fbb49abcd None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:10:39.899446 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cddf36-deaa-4d85-878c-db3fbb49abcd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:10:39.929163 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.auth.core [None req-06cddf36-deaa-4d85-878c-db3fbb49abcd None None] MFA Rules not processed for user `fe2244818e4d4dca9c424cd078653e6a`. Rule list: `[]` (Enabled: `True`). {{(pid=81593) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 18:10:39.931435 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-06cddf36-deaa-4d85-878c-db3fbb49abcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:10:39.949891 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1322/2632] 10.222.0.25 () {58 vars in 1018 bytes} [Thu Sep 15 18:10:39 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 18:10:39.967676 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410a6809-8f3b-4583-a161-6406e0d367b7 None None] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:10:39.982368 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410a6809-8f3b-4583-a161-6406e0d367b7 None None] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:10:39.985989 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93bb05a-43a9-42f9-918f-89fd1550ba2a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a32274b4781b40fea9f28da8a9bde5ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1213c0d1b584404ba3998e136f166e89', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:10:39.986588 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93bb05a-43a9-42f9-918f-89fd1550ba2a service neutron] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:10:39.986861 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93bb05a-43a9-42f9-918f-89fd1550ba2a service neutron] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:10:39.987126 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93bb05a-43a9-42f9-918f-89fd1550ba2a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:10:39.998176 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e93bb05a-43a9-42f9-918f-89fd1550ba2a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:10:39.999599 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e93bb05a-43a9-42f9-918f-89fd1550ba2a service neutron] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:10:40.011554 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1311/2633] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 15 18:10:39 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 15 18:10:42.722770 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c024040-777f-4c0d-8c62-6d36fbe517b7 None None] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:10:42.723274 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c024040-777f-4c0d-8c62-6d36fbe517b7 None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:10:42.723366 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c024040-777f-4c0d-8c62-6d36fbe517b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:10:42.744504 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.auth.core [None req-5c024040-777f-4c0d-8c62-6d36fbe517b7 None None] MFA Rules not processed for user `d899ec4fcbeb4de382c7f0a779ca8ed5`. Rule list: `[]` (Enabled: `True`). {{(pid=81593) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 18:10:42.745735 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-5c024040-777f-4c0d-8c62-6d36fbe517b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:10:42.752739 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1323/2634] 10.222.0.25 () {58 vars in 1009 bytes} [Thu Sep 15 18:10:42 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 18:10:42.765881 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93bb05a-43a9-42f9-918f-89fd1550ba2a service neutron] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:10:42.776983 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93bb05a-43a9-42f9-918f-89fd1550ba2a service neutron] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:10:42.782354 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb683f2-2a58-4952-8e66-a7ac406b1769 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '685f7ad4c6fe4c878d542dddd6d81593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1213c0d1b584404ba3998e136f166e89', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:10:42.783051 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb683f2-2a58-4952-8e66-a7ac406b1769 service swift] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:10:42.783320 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb683f2-2a58-4952-8e66-a7ac406b1769 service swift] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:10:42.783584 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb683f2-2a58-4952-8e66-a7ac406b1769 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:10:42.792129 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb683f2-2a58-4952-8e66-a7ac406b1769 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:10:42.793718 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb683f2-2a58-4952-8e66-a7ac406b1769 service swift] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:10:42.803169 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1312/2635] 10.222.0.25 () {60 vars in 1384 bytes} [Thu Sep 15 18:10:42 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 15 18:10:52.738482 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=59 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 18:10:52.799106 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=50 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 18:10:59.704840 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8d4669-7b87-4bdd-82c2-b3abf102c90f None None] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:10:59.705340 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8d4669-7b87-4bdd-82c2-b3abf102c90f None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:10:59.705439 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8d4669-7b87-4bdd-82c2-b3abf102c90f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:10:59.724998 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.auth.core [None req-6a8d4669-7b87-4bdd-82c2-b3abf102c90f None None] MFA Rules not processed for user `d899ec4fcbeb4de382c7f0a779ca8ed5`. Rule list: `[]` (Enabled: `True`). {{(pid=81593) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 18:10:59.726260 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-6a8d4669-7b87-4bdd-82c2-b3abf102c90f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:10:59.735248 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1324/2636] 10.222.0.25 () {58 vars in 967 bytes} [Thu Sep 15 18:10:59 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 18:10:59.753434 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb683f2-2a58-4952-8e66-a7ac406b1769 service swift] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:10:59.759003 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb683f2-2a58-4952-8e66-a7ac406b1769 service swift] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:10:59.763991 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69481d6e-0f89-449d-9ce6-33971cd358a1 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '685f7ad4c6fe4c878d542dddd6d81593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1213c0d1b584404ba3998e136f166e89', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:10:59.764615 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69481d6e-0f89-449d-9ce6-33971cd358a1 service swift] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:10:59.764893 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69481d6e-0f89-449d-9ce6-33971cd358a1 service swift] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:10:59.765164 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69481d6e-0f89-449d-9ce6-33971cd358a1 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:10:59.774462 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69481d6e-0f89-449d-9ce6-33971cd358a1 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:10:59.776038 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69481d6e-0f89-449d-9ce6-33971cd358a1 service swift] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:10:59.784888 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1313/2637] 10.222.0.25 () {60 vars in 1384 bytes} [Thu Sep 15 18:10:59 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Sep 15 18:11:05.375477 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8d4669-7b87-4bdd-82c2-b3abf102c90f None None] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:11:05.376865 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-6a8d4669-7b87-4bdd-82c2-b3abf102c90f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:11:05.466938 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8d4669-7b87-4bdd-82c2-b3abf102c90f None None] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:11:05.472627 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c279f360-b45d-48dd-bdfc-f37ad5a3e3b5 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10af119bd39841ed8163993676230fca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1213c0d1b584404ba3998e136f166e89', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:11:05.473234 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c279f360-b45d-48dd-bdfc-f37ad5a3e3b5 service placement] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:11:05.473550 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c279f360-b45d-48dd-bdfc-f37ad5a3e3b5 service placement] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:11:05.473827 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c279f360-b45d-48dd-bdfc-f37ad5a3e3b5 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:11:05.475576 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-c279f360-b45d-48dd-bdfc-f37ad5a3e3b5 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:11:05.487042 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c279f360-b45d-48dd-bdfc-f37ad5a3e3b5 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:11:05.488630 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c279f360-b45d-48dd-bdfc-f37ad5a3e3b5 service placement] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:11:05.498400 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1325/2638] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 15 18:11:05 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 18:11:09.780874 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=6 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 18:11:15.494312 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=44 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 18:11:40.906286 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69481d6e-0f89-449d-9ce6-33971cd358a1 service swift] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:11:40.907706 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-69481d6e-0f89-449d-9ce6-33971cd358a1 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:11:40.995665 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69481d6e-0f89-449d-9ce6-33971cd358a1 service swift] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:11:40.999602 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a87f832-a041-4126-b829-2bcbadb3f168 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b232e7a841145ba93c6d8462ccb751a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1213c0d1b584404ba3998e136f166e89', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:11:41.000215 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a87f832-a041-4126-b829-2bcbadb3f168 service cinder] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:11:41.000491 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a87f832-a041-4126-b829-2bcbadb3f168 service cinder] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:11:41.000757 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a87f832-a041-4126-b829-2bcbadb3f168 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:11:41.003215 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-2a87f832-a041-4126-b829-2bcbadb3f168 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:11:41.014724 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a87f832-a041-4126-b829-2bcbadb3f168 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:11:41.016165 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a87f832-a041-4126-b829-2bcbadb3f168 service cinder] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:11:41.026403 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1314/2639] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 15 18:11:40 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 18:11:41.132974 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c279f360-b45d-48dd-bdfc-f37ad5a3e3b5 service placement] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:11:41.142504 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c279f360-b45d-48dd-bdfc-f37ad5a3e3b5 service placement] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:11:41.146092 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f112c83-6e5b-43a3-a5de-5524abf4aecf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a32274b4781b40fea9f28da8a9bde5ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1213c0d1b584404ba3998e136f166e89', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:11:41.146692 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f112c83-6e5b-43a3-a5de-5524abf4aecf service neutron] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:11:41.146971 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f112c83-6e5b-43a3-a5de-5524abf4aecf service neutron] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:11:41.147245 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f112c83-6e5b-43a3-a5de-5524abf4aecf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:11:41.149126 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-2f112c83-6e5b-43a3-a5de-5524abf4aecf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:11:41.257619 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f112c83-6e5b-43a3-a5de-5524abf4aecf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:11:41.260013 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f112c83-6e5b-43a3-a5de-5524abf4aecf service neutron] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:11:41.286408 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1326/2640] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 15 18:11:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 18:11:45.019671 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a87f832-a041-4126-b829-2bcbadb3f168 service cinder] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:11:45.023649 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-2a87f832-a041-4126-b829-2bcbadb3f168 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:11:45.054000 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a87f832-a041-4126-b829-2bcbadb3f168 service cinder] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:11:45.061132 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa55b0d-d39d-47f4-bfce-983b4898981e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:11:45.063186 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa55b0d-d39d-47f4-bfce-983b4898981e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:11:45.063734 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa55b0d-d39d-47f4-bfce-983b4898981e admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:11:45.064192 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa55b0d-d39d-47f4-bfce-983b4898981e admin admin] PATH_INFO: `/v3/users/88fc4ef6c85141db8b552441da6c5af1` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:11:45.065974 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa55b0d-d39d-47f4-bfce-983b4898981e admin admin] RBAC: Authorizing `identity:delete_user(user_id=88fc4ef6c85141db8b552441da6c5af1)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:11:45.068808 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa55b0d-d39d-47f4-bfce-983b4898981e admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:11:45.138502 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-4aa55b0d-d39d-47f4-bfce-983b4898981e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '88fc4ef6c85141db8b552441da6c5af1'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:11:45.150538 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-4aa55b0d-d39d-47f4-bfce-983b4898981e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '88fc4ef6c85141db8b552441da6c5af1'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:11:45.151692 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-4aa55b0d-d39d-47f4-bfce-983b4898981e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '88fc4ef6c85141db8b552441da6c5af1'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:11:45.152809 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-4aa55b0d-d39d-47f4-bfce-983b4898981e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '88fc4ef6c85141db8b552441da6c5af1'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:11:45.163542 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-4aa55b0d-d39d-47f4-bfce-983b4898981e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '88fc4ef6c85141db8b552441da6c5af1'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:11:45.188165 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1315/2641] 10.222.0.25 () {58 vars in 1224 bytes} [Thu Sep 15 18:11:45 2022] DELETE /identity/v3/users/88fc4ef6c85141db8b552441da6c5af1 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 18:11:45.375462 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f112c83-6e5b-43a3-a5de-5524abf4aecf service neutron] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:11:45.388040 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f112c83-6e5b-43a3-a5de-5524abf4aecf service neutron] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:11:45.450936 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b22590-2d5c-4810-9dd7-fae7c5adbf9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:11:45.451628 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b22590-2d5c-4810-9dd7-fae7c5adbf9c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:11:45.451904 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b22590-2d5c-4810-9dd7-fae7c5adbf9c admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:11:45.452171 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b22590-2d5c-4810-9dd7-fae7c5adbf9c admin admin] PATH_INFO: `/v3/projects/dda6be1ed33a44979aae8cd74d60cb93` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:11:45.453287 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b22590-2d5c-4810-9dd7-fae7c5adbf9c admin admin] RBAC: Authorizing `identity:delete_project(project_id=dda6be1ed33a44979aae8cd74d60cb93)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:11:45.455231 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b22590-2d5c-4810-9dd7-fae7c5adbf9c admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:11:45.502602 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-f0b22590-2d5c-4810-9dd7-fae7c5adbf9c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dda6be1ed33a44979aae8cd74d60cb93', 'request_id': 'req-f0b22590-2d5c-4810-9dd7-fae7c5adbf9c'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:11:45.508476 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-f0b22590-2d5c-4810-9dd7-fae7c5adbf9c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dda6be1ed33a44979aae8cd74d60cb93', 'request_id': 'req-f0b22590-2d5c-4810-9dd7-fae7c5adbf9c'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:11:45.517591 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-f0b22590-2d5c-4810-9dd7-fae7c5adbf9c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dda6be1ed33a44979aae8cd74d60cb93', 'request_id': 'req-f0b22590-2d5c-4810-9dd7-fae7c5adbf9c'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:11:45.520771 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 18:11:45.532833 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-f0b22590-2d5c-4810-9dd7-fae7c5adbf9c admin admin] The token cache is being invalidate because project dda6be1ed33a44979aae8cd74d60cb93 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81593) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 18:11:45.533126 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-f0b22590-2d5c-4810-9dd7-fae7c5adbf9c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:11:45.533820 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-f0b22590-2d5c-4810-9dd7-fae7c5adbf9c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:11:45.535520 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1327/2642] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Sep 15 18:11:45 2022] DELETE /identity/v3/projects/dda6be1ed33a44979aae8cd74d60cb93 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 18:11:45.540168 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff184678-02b0-4781-b9ad-4de11b078811 None None] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:11:45.540393 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff184678-02b0-4781-b9ad-4de11b078811 None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:11:45.540664 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff184678-02b0-4781-b9ad-4de11b078811 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:11:45.596676 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.auth.core [None req-ff184678-02b0-4781-b9ad-4de11b078811 None None] MFA Rules not processed for user `5cfa58ef86774ab7800bf91930bf6028`. Rule list: `[]` (Enabled: `True`). {{(pid=81592) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 18:11:45.598359 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-ff184678-02b0-4781-b9ad-4de11b078811 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:11:45.630897 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 18:11:45.685471 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1316/2643] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 15 18:11:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 18:11:45.688237 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e372a76b-606f-40ce-8a69-57ff3192a480 None None] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:11:45.688537 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e372a76b-606f-40ce-8a69-57ff3192a480 None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:11:45.688850 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e372a76b-606f-40ce-8a69-57ff3192a480 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:11:45.722801 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.auth.core [None req-e372a76b-606f-40ce-8a69-57ff3192a480 None None] MFA Rules not processed for user `5cfa58ef86774ab7800bf91930bf6028`. Rule list: `[]` (Enabled: `True`). {{(pid=81593) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 18:11:45.724194 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-e372a76b-606f-40ce-8a69-57ff3192a480 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:11:45.734462 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1328/2644] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 15 18:11:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 18:11:45.739443 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff184678-02b0-4781-b9ad-4de11b078811 None None] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:11:45.750527 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff184678-02b0-4781-b9ad-4de11b078811 None None] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:11:45.755674 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d683d44-9091-45f8-8fa0-5493ffc68379 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:11:45.756286 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d683d44-9091-45f8-8fa0-5493ffc68379 admin admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:11:45.756561 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d683d44-9091-45f8-8fa0-5493ffc68379 admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:11:45.756827 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d683d44-9091-45f8-8fa0-5493ffc68379 admin admin] PATH_INFO: `/v3/domains` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:11:45.757509 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d683d44-9091-45f8-8fa0-5493ffc68379 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81592) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 18:11:45.758047 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d683d44-9091-45f8-8fa0-5493ffc68379 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:11:45.759744 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d683d44-9091-45f8-8fa0-5493ffc68379 admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:11:45.777809 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1317/2645] 10.222.0.25 () {58 vars in 1153 bytes} [Thu Sep 15 18:11:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 18:11:45.782318 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e372a76b-606f-40ce-8a69-57ff3192a480 None None] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:11:45.792575 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e372a76b-606f-40ce-8a69-57ff3192a480 None None] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:11:45.798086 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e287652-89ba-4611-9289-9c9c1c2dff39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:11:45.798943 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e287652-89ba-4611-9289-9c9c1c2dff39 admin admin] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:11:45.799223 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e287652-89ba-4611-9289-9c9c1c2dff39 admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:11:45.799533 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e287652-89ba-4611-9289-9c9c1c2dff39 admin admin] PATH_INFO: `/v3/projects` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:11:45.800594 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e287652-89ba-4611-9289-9c9c1c2dff39 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:11:45.802261 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e287652-89ba-4611-9289-9c9c1c2dff39 admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:11:45.849129 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1329/2646] 10.222.0.25 () {60 vars in 1153 bytes} [Thu Sep 15 18:11:45 2022] POST /identity/v3/projects => generated 373 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 18:11:45.850175 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d683d44-9091-45f8-8fa0-5493ffc68379 admin admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:11:45.861930 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d683d44-9091-45f8-8fa0-5493ffc68379 admin admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:11:45.936268 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c805b393-7fa8-4589-97d8-68f0848c557a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:11:45.937072 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c805b393-7fa8-4589-97d8-68f0848c557a admin admin] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:11:45.937390 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c805b393-7fa8-4589-97d8-68f0848c557a admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:11:45.937811 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c805b393-7fa8-4589-97d8-68f0848c557a admin admin] PATH_INFO: `/v3/users` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:11:45.938534 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c805b393-7fa8-4589-97d8-68f0848c557a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:11:45.940504 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c805b393-7fa8-4589-97d8-68f0848c557a admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:11:45.973346 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1318/2647] 10.222.0.25 () {60 vars in 1144 bytes} [Thu Sep 15 18:11:45 2022] POST /identity/v3/users => generated 287 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 18:11:45.978034 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e287652-89ba-4611-9289-9c9c1c2dff39 admin admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:11:45.989684 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e287652-89ba-4611-9289-9c9c1c2dff39 admin admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:11:45.994728 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1aa634-1089-4809-8b21-00d84a2171fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:11:45.995733 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1aa634-1089-4809-8b21-00d84a2171fd admin admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:11:45.996184 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1aa634-1089-4809-8b21-00d84a2171fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:11:45.996627 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1aa634-1089-4809-8b21-00d84a2171fd admin admin] PATH_INFO: `/v3/roles` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:11:45.997710 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e1aa634-1089-4809-8b21-00d84a2171fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:11:46.000266 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e1aa634-1089-4809-8b21-00d84a2171fd admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:11:46.018911 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1330/2648] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Sep 15 18:11:45 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 18:11:46.023104 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c805b393-7fa8-4589-97d8-68f0848c557a admin admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:11:46.036754 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c805b393-7fa8-4589-97d8-68f0848c557a admin admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:11:46.052664 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ccc903-293d-4278-91c9-91f10ac14008 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:11:46.053578 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ccc903-293d-4278-91c9-91f10ac14008 admin admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:11:46.054040 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ccc903-293d-4278-91c9-91f10ac14008 admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:11:46.054635 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ccc903-293d-4278-91c9-91f10ac14008 admin admin] PATH_INFO: `/v3/roles` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:11:46.056364 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ccc903-293d-4278-91c9-91f10ac14008 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:11:46.059098 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ccc903-293d-4278-91c9-91f10ac14008 admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:11:46.092121 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1319/2649] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Sep 15 18:11:46 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 18:11:46.093327 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1aa634-1089-4809-8b21-00d84a2171fd admin admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:11:46.103740 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1aa634-1089-4809-8b21-00d84a2171fd admin admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:11:46.109282 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16a1856-bbf6-4188-bb1b-57dae078777d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:11:46.110034 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16a1856-bbf6-4188-bb1b-57dae078777d admin admin] REQUEST_METHOD: `PUT` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:11:46.110404 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16a1856-bbf6-4188-bb1b-57dae078777d admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:11:46.111079 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16a1856-bbf6-4188-bb1b-57dae078777d admin admin] PATH_INFO: `/v3/projects/13fe62945a42476aa6efbcfc37ae90de/users/b7533beccad6456488f277ee187afded/roles/343cc8b1bc7243eebabdf08147e8366d` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:11:46.128793 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a16a1856-bbf6-4188-bb1b-57dae078777d admin admin] RBAC: Authorizing `identity:create_grant(project_id=13fe62945a42476aa6efbcfc37ae90de, user_id=b7533beccad6456488f277ee187afded, role_id=343cc8b1bc7243eebabdf08147e8366d)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:11:46.132284 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a16a1856-bbf6-4188-bb1b-57dae078777d admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:11:46.153811 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1331/2650] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Sep 15 18:11:46 2022] PUT /identity/v3/projects/13fe62945a42476aa6efbcfc37ae90de/users/b7533beccad6456488f277ee187afded/roles/343cc8b1bc7243eebabdf08147e8366d => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 15 18:11:46.164166 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e61568-e6bc-4e41-8f23-c2bd60842f1d None None] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:11:46.164479 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e61568-e6bc-4e41-8f23-c2bd60842f1d None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:11:46.164752 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e61568-e6bc-4e41-8f23-c2bd60842f1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:11:46.195048 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.auth.core [None req-91e61568-e6bc-4e41-8f23-c2bd60842f1d None None] MFA Rules not processed for user `b7533beccad6456488f277ee187afded`. Rule list: `[]` (Enabled: `True`). {{(pid=81592) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 18:11:46.196273 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-91e61568-e6bc-4e41-8f23-c2bd60842f1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:11:46.263176 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1320/2651] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 15 18:11:46 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 18:11:46.267267 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16a1856-bbf6-4188-bb1b-57dae078777d admin admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:11:46.330377 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16a1856-bbf6-4188-bb1b-57dae078777d admin admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:11:46.335039 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc2e89a-5419-4a0f-87e2-3850299cd26b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:11:46.335898 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc2e89a-5419-4a0f-87e2-3850299cd26b admin admin] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:11:46.336177 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc2e89a-5419-4a0f-87e2-3850299cd26b admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:11:46.336450 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc2e89a-5419-4a0f-87e2-3850299cd26b admin admin] PATH_INFO: `/v3/projects` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:11:46.337082 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc2e89a-5419-4a0f-87e2-3850299cd26b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:11:46.339066 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc2e89a-5419-4a0f-87e2-3850299cd26b admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:11:46.368830 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1332/2652] 10.222.0.25 () {60 vars in 1153 bytes} [Thu Sep 15 18:11:46 2022] POST /identity/v3/projects => generated 371 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 18:11:46.373052 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e61568-e6bc-4e41-8f23-c2bd60842f1d None None] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:11:46.384300 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e61568-e6bc-4e41-8f23-c2bd60842f1d None None] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:11:46.412290 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 18:11:46.444648 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8347e4-3ee8-4594-8ef5-d66e367c3f2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:11:46.445281 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8347e4-3ee8-4594-8ef5-d66e367c3f2e admin admin] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:11:46.445599 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8347e4-3ee8-4594-8ef5-d66e367c3f2e admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:11:46.445882 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8347e4-3ee8-4594-8ef5-d66e367c3f2e admin admin] PATH_INFO: `/v3/users` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:11:46.446830 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df8347e4-3ee8-4594-8ef5-d66e367c3f2e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:11:46.448483 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df8347e4-3ee8-4594-8ef5-d66e367c3f2e admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:11:46.472748 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1321/2653] 10.222.0.25 () {60 vars in 1144 bytes} [Thu Sep 15 18:11:46 2022] POST /identity/v3/users => generated 292 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 15 18:11:46.476756 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc2e89a-5419-4a0f-87e2-3850299cd26b admin admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:11:46.491657 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc2e89a-5419-4a0f-87e2-3850299cd26b admin admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:11:46.496528 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8f83fe-c891-42e1-b326-3ad72b7f4010 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:11:46.497143 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8f83fe-c891-42e1-b326-3ad72b7f4010 admin admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:11:46.497459 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8f83fe-c891-42e1-b326-3ad72b7f4010 admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:11:46.497739 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8f83fe-c891-42e1-b326-3ad72b7f4010 admin admin] PATH_INFO: `/v3/roles` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:11:46.498382 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee8f83fe-c891-42e1-b326-3ad72b7f4010 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:11:46.500046 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee8f83fe-c891-42e1-b326-3ad72b7f4010 admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:11:46.512473 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1333/2654] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Sep 15 18:11:46 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 15 18:11:46.516845 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8347e4-3ee8-4594-8ef5-d66e367c3f2e admin admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:11:46.528136 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8347e4-3ee8-4594-8ef5-d66e367c3f2e admin admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:11:46.534271 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac5b470-ce24-4e1c-afff-37aeb2a68da8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:11:46.535065 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac5b470-ce24-4e1c-afff-37aeb2a68da8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:11:46.535356 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac5b470-ce24-4e1c-afff-37aeb2a68da8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:11:46.535750 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac5b470-ce24-4e1c-afff-37aeb2a68da8 admin admin] PATH_INFO: `/v3/projects/d1e6276ac937411b8b97f5c809904fab/users/75b19acc9e1e4d35aa19e6006b035670/roles/a9e42be86923434f8af52d3fc07fb4f7` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:11:46.553053 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac5b470-ce24-4e1c-afff-37aeb2a68da8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d1e6276ac937411b8b97f5c809904fab, user_id=75b19acc9e1e4d35aa19e6006b035670, role_id=a9e42be86923434f8af52d3fc07fb4f7)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:11:46.554870 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac5b470-ce24-4e1c-afff-37aeb2a68da8 admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:11:46.575345 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1322/2655] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Sep 15 18:11:46 2022] PUT /identity/v3/projects/d1e6276ac937411b8b97f5c809904fab/users/75b19acc9e1e4d35aa19e6006b035670/roles/a9e42be86923434f8af52d3fc07fb4f7 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 18:11:46.579507 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8f83fe-c891-42e1-b326-3ad72b7f4010 admin admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:11:46.590777 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8f83fe-c891-42e1-b326-3ad72b7f4010 admin admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:11:46.768609 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 18:11:46.775824 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ccac8c-e376-4566-8b35-fe06b309ee67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:11:46.776439 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ccac8c-e376-4566-8b35-fe06b309ee67 admin admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:11:46.776714 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ccac8c-e376-4566-8b35-fe06b309ee67 admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:11:46.776997 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ccac8c-e376-4566-8b35-fe06b309ee67 admin admin] PATH_INFO: `/v3/roles` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:11:46.777680 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ccac8c-e376-4566-8b35-fe06b309ee67 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:11:46.779330 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ccac8c-e376-4566-8b35-fe06b309ee67 admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:11:46.789761 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1334/2656] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Sep 15 18:11:46 2022] GET /identity/v3/roles => generated 1420 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 18:11:46.793996 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac5b470-ce24-4e1c-afff-37aeb2a68da8 admin admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:11:46.804978 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac5b470-ce24-4e1c-afff-37aeb2a68da8 admin admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:11:46.809865 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91201bd1-0420-42fe-9f1f-f1d968d3872b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:11:46.810571 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91201bd1-0420-42fe-9f1f-f1d968d3872b admin admin] REQUEST_METHOD: `PUT` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:11:46.810794 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91201bd1-0420-42fe-9f1f-f1d968d3872b admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:11:46.811095 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91201bd1-0420-42fe-9f1f-f1d968d3872b admin admin] PATH_INFO: `/v3/projects/d1e6276ac937411b8b97f5c809904fab/users/75b19acc9e1e4d35aa19e6006b035670/roles/a9e42be86923434f8af52d3fc07fb4f7` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:11:46.813083 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91201bd1-0420-42fe-9f1f-f1d968d3872b admin admin] RBAC: Authorizing `identity:create_grant(project_id=d1e6276ac937411b8b97f5c809904fab, user_id=75b19acc9e1e4d35aa19e6006b035670, role_id=a9e42be86923434f8af52d3fc07fb4f7)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:11:46.816536 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91201bd1-0420-42fe-9f1f-f1d968d3872b admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:11:46.827654 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1323/2657] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Sep 15 18:11:46 2022] PUT /identity/v3/projects/d1e6276ac937411b8b97f5c809904fab/users/75b19acc9e1e4d35aa19e6006b035670/roles/a9e42be86923434f8af52d3fc07fb4f7 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 15 18:11:46.839728 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d7cd06-620e-4812-ab98-8b1d023fa5f0 None None] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:11:46.840018 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d7cd06-620e-4812-ab98-8b1d023fa5f0 None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:11:46.840293 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d7cd06-620e-4812-ab98-8b1d023fa5f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:11:46.868253 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.auth.core [None req-b8d7cd06-620e-4812-ab98-8b1d023fa5f0 None None] MFA Rules not processed for user `75b19acc9e1e4d35aa19e6006b035670`. Rule list: `[]` (Enabled: `True`). {{(pid=81593) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 18:11:46.869507 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-b8d7cd06-620e-4812-ab98-8b1d023fa5f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:11:46.946098 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1335/2658] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 15 18:11:46 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 18:11:46.957454 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91201bd1-0420-42fe-9f1f-f1d968d3872b admin admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:11:46.959148 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-91201bd1-0420-42fe-9f1f-f1d968d3872b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:11:47.018757 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91201bd1-0420-42fe-9f1f-f1d968d3872b admin admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:11:47.022377 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5a4282-db97-4551-b578-30cb9182fdd4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b232e7a841145ba93c6d8462ccb751a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1213c0d1b584404ba3998e136f166e89', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:11:47.022971 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5a4282-db97-4551-b578-30cb9182fdd4 service cinder] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:11:47.023244 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5a4282-db97-4551-b578-30cb9182fdd4 service cinder] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:11:47.023776 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5a4282-db97-4551-b578-30cb9182fdd4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:11:47.032197 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e5a4282-db97-4551-b578-30cb9182fdd4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:11:47.033642 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e5a4282-db97-4551-b578-30cb9182fdd4 service cinder] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:11:47.043004 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1324/2659] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 15 18:11:46 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 18:11:47.418746 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d7cd06-620e-4812-ab98-8b1d023fa5f0 None None] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:11:47.479160 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d7cd06-620e-4812-ab98-8b1d023fa5f0 None None] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:11:47.483715 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e6040f-cce2-412e-a35d-c57249d36a17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:11:47.484330 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e6040f-cce2-412e-a35d-c57249d36a17 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:11:47.484611 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e6040f-cce2-412e-a35d-c57249d36a17 admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:11:47.484883 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e6040f-cce2-412e-a35d-c57249d36a17 admin admin] PATH_INFO: `/v3/users/b7533beccad6456488f277ee187afded` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:11:47.486669 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e6040f-cce2-412e-a35d-c57249d36a17 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b7533beccad6456488f277ee187afded)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:11:47.488590 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e6040f-cce2-412e-a35d-c57249d36a17 admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:11:47.533873 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-e7e6040f-cce2-412e-a35d-c57249d36a17 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b7533beccad6456488f277ee187afded'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:11:47.541333 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-e7e6040f-cce2-412e-a35d-c57249d36a17 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b7533beccad6456488f277ee187afded'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:11:47.541973 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-e7e6040f-cce2-412e-a35d-c57249d36a17 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b7533beccad6456488f277ee187afded'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:11:47.542600 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-e7e6040f-cce2-412e-a35d-c57249d36a17 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b7533beccad6456488f277ee187afded'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:11:47.549601 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-e7e6040f-cce2-412e-a35d-c57249d36a17 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b7533beccad6456488f277ee187afded'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:11:47.561930 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 18:11:47.567184 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1336/2660] 10.222.0.25 () {58 vars in 1224 bytes} [Thu Sep 15 18:11:47 2022] DELETE /identity/v3/users/b7533beccad6456488f277ee187afded => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 18:11:47.571809 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bc81c9-f312-49fa-abb8-a33cca326682 None None] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:11:47.572033 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bc81c9-f312-49fa-abb8-a33cca326682 None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:11:47.572305 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bc81c9-f312-49fa-abb8-a33cca326682 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:11:47.591355 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.auth.core [None req-14bc81c9-f312-49fa-abb8-a33cca326682 None None] MFA Rules not processed for user `5cfa58ef86774ab7800bf91930bf6028`. Rule list: `[]` (Enabled: `True`). {{(pid=81592) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 18:11:47.592531 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-14bc81c9-f312-49fa-abb8-a33cca326682 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:11:47.650294 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1325/2661] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 15 18:11:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 18:11:47.660698 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e6040f-cce2-412e-a35d-c57249d36a17 admin admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:11:47.662182 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-e7e6040f-cce2-412e-a35d-c57249d36a17 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:11:47.721242 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e6040f-cce2-412e-a35d-c57249d36a17 admin admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:11:47.724891 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ad2652-a0d3-48ce-bd86-bcec8216e7bc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a32274b4781b40fea9f28da8a9bde5ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1213c0d1b584404ba3998e136f166e89', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:11:47.725544 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ad2652-a0d3-48ce-bd86-bcec8216e7bc service neutron] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:11:47.725830 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ad2652-a0d3-48ce-bd86-bcec8216e7bc service neutron] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:11:47.726106 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ad2652-a0d3-48ce-bd86-bcec8216e7bc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:11:47.737772 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ad2652-a0d3-48ce-bd86-bcec8216e7bc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:11:47.737772 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ad2652-a0d3-48ce-bd86-bcec8216e7bc service neutron] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:11:47.747801 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1337/2662] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 15 18:11:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 15 18:11:48.022638 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14bc81c9-f312-49fa-abb8-a33cca326682 None None] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:11:48.024096 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-14bc81c9-f312-49fa-abb8-a33cca326682 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:11:48.036630 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14bc81c9-f312-49fa-abb8-a33cca326682 None None] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:11:48.047751 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0316eb2-9d40-41bf-94a6-b61dd8590bf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:11:48.048432 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0316eb2-9d40-41bf-94a6-b61dd8590bf9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:11:48.048710 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0316eb2-9d40-41bf-94a6-b61dd8590bf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:11:48.049025 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0316eb2-9d40-41bf-94a6-b61dd8590bf9 admin admin] PATH_INFO: `/v3/projects/13fe62945a42476aa6efbcfc37ae90de` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:11:48.050251 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0316eb2-9d40-41bf-94a6-b61dd8590bf9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=13fe62945a42476aa6efbcfc37ae90de)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:11:48.052478 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0316eb2-9d40-41bf-94a6-b61dd8590bf9 admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:11:48.075750 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 18:11:48.103135 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-f0316eb2-9d40-41bf-94a6-b61dd8590bf9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '13fe62945a42476aa6efbcfc37ae90de', 'request_id': 'req-f0316eb2-9d40-41bf-94a6-b61dd8590bf9'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:11:48.108462 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-f0316eb2-9d40-41bf-94a6-b61dd8590bf9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '13fe62945a42476aa6efbcfc37ae90de', 'request_id': 'req-f0316eb2-9d40-41bf-94a6-b61dd8590bf9'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:11:48.115612 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-f0316eb2-9d40-41bf-94a6-b61dd8590bf9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '13fe62945a42476aa6efbcfc37ae90de', 'request_id': 'req-f0316eb2-9d40-41bf-94a6-b61dd8590bf9'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:11:48.126989 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-f0316eb2-9d40-41bf-94a6-b61dd8590bf9 admin admin] The token cache is being invalidate because project 13fe62945a42476aa6efbcfc37ae90de was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81592) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 18:11:48.127285 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-f0316eb2-9d40-41bf-94a6-b61dd8590bf9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:11:48.127918 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-f0316eb2-9d40-41bf-94a6-b61dd8590bf9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:11:48.129463 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1326/2663] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Sep 15 18:11:48 2022] DELETE /identity/v3/projects/13fe62945a42476aa6efbcfc37ae90de => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 18:11:48.133461 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ad2652-a0d3-48ce-bd86-bcec8216e7bc service neutron] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:11:48.143747 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ad2652-a0d3-48ce-bd86-bcec8216e7bc service neutron] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:11:48.202440 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e0a276-d70d-4d17-9f90-b5587df03c07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:11:48.203067 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e0a276-d70d-4d17-9f90-b5587df03c07 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:11:48.203348 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e0a276-d70d-4d17-9f90-b5587df03c07 admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:11:48.203625 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e0a276-d70d-4d17-9f90-b5587df03c07 admin admin] PATH_INFO: `/v3/users/75b19acc9e1e4d35aa19e6006b035670` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:11:48.205434 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e0a276-d70d-4d17-9f90-b5587df03c07 admin admin] RBAC: Authorizing `identity:delete_user(user_id=75b19acc9e1e4d35aa19e6006b035670)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:11:48.207481 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e0a276-d70d-4d17-9f90-b5587df03c07 admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:11:48.254481 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-83e0a276-d70d-4d17-9f90-b5587df03c07 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '75b19acc9e1e4d35aa19e6006b035670'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:11:48.261553 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-83e0a276-d70d-4d17-9f90-b5587df03c07 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '75b19acc9e1e4d35aa19e6006b035670'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:11:48.262149 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-83e0a276-d70d-4d17-9f90-b5587df03c07 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '75b19acc9e1e4d35aa19e6006b035670'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:11:48.262761 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-83e0a276-d70d-4d17-9f90-b5587df03c07 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '75b19acc9e1e4d35aa19e6006b035670'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:11:48.270181 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-83e0a276-d70d-4d17-9f90-b5587df03c07 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '75b19acc9e1e4d35aa19e6006b035670'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:11:48.286864 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1338/2664] 10.222.0.25 () {58 vars in 1224 bytes} [Thu Sep 15 18:11:48 2022] DELETE /identity/v3/users/75b19acc9e1e4d35aa19e6006b035670 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 18:11:48.567084 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0316eb2-9d40-41bf-94a6-b61dd8590bf9 admin admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:11:48.568595 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-f0316eb2-9d40-41bf-94a6-b61dd8590bf9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:11:48.584684 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0316eb2-9d40-41bf-94a6-b61dd8590bf9 admin admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:11:48.643446 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f02f32-1cf1-4182-838b-64721803ec08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:11:48.643999 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f02f32-1cf1-4182-838b-64721803ec08 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:11:48.644276 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f02f32-1cf1-4182-838b-64721803ec08 admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:11:48.644543 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f02f32-1cf1-4182-838b-64721803ec08 admin admin] PATH_INFO: `/v3/projects/d1e6276ac937411b8b97f5c809904fab` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:11:48.645679 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f02f32-1cf1-4182-838b-64721803ec08 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d1e6276ac937411b8b97f5c809904fab)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:11:48.647610 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f02f32-1cf1-4182-838b-64721803ec08 admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:11:48.693243 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-76f02f32-1cf1-4182-838b-64721803ec08 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd1e6276ac937411b8b97f5c809904fab', 'request_id': 'req-76f02f32-1cf1-4182-838b-64721803ec08'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:11:48.698685 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-76f02f32-1cf1-4182-838b-64721803ec08 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd1e6276ac937411b8b97f5c809904fab', 'request_id': 'req-76f02f32-1cf1-4182-838b-64721803ec08'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:11:48.706850 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-76f02f32-1cf1-4182-838b-64721803ec08 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd1e6276ac937411b8b97f5c809904fab', 'request_id': 'req-76f02f32-1cf1-4182-838b-64721803ec08'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:11:48.718284 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-76f02f32-1cf1-4182-838b-64721803ec08 admin admin] The token cache is being invalidate because project d1e6276ac937411b8b97f5c809904fab was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81592) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 18:11:48.718577 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-76f02f32-1cf1-4182-838b-64721803ec08 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:11:48.719282 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-76f02f32-1cf1-4182-838b-64721803ec08 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:11:48.722337 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1327/2665] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Sep 15 18:11:48 2022] DELETE /identity/v3/projects/d1e6276ac937411b8b97f5c809904fab => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 18:11:48.727446 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868c1eb3-44f9-4bdf-b93f-c751999212e1 None None] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:11:48.727931 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868c1eb3-44f9-4bdf-b93f-c751999212e1 None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:11:48.728037 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868c1eb3-44f9-4bdf-b93f-c751999212e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:11:48.751045 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.auth.core [None req-868c1eb3-44f9-4bdf-b93f-c751999212e1 None None] MFA Rules not processed for user `5cfa58ef86774ab7800bf91930bf6028`. Rule list: `[]` (Enabled: `True`). {{(pid=81593) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 18:11:48.752256 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-868c1eb3-44f9-4bdf-b93f-c751999212e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:11:48.765011 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 18:11:48.812318 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1339/2666] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 15 18:11:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 18:11:48.820187 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c23c3c6-8613-4dc3-9bf2-4ea18ac828b8 None None] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:11:48.820570 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c23c3c6-8613-4dc3-9bf2-4ea18ac828b8 None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:11:48.820932 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c23c3c6-8613-4dc3-9bf2-4ea18ac828b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:11:48.840580 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.auth.core [None req-2c23c3c6-8613-4dc3-9bf2-4ea18ac828b8 None None] MFA Rules not processed for user `5cfa58ef86774ab7800bf91930bf6028`. Rule list: `[]` (Enabled: `True`). {{(pid=81592) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 18:11:48.841862 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-2c23c3c6-8613-4dc3-9bf2-4ea18ac828b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:11:48.850237 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1328/2667] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 15 18:11:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 18:11:48.854369 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868c1eb3-44f9-4bdf-b93f-c751999212e1 None None] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:11:48.864778 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868c1eb3-44f9-4bdf-b93f-c751999212e1 None None] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:11:48.869226 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16562886-4ea8-456c-a1a5-8fa17b1cdcbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:11:48.869846 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16562886-4ea8-456c-a1a5-8fa17b1cdcbf admin admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:11:48.870143 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16562886-4ea8-456c-a1a5-8fa17b1cdcbf admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:11:48.870411 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16562886-4ea8-456c-a1a5-8fa17b1cdcbf admin admin] PATH_INFO: `/v3/domains` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:11:48.871050 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16562886-4ea8-456c-a1a5-8fa17b1cdcbf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81593) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 18:11:48.871348 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16562886-4ea8-456c-a1a5-8fa17b1cdcbf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:11:48.872961 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16562886-4ea8-456c-a1a5-8fa17b1cdcbf admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:11:48.884221 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1340/2668] 10.222.0.25 () {58 vars in 1153 bytes} [Thu Sep 15 18:11:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 18:11:48.888342 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c23c3c6-8613-4dc3-9bf2-4ea18ac828b8 None None] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:11:48.897691 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c23c3c6-8613-4dc3-9bf2-4ea18ac828b8 None None] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:11:48.902374 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f001fa6f-e897-4ae0-9dc7-4677d90ca21b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:11:48.902969 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f001fa6f-e897-4ae0-9dc7-4677d90ca21b admin admin] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:11:48.903250 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f001fa6f-e897-4ae0-9dc7-4677d90ca21b admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:11:48.903521 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f001fa6f-e897-4ae0-9dc7-4677d90ca21b admin admin] PATH_INFO: `/v3/projects` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:11:48.904150 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f001fa6f-e897-4ae0-9dc7-4677d90ca21b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:11:48.906063 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f001fa6f-e897-4ae0-9dc7-4677d90ca21b admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:11:48.942868 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1329/2669] 10.222.0.25 () {60 vars in 1153 bytes} [Thu Sep 15 18:11:48 2022] POST /identity/v3/projects => generated 377 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 18:11:48.949462 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16562886-4ea8-456c-a1a5-8fa17b1cdcbf admin admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:11:48.963148 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16562886-4ea8-456c-a1a5-8fa17b1cdcbf admin admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:11:49.028712 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900f367e-b4b1-4bd3-a6ad-058d49d7c496 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:11:49.028712 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900f367e-b4b1-4bd3-a6ad-058d49d7c496 admin admin] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:11:49.028712 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900f367e-b4b1-4bd3-a6ad-058d49d7c496 admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:11:49.028712 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900f367e-b4b1-4bd3-a6ad-058d49d7c496 admin admin] PATH_INFO: `/v3/users` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:11:49.030781 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-900f367e-b4b1-4bd3-a6ad-058d49d7c496 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:11:49.031147 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-900f367e-b4b1-4bd3-a6ad-058d49d7c496 admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:11:49.055001 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1341/2670] 10.222.0.25 () {60 vars in 1144 bytes} [Thu Sep 15 18:11:48 2022] POST /identity/v3/users => generated 289 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 18:11:49.059264 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f001fa6f-e897-4ae0-9dc7-4677d90ca21b admin admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:11:49.075177 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f001fa6f-e897-4ae0-9dc7-4677d90ca21b admin admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:11:49.080736 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18f38be-e687-4dc0-a933-a30848b30217 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:11:49.081378 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18f38be-e687-4dc0-a933-a30848b30217 admin admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:11:49.081686 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18f38be-e687-4dc0-a933-a30848b30217 admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:11:49.082114 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18f38be-e687-4dc0-a933-a30848b30217 admin admin] PATH_INFO: `/v3/roles` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:11:49.082772 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a18f38be-e687-4dc0-a933-a30848b30217 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:11:49.084355 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a18f38be-e687-4dc0-a933-a30848b30217 admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:11:49.086967 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 18:11:49.100566 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1330/2671] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Sep 15 18:11:49 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 15 18:11:49.101442 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900f367e-b4b1-4bd3-a6ad-058d49d7c496 admin admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:11:49.111918 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900f367e-b4b1-4bd3-a6ad-058d49d7c496 admin admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:11:49.117067 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c4cab4-72dd-4fae-8d7a-855f626afecc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:11:49.117778 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c4cab4-72dd-4fae-8d7a-855f626afecc admin admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:11:49.118119 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c4cab4-72dd-4fae-8d7a-855f626afecc admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:11:49.118402 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c4cab4-72dd-4fae-8d7a-855f626afecc admin admin] PATH_INFO: `/v3/roles` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:11:49.119046 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c4cab4-72dd-4fae-8d7a-855f626afecc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:11:49.120806 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c4cab4-72dd-4fae-8d7a-855f626afecc admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:11:49.134733 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1342/2672] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Sep 15 18:11:49 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 15 18:11:49.138731 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18f38be-e687-4dc0-a933-a30848b30217 admin admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:11:49.149939 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18f38be-e687-4dc0-a933-a30848b30217 admin admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:11:49.155351 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d63b6f1-80d7-49c9-8967-5d1dadaf06e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:11:49.156170 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d63b6f1-80d7-49c9-8967-5d1dadaf06e5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:11:49.156446 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d63b6f1-80d7-49c9-8967-5d1dadaf06e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:11:49.156717 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d63b6f1-80d7-49c9-8967-5d1dadaf06e5 admin admin] PATH_INFO: `/v3/projects/a69e11c8e36c4d75830827a5bde6ad29/users/e88c61bf70b149689dcc963380dc952a/roles/343cc8b1bc7243eebabdf08147e8366d` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:11:49.188453 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d63b6f1-80d7-49c9-8967-5d1dadaf06e5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a69e11c8e36c4d75830827a5bde6ad29, user_id=e88c61bf70b149689dcc963380dc952a, role_id=343cc8b1bc7243eebabdf08147e8366d)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:11:49.188453 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d63b6f1-80d7-49c9-8967-5d1dadaf06e5 admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:11:49.194806 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1331/2673] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Sep 15 18:11:49 2022] PUT /identity/v3/projects/a69e11c8e36c4d75830827a5bde6ad29/users/e88c61bf70b149689dcc963380dc952a/roles/343cc8b1bc7243eebabdf08147e8366d => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 18:11:49.205752 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c13809-1410-434d-8264-d029d977ddf6 None None] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:11:49.206029 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c13809-1410-434d-8264-d029d977ddf6 None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:11:49.206300 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c13809-1410-434d-8264-d029d977ddf6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:11:49.234646 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.auth.core [None req-34c13809-1410-434d-8264-d029d977ddf6 None None] MFA Rules not processed for user `e88c61bf70b149689dcc963380dc952a`. Rule list: `[]` (Enabled: `True`). {{(pid=81593) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 18:11:49.235862 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-34c13809-1410-434d-8264-d029d977ddf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:11:49.299415 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1343/2674] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 15 18:11:49 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 18:11:49.304002 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d63b6f1-80d7-49c9-8967-5d1dadaf06e5 admin admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:11:49.369434 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d63b6f1-80d7-49c9-8967-5d1dadaf06e5 admin admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:11:49.375663 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8105dbe5-0a11-46ee-9d3a-fd264c93ca0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:11:49.376419 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8105dbe5-0a11-46ee-9d3a-fd264c93ca0e admin admin] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:11:49.376725 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8105dbe5-0a11-46ee-9d3a-fd264c93ca0e admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:11:49.376998 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8105dbe5-0a11-46ee-9d3a-fd264c93ca0e admin admin] PATH_INFO: `/v3/projects` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:11:49.377721 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8105dbe5-0a11-46ee-9d3a-fd264c93ca0e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:11:49.379840 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8105dbe5-0a11-46ee-9d3a-fd264c93ca0e admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:11:49.407362 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1332/2675] 10.222.0.25 () {60 vars in 1153 bytes} [Thu Sep 15 18:11:49 2022] POST /identity/v3/projects => generated 377 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 18:11:49.412017 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c13809-1410-434d-8264-d029d977ddf6 None None] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:11:49.422823 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c13809-1410-434d-8264-d029d977ddf6 None None] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:11:49.434050 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 18:11:49.483661 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74514228-11b6-4180-9260-8dcf19fca0c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:11:49.484274 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74514228-11b6-4180-9260-8dcf19fca0c9 admin admin] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:11:49.484620 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74514228-11b6-4180-9260-8dcf19fca0c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:11:49.484826 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74514228-11b6-4180-9260-8dcf19fca0c9 admin admin] PATH_INFO: `/v3/users` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:11:49.485485 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74514228-11b6-4180-9260-8dcf19fca0c9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:11:49.487434 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74514228-11b6-4180-9260-8dcf19fca0c9 admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:11:49.509274 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1344/2676] 10.222.0.25 () {60 vars in 1144 bytes} [Thu Sep 15 18:11:49 2022] POST /identity/v3/users => generated 295 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 18:11:49.513325 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8105dbe5-0a11-46ee-9d3a-fd264c93ca0e admin admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:11:49.524900 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8105dbe5-0a11-46ee-9d3a-fd264c93ca0e admin admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:11:49.529604 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b0f373-bb2b-4c7a-899d-cfeb7218e50f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:11:49.530204 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b0f373-bb2b-4c7a-899d-cfeb7218e50f admin admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:11:49.530484 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b0f373-bb2b-4c7a-899d-cfeb7218e50f admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:11:49.530757 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b0f373-bb2b-4c7a-899d-cfeb7218e50f admin admin] PATH_INFO: `/v3/roles` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:11:49.531404 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b0f373-bb2b-4c7a-899d-cfeb7218e50f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:11:49.532989 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b0f373-bb2b-4c7a-899d-cfeb7218e50f admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:11:49.544531 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1333/2677] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Sep 15 18:11:49 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 15 18:11:49.549361 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74514228-11b6-4180-9260-8dcf19fca0c9 admin admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:11:49.559660 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74514228-11b6-4180-9260-8dcf19fca0c9 admin admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:11:49.564755 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08ccd2e-12f4-4491-a50b-3659f221d9b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:11:49.565423 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08ccd2e-12f4-4491-a50b-3659f221d9b0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:11:49.565700 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08ccd2e-12f4-4491-a50b-3659f221d9b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:11:49.566018 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08ccd2e-12f4-4491-a50b-3659f221d9b0 admin admin] PATH_INFO: `/v3/projects/7405b61dbdbd43a4b671fa82a743c8dc/users/9f23677ecbfc4271a75f303b929840f9/roles/a9e42be86923434f8af52d3fc07fb4f7` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:11:49.581498 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08ccd2e-12f4-4491-a50b-3659f221d9b0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7405b61dbdbd43a4b671fa82a743c8dc, user_id=9f23677ecbfc4271a75f303b929840f9, role_id=a9e42be86923434f8af52d3fc07fb4f7)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:11:49.584397 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08ccd2e-12f4-4491-a50b-3659f221d9b0 admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:11:49.597900 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1345/2678] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Sep 15 18:11:49 2022] PUT /identity/v3/projects/7405b61dbdbd43a4b671fa82a743c8dc/users/9f23677ecbfc4271a75f303b929840f9/roles/a9e42be86923434f8af52d3fc07fb4f7 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 18:11:49.601931 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b0f373-bb2b-4c7a-899d-cfeb7218e50f admin admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:11:49.612046 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b0f373-bb2b-4c7a-899d-cfeb7218e50f admin admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:11:49.668694 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34dc9453-e43e-48e3-927a-0c4bd95090ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:11:49.669227 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34dc9453-e43e-48e3-927a-0c4bd95090ab admin admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:11:49.669551 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34dc9453-e43e-48e3-927a-0c4bd95090ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:11:49.670498 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34dc9453-e43e-48e3-927a-0c4bd95090ab admin admin] PATH_INFO: `/v3/roles` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:11:49.670498 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34dc9453-e43e-48e3-927a-0c4bd95090ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:11:49.672085 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34dc9453-e43e-48e3-927a-0c4bd95090ab admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:11:49.682877 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1334/2679] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Sep 15 18:11:49 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 15 18:11:49.687092 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08ccd2e-12f4-4491-a50b-3659f221d9b0 admin admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:11:49.697788 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08ccd2e-12f4-4491-a50b-3659f221d9b0 admin admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:11:49.702296 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972c0fee-c95c-41b3-b5cf-57fd9175f0e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:11:49.702941 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972c0fee-c95c-41b3-b5cf-57fd9175f0e3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:11:49.703218 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972c0fee-c95c-41b3-b5cf-57fd9175f0e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:11:49.703488 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972c0fee-c95c-41b3-b5cf-57fd9175f0e3 admin admin] PATH_INFO: `/v3/projects/7405b61dbdbd43a4b671fa82a743c8dc/users/9f23677ecbfc4271a75f303b929840f9/roles/a9e42be86923434f8af52d3fc07fb4f7` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:11:49.706103 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972c0fee-c95c-41b3-b5cf-57fd9175f0e3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7405b61dbdbd43a4b671fa82a743c8dc, user_id=9f23677ecbfc4271a75f303b929840f9, role_id=a9e42be86923434f8af52d3fc07fb4f7)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:11:49.708745 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972c0fee-c95c-41b3-b5cf-57fd9175f0e3 admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:11:49.719314 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1346/2680] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Sep 15 18:11:49 2022] PUT /identity/v3/projects/7405b61dbdbd43a4b671fa82a743c8dc/users/9f23677ecbfc4271a75f303b929840f9/roles/a9e42be86923434f8af52d3fc07fb4f7 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 18:11:49.731169 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb1dfc2-3904-4733-9305-63152c746fc5 None None] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:11:49.731454 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb1dfc2-3904-4733-9305-63152c746fc5 None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:11:49.731730 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb1dfc2-3904-4733-9305-63152c746fc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:11:49.761071 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.auth.core [None req-7cb1dfc2-3904-4733-9305-63152c746fc5 None None] MFA Rules not processed for user `9f23677ecbfc4271a75f303b929840f9`. Rule list: `[]` (Enabled: `True`). {{(pid=81592) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 18:11:49.762346 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-7cb1dfc2-3904-4733-9305-63152c746fc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:11:49.794274 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 18:11:49.833066 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1335/2681] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 15 18:11:49 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 18:11:49.844840 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972c0fee-c95c-41b3-b5cf-57fd9175f0e3 admin admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:11:49.846729 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-972c0fee-c95c-41b3-b5cf-57fd9175f0e3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:11:49.906015 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972c0fee-c95c-41b3-b5cf-57fd9175f0e3 admin admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:11:49.909688 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c22841a-dbdd-44ba-bf69-577217ff0ad6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b232e7a841145ba93c6d8462ccb751a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1213c0d1b584404ba3998e136f166e89', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:11:49.910293 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c22841a-dbdd-44ba-bf69-577217ff0ad6 service cinder] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:11:49.910568 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c22841a-dbdd-44ba-bf69-577217ff0ad6 service cinder] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:11:49.910838 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c22841a-dbdd-44ba-bf69-577217ff0ad6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:11:49.968694 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c22841a-dbdd-44ba-bf69-577217ff0ad6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:11:49.970198 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c22841a-dbdd-44ba-bf69-577217ff0ad6 service cinder] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:11:49.979200 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1347/2682] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 15 18:11:49 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 15 18:11:52.583320 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb1dfc2-3904-4733-9305-63152c746fc5 None None] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:11:52.584703 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-7cb1dfc2-3904-4733-9305-63152c746fc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:11:52.597008 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb1dfc2-3904-4733-9305-63152c746fc5 None None] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:11:52.600521 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42bd931-f95d-407c-9e76-9c2bbab6b356 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b232e7a841145ba93c6d8462ccb751a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1213c0d1b584404ba3998e136f166e89', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:11:52.601114 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42bd931-f95d-407c-9e76-9c2bbab6b356 service cinder] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:11:52.601429 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42bd931-f95d-407c-9e76-9c2bbab6b356 service cinder] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:11:52.601700 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42bd931-f95d-407c-9e76-9c2bbab6b356 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:11:52.610539 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f42bd931-f95d-407c-9e76-9c2bbab6b356 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:11:52.612239 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f42bd931-f95d-407c-9e76-9c2bbab6b356 service cinder] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:11:52.623592 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1336/2683] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 15 18:11:52 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 18:11:53.412496 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c22841a-dbdd-44ba-bf69-577217ff0ad6 service cinder] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:11:53.414880 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-8c22841a-dbdd-44ba-bf69-577217ff0ad6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:11:53.442785 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 18:11:53.485764 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42bd931-f95d-407c-9e76-9c2bbab6b356 service cinder] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:11:53.487721 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-f42bd931-f95d-407c-9e76-9c2bbab6b356 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:11:53.501549 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c22841a-dbdd-44ba-bf69-577217ff0ad6 service cinder] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:11:53.507953 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db1e503-15dd-451f-b03b-64c2e46ed883 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10af119bd39841ed8163993676230fca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1213c0d1b584404ba3998e136f166e89', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:11:53.510191 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db1e503-15dd-451f-b03b-64c2e46ed883 service placement] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:11:53.510954 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db1e503-15dd-451f-b03b-64c2e46ed883 service placement] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:11:53.511249 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db1e503-15dd-451f-b03b-64c2e46ed883 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:11:53.514074 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-2db1e503-15dd-451f-b03b-64c2e46ed883 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:11:53.528995 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db1e503-15dd-451f-b03b-64c2e46ed883 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:11:53.530597 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db1e503-15dd-451f-b03b-64c2e46ed883 service placement] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:11:53.552235 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1348/2684] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 15 18:11:53 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 18:11:53.576585 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42bd931-f95d-407c-9e76-9c2bbab6b356 service cinder] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:11:53.583879 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1f8123-3df0-4e8b-b8de-fa36600ec023 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:11:53.583879 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1f8123-3df0-4e8b-b8de-fa36600ec023 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:11:53.583879 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1f8123-3df0-4e8b-b8de-fa36600ec023 admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:11:53.583879 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1f8123-3df0-4e8b-b8de-fa36600ec023 admin admin] PATH_INFO: `/v3/users/f9e92c9c725e4b76b0422fc6f86d6631` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:11:53.585328 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1f8123-3df0-4e8b-b8de-fa36600ec023 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f9e92c9c725e4b76b0422fc6f86d6631)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:11:53.587521 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1f8123-3df0-4e8b-b8de-fa36600ec023 admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:11:53.635191 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-8f1f8123-3df0-4e8b-b8de-fa36600ec023 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f9e92c9c725e4b76b0422fc6f86d6631'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:11:53.644540 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-8f1f8123-3df0-4e8b-b8de-fa36600ec023 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f9e92c9c725e4b76b0422fc6f86d6631'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:11:53.644540 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-8f1f8123-3df0-4e8b-b8de-fa36600ec023 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f9e92c9c725e4b76b0422fc6f86d6631'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:11:53.644540 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-8f1f8123-3df0-4e8b-b8de-fa36600ec023 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f9e92c9c725e4b76b0422fc6f86d6631'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:11:53.651001 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-8f1f8123-3df0-4e8b-b8de-fa36600ec023 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f9e92c9c725e4b76b0422fc6f86d6631'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:11:53.669102 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1337/2685] 10.222.0.25 () {58 vars in 1224 bytes} [Thu Sep 15 18:11:53 2022] DELETE /identity/v3/users/f9e92c9c725e4b76b0422fc6f86d6631 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 18:11:53.846522 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db1e503-15dd-451f-b03b-64c2e46ed883 service placement] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:11:53.859601 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db1e503-15dd-451f-b03b-64c2e46ed883 service placement] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:11:53.915062 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e306f0-de23-4fff-8f19-5e331fbade4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:11:53.915691 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e306f0-de23-4fff-8f19-5e331fbade4b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:11:53.915964 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e306f0-de23-4fff-8f19-5e331fbade4b admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:11:53.916232 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e306f0-de23-4fff-8f19-5e331fbade4b admin admin] PATH_INFO: `/v3/projects/57eda6ece5ca41a592f43ffe27372b28` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:11:53.917361 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e306f0-de23-4fff-8f19-5e331fbade4b admin admin] RBAC: Authorizing `identity:delete_project(project_id=57eda6ece5ca41a592f43ffe27372b28)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:11:53.919257 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e306f0-de23-4fff-8f19-5e331fbade4b admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:11:53.965676 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-14e306f0-de23-4fff-8f19-5e331fbade4b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '57eda6ece5ca41a592f43ffe27372b28', 'request_id': 'req-14e306f0-de23-4fff-8f19-5e331fbade4b'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:11:53.971138 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-14e306f0-de23-4fff-8f19-5e331fbade4b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '57eda6ece5ca41a592f43ffe27372b28', 'request_id': 'req-14e306f0-de23-4fff-8f19-5e331fbade4b'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:11:53.978299 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-14e306f0-de23-4fff-8f19-5e331fbade4b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '57eda6ece5ca41a592f43ffe27372b28', 'request_id': 'req-14e306f0-de23-4fff-8f19-5e331fbade4b'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:11:53.989517 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-14e306f0-de23-4fff-8f19-5e331fbade4b admin admin] The token cache is being invalidate because project 57eda6ece5ca41a592f43ffe27372b28 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81593) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 18:11:53.989814 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-14e306f0-de23-4fff-8f19-5e331fbade4b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:11:53.990495 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-14e306f0-de23-4fff-8f19-5e331fbade4b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:11:53.991986 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1349/2686] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Sep 15 18:11:53 2022] DELETE /identity/v3/projects/57eda6ece5ca41a592f43ffe27372b28 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 18:11:53.996913 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2f9fa3-d0e7-41f8-949a-70b477a0ceca None None] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:11:53.997199 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2f9fa3-d0e7-41f8-949a-70b477a0ceca None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:11:53.997500 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2f9fa3-d0e7-41f8-949a-70b477a0ceca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:11:54.018873 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.auth.core [None req-6c2f9fa3-d0e7-41f8-949a-70b477a0ceca None None] MFA Rules not processed for user `5cfa58ef86774ab7800bf91930bf6028`. Rule list: `[]` (Enabled: `True`). {{(pid=81592) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 18:11:54.020061 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-6c2f9fa3-d0e7-41f8-949a-70b477a0ceca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:11:54.051327 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 18:11:54.085151 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1338/2687] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 15 18:11:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 18:11:54.093809 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80765148-e85b-4217-ae26-2d90d64a630d None None] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:11:54.094163 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80765148-e85b-4217-ae26-2d90d64a630d None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:11:54.094451 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80765148-e85b-4217-ae26-2d90d64a630d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:11:54.115312 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.auth.core [None req-80765148-e85b-4217-ae26-2d90d64a630d None None] MFA Rules not processed for user `5cfa58ef86774ab7800bf91930bf6028`. Rule list: `[]` (Enabled: `True`). {{(pid=81593) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 18:11:54.116548 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-80765148-e85b-4217-ae26-2d90d64a630d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:11:54.125123 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1350/2688] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 15 18:11:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 18:11:54.129797 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2f9fa3-d0e7-41f8-949a-70b477a0ceca None None] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:11:54.141142 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2f9fa3-d0e7-41f8-949a-70b477a0ceca None None] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:11:54.147019 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45f597f-ab49-47ee-b8d8-268ba24c1419 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:11:54.147624 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45f597f-ab49-47ee-b8d8-268ba24c1419 admin admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:11:54.147900 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45f597f-ab49-47ee-b8d8-268ba24c1419 admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:11:54.148166 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45f597f-ab49-47ee-b8d8-268ba24c1419 admin admin] PATH_INFO: `/v3/domains` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:11:54.148837 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b45f597f-ab49-47ee-b8d8-268ba24c1419 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81592) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 18:11:54.149134 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b45f597f-ab49-47ee-b8d8-268ba24c1419 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:11:54.150786 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b45f597f-ab49-47ee-b8d8-268ba24c1419 admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:11:54.163804 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1339/2689] 10.222.0.25 () {58 vars in 1153 bytes} [Thu Sep 15 18:11:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 18:11:54.168480 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80765148-e85b-4217-ae26-2d90d64a630d None None] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:11:54.177777 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80765148-e85b-4217-ae26-2d90d64a630d None None] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:11:54.182502 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b85fbed-1f4a-4263-948b-51d12727d546 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:11:54.183137 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b85fbed-1f4a-4263-948b-51d12727d546 admin admin] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:11:54.183416 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b85fbed-1f4a-4263-948b-51d12727d546 admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:11:54.183679 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b85fbed-1f4a-4263-948b-51d12727d546 admin admin] PATH_INFO: `/v3/projects` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:11:54.184350 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b85fbed-1f4a-4263-948b-51d12727d546 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:11:54.186368 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b85fbed-1f4a-4263-948b-51d12727d546 admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:11:54.221136 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1351/2690] 10.222.0.25 () {60 vars in 1153 bytes} [Thu Sep 15 18:11:54 2022] POST /identity/v3/projects => generated 379 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 18:11:54.225794 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45f597f-ab49-47ee-b8d8-268ba24c1419 admin admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:11:54.237839 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45f597f-ab49-47ee-b8d8-268ba24c1419 admin admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:11:54.293006 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf4bd10-48ee-422e-aa61-9d061eb3d793 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:11:54.293555 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf4bd10-48ee-422e-aa61-9d061eb3d793 admin admin] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:11:54.293838 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf4bd10-48ee-422e-aa61-9d061eb3d793 admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:11:54.294111 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf4bd10-48ee-422e-aa61-9d061eb3d793 admin admin] PATH_INFO: `/v3/users` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:11:54.294745 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf4bd10-48ee-422e-aa61-9d061eb3d793 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:11:54.296640 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf4bd10-48ee-422e-aa61-9d061eb3d793 admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:11:54.318653 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1340/2691] 10.222.0.25 () {60 vars in 1144 bytes} [Thu Sep 15 18:11:54 2022] POST /identity/v3/users => generated 290 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 18:11:54.322727 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b85fbed-1f4a-4263-948b-51d12727d546 admin admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:11:54.333880 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b85fbed-1f4a-4263-948b-51d12727d546 admin admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:11:54.338726 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca95248-5e0c-41e6-8019-fa15028f358b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:11:54.339351 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca95248-5e0c-41e6-8019-fa15028f358b admin admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:11:54.339630 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca95248-5e0c-41e6-8019-fa15028f358b admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:11:54.339900 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca95248-5e0c-41e6-8019-fa15028f358b admin admin] PATH_INFO: `/v3/roles` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:11:54.340554 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca95248-5e0c-41e6-8019-fa15028f358b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:11:54.342177 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca95248-5e0c-41e6-8019-fa15028f358b admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:11:54.353046 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1352/2692] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Sep 15 18:11:54 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 18:11:54.357447 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf4bd10-48ee-422e-aa61-9d061eb3d793 admin admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:11:54.367310 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf4bd10-48ee-422e-aa61-9d061eb3d793 admin admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:11:54.371928 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e3f538-e8fe-4a43-b32f-2200477da837 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:11:54.372518 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e3f538-e8fe-4a43-b32f-2200477da837 admin admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:11:54.372787 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e3f538-e8fe-4a43-b32f-2200477da837 admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:11:54.373052 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e3f538-e8fe-4a43-b32f-2200477da837 admin admin] PATH_INFO: `/v3/roles` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:11:54.373731 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e3f538-e8fe-4a43-b32f-2200477da837 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:11:54.375309 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e3f538-e8fe-4a43-b32f-2200477da837 admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:11:54.385899 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1341/2693] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Sep 15 18:11:54 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 18:11:54.389956 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca95248-5e0c-41e6-8019-fa15028f358b admin admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:11:54.395705 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 18:11:54.402274 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca95248-5e0c-41e6-8019-fa15028f358b admin admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:11:54.408693 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee5f1e4-5604-41c6-90e5-590f3d9fa3de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:11:54.409388 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee5f1e4-5604-41c6-90e5-590f3d9fa3de admin admin] REQUEST_METHOD: `PUT` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:11:54.409687 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee5f1e4-5604-41c6-90e5-590f3d9fa3de admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:11:54.410146 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee5f1e4-5604-41c6-90e5-590f3d9fa3de admin admin] PATH_INFO: `/v3/projects/d874ed45fe654f2b8d84e6dcb4afe3db/users/3117c05184994380a474167e80905843/roles/343cc8b1bc7243eebabdf08147e8366d` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:11:54.426394 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee5f1e4-5604-41c6-90e5-590f3d9fa3de admin admin] RBAC: Authorizing `identity:create_grant(project_id=d874ed45fe654f2b8d84e6dcb4afe3db, user_id=3117c05184994380a474167e80905843, role_id=343cc8b1bc7243eebabdf08147e8366d)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:11:54.429088 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee5f1e4-5604-41c6-90e5-590f3d9fa3de admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:11:54.443208 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1353/2694] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Sep 15 18:11:54 2022] PUT /identity/v3/projects/d874ed45fe654f2b8d84e6dcb4afe3db/users/3117c05184994380a474167e80905843/roles/343cc8b1bc7243eebabdf08147e8366d => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 18:11:54.455452 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae59314b-c507-4e92-9b0a-e63785b6c742 None None] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:11:54.455800 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae59314b-c507-4e92-9b0a-e63785b6c742 None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:11:54.456081 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae59314b-c507-4e92-9b0a-e63785b6c742 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:11:54.485810 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.auth.core [None req-ae59314b-c507-4e92-9b0a-e63785b6c742 None None] MFA Rules not processed for user `3117c05184994380a474167e80905843`. Rule list: `[]` (Enabled: `True`). {{(pid=81592) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 18:11:54.487050 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-ae59314b-c507-4e92-9b0a-e63785b6c742 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:11:54.558266 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1342/2695] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 15 18:11:54 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 18:11:54.562745 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee5f1e4-5604-41c6-90e5-590f3d9fa3de admin admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:11:54.624026 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee5f1e4-5604-41c6-90e5-590f3d9fa3de admin admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:11:54.628615 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49778333-8fa0-4b65-824c-c032a0798812 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:11:54.629209 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49778333-8fa0-4b65-824c-c032a0798812 admin admin] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:11:54.629520 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49778333-8fa0-4b65-824c-c032a0798812 admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:11:54.629795 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49778333-8fa0-4b65-824c-c032a0798812 admin admin] PATH_INFO: `/v3/projects` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:11:54.630417 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49778333-8fa0-4b65-824c-c032a0798812 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:11:54.632313 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49778333-8fa0-4b65-824c-c032a0798812 admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:11:54.658563 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1354/2696] 10.222.0.25 () {60 vars in 1153 bytes} [Thu Sep 15 18:11:54 2022] POST /identity/v3/projects => generated 379 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 18:11:54.662796 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae59314b-c507-4e92-9b0a-e63785b6c742 None None] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:11:54.673177 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae59314b-c507-4e92-9b0a-e63785b6c742 None None] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:11:54.702012 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 18:11:54.729891 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2364699-de38-44f6-bd62-c7abf31563c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:11:54.730483 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2364699-de38-44f6-bd62-c7abf31563c7 admin admin] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:11:54.730757 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2364699-de38-44f6-bd62-c7abf31563c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:11:54.731024 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2364699-de38-44f6-bd62-c7abf31563c7 admin admin] PATH_INFO: `/v3/users` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:11:54.731634 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2364699-de38-44f6-bd62-c7abf31563c7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:11:54.733571 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2364699-de38-44f6-bd62-c7abf31563c7 admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:11:54.755928 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1343/2697] 10.222.0.25 () {60 vars in 1144 bytes} [Thu Sep 15 18:11:54 2022] POST /identity/v3/users => generated 296 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 18:11:54.759672 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49778333-8fa0-4b65-824c-c032a0798812 admin admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:11:54.771302 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49778333-8fa0-4b65-824c-c032a0798812 admin admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:11:54.775919 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b24ea6-4c4e-47ca-a234-1afa21377c7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:11:54.776522 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b24ea6-4c4e-47ca-a234-1afa21377c7d admin admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:11:54.776807 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b24ea6-4c4e-47ca-a234-1afa21377c7d admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:11:54.777063 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b24ea6-4c4e-47ca-a234-1afa21377c7d admin admin] PATH_INFO: `/v3/roles` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:11:54.777760 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b24ea6-4c4e-47ca-a234-1afa21377c7d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:11:54.779353 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b24ea6-4c4e-47ca-a234-1afa21377c7d admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:11:54.789817 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1355/2698] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Sep 15 18:11:54 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 15 18:11:54.794028 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2364699-de38-44f6-bd62-c7abf31563c7 admin admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:11:54.807984 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2364699-de38-44f6-bd62-c7abf31563c7 admin admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:11:54.812644 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662328fd-d73a-47e8-9e90-6ebb7061fa71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:11:54.813245 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662328fd-d73a-47e8-9e90-6ebb7061fa71 admin admin] REQUEST_METHOD: `PUT` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:11:54.813566 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662328fd-d73a-47e8-9e90-6ebb7061fa71 admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:11:54.813837 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662328fd-d73a-47e8-9e90-6ebb7061fa71 admin admin] PATH_INFO: `/v3/projects/945b7765a7504d17bba97280cd934489/users/4a1f87798edd431f8ee5bb4b0ffb21c1/roles/a9e42be86923434f8af52d3fc07fb4f7` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:11:54.830761 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-662328fd-d73a-47e8-9e90-6ebb7061fa71 admin admin] RBAC: Authorizing `identity:create_grant(project_id=945b7765a7504d17bba97280cd934489, user_id=4a1f87798edd431f8ee5bb4b0ffb21c1, role_id=a9e42be86923434f8af52d3fc07fb4f7)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:11:54.833888 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-662328fd-d73a-47e8-9e90-6ebb7061fa71 admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:11:54.846238 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1344/2699] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Sep 15 18:11:54 2022] PUT /identity/v3/projects/945b7765a7504d17bba97280cd934489/users/4a1f87798edd431f8ee5bb4b0ffb21c1/roles/a9e42be86923434f8af52d3fc07fb4f7 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 18:11:54.850286 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b24ea6-4c4e-47ca-a234-1afa21377c7d admin admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:11:54.860074 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b24ea6-4c4e-47ca-a234-1afa21377c7d admin admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:11:54.914510 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34e2493-99de-4cd8-8910-aaca0c704a1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:11:54.915954 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34e2493-99de-4cd8-8910-aaca0c704a1f admin admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:11:54.916242 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34e2493-99de-4cd8-8910-aaca0c704a1f admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:11:54.916525 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34e2493-99de-4cd8-8910-aaca0c704a1f admin admin] PATH_INFO: `/v3/roles` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:11:54.917192 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a34e2493-99de-4cd8-8910-aaca0c704a1f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:11:54.918850 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a34e2493-99de-4cd8-8910-aaca0c704a1f admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:11:54.928994 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1356/2700] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Sep 15 18:11:54 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 18:11:54.933221 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662328fd-d73a-47e8-9e90-6ebb7061fa71 admin admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:11:54.943957 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662328fd-d73a-47e8-9e90-6ebb7061fa71 admin admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:11:54.948411 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed53f857-fc15-49f6-9051-ed1f4280dd29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:11:54.949041 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed53f857-fc15-49f6-9051-ed1f4280dd29 admin admin] REQUEST_METHOD: `PUT` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:11:54.949343 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed53f857-fc15-49f6-9051-ed1f4280dd29 admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:11:54.949615 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed53f857-fc15-49f6-9051-ed1f4280dd29 admin admin] PATH_INFO: `/v3/projects/945b7765a7504d17bba97280cd934489/users/4a1f87798edd431f8ee5bb4b0ffb21c1/roles/a9e42be86923434f8af52d3fc07fb4f7` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:11:54.951546 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed53f857-fc15-49f6-9051-ed1f4280dd29 admin admin] RBAC: Authorizing `identity:create_grant(project_id=945b7765a7504d17bba97280cd934489, user_id=4a1f87798edd431f8ee5bb4b0ffb21c1, role_id=a9e42be86923434f8af52d3fc07fb4f7)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:11:54.954184 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed53f857-fc15-49f6-9051-ed1f4280dd29 admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:11:54.965400 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1345/2701] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Sep 15 18:11:54 2022] PUT /identity/v3/projects/945b7765a7504d17bba97280cd934489/users/4a1f87798edd431f8ee5bb4b0ffb21c1/roles/a9e42be86923434f8af52d3fc07fb4f7 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 15 18:11:54.975396 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5d7dbb-02be-47c2-b285-604f5c3057cd None None] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:11:54.975683 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5d7dbb-02be-47c2-b285-604f5c3057cd None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:11:54.975959 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5d7dbb-02be-47c2-b285-604f5c3057cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:11:55.003274 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.auth.core [None req-8a5d7dbb-02be-47c2-b285-604f5c3057cd None None] MFA Rules not processed for user `4a1f87798edd431f8ee5bb4b0ffb21c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81593) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 18:11:55.004470 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-8a5d7dbb-02be-47c2-b285-604f5c3057cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:11:55.041496 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 18:11:55.072346 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1357/2702] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 15 18:11:54 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 18:11:55.083617 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed53f857-fc15-49f6-9051-ed1f4280dd29 admin admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:11:55.085319 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-ed53f857-fc15-49f6-9051-ed1f4280dd29 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:11:55.145752 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed53f857-fc15-49f6-9051-ed1f4280dd29 admin admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:11:55.149350 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8018f623-9965-44e6-87c7-38d1ebb76062 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b232e7a841145ba93c6d8462ccb751a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1213c0d1b584404ba3998e136f166e89', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:11:55.149947 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8018f623-9965-44e6-87c7-38d1ebb76062 service cinder] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:11:55.150226 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8018f623-9965-44e6-87c7-38d1ebb76062 service cinder] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:11:55.150495 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8018f623-9965-44e6-87c7-38d1ebb76062 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:11:55.159379 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8018f623-9965-44e6-87c7-38d1ebb76062 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:11:55.160796 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8018f623-9965-44e6-87c7-38d1ebb76062 service cinder] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:11:55.170082 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1346/2703] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 15 18:11:55 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 18:11:55.248028 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5d7dbb-02be-47c2-b285-604f5c3057cd None None] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:11:55.249611 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-8a5d7dbb-02be-47c2-b285-604f5c3057cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:11:55.262087 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5d7dbb-02be-47c2-b285-604f5c3057cd None None] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:11:55.266608 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8585a75e-1312-46b2-a606-ffae4bfac867 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b232e7a841145ba93c6d8462ccb751a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1213c0d1b584404ba3998e136f166e89', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:11:55.267357 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8585a75e-1312-46b2-a606-ffae4bfac867 service cinder] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:11:55.267681 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8585a75e-1312-46b2-a606-ffae4bfac867 service cinder] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:11:55.267957 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8585a75e-1312-46b2-a606-ffae4bfac867 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:11:55.329230 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8585a75e-1312-46b2-a606-ffae4bfac867 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:11:55.331901 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8585a75e-1312-46b2-a606-ffae4bfac867 service cinder] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:11:55.345750 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1358/2704] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 15 18:11:55 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 15 18:12:02.114319 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8018f623-9965-44e6-87c7-38d1ebb76062 service cinder] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:12:02.175076 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8018f623-9965-44e6-87c7-38d1ebb76062 service cinder] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:12:02.179610 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a03949f-4932-45d0-9964-94c83803212c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:12:02.180170 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a03949f-4932-45d0-9964-94c83803212c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:12:02.180449 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a03949f-4932-45d0-9964-94c83803212c admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:12:02.180719 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a03949f-4932-45d0-9964-94c83803212c admin admin] PATH_INFO: `/v3/users/3117c05184994380a474167e80905843` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:12:02.181881 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a03949f-4932-45d0-9964-94c83803212c admin admin] RBAC: Authorizing `identity:delete_user(user_id=3117c05184994380a474167e80905843)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:12:02.183781 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a03949f-4932-45d0-9964-94c83803212c admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:12:02.213545 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=90,keystone:INSERT=5,keystone:DELETE=5 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 18:12:02.234704 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-7a03949f-4932-45d0-9964-94c83803212c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3117c05184994380a474167e80905843'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:12:02.243046 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-7a03949f-4932-45d0-9964-94c83803212c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3117c05184994380a474167e80905843'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:12:02.243770 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-7a03949f-4932-45d0-9964-94c83803212c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3117c05184994380a474167e80905843'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:12:02.244366 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-7a03949f-4932-45d0-9964-94c83803212c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3117c05184994380a474167e80905843'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:12:02.251045 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-7a03949f-4932-45d0-9964-94c83803212c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3117c05184994380a474167e80905843'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:12:02.268471 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1347/2705] 10.222.0.25 () {58 vars in 1224 bytes} [Thu Sep 15 18:12:02 2022] DELETE /identity/v3/users/3117c05184994380a474167e80905843 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 18:12:02.273095 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1afed64-25fd-44bc-afb2-58a1c7408b82 None None] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:12:02.273619 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1afed64-25fd-44bc-afb2-58a1c7408b82 None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:12:02.273803 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1afed64-25fd-44bc-afb2-58a1c7408b82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:12:02.292570 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.auth.core [None req-e1afed64-25fd-44bc-afb2-58a1c7408b82 None None] MFA Rules not processed for user `5cfa58ef86774ab7800bf91930bf6028`. Rule list: `[]` (Enabled: `True`). {{(pid=81593) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 18:12:02.293785 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-e1afed64-25fd-44bc-afb2-58a1c7408b82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:12:02.350233 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1359/2706] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 15 18:12:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 18:12:02.360147 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a03949f-4932-45d0-9964-94c83803212c admin admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:12:02.362808 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-7a03949f-4932-45d0-9964-94c83803212c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:12:02.421212 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a03949f-4932-45d0-9964-94c83803212c admin admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:12:02.425782 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b9e0ea-4700-4630-a77c-50d635ca2888 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a32274b4781b40fea9f28da8a9bde5ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1213c0d1b584404ba3998e136f166e89', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:12:02.426425 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b9e0ea-4700-4630-a77c-50d635ca2888 service neutron] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:12:02.426704 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b9e0ea-4700-4630-a77c-50d635ca2888 service neutron] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:12:02.426975 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b9e0ea-4700-4630-a77c-50d635ca2888 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:12:02.436616 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b9e0ea-4700-4630-a77c-50d635ca2888 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:12:02.438099 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b9e0ea-4700-4630-a77c-50d635ca2888 service neutron] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:12:02.447570 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1348/2707] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 15 18:12:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 18:12:02.722971 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1afed64-25fd-44bc-afb2-58a1c7408b82 None None] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:12:02.724385 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-e1afed64-25fd-44bc-afb2-58a1c7408b82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:12:02.739894 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1afed64-25fd-44bc-afb2-58a1c7408b82 None None] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:12:02.746327 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b149ad-80f2-4bb8-bfe4-c69ba71cf9fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:12:02.747340 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b149ad-80f2-4bb8-bfe4-c69ba71cf9fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:12:02.747685 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b149ad-80f2-4bb8-bfe4-c69ba71cf9fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:12:02.748085 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b149ad-80f2-4bb8-bfe4-c69ba71cf9fc admin admin] PATH_INFO: `/v3/projects/d874ed45fe654f2b8d84e6dcb4afe3db` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:12:02.749220 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b149ad-80f2-4bb8-bfe4-c69ba71cf9fc admin admin] RBAC: Authorizing `identity:delete_project(project_id=d874ed45fe654f2b8d84e6dcb4afe3db)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:12:02.752457 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b149ad-80f2-4bb8-bfe4-c69ba71cf9fc admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:12:02.799859 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-48b149ad-80f2-4bb8-bfe4-c69ba71cf9fc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd874ed45fe654f2b8d84e6dcb4afe3db', 'request_id': 'req-48b149ad-80f2-4bb8-bfe4-c69ba71cf9fc'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:12:02.805757 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-48b149ad-80f2-4bb8-bfe4-c69ba71cf9fc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd874ed45fe654f2b8d84e6dcb4afe3db', 'request_id': 'req-48b149ad-80f2-4bb8-bfe4-c69ba71cf9fc'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:12:02.812866 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-48b149ad-80f2-4bb8-bfe4-c69ba71cf9fc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd874ed45fe654f2b8d84e6dcb4afe3db', 'request_id': 'req-48b149ad-80f2-4bb8-bfe4-c69ba71cf9fc'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:12:02.815394 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 18:12:02.826262 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-48b149ad-80f2-4bb8-bfe4-c69ba71cf9fc admin admin] The token cache is being invalidate because project d874ed45fe654f2b8d84e6dcb4afe3db was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81593) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 18:12:02.826555 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-48b149ad-80f2-4bb8-bfe4-c69ba71cf9fc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:12:02.827185 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-48b149ad-80f2-4bb8-bfe4-c69ba71cf9fc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:12:02.828644 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1360/2708] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Sep 15 18:12:02 2022] DELETE /identity/v3/projects/d874ed45fe654f2b8d84e6dcb4afe3db => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 18:12:02.832639 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b9e0ea-4700-4630-a77c-50d635ca2888 service neutron] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:12:02.842236 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b9e0ea-4700-4630-a77c-50d635ca2888 service neutron] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:12:02.897611 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8bcd2a-980b-48cb-bb58-32ad4321c5a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:12:02.898332 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8bcd2a-980b-48cb-bb58-32ad4321c5a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:12:02.898611 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8bcd2a-980b-48cb-bb58-32ad4321c5a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:12:02.898912 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8bcd2a-980b-48cb-bb58-32ad4321c5a5 admin admin] PATH_INFO: `/v3/users/4a1f87798edd431f8ee5bb4b0ffb21c1` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:12:02.900007 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e8bcd2a-980b-48cb-bb58-32ad4321c5a5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4a1f87798edd431f8ee5bb4b0ffb21c1)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:12:02.901974 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e8bcd2a-980b-48cb-bb58-32ad4321c5a5 admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:12:02.950730 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-0e8bcd2a-980b-48cb-bb58-32ad4321c5a5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4a1f87798edd431f8ee5bb4b0ffb21c1'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:12:02.953410 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 18:12:02.958974 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-0e8bcd2a-980b-48cb-bb58-32ad4321c5a5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4a1f87798edd431f8ee5bb4b0ffb21c1'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:12:02.960022 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-0e8bcd2a-980b-48cb-bb58-32ad4321c5a5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4a1f87798edd431f8ee5bb4b0ffb21c1'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:12:02.960729 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-0e8bcd2a-980b-48cb-bb58-32ad4321c5a5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4a1f87798edd431f8ee5bb4b0ffb21c1'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:12:02.968127 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-0e8bcd2a-980b-48cb-bb58-32ad4321c5a5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4a1f87798edd431f8ee5bb4b0ffb21c1'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:12:02.985448 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1349/2709] 10.222.0.25 () {58 vars in 1224 bytes} [Thu Sep 15 18:12:02 2022] DELETE /identity/v3/users/4a1f87798edd431f8ee5bb4b0ffb21c1 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 18:12:03.258181 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b149ad-80f2-4bb8-bfe4-c69ba71cf9fc admin admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:12:03.259822 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-48b149ad-80f2-4bb8-bfe4-c69ba71cf9fc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:12:03.281025 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b149ad-80f2-4bb8-bfe4-c69ba71cf9fc admin admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:12:03.341720 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4eea39-ab29-4ca4-b18e-3ed5ba616170 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:12:03.342345 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4eea39-ab29-4ca4-b18e-3ed5ba616170 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:12:03.342658 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4eea39-ab29-4ca4-b18e-3ed5ba616170 admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:12:03.342928 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4eea39-ab29-4ca4-b18e-3ed5ba616170 admin admin] PATH_INFO: `/v3/projects/945b7765a7504d17bba97280cd934489` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:12:03.344213 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4eea39-ab29-4ca4-b18e-3ed5ba616170 admin admin] RBAC: Authorizing `identity:delete_project(project_id=945b7765a7504d17bba97280cd934489)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:12:03.346861 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4eea39-ab29-4ca4-b18e-3ed5ba616170 admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:12:03.392262 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-2f4eea39-ab29-4ca4-b18e-3ed5ba616170 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '945b7765a7504d17bba97280cd934489', 'request_id': 'req-2f4eea39-ab29-4ca4-b18e-3ed5ba616170'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:12:03.398549 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-2f4eea39-ab29-4ca4-b18e-3ed5ba616170 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '945b7765a7504d17bba97280cd934489', 'request_id': 'req-2f4eea39-ab29-4ca4-b18e-3ed5ba616170'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:12:03.405923 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-2f4eea39-ab29-4ca4-b18e-3ed5ba616170 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '945b7765a7504d17bba97280cd934489', 'request_id': 'req-2f4eea39-ab29-4ca4-b18e-3ed5ba616170'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:12:03.417225 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-2f4eea39-ab29-4ca4-b18e-3ed5ba616170 admin admin] The token cache is being invalidate because project 945b7765a7504d17bba97280cd934489 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81593) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 18:12:03.417574 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-2f4eea39-ab29-4ca4-b18e-3ed5ba616170 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:12:03.418219 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-2f4eea39-ab29-4ca4-b18e-3ed5ba616170 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:12:03.419652 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1361/2710] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Sep 15 18:12:03 2022] DELETE /identity/v3/projects/945b7765a7504d17bba97280cd934489 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 18:12:03.424515 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5a0ed4-56f2-4c99-abdd-4e0fc6db7256 None None] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:12:03.424993 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5a0ed4-56f2-4c99-abdd-4e0fc6db7256 None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:12:03.425097 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5a0ed4-56f2-4c99-abdd-4e0fc6db7256 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:12:03.444178 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.auth.core [None req-5d5a0ed4-56f2-4c99-abdd-4e0fc6db7256 None None] MFA Rules not processed for user `5cfa58ef86774ab7800bf91930bf6028`. Rule list: `[]` (Enabled: `True`). {{(pid=81592) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 18:12:03.445388 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-5d5a0ed4-56f2-4c99-abdd-4e0fc6db7256 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:12:03.503888 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1350/2711] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 15 18:12:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 18:12:03.511350 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16413a9c-d92a-411b-a813-aa640688e877 None None] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:12:03.511635 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16413a9c-d92a-411b-a813-aa640688e877 None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:12:03.511912 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16413a9c-d92a-411b-a813-aa640688e877 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:12:03.530831 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.auth.core [None req-16413a9c-d92a-411b-a813-aa640688e877 None None] MFA Rules not processed for user `5cfa58ef86774ab7800bf91930bf6028`. Rule list: `[]` (Enabled: `True`). {{(pid=81593) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 18:12:03.532018 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-16413a9c-d92a-411b-a813-aa640688e877 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:12:03.539732 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1362/2712] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 15 18:12:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 18:12:03.543801 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5a0ed4-56f2-4c99-abdd-4e0fc6db7256 None None] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:12:03.554386 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5a0ed4-56f2-4c99-abdd-4e0fc6db7256 None None] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:12:03.559241 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d7b009-6053-49ae-8acf-55615e9f9065 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:12:03.559869 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d7b009-6053-49ae-8acf-55615e9f9065 admin admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:12:03.560145 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d7b009-6053-49ae-8acf-55615e9f9065 admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:12:03.560442 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d7b009-6053-49ae-8acf-55615e9f9065 admin admin] PATH_INFO: `/v3/domains` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:12:03.561083 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d7b009-6053-49ae-8acf-55615e9f9065 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81592) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 18:12:03.561415 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d7b009-6053-49ae-8acf-55615e9f9065 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:12:03.562996 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d7b009-6053-49ae-8acf-55615e9f9065 admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:12:03.576622 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1351/2713] 10.222.0.25 () {58 vars in 1153 bytes} [Thu Sep 15 18:12:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 18:12:03.580274 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16413a9c-d92a-411b-a813-aa640688e877 None None] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:12:03.589906 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16413a9c-d92a-411b-a813-aa640688e877 None None] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:12:03.594899 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc98649-2bda-413c-ab04-fd259b77109f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:12:03.595502 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc98649-2bda-413c-ab04-fd259b77109f admin admin] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:12:03.595822 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc98649-2bda-413c-ab04-fd259b77109f admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:12:03.596099 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc98649-2bda-413c-ab04-fd259b77109f admin admin] PATH_INFO: `/v3/projects` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:12:03.597086 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc98649-2bda-413c-ab04-fd259b77109f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:12:03.599051 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc98649-2bda-413c-ab04-fd259b77109f admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:12:03.628013 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1363/2714] 10.222.0.25 () {60 vars in 1153 bytes} [Thu Sep 15 18:12:03 2022] POST /identity/v3/projects => generated 365 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 18:12:03.631901 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d7b009-6053-49ae-8acf-55615e9f9065 admin admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:12:03.641983 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d7b009-6053-49ae-8acf-55615e9f9065 admin admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:12:03.700321 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f21ce28-fca6-47d4-a336-12642f25a098 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:12:03.700924 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f21ce28-fca6-47d4-a336-12642f25a098 admin admin] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:12:03.701201 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f21ce28-fca6-47d4-a336-12642f25a098 admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:12:03.701500 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f21ce28-fca6-47d4-a336-12642f25a098 admin admin] PATH_INFO: `/v3/users` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:12:03.702118 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f21ce28-fca6-47d4-a336-12642f25a098 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:12:03.704045 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f21ce28-fca6-47d4-a336-12642f25a098 admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:12:03.728868 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1352/2715] 10.222.0.25 () {60 vars in 1144 bytes} [Thu Sep 15 18:12:03 2022] POST /identity/v3/users => generated 283 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 18:12:03.730402 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc98649-2bda-413c-ab04-fd259b77109f admin admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:12:03.741371 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc98649-2bda-413c-ab04-fd259b77109f admin admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:12:03.746209 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23db5ccc-d7c8-458d-bd2c-a82fc205615c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:12:03.747070 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23db5ccc-d7c8-458d-bd2c-a82fc205615c admin admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:12:03.747070 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23db5ccc-d7c8-458d-bd2c-a82fc205615c admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:12:03.747364 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23db5ccc-d7c8-458d-bd2c-a82fc205615c admin admin] PATH_INFO: `/v3/roles` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:12:03.748004 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23db5ccc-d7c8-458d-bd2c-a82fc205615c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:12:03.749607 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23db5ccc-d7c8-458d-bd2c-a82fc205615c admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:12:03.763217 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1364/2716] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Sep 15 18:12:03 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 15 18:12:03.766954 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f21ce28-fca6-47d4-a336-12642f25a098 admin admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:12:03.777361 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f21ce28-fca6-47d4-a336-12642f25a098 admin admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:12:03.782147 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2092180-9c82-4216-9113-8f455814bd2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:12:03.782736 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2092180-9c82-4216-9113-8f455814bd2c admin admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:12:03.783036 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2092180-9c82-4216-9113-8f455814bd2c admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:12:03.783307 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2092180-9c82-4216-9113-8f455814bd2c admin admin] PATH_INFO: `/v3/roles` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:12:03.783946 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2092180-9c82-4216-9113-8f455814bd2c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:12:03.785558 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2092180-9c82-4216-9113-8f455814bd2c admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:12:03.797600 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1353/2717] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Sep 15 18:12:03 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 18:12:03.801632 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23db5ccc-d7c8-458d-bd2c-a82fc205615c admin admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:12:03.811320 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23db5ccc-d7c8-458d-bd2c-a82fc205615c admin admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:12:03.816376 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9def2c6-97a3-4d65-b202-180ab64052d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:12:03.817030 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9def2c6-97a3-4d65-b202-180ab64052d5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:12:03.817325 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9def2c6-97a3-4d65-b202-180ab64052d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:12:03.817600 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9def2c6-97a3-4d65-b202-180ab64052d5 admin admin] PATH_INFO: `/v3/projects/23ec1f07f3dd45518d8aacb39a6add93/users/c58a7fad765644d99e1983af7a2462f9/roles/343cc8b1bc7243eebabdf08147e8366d` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:12:03.832201 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9def2c6-97a3-4d65-b202-180ab64052d5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=23ec1f07f3dd45518d8aacb39a6add93, user_id=c58a7fad765644d99e1983af7a2462f9, role_id=343cc8b1bc7243eebabdf08147e8366d)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:12:03.834982 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9def2c6-97a3-4d65-b202-180ab64052d5 admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:12:03.848739 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1365/2718] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Sep 15 18:12:03 2022] PUT /identity/v3/projects/23ec1f07f3dd45518d8aacb39a6add93/users/c58a7fad765644d99e1983af7a2462f9/roles/343cc8b1bc7243eebabdf08147e8366d => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 18:12:03.860010 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfe10ee-3416-40eb-b1e6-6a3f84b0ba56 None None] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:12:03.860288 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfe10ee-3416-40eb-b1e6-6a3f84b0ba56 None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:12:03.860561 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfe10ee-3416-40eb-b1e6-6a3f84b0ba56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:12:03.891388 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.auth.core [None req-dbfe10ee-3416-40eb-b1e6-6a3f84b0ba56 None None] MFA Rules not processed for user `c58a7fad765644d99e1983af7a2462f9`. Rule list: `[]` (Enabled: `True`). {{(pid=81592) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 18:12:03.893221 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-dbfe10ee-3416-40eb-b1e6-6a3f84b0ba56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:12:03.933932 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:DELETE=3,keystone:SELECT=94,keystone:INSERT=3 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 18:12:03.984463 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1354/2719] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 15 18:12:03 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 18:12:03.989367 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9def2c6-97a3-4d65-b202-180ab64052d5 admin admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:12:04.015854 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 18:12:04.061154 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9def2c6-97a3-4d65-b202-180ab64052d5 admin admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:12:04.066542 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad782e3-17da-4d3d-806e-3be2f032807d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:12:04.067027 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad782e3-17da-4d3d-806e-3be2f032807d admin admin] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:12:04.067305 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad782e3-17da-4d3d-806e-3be2f032807d admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:12:04.067574 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad782e3-17da-4d3d-806e-3be2f032807d admin admin] PATH_INFO: `/v3/projects` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:12:04.068211 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad782e3-17da-4d3d-806e-3be2f032807d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:12:04.070166 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad782e3-17da-4d3d-806e-3be2f032807d admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:12:04.099191 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1366/2720] 10.222.0.25 () {60 vars in 1153 bytes} [Thu Sep 15 18:12:03 2022] POST /identity/v3/projects => generated 365 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 18:12:04.103242 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbfe10ee-3416-40eb-b1e6-6a3f84b0ba56 None None] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:12:04.114675 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbfe10ee-3416-40eb-b1e6-6a3f84b0ba56 None None] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:12:04.169571 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea20721e-b361-4493-aeb0-a07d1146dc83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:12:04.170180 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea20721e-b361-4493-aeb0-a07d1146dc83 admin admin] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:12:04.170459 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea20721e-b361-4493-aeb0-a07d1146dc83 admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:12:04.170733 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea20721e-b361-4493-aeb0-a07d1146dc83 admin admin] PATH_INFO: `/v3/users` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:12:04.171364 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea20721e-b361-4493-aeb0-a07d1146dc83 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:12:04.173262 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea20721e-b361-4493-aeb0-a07d1146dc83 admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:12:04.194760 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1355/2721] 10.222.0.25 () {60 vars in 1144 bytes} [Thu Sep 15 18:12:04 2022] POST /identity/v3/users => generated 289 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 18:12:04.198737 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad782e3-17da-4d3d-806e-3be2f032807d admin admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:12:04.208875 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad782e3-17da-4d3d-806e-3be2f032807d admin admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:12:04.213856 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fec9834-f793-4c88-accb-9e229b7561f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:12:04.214675 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fec9834-f793-4c88-accb-9e229b7561f1 admin admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:12:04.214810 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fec9834-f793-4c88-accb-9e229b7561f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:12:04.214990 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fec9834-f793-4c88-accb-9e229b7561f1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:12:04.215651 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fec9834-f793-4c88-accb-9e229b7561f1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:12:04.217397 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fec9834-f793-4c88-accb-9e229b7561f1 admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:12:04.229351 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1367/2722] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Sep 15 18:12:04 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 18:12:04.233871 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea20721e-b361-4493-aeb0-a07d1146dc83 admin admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:12:04.244559 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea20721e-b361-4493-aeb0-a07d1146dc83 admin admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:12:04.249482 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6145be-fc28-494d-a391-3b0752aa41da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:12:04.250142 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6145be-fc28-494d-a391-3b0752aa41da admin admin] REQUEST_METHOD: `PUT` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:12:04.250428 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6145be-fc28-494d-a391-3b0752aa41da admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:12:04.250709 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6145be-fc28-494d-a391-3b0752aa41da admin admin] PATH_INFO: `/v3/projects/4e54fa3ffa574ac7b80726e9e87be51d/users/1b92ef052cd34d96a2695b4a2b8cd7c3/roles/a9e42be86923434f8af52d3fc07fb4f7` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:12:04.266628 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6145be-fc28-494d-a391-3b0752aa41da admin admin] RBAC: Authorizing `identity:create_grant(project_id=4e54fa3ffa574ac7b80726e9e87be51d, user_id=1b92ef052cd34d96a2695b4a2b8cd7c3, role_id=a9e42be86923434f8af52d3fc07fb4f7)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:12:04.269240 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6145be-fc28-494d-a391-3b0752aa41da admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:12:04.281692 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1356/2723] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Sep 15 18:12:04 2022] PUT /identity/v3/projects/4e54fa3ffa574ac7b80726e9e87be51d/users/1b92ef052cd34d96a2695b4a2b8cd7c3/roles/a9e42be86923434f8af52d3fc07fb4f7 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 18:12:04.285675 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fec9834-f793-4c88-accb-9e229b7561f1 admin admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:12:04.295572 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fec9834-f793-4c88-accb-9e229b7561f1 admin admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:12:04.368101 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2b6e8a-7e5b-48ed-82b2-824031941873 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:12:04.368990 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2b6e8a-7e5b-48ed-82b2-824031941873 admin admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:12:04.369448 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2b6e8a-7e5b-48ed-82b2-824031941873 admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:12:04.369865 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2b6e8a-7e5b-48ed-82b2-824031941873 admin admin] PATH_INFO: `/v3/roles` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:12:04.370832 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e2b6e8a-7e5b-48ed-82b2-824031941873 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:12:04.372754 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e2b6e8a-7e5b-48ed-82b2-824031941873 admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:12:04.387633 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1368/2724] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Sep 15 18:12:04 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 18:12:04.391810 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6145be-fc28-494d-a391-3b0752aa41da admin admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:12:04.402039 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6145be-fc28-494d-a391-3b0752aa41da admin admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:12:04.406625 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567f837e-12fa-4c37-92f4-4449865a1fbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:12:04.407258 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567f837e-12fa-4c37-92f4-4449865a1fbf admin admin] REQUEST_METHOD: `PUT` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:12:04.407534 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567f837e-12fa-4c37-92f4-4449865a1fbf admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:12:04.407804 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567f837e-12fa-4c37-92f4-4449865a1fbf admin admin] PATH_INFO: `/v3/projects/4e54fa3ffa574ac7b80726e9e87be51d/users/1b92ef052cd34d96a2695b4a2b8cd7c3/roles/a9e42be86923434f8af52d3fc07fb4f7` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:12:04.410351 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-567f837e-12fa-4c37-92f4-4449865a1fbf admin admin] RBAC: Authorizing `identity:create_grant(project_id=4e54fa3ffa574ac7b80726e9e87be51d, user_id=1b92ef052cd34d96a2695b4a2b8cd7c3, role_id=a9e42be86923434f8af52d3fc07fb4f7)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:12:04.412979 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-567f837e-12fa-4c37-92f4-4449865a1fbf admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:12:04.422833 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1357/2725] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Sep 15 18:12:04 2022] PUT /identity/v3/projects/4e54fa3ffa574ac7b80726e9e87be51d/users/1b92ef052cd34d96a2695b4a2b8cd7c3/roles/a9e42be86923434f8af52d3fc07fb4f7 => generated 0 bytes in 31 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 18:12:04.433484 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0e8b3d-0762-4024-84ab-efc467db3780 None None] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:12:04.433781 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0e8b3d-0762-4024-84ab-efc467db3780 None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:12:04.434053 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0e8b3d-0762-4024-84ab-efc467db3780 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:12:04.460539 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.auth.core [None req-7a0e8b3d-0762-4024-84ab-efc467db3780 None None] MFA Rules not processed for user `1b92ef052cd34d96a2695b4a2b8cd7c3`. Rule list: `[]` (Enabled: `True`). {{(pid=81593) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 18:12:04.462010 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-7a0e8b3d-0762-4024-84ab-efc467db3780 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:12:04.527112 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1369/2726] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 15 18:12:04 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 18:12:04.538663 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567f837e-12fa-4c37-92f4-4449865a1fbf admin admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:12:04.540448 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-567f837e-12fa-4c37-92f4-4449865a1fbf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:12:04.597390 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567f837e-12fa-4c37-92f4-4449865a1fbf admin admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:12:04.600961 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379b0197-5cca-4e50-a0ff-ef6d8d29447a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b232e7a841145ba93c6d8462ccb751a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1213c0d1b584404ba3998e136f166e89', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:12:04.601589 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379b0197-5cca-4e50-a0ff-ef6d8d29447a service cinder] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:12:04.601861 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379b0197-5cca-4e50-a0ff-ef6d8d29447a service cinder] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:12:04.602128 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379b0197-5cca-4e50-a0ff-ef6d8d29447a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:12:04.610961 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-379b0197-5cca-4e50-a0ff-ef6d8d29447a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:12:04.613042 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-379b0197-5cca-4e50-a0ff-ef6d8d29447a service cinder] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:12:04.622138 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1358/2727] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 15 18:12:04 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 18:12:05.036795 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0e8b3d-0762-4024-84ab-efc467db3780 None None] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:12:05.055940 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 18:12:05.100604 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0e8b3d-0762-4024-84ab-efc467db3780 None None] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:12:05.106847 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00232d1e-7d42-440d-b5db-cf302118e0c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:12:05.107760 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00232d1e-7d42-440d-b5db-cf302118e0c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:12:05.108066 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00232d1e-7d42-440d-b5db-cf302118e0c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:12:05.108336 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00232d1e-7d42-440d-b5db-cf302118e0c1 admin admin] PATH_INFO: `/v3/users/c58a7fad765644d99e1983af7a2462f9` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:12:05.109493 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00232d1e-7d42-440d-b5db-cf302118e0c1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c58a7fad765644d99e1983af7a2462f9)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:12:05.111943 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00232d1e-7d42-440d-b5db-cf302118e0c1 admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:12:05.168388 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-00232d1e-7d42-440d-b5db-cf302118e0c1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c58a7fad765644d99e1983af7a2462f9'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:12:05.178514 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-00232d1e-7d42-440d-b5db-cf302118e0c1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c58a7fad765644d99e1983af7a2462f9'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:12:05.179401 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-00232d1e-7d42-440d-b5db-cf302118e0c1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c58a7fad765644d99e1983af7a2462f9'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:12:05.180342 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-00232d1e-7d42-440d-b5db-cf302118e0c1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c58a7fad765644d99e1983af7a2462f9'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:12:05.190227 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-00232d1e-7d42-440d-b5db-cf302118e0c1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c58a7fad765644d99e1983af7a2462f9'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:12:05.207993 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1370/2728] 10.222.0.25 () {58 vars in 1224 bytes} [Thu Sep 15 18:12:05 2022] DELETE /identity/v3/users/c58a7fad765644d99e1983af7a2462f9 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 18:12:05.212639 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5b4d0d-e2e5-49d1-8cb9-cd85393ca8a5 None None] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:12:05.212950 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5b4d0d-e2e5-49d1-8cb9-cd85393ca8a5 None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:12:05.213227 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5b4d0d-e2e5-49d1-8cb9-cd85393ca8a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:12:05.232271 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.auth.core [None req-ab5b4d0d-e2e5-49d1-8cb9-cd85393ca8a5 None None] MFA Rules not processed for user `5cfa58ef86774ab7800bf91930bf6028`. Rule list: `[]` (Enabled: `True`). {{(pid=81592) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 18:12:05.233460 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-ab5b4d0d-e2e5-49d1-8cb9-cd85393ca8a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:12:05.246200 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 18:12:05.294011 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1359/2729] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 15 18:12:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 18:12:05.304238 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00232d1e-7d42-440d-b5db-cf302118e0c1 admin admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:12:05.305650 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-00232d1e-7d42-440d-b5db-cf302118e0c1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:12:05.365706 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00232d1e-7d42-440d-b5db-cf302118e0c1 admin admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:12:05.369269 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50dd848c-e3bd-454a-8db3-749122a1475c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a32274b4781b40fea9f28da8a9bde5ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1213c0d1b584404ba3998e136f166e89', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:12:05.369913 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50dd848c-e3bd-454a-8db3-749122a1475c service neutron] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:12:05.370186 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50dd848c-e3bd-454a-8db3-749122a1475c service neutron] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:12:05.370452 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50dd848c-e3bd-454a-8db3-749122a1475c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:12:05.379245 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50dd848c-e3bd-454a-8db3-749122a1475c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:12:05.380689 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50dd848c-e3bd-454a-8db3-749122a1475c service neutron] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:12:05.390912 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1371/2730] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 15 18:12:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 18:12:05.655785 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5b4d0d-e2e5-49d1-8cb9-cd85393ca8a5 None None] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:12:05.657617 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-ab5b4d0d-e2e5-49d1-8cb9-cd85393ca8a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:12:05.670802 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5b4d0d-e2e5-49d1-8cb9-cd85393ca8a5 None None] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:12:05.676454 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0625285d-59dc-482a-96c1-d4b1b3fe1d25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:12:05.677755 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0625285d-59dc-482a-96c1-d4b1b3fe1d25 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:12:05.678025 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0625285d-59dc-482a-96c1-d4b1b3fe1d25 admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:12:05.678578 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0625285d-59dc-482a-96c1-d4b1b3fe1d25 admin admin] PATH_INFO: `/v3/projects/23ec1f07f3dd45518d8aacb39a6add93` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:12:05.679839 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0625285d-59dc-482a-96c1-d4b1b3fe1d25 admin admin] RBAC: Authorizing `identity:delete_project(project_id=23ec1f07f3dd45518d8aacb39a6add93)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:12:05.681768 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0625285d-59dc-482a-96c1-d4b1b3fe1d25 admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:12:05.727417 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-0625285d-59dc-482a-96c1-d4b1b3fe1d25 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '23ec1f07f3dd45518d8aacb39a6add93', 'request_id': 'req-0625285d-59dc-482a-96c1-d4b1b3fe1d25'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:12:05.732808 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-0625285d-59dc-482a-96c1-d4b1b3fe1d25 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '23ec1f07f3dd45518d8aacb39a6add93', 'request_id': 'req-0625285d-59dc-482a-96c1-d4b1b3fe1d25'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:12:05.741932 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-0625285d-59dc-482a-96c1-d4b1b3fe1d25 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '23ec1f07f3dd45518d8aacb39a6add93', 'request_id': 'req-0625285d-59dc-482a-96c1-d4b1b3fe1d25'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:12:05.754204 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-0625285d-59dc-482a-96c1-d4b1b3fe1d25 admin admin] The token cache is being invalidate because project 23ec1f07f3dd45518d8aacb39a6add93 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81592) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 18:12:05.754489 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-0625285d-59dc-482a-96c1-d4b1b3fe1d25 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:12:05.755105 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-0625285d-59dc-482a-96c1-d4b1b3fe1d25 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:12:05.756594 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1360/2731] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Sep 15 18:12:05 2022] DELETE /identity/v3/projects/23ec1f07f3dd45518d8aacb39a6add93 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 18:12:05.760631 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50dd848c-e3bd-454a-8db3-749122a1475c service neutron] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:12:05.770794 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50dd848c-e3bd-454a-8db3-749122a1475c service neutron] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:12:05.807903 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 18:12:05.827754 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c85936-b1a7-4841-9674-0c3140671587 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:12:05.828380 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c85936-b1a7-4841-9674-0c3140671587 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:12:05.828676 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c85936-b1a7-4841-9674-0c3140671587 admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:12:05.828930 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c85936-b1a7-4841-9674-0c3140671587 admin admin] PATH_INFO: `/v3/users/1b92ef052cd34d96a2695b4a2b8cd7c3` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:12:05.830636 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c85936-b1a7-4841-9674-0c3140671587 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1b92ef052cd34d96a2695b4a2b8cd7c3)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:12:05.832487 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c85936-b1a7-4841-9674-0c3140671587 admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:12:05.878116 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-a4c85936-b1a7-4841-9674-0c3140671587 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1b92ef052cd34d96a2695b4a2b8cd7c3'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:12:05.885088 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-a4c85936-b1a7-4841-9674-0c3140671587 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1b92ef052cd34d96a2695b4a2b8cd7c3'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:12:05.885738 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-a4c85936-b1a7-4841-9674-0c3140671587 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1b92ef052cd34d96a2695b4a2b8cd7c3'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:12:05.886367 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-a4c85936-b1a7-4841-9674-0c3140671587 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1b92ef052cd34d96a2695b4a2b8cd7c3'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:12:05.893149 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-a4c85936-b1a7-4841-9674-0c3140671587 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1b92ef052cd34d96a2695b4a2b8cd7c3'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:12:05.913371 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1372/2732] 10.222.0.25 () {58 vars in 1224 bytes} [Thu Sep 15 18:12:05 2022] DELETE /identity/v3/users/1b92ef052cd34d96a2695b4a2b8cd7c3 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 18:12:06.180144 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0625285d-59dc-482a-96c1-d4b1b3fe1d25 admin admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:12:06.181627 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-0625285d-59dc-482a-96c1-d4b1b3fe1d25 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:12:06.197099 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0625285d-59dc-482a-96c1-d4b1b3fe1d25 admin admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:12:06.237593 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c85936-b1a7-4841-9674-0c3140671587 admin admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:12:06.239097 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-a4c85936-b1a7-4841-9674-0c3140671587 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:12:06.260637 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d596c80c-62b7-45a2-a1ae-69312f1fd3f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:12:06.261264 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d596c80c-62b7-45a2-a1ae-69312f1fd3f5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:12:06.261569 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d596c80c-62b7-45a2-a1ae-69312f1fd3f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:12:06.261838 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d596c80c-62b7-45a2-a1ae-69312f1fd3f5 admin admin] PATH_INFO: `/v3/projects/4e54fa3ffa574ac7b80726e9e87be51d` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:12:06.262948 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d596c80c-62b7-45a2-a1ae-69312f1fd3f5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4e54fa3ffa574ac7b80726e9e87be51d)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:12:06.265016 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d596c80c-62b7-45a2-a1ae-69312f1fd3f5 admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:12:06.306297 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c85936-b1a7-4841-9674-0c3140671587 admin admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:12:06.311999 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 18:12:06.316290 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-d596c80c-62b7-45a2-a1ae-69312f1fd3f5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4e54fa3ffa574ac7b80726e9e87be51d', 'request_id': 'req-d596c80c-62b7-45a2-a1ae-69312f1fd3f5'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:12:06.323216 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-d596c80c-62b7-45a2-a1ae-69312f1fd3f5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4e54fa3ffa574ac7b80726e9e87be51d', 'request_id': 'req-d596c80c-62b7-45a2-a1ae-69312f1fd3f5'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:12:06.331372 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-d596c80c-62b7-45a2-a1ae-69312f1fd3f5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4e54fa3ffa574ac7b80726e9e87be51d', 'request_id': 'req-d596c80c-62b7-45a2-a1ae-69312f1fd3f5'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:12:06.343644 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-d596c80c-62b7-45a2-a1ae-69312f1fd3f5 admin admin] The token cache is being invalidate because project 4e54fa3ffa574ac7b80726e9e87be51d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81592) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 18:12:06.343932 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-d596c80c-62b7-45a2-a1ae-69312f1fd3f5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:12:06.344585 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-d596c80c-62b7-45a2-a1ae-69312f1fd3f5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:12:06.346150 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1361/2733] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Sep 15 18:12:06 2022] DELETE /identity/v3/projects/4e54fa3ffa574ac7b80726e9e87be51d => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 18:12:06.350753 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad3e466-7d34-4a9c-a20c-0c3871254c69 None None] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:12:06.351035 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad3e466-7d34-4a9c-a20c-0c3871254c69 None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:12:06.351305 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad3e466-7d34-4a9c-a20c-0c3871254c69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:12:06.365743 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc36a87d-1c6f-449f-8211-b5eee60acf75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:12:06.366299 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc36a87d-1c6f-449f-8211-b5eee60acf75 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:12:06.366578 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc36a87d-1c6f-449f-8211-b5eee60acf75 admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:12:06.366859 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc36a87d-1c6f-449f-8211-b5eee60acf75 admin admin] PATH_INFO: `/v3/users/e88c61bf70b149689dcc963380dc952a` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:12:06.367975 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc36a87d-1c6f-449f-8211-b5eee60acf75 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e88c61bf70b149689dcc963380dc952a)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:12:06.369924 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc36a87d-1c6f-449f-8211-b5eee60acf75 admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:12:06.372245 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.auth.core [None req-3ad3e466-7d34-4a9c-a20c-0c3871254c69 None None] MFA Rules not processed for user `5cfa58ef86774ab7800bf91930bf6028`. Rule list: `[]` (Enabled: `True`). {{(pid=81592) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 18:12:06.373508 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-3ad3e466-7d34-4a9c-a20c-0c3871254c69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:12:06.375594 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 18:12:06.382911 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1362/2734] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 15 18:12:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 18:12:06.390744 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319c9e92-498e-4b96-8d83-1ebdc3b2254f None None] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:12:06.391257 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319c9e92-498e-4b96-8d83-1ebdc3b2254f None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:12:06.391535 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319c9e92-498e-4b96-8d83-1ebdc3b2254f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:12:06.411791 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.auth.core [None req-319c9e92-498e-4b96-8d83-1ebdc3b2254f None None] MFA Rules not processed for user `5cfa58ef86774ab7800bf91930bf6028`. Rule list: `[]` (Enabled: `True`). {{(pid=81592) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 18:12:06.412988 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-319c9e92-498e-4b96-8d83-1ebdc3b2254f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:12:06.418728 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-fc36a87d-1c6f-449f-8211-b5eee60acf75 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e88c61bf70b149689dcc963380dc952a'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:12:06.420963 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1363/2735] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 15 18:12:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 18:12:06.425656 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319c9e92-498e-4b96-8d83-1ebdc3b2254f None None] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:12:06.427829 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-fc36a87d-1c6f-449f-8211-b5eee60acf75 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e88c61bf70b149689dcc963380dc952a'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:12:06.428522 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-fc36a87d-1c6f-449f-8211-b5eee60acf75 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e88c61bf70b149689dcc963380dc952a'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:12:06.429204 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-fc36a87d-1c6f-449f-8211-b5eee60acf75 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e88c61bf70b149689dcc963380dc952a'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:12:06.434680 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319c9e92-498e-4b96-8d83-1ebdc3b2254f None None] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:12:06.436989 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-fc36a87d-1c6f-449f-8211-b5eee60acf75 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e88c61bf70b149689dcc963380dc952a'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:12:06.440059 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61770ad0-9639-4af5-889c-ead3962335c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:12:06.440650 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61770ad0-9639-4af5-889c-ead3962335c8 admin admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:12:06.440934 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61770ad0-9639-4af5-889c-ead3962335c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:12:06.441198 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61770ad0-9639-4af5-889c-ead3962335c8 admin admin] PATH_INFO: `/v3/domains` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:12:06.441904 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61770ad0-9639-4af5-889c-ead3962335c8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81592) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 18:12:06.442176 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61770ad0-9639-4af5-889c-ead3962335c8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:12:06.443752 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61770ad0-9639-4af5-889c-ead3962335c8 admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:12:06.455408 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1364/2736] 10.222.0.25 () {58 vars in 1153 bytes} [Thu Sep 15 18:12:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 18:12:06.459112 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1373/2737] 10.222.0.25 () {58 vars in 1224 bytes} [Thu Sep 15 18:12:06 2022] DELETE /identity/v3/users/e88c61bf70b149689dcc963380dc952a => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 15 18:12:06.459646 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61770ad0-9639-4af5-889c-ead3962335c8 admin admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:12:06.461270 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-61770ad0-9639-4af5-889c-ead3962335c8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:12:06.463429 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e50f58-dc67-4b3e-909c-cfaa9d16a93d None None] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:12:06.463718 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e50f58-dc67-4b3e-909c-cfaa9d16a93d None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:12:06.463991 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e50f58-dc67-4b3e-909c-cfaa9d16a93d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:12:06.473905 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61770ad0-9639-4af5-889c-ead3962335c8 admin admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:12:06.483525 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.auth.core [None req-d1e50f58-dc67-4b3e-909c-cfaa9d16a93d None None] MFA Rules not processed for user `5cfa58ef86774ab7800bf91930bf6028`. Rule list: `[]` (Enabled: `True`). {{(pid=81593) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 18:12:06.484726 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-d1e50f58-dc67-4b3e-909c-cfaa9d16a93d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:12:06.531456 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3291fde-f848-4105-959d-1f74c5dccb0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:12:06.532069 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3291fde-f848-4105-959d-1f74c5dccb0e admin admin] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:12:06.532353 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3291fde-f848-4105-959d-1f74c5dccb0e admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:12:06.532631 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3291fde-f848-4105-959d-1f74c5dccb0e admin admin] PATH_INFO: `/v3/projects` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:12:06.533265 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3291fde-f848-4105-959d-1f74c5dccb0e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:12:06.535266 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3291fde-f848-4105-959d-1f74c5dccb0e admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:12:06.544200 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1374/2738] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 15 18:12:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 18:12:06.554589 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e50f58-dc67-4b3e-909c-cfaa9d16a93d None None] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:12:06.555965 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-d1e50f58-dc67-4b3e-909c-cfaa9d16a93d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:12:06.564108 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1365/2739] 10.222.0.25 () {60 vars in 1153 bytes} [Thu Sep 15 18:12:06 2022] POST /identity/v3/projects => generated 387 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 15 18:12:06.568481 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3291fde-f848-4105-959d-1f74c5dccb0e admin admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:12:06.615213 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e50f58-dc67-4b3e-909c-cfaa9d16a93d None None] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:12:06.630611 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3291fde-f848-4105-959d-1f74c5dccb0e admin admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:12:06.635305 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d65494-df3a-4d47-855b-67fee8db266b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:12:06.635912 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d65494-df3a-4d47-855b-67fee8db266b admin admin] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:12:06.636193 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d65494-df3a-4d47-855b-67fee8db266b admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:12:06.636461 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d65494-df3a-4d47-855b-67fee8db266b admin admin] PATH_INFO: `/v3/users` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:12:06.637085 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d65494-df3a-4d47-855b-67fee8db266b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:12:06.639008 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d65494-df3a-4d47-855b-67fee8db266b admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:12:06.656947 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 18:12:06.660841 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1366/2740] 10.222.0.25 () {60 vars in 1144 bytes} [Thu Sep 15 18:12:06 2022] POST /identity/v3/users => generated 294 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 15 18:12:06.666243 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d65494-df3a-4d47-855b-67fee8db266b admin admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:12:06.668512 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e659383-5bcf-4ffa-82a9-ee1f15c4e075 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a32274b4781b40fea9f28da8a9bde5ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1213c0d1b584404ba3998e136f166e89', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:12:06.669120 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e659383-5bcf-4ffa-82a9-ee1f15c4e075 service neutron] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:12:06.669436 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e659383-5bcf-4ffa-82a9-ee1f15c4e075 service neutron] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:12:06.669765 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e659383-5bcf-4ffa-82a9-ee1f15c4e075 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:12:06.676110 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d65494-df3a-4d47-855b-67fee8db266b admin admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:12:06.680602 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e659383-5bcf-4ffa-82a9-ee1f15c4e075 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:12:06.681749 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0b5ccc-2c9b-4706-a47a-db69aee60e6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:12:06.682359 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e659383-5bcf-4ffa-82a9-ee1f15c4e075 service neutron] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:12:06.682488 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0b5ccc-2c9b-4706-a47a-db69aee60e6a admin admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:12:06.682664 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0b5ccc-2c9b-4706-a47a-db69aee60e6a admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:12:06.683014 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0b5ccc-2c9b-4706-a47a-db69aee60e6a admin admin] PATH_INFO: `/v3/roles` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:12:06.683837 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b0b5ccc-2c9b-4706-a47a-db69aee60e6a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:12:06.685570 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b0b5ccc-2c9b-4706-a47a-db69aee60e6a admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:12:06.692781 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1375/2741] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 15 18:12:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 15 18:12:06.696171 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1367/2742] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Sep 15 18:12:06 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 15 18:12:06.699937 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e659383-5bcf-4ffa-82a9-ee1f15c4e075 service neutron] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:12:06.710408 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e659383-5bcf-4ffa-82a9-ee1f15c4e075 service neutron] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:12:06.715465 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f399ef-e333-4a01-ab25-0a96311d7fd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:12:06.716168 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f399ef-e333-4a01-ab25-0a96311d7fd6 admin admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:12:06.716580 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f399ef-e333-4a01-ab25-0a96311d7fd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:12:06.716954 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f399ef-e333-4a01-ab25-0a96311d7fd6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:12:06.717741 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f399ef-e333-4a01-ab25-0a96311d7fd6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:12:06.719372 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f399ef-e333-4a01-ab25-0a96311d7fd6 admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:12:06.729645 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1376/2743] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Sep 15 18:12:06 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 18:12:06.734731 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0b5ccc-2c9b-4706-a47a-db69aee60e6a admin admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:12:06.746400 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0b5ccc-2c9b-4706-a47a-db69aee60e6a admin admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:12:06.751798 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163474d5-5c6c-4571-933d-3a8797285507 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:12:06.753089 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163474d5-5c6c-4571-933d-3a8797285507 admin admin] REQUEST_METHOD: `PUT` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:12:06.753400 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163474d5-5c6c-4571-933d-3a8797285507 admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:12:06.753676 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163474d5-5c6c-4571-933d-3a8797285507 admin admin] PATH_INFO: `/v3/projects/e03749f933ce4ec48dff876c09c4bf15/users/0b12a0fef36144bb9e449d544d3558b4/roles/343cc8b1bc7243eebabdf08147e8366d` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:12:06.756869 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=91,keystone:DELETE=4,keystone:INSERT=5 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 18:12:06.772111 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-163474d5-5c6c-4571-933d-3a8797285507 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e03749f933ce4ec48dff876c09c4bf15, user_id=0b12a0fef36144bb9e449d544d3558b4, role_id=343cc8b1bc7243eebabdf08147e8366d)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:12:06.774988 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-163474d5-5c6c-4571-933d-3a8797285507 admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:12:06.787657 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1368/2744] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Sep 15 18:12:06 2022] PUT /identity/v3/projects/e03749f933ce4ec48dff876c09c4bf15/users/0b12a0fef36144bb9e449d544d3558b4/roles/343cc8b1bc7243eebabdf08147e8366d => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 18:12:06.799054 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f15323-269f-46c9-a897-637b42027b47 None None] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:12:06.799367 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f15323-269f-46c9-a897-637b42027b47 None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:12:06.799640 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f15323-269f-46c9-a897-637b42027b47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:12:06.827378 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.auth.core [None req-95f15323-269f-46c9-a897-637b42027b47 None None] MFA Rules not processed for user `0b12a0fef36144bb9e449d544d3558b4`. Rule list: `[]` (Enabled: `True`). {{(pid=81593) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 18:12:06.828679 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-95f15323-269f-46c9-a897-637b42027b47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:12:06.897977 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1377/2745] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 15 18:12:06 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 18:12:06.903298 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163474d5-5c6c-4571-933d-3a8797285507 admin admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:12:06.974531 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163474d5-5c6c-4571-933d-3a8797285507 admin admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:12:06.979000 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f15323-269f-46c9-a897-637b42027b47 None None] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:12:06.980516 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-95f15323-269f-46c9-a897-637b42027b47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:12:06.980907 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6d95db-b16f-4e94-9373-892eebf7cb53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:12:06.981557 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6d95db-b16f-4e94-9373-892eebf7cb53 admin admin] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:12:06.981831 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6d95db-b16f-4e94-9373-892eebf7cb53 admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:12:06.982108 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6d95db-b16f-4e94-9373-892eebf7cb53 admin admin] PATH_INFO: `/v3/projects` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:12:06.982764 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a6d95db-b16f-4e94-9373-892eebf7cb53 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:12:06.984717 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a6d95db-b16f-4e94-9373-892eebf7cb53 admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:12:06.996244 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f15323-269f-46c9-a897-637b42027b47 None None] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:12:07.001031 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7601893c-ecba-4104-a706-4ac4b387caa7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:12:07.001794 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7601893c-ecba-4104-a706-4ac4b387caa7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:12:07.002816 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7601893c-ecba-4104-a706-4ac4b387caa7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:12:07.002971 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7601893c-ecba-4104-a706-4ac4b387caa7 admin admin] PATH_INFO: `/v3/projects/a69e11c8e36c4d75830827a5bde6ad29` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:12:07.004200 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7601893c-ecba-4104-a706-4ac4b387caa7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a69e11c8e36c4d75830827a5bde6ad29)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:12:07.006283 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7601893c-ecba-4104-a706-4ac4b387caa7 admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:12:07.032469 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1369/2746] 10.222.0.25 () {60 vars in 1153 bytes} [Thu Sep 15 18:12:06 2022] POST /identity/v3/projects => generated 387 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 18:12:07.033531 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6d95db-b16f-4e94-9373-892eebf7cb53 admin admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:12:07.058652 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-7601893c-ecba-4104-a706-4ac4b387caa7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a69e11c8e36c4d75830827a5bde6ad29', 'request_id': 'req-7601893c-ecba-4104-a706-4ac4b387caa7'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:12:07.064324 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-7601893c-ecba-4104-a706-4ac4b387caa7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a69e11c8e36c4d75830827a5bde6ad29', 'request_id': 'req-7601893c-ecba-4104-a706-4ac4b387caa7'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:12:07.072431 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-7601893c-ecba-4104-a706-4ac4b387caa7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a69e11c8e36c4d75830827a5bde6ad29', 'request_id': 'req-7601893c-ecba-4104-a706-4ac4b387caa7'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:12:07.083803 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-7601893c-ecba-4104-a706-4ac4b387caa7 admin admin] The token cache is being invalidate because project a69e11c8e36c4d75830827a5bde6ad29 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81593) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 18:12:07.084096 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-7601893c-ecba-4104-a706-4ac4b387caa7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:12:07.084869 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-7601893c-ecba-4104-a706-4ac4b387caa7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:12:07.086363 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1378/2747] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Sep 15 18:12:06 2022] DELETE /identity/v3/projects/a69e11c8e36c4d75830827a5bde6ad29 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 18:12:07.090629 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7601893c-ecba-4104-a706-4ac4b387caa7 admin admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:12:07.092181 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-7601893c-ecba-4104-a706-4ac4b387caa7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:12:07.100980 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6d95db-b16f-4e94-9373-892eebf7cb53 admin admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:12:07.140716 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 18:12:07.160012 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7601893c-ecba-4104-a706-4ac4b387caa7 admin admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:12:07.161692 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a885589-378a-470e-907f-ff018e5fa860 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:12:07.162356 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a885589-378a-470e-907f-ff018e5fa860 admin admin] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:12:07.162635 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a885589-378a-470e-907f-ff018e5fa860 admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:12:07.162953 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a885589-378a-470e-907f-ff018e5fa860 admin admin] PATH_INFO: `/v3/users` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:12:07.163558 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a885589-378a-470e-907f-ff018e5fa860 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:12:07.164550 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32f46d8-b86f-4214-b0e8-11e9517c9860 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:12:07.165175 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32f46d8-b86f-4214-b0e8-11e9517c9860 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:12:07.165488 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a885589-378a-470e-907f-ff018e5fa860 admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:12:07.165593 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32f46d8-b86f-4214-b0e8-11e9517c9860 admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:12:07.165760 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32f46d8-b86f-4214-b0e8-11e9517c9860 admin admin] PATH_INFO: `/v3/users/9f23677ecbfc4271a75f303b929840f9` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:12:07.166881 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a32f46d8-b86f-4214-b0e8-11e9517c9860 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9f23677ecbfc4271a75f303b929840f9)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:12:07.168782 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a32f46d8-b86f-4214-b0e8-11e9517c9860 admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:12:07.188228 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1370/2748] 10.222.0.25 () {60 vars in 1144 bytes} [Thu Sep 15 18:12:07 2022] POST /identity/v3/users => generated 300 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 15 18:12:07.192981 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a885589-378a-470e-907f-ff018e5fa860 admin admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:12:07.194600 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-3a885589-378a-470e-907f-ff018e5fa860 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:12:07.206899 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a885589-378a-470e-907f-ff018e5fa860 admin admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:12:07.211990 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac1eabd-98a4-448f-93fa-f57b62fd9b5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:12:07.212599 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac1eabd-98a4-448f-93fa-f57b62fd9b5d admin admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:12:07.212865 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac1eabd-98a4-448f-93fa-f57b62fd9b5d admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:12:07.213138 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac1eabd-98a4-448f-93fa-f57b62fd9b5d admin admin] PATH_INFO: `/v3/roles` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:12:07.213827 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac1eabd-98a4-448f-93fa-f57b62fd9b5d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:12:07.215444 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac1eabd-98a4-448f-93fa-f57b62fd9b5d admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:12:07.216772 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 18:12:07.217143 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-a32f46d8-b86f-4214-b0e8-11e9517c9860 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9f23677ecbfc4271a75f303b929840f9'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:12:07.225606 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-a32f46d8-b86f-4214-b0e8-11e9517c9860 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9f23677ecbfc4271a75f303b929840f9'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:12:07.226437 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-a32f46d8-b86f-4214-b0e8-11e9517c9860 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9f23677ecbfc4271a75f303b929840f9'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:12:07.227102 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-a32f46d8-b86f-4214-b0e8-11e9517c9860 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9f23677ecbfc4271a75f303b929840f9'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:12:07.231249 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1371/2749] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Sep 15 18:12:07 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 15 18:12:07.232244 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac1eabd-98a4-448f-93fa-f57b62fd9b5d admin admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:12:07.234027 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-8ac1eabd-98a4-448f-93fa-f57b62fd9b5d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:12:07.234403 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-a32f46d8-b86f-4214-b0e8-11e9517c9860 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9f23677ecbfc4271a75f303b929840f9'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:12:07.247272 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac1eabd-98a4-448f-93fa-f57b62fd9b5d admin admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:12:07.252615 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840deb2b-6bc5-4fd5-ac0e-322e794c37d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:12:07.252968 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1379/2750] 10.222.0.25 () {58 vars in 1224 bytes} [Thu Sep 15 18:12:07 2022] DELETE /identity/v3/users/9f23677ecbfc4271a75f303b929840f9 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 15 18:12:07.253265 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840deb2b-6bc5-4fd5-ac0e-322e794c37d6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:12:07.253583 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840deb2b-6bc5-4fd5-ac0e-322e794c37d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:12:07.253889 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840deb2b-6bc5-4fd5-ac0e-322e794c37d6 admin admin] PATH_INFO: `/v3/projects/47851db1314e4e6894b3bfcbe8135bed/users/c799c72e06674b6c83f2237a04c3f746/roles/a9e42be86923434f8af52d3fc07fb4f7` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:12:07.269733 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-840deb2b-6bc5-4fd5-ac0e-322e794c37d6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=47851db1314e4e6894b3bfcbe8135bed, user_id=c799c72e06674b6c83f2237a04c3f746, role_id=a9e42be86923434f8af52d3fc07fb4f7)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:12:07.272391 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-840deb2b-6bc5-4fd5-ac0e-322e794c37d6 admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:12:07.285766 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1372/2751] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Sep 15 18:12:07 2022] PUT /identity/v3/projects/47851db1314e4e6894b3bfcbe8135bed/users/c799c72e06674b6c83f2237a04c3f746/roles/a9e42be86923434f8af52d3fc07fb4f7 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 15 18:12:07.290062 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32f46d8-b86f-4214-b0e8-11e9517c9860 admin admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:12:07.357171 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32f46d8-b86f-4214-b0e8-11e9517c9860 admin admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:12:07.421972 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35706b7-9b98-41c6-a8b8-c0b6776ac674 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:12:07.422669 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35706b7-9b98-41c6-a8b8-c0b6776ac674 admin admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:12:07.423045 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35706b7-9b98-41c6-a8b8-c0b6776ac674 admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:12:07.423427 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35706b7-9b98-41c6-a8b8-c0b6776ac674 admin admin] PATH_INFO: `/v3/roles` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:12:07.424858 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a35706b7-9b98-41c6-a8b8-c0b6776ac674 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:12:07.426959 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a35706b7-9b98-41c6-a8b8-c0b6776ac674 admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:12:07.441405 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1380/2752] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Sep 15 18:12:07 2022] GET /identity/v3/roles => generated 1420 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 18:12:07.443037 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840deb2b-6bc5-4fd5-ac0e-322e794c37d6 admin admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:12:07.453782 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840deb2b-6bc5-4fd5-ac0e-322e794c37d6 admin admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:12:07.466684 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2832bb4-21d0-4be9-999a-c0184326dd31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:12:07.467495 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2832bb4-21d0-4be9-999a-c0184326dd31 admin admin] REQUEST_METHOD: `PUT` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:12:07.467865 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2832bb4-21d0-4be9-999a-c0184326dd31 admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:12:07.468215 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2832bb4-21d0-4be9-999a-c0184326dd31 admin admin] PATH_INFO: `/v3/projects/47851db1314e4e6894b3bfcbe8135bed/users/c799c72e06674b6c83f2237a04c3f746/roles/a9e42be86923434f8af52d3fc07fb4f7` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:12:07.471637 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2832bb4-21d0-4be9-999a-c0184326dd31 admin admin] RBAC: Authorizing `identity:create_grant(project_id=47851db1314e4e6894b3bfcbe8135bed, user_id=c799c72e06674b6c83f2237a04c3f746, role_id=a9e42be86923434f8af52d3fc07fb4f7)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:12:07.474585 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2832bb4-21d0-4be9-999a-c0184326dd31 admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:12:07.487293 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1373/2753] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Sep 15 18:12:07 2022] PUT /identity/v3/projects/47851db1314e4e6894b3bfcbe8135bed/users/c799c72e06674b6c83f2237a04c3f746/roles/a9e42be86923434f8af52d3fc07fb4f7 => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 15 18:12:07.497588 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1f5879-05aa-4986-967b-28aa7c8e24a6 None None] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:12:07.497876 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1f5879-05aa-4986-967b-28aa7c8e24a6 None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:12:07.498193 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1f5879-05aa-4986-967b-28aa7c8e24a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:12:07.520804 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 18:12:07.535372 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.auth.core [None req-1d1f5879-05aa-4986-967b-28aa7c8e24a6 None None] MFA Rules not processed for user `c799c72e06674b6c83f2237a04c3f746`. Rule list: `[]` (Enabled: `True`). {{(pid=81593) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 18:12:07.537203 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-1d1f5879-05aa-4986-967b-28aa7c8e24a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:12:07.542687 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2832bb4-21d0-4be9-999a-c0184326dd31 admin admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:12:07.544817 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-a2832bb4-21d0-4be9-999a-c0184326dd31 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:12:07.615106 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1381/2754] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 15 18:12:07 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 18:12:07.617924 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2832bb4-21d0-4be9-999a-c0184326dd31 admin admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:12:07.622709 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3967b53-8aa8-4088-8c5d-ff7c83d44489 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:12:07.623347 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3967b53-8aa8-4088-8c5d-ff7c83d44489 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:12:07.623691 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3967b53-8aa8-4088-8c5d-ff7c83d44489 admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:12:07.623971 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3967b53-8aa8-4088-8c5d-ff7c83d44489 admin admin] PATH_INFO: `/v3/projects/7405b61dbdbd43a4b671fa82a743c8dc` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:12:07.625115 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3967b53-8aa8-4088-8c5d-ff7c83d44489 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7405b61dbdbd43a4b671fa82a743c8dc)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:12:07.626803 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1f5879-05aa-4986-967b-28aa7c8e24a6 None None] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:12:07.627231 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3967b53-8aa8-4088-8c5d-ff7c83d44489 admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:12:07.628303 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-1d1f5879-05aa-4986-967b-28aa7c8e24a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:12:07.679908 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-f3967b53-8aa8-4088-8c5d-ff7c83d44489 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7405b61dbdbd43a4b671fa82a743c8dc', 'request_id': 'req-f3967b53-8aa8-4088-8c5d-ff7c83d44489'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:12:07.685985 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-f3967b53-8aa8-4088-8c5d-ff7c83d44489 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7405b61dbdbd43a4b671fa82a743c8dc', 'request_id': 'req-f3967b53-8aa8-4088-8c5d-ff7c83d44489'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:12:07.687209 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1f5879-05aa-4986-967b-28aa7c8e24a6 None None] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:12:07.694021 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-f3967b53-8aa8-4088-8c5d-ff7c83d44489 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7405b61dbdbd43a4b671fa82a743c8dc', 'request_id': 'req-f3967b53-8aa8-4088-8c5d-ff7c83d44489'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:12:07.705137 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-f3967b53-8aa8-4088-8c5d-ff7c83d44489 admin admin] The token cache is being invalidate because project 7405b61dbdbd43a4b671fa82a743c8dc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81592) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 18:12:07.705461 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-f3967b53-8aa8-4088-8c5d-ff7c83d44489 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:12:07.706113 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-f3967b53-8aa8-4088-8c5d-ff7c83d44489 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:12:07.707614 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1374/2755] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Sep 15 18:12:07 2022] DELETE /identity/v3/projects/7405b61dbdbd43a4b671fa82a743c8dc => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 15 18:12:07.712450 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4c7a3b-2ec3-4b94-835d-2d82ffe2be65 None None] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:12:07.712735 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4c7a3b-2ec3-4b94-835d-2d82ffe2be65 None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:12:07.713009 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4c7a3b-2ec3-4b94-835d-2d82ffe2be65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:12:07.733456 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.auth.core [None req-7d4c7a3b-2ec3-4b94-835d-2d82ffe2be65 None None] MFA Rules not processed for user `5cfa58ef86774ab7800bf91930bf6028`. Rule list: `[]` (Enabled: `True`). {{(pid=81592) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 18:12:07.734675 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-7d4c7a3b-2ec3-4b94-835d-2d82ffe2be65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:12:07.741220 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29ee312-d1af-426e-9afb-78accc6105e6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b232e7a841145ba93c6d8462ccb751a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1213c0d1b584404ba3998e136f166e89', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:12:07.741861 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29ee312-d1af-426e-9afb-78accc6105e6 service cinder] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:12:07.742148 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29ee312-d1af-426e-9afb-78accc6105e6 service cinder] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:12:07.742421 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29ee312-d1af-426e-9afb-78accc6105e6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:12:07.744168 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-e29ee312-d1af-426e-9afb-78accc6105e6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:12:07.784072 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 18:12:07.803712 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1375/2756] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 15 18:12:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 18:12:07.810467 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29ee312-d1af-426e-9afb-78accc6105e6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:12:07.810966 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067dd20e-289b-479a-ad20-cc73352c3bb7 None None] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:12:07.811251 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067dd20e-289b-479a-ad20-cc73352c3bb7 None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:12:07.811522 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067dd20e-289b-479a-ad20-cc73352c3bb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:12:07.811920 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29ee312-d1af-426e-9afb-78accc6105e6 service cinder] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:12:07.816838 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 18:12:07.822155 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1382/2757] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 15 18:12:07 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 196 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 15 18:12:07.831239 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.auth.core [None req-067dd20e-289b-479a-ad20-cc73352c3bb7 None None] MFA Rules not processed for user `5cfa58ef86774ab7800bf91930bf6028`. Rule list: `[]` (Enabled: `True`). {{(pid=81592) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 18:12:07.832434 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-067dd20e-289b-479a-ad20-cc73352c3bb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:12:07.841184 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1376/2758] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 15 18:12:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 18:12:07.845224 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29ee312-d1af-426e-9afb-78accc6105e6 service cinder] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:12:07.853457 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067dd20e-289b-479a-ad20-cc73352c3bb7 None None] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:12:07.854798 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-067dd20e-289b-479a-ad20-cc73352c3bb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:12:07.856202 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29ee312-d1af-426e-9afb-78accc6105e6 service cinder] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:12:07.860786 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd2109a-717d-40c5-8eec-bae39682e434 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:12:07.861930 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd2109a-717d-40c5-8eec-bae39682e434 admin admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:12:07.862211 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd2109a-717d-40c5-8eec-bae39682e434 admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:12:07.862483 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd2109a-717d-40c5-8eec-bae39682e434 admin admin] PATH_INFO: `/v3/domains` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:12:07.863121 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd2109a-717d-40c5-8eec-bae39682e434 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81593) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 18:12:07.863420 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd2109a-717d-40c5-8eec-bae39682e434 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:12:07.865003 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd2109a-717d-40c5-8eec-bae39682e434 admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:12:07.867150 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067dd20e-289b-479a-ad20-cc73352c3bb7 None None] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:12:07.871755 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b791eb40-6263-4e98-abf4-4d7a3cb71b9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:12:07.872369 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b791eb40-6263-4e98-abf4-4d7a3cb71b9f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:12:07.872647 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b791eb40-6263-4e98-abf4-4d7a3cb71b9f admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:12:07.872924 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b791eb40-6263-4e98-abf4-4d7a3cb71b9f admin admin] PATH_INFO: `/v3/users/0b12a0fef36144bb9e449d544d3558b4` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:12:07.874094 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b791eb40-6263-4e98-abf4-4d7a3cb71b9f admin admin] RBAC: Authorizing `identity:delete_user(user_id=0b12a0fef36144bb9e449d544d3558b4)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:12:07.875986 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b791eb40-6263-4e98-abf4-4d7a3cb71b9f admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:12:07.876818 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1383/2759] 10.222.0.25 () {58 vars in 1153 bytes} [Thu Sep 15 18:12:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 18:12:07.881610 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd2109a-717d-40c5-8eec-bae39682e434 admin admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:12:07.890993 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd2109a-717d-40c5-8eec-bae39682e434 admin admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:12:07.895501 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1088b562-0340-46a3-a593-1cb53ffcb0f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:12:07.896087 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1088b562-0340-46a3-a593-1cb53ffcb0f1 admin admin] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:12:07.896366 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1088b562-0340-46a3-a593-1cb53ffcb0f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:12:07.896639 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1088b562-0340-46a3-a593-1cb53ffcb0f1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:12:07.897258 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1088b562-0340-46a3-a593-1cb53ffcb0f1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:12:07.899183 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1088b562-0340-46a3-a593-1cb53ffcb0f1 admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:12:07.928302 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1384/2760] 10.222.0.25 () {60 vars in 1153 bytes} [Thu Sep 15 18:12:07 2022] POST /identity/v3/projects => generated 401 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 15 18:12:07.932448 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1088b562-0340-46a3-a593-1cb53ffcb0f1 admin admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:12:07.935419 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-b791eb40-6263-4e98-abf4-4d7a3cb71b9f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0b12a0fef36144bb9e449d544d3558b4'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:12:07.944798 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-b791eb40-6263-4e98-abf4-4d7a3cb71b9f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0b12a0fef36144bb9e449d544d3558b4'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:12:07.945481 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-b791eb40-6263-4e98-abf4-4d7a3cb71b9f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0b12a0fef36144bb9e449d544d3558b4'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:12:07.946271 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-b791eb40-6263-4e98-abf4-4d7a3cb71b9f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0b12a0fef36144bb9e449d544d3558b4'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:12:07.954380 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-b791eb40-6263-4e98-abf4-4d7a3cb71b9f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0b12a0fef36144bb9e449d544d3558b4'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:12:07.973221 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1377/2761] 10.222.0.25 () {58 vars in 1224 bytes} [Thu Sep 15 18:12:07 2022] DELETE /identity/v3/users/0b12a0fef36144bb9e449d544d3558b4 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 15 18:12:07.977598 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09efcf45-deb2-4539-a549-e6f0d02667c3 None None] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:12:07.977922 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09efcf45-deb2-4539-a549-e6f0d02667c3 None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:12:07.978204 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09efcf45-deb2-4539-a549-e6f0d02667c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:12:07.996262 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1088b562-0340-46a3-a593-1cb53ffcb0f1 admin admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:12:07.997535 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.auth.core [None req-09efcf45-deb2-4539-a549-e6f0d02667c3 None None] MFA Rules not processed for user `5cfa58ef86774ab7800bf91930bf6028`. Rule list: `[]` (Enabled: `True`). {{(pid=81592) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 18:12:07.998730 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-09efcf45-deb2-4539-a549-e6f0d02667c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:12:08.054724 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a5b0d5-941c-4c7e-a9b6-68fc8a2c96f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:12:08.055356 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a5b0d5-941c-4c7e-a9b6-68fc8a2c96f6 admin admin] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:12:08.055634 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a5b0d5-941c-4c7e-a9b6-68fc8a2c96f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:12:08.055904 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a5b0d5-941c-4c7e-a9b6-68fc8a2c96f6 admin admin] PATH_INFO: `/v3/users` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:12:08.056783 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a5b0d5-941c-4c7e-a9b6-68fc8a2c96f6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:12:08.056899 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1378/2762] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 15 18:12:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 18:12:08.058501 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a5b0d5-941c-4c7e-a9b6-68fc8a2c96f6 admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:12:08.066975 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09efcf45-deb2-4539-a549-e6f0d02667c3 None None] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:12:08.068557 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-09efcf45-deb2-4539-a549-e6f0d02667c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:12:08.082313 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1385/2763] 10.222.0.25 () {60 vars in 1144 bytes} [Thu Sep 15 18:12:07 2022] POST /identity/v3/users => generated 301 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 15 18:12:08.086220 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a5b0d5-941c-4c7e-a9b6-68fc8a2c96f6 admin admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:12:08.088125 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-43a5b0d5-941c-4c7e-a9b6-68fc8a2c96f6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:12:08.099759 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a5b0d5-941c-4c7e-a9b6-68fc8a2c96f6 admin admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:12:08.104422 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef75922a-0058-4875-a12d-06c212d1d4b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:12:08.105015 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef75922a-0058-4875-a12d-06c212d1d4b3 admin admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:12:08.105314 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef75922a-0058-4875-a12d-06c212d1d4b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:12:08.105599 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef75922a-0058-4875-a12d-06c212d1d4b3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:12:08.106230 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef75922a-0058-4875-a12d-06c212d1d4b3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:12:08.107858 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef75922a-0058-4875-a12d-06c212d1d4b3 admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:12:08.118262 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1386/2764] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Sep 15 18:12:08 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 15 18:12:08.122066 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef75922a-0058-4875-a12d-06c212d1d4b3 admin admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:12:08.127749 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09efcf45-deb2-4539-a549-e6f0d02667c3 None None] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:12:08.131401 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842ebce2-f82b-40f7-8790-ce8e2c9ca925 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a32274b4781b40fea9f28da8a9bde5ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1213c0d1b584404ba3998e136f166e89', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:12:08.132006 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842ebce2-f82b-40f7-8790-ce8e2c9ca925 service neutron] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:12:08.132176 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef75922a-0058-4875-a12d-06c212d1d4b3 admin admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:12:08.132301 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842ebce2-f82b-40f7-8790-ce8e2c9ca925 service neutron] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:12:08.132550 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842ebce2-f82b-40f7-8790-ce8e2c9ca925 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:12:08.136669 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbb4489-bc01-4e8f-b12d-9992387d4fae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:12:08.137278 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbb4489-bc01-4e8f-b12d-9992387d4fae admin admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:12:08.137591 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbb4489-bc01-4e8f-b12d-9992387d4fae admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:12:08.137867 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbb4489-bc01-4e8f-b12d-9992387d4fae admin admin] PATH_INFO: `/v3/roles` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:12:08.138507 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdbb4489-bc01-4e8f-b12d-9992387d4fae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:12:08.140170 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdbb4489-bc01-4e8f-b12d-9992387d4fae admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:12:08.141709 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842ebce2-f82b-40f7-8790-ce8e2c9ca925 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:12:08.143193 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842ebce2-f82b-40f7-8790-ce8e2c9ca925 service neutron] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:12:08.147128 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 18:12:08.150875 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1387/2765] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Sep 15 18:12:08 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 15 18:12:08.154974 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbb4489-bc01-4e8f-b12d-9992387d4fae admin admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:12:08.166774 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbb4489-bc01-4e8f-b12d-9992387d4fae admin admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:12:08.169486 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1379/2766] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 15 18:12:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 15 18:12:08.172265 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01103a94-a680-4229-93dc-992a6a34fe4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:12:08.172960 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01103a94-a680-4229-93dc-992a6a34fe4e admin admin] REQUEST_METHOD: `PUT` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:12:08.173244 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01103a94-a680-4229-93dc-992a6a34fe4e admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:12:08.173551 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01103a94-a680-4229-93dc-992a6a34fe4e admin admin] PATH_INFO: `/v3/projects/d74208b733eb4983b91e04c088200d92/users/bda9d649fd334dc1a6f5bf7127acb028/roles/343cc8b1bc7243eebabdf08147e8366d` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:12:08.188689 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01103a94-a680-4229-93dc-992a6a34fe4e admin admin] RBAC: Authorizing `identity:create_grant(project_id=d74208b733eb4983b91e04c088200d92, user_id=bda9d649fd334dc1a6f5bf7127acb028, role_id=343cc8b1bc7243eebabdf08147e8366d)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:12:08.191384 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01103a94-a680-4229-93dc-992a6a34fe4e admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:12:08.204784 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1388/2767] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Sep 15 18:12:08 2022] PUT /identity/v3/projects/d74208b733eb4983b91e04c088200d92/users/bda9d649fd334dc1a6f5bf7127acb028/roles/343cc8b1bc7243eebabdf08147e8366d => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 15 18:12:08.272857 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd302cd-a653-40eb-af8b-3202edbeb44c None None] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:12:08.273146 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd302cd-a653-40eb-af8b-3202edbeb44c None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:12:08.273527 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd302cd-a653-40eb-af8b-3202edbeb44c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:12:08.302701 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.auth.core [None req-1cd302cd-a653-40eb-af8b-3202edbeb44c None None] MFA Rules not processed for user `bda9d649fd334dc1a6f5bf7127acb028`. Rule list: `[]` (Enabled: `True`). {{(pid=81592) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 18:12:08.303930 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-1cd302cd-a653-40eb-af8b-3202edbeb44c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:12:08.372586 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1380/2768] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 15 18:12:08 2022] POST /identity/v3/auth/tokens => generated 3278 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 18:12:08.377827 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01103a94-a680-4229-93dc-992a6a34fe4e admin admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:12:08.397526 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 18:12:08.446188 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01103a94-a680-4229-93dc-992a6a34fe4e admin admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:12:08.449014 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd302cd-a653-40eb-af8b-3202edbeb44c None None] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:12:08.450451 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-1cd302cd-a653-40eb-af8b-3202edbeb44c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:12:08.453126 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28796682-d3ee-41eb-bbea-42ab220bea19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:12:08.454016 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28796682-d3ee-41eb-bbea-42ab220bea19 admin admin] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:12:08.454386 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28796682-d3ee-41eb-bbea-42ab220bea19 admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:12:08.455576 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28796682-d3ee-41eb-bbea-42ab220bea19 admin admin] PATH_INFO: `/v3/projects` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:12:08.456700 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28796682-d3ee-41eb-bbea-42ab220bea19 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:12:08.459138 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28796682-d3ee-41eb-bbea-42ab220bea19 admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:12:08.465464 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd302cd-a653-40eb-af8b-3202edbeb44c None None] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:12:08.471705 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96eefd19-f8db-46e8-86cc-360d3b0b9278 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:12:08.472495 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96eefd19-f8db-46e8-86cc-360d3b0b9278 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:12:08.472780 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96eefd19-f8db-46e8-86cc-360d3b0b9278 admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:12:08.473054 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96eefd19-f8db-46e8-86cc-360d3b0b9278 admin admin] PATH_INFO: `/v3/projects/e03749f933ce4ec48dff876c09c4bf15` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:12:08.474241 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96eefd19-f8db-46e8-86cc-360d3b0b9278 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e03749f933ce4ec48dff876c09c4bf15)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:12:08.476478 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96eefd19-f8db-46e8-86cc-360d3b0b9278 admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:12:08.495703 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1389/2769] 10.222.0.25 () {60 vars in 1153 bytes} [Thu Sep 15 18:12:08 2022] POST /identity/v3/projects => generated 399 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 18:12:08.500295 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28796682-d3ee-41eb-bbea-42ab220bea19 admin admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:12:08.526407 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-96eefd19-f8db-46e8-86cc-360d3b0b9278 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e03749f933ce4ec48dff876c09c4bf15', 'request_id': 'req-96eefd19-f8db-46e8-86cc-360d3b0b9278'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:12:08.532211 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-96eefd19-f8db-46e8-86cc-360d3b0b9278 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e03749f933ce4ec48dff876c09c4bf15', 'request_id': 'req-96eefd19-f8db-46e8-86cc-360d3b0b9278'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:12:08.542436 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-96eefd19-f8db-46e8-86cc-360d3b0b9278 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e03749f933ce4ec48dff876c09c4bf15', 'request_id': 'req-96eefd19-f8db-46e8-86cc-360d3b0b9278'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:12:08.553940 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-96eefd19-f8db-46e8-86cc-360d3b0b9278 admin admin] The token cache is being invalidate because project e03749f933ce4ec48dff876c09c4bf15 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81592) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 18:12:08.554245 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-96eefd19-f8db-46e8-86cc-360d3b0b9278 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:12:08.554937 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-96eefd19-f8db-46e8-86cc-360d3b0b9278 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:12:08.556448 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1381/2770] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Sep 15 18:12:08 2022] DELETE /identity/v3/projects/e03749f933ce4ec48dff876c09c4bf15 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 15 18:12:08.560192 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96eefd19-f8db-46e8-86cc-360d3b0b9278 admin admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:12:08.561651 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-96eefd19-f8db-46e8-86cc-360d3b0b9278 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:12:08.567212 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28796682-d3ee-41eb-bbea-42ab220bea19 admin admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:12:08.624185 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa86234-71c5-4e36-821c-a2062010bdc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:12:08.624785 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa86234-71c5-4e36-821c-a2062010bdc4 admin admin] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:12:08.625059 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa86234-71c5-4e36-821c-a2062010bdc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:12:08.625357 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa86234-71c5-4e36-821c-a2062010bdc4 admin admin] PATH_INFO: `/v3/users` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:12:08.625972 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa86234-71c5-4e36-821c-a2062010bdc4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:12:08.626111 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96eefd19-f8db-46e8-86cc-360d3b0b9278 admin admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:12:08.627920 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa86234-71c5-4e36-821c-a2062010bdc4 admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:12:08.631218 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec19eae-ee4c-4d04-828e-971302271e52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:12:08.631847 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec19eae-ee4c-4d04-828e-971302271e52 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:12:08.632131 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec19eae-ee4c-4d04-828e-971302271e52 admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:12:08.632409 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec19eae-ee4c-4d04-828e-971302271e52 admin admin] PATH_INFO: `/v3/users/c799c72e06674b6c83f2237a04c3f746` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:12:08.633587 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec19eae-ee4c-4d04-828e-971302271e52 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c799c72e06674b6c83f2237a04c3f746)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:12:08.635491 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec19eae-ee4c-4d04-828e-971302271e52 admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:12:08.651133 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 18:12:08.651444 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1390/2771] 10.222.0.25 () {60 vars in 1144 bytes} [Thu Sep 15 18:12:08 2022] POST /identity/v3/users => generated 306 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 15 18:12:08.655500 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa86234-71c5-4e36-821c-a2062010bdc4 admin admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:12:08.657516 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-7fa86234-71c5-4e36-821c-a2062010bdc4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:12:08.669926 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa86234-71c5-4e36-821c-a2062010bdc4 admin admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:12:08.675193 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def25fc9-7509-4a6b-97bd-cd9113c2b1b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:12:08.675879 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def25fc9-7509-4a6b-97bd-cd9113c2b1b7 admin admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:12:08.676168 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def25fc9-7509-4a6b-97bd-cd9113c2b1b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:12:08.676436 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def25fc9-7509-4a6b-97bd-cd9113c2b1b7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:12:08.677076 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def25fc9-7509-4a6b-97bd-cd9113c2b1b7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:12:08.678704 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def25fc9-7509-4a6b-97bd-cd9113c2b1b7 admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:12:08.686931 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-aec19eae-ee4c-4d04-828e-971302271e52 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c799c72e06674b6c83f2237a04c3f746'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:12:08.688952 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1391/2772] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Sep 15 18:12:08 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 15 18:12:08.693332 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def25fc9-7509-4a6b-97bd-cd9113c2b1b7 admin admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:12:08.695325 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-aec19eae-ee4c-4d04-828e-971302271e52 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c799c72e06674b6c83f2237a04c3f746'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:12:08.696161 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-aec19eae-ee4c-4d04-828e-971302271e52 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c799c72e06674b6c83f2237a04c3f746'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:12:08.696855 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-aec19eae-ee4c-4d04-828e-971302271e52 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c799c72e06674b6c83f2237a04c3f746'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:12:08.703593 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def25fc9-7509-4a6b-97bd-cd9113c2b1b7 admin admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:12:08.704082 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-aec19eae-ee4c-4d04-828e-971302271e52 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c799c72e06674b6c83f2237a04c3f746'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:12:08.708859 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82d0df7-f2a2-462a-af45-265fb7889815 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:12:08.709523 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82d0df7-f2a2-462a-af45-265fb7889815 admin admin] REQUEST_METHOD: `PUT` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:12:08.709808 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82d0df7-f2a2-462a-af45-265fb7889815 admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:12:08.710087 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82d0df7-f2a2-462a-af45-265fb7889815 admin admin] PATH_INFO: `/v3/projects/2c67d6aa814045afb60b46e535f36248/users/739cb5ed1b114f61baff1733685d0c1e/roles/a9e42be86923434f8af52d3fc07fb4f7` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:12:08.722912 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1382/2773] 10.222.0.25 () {58 vars in 1224 bytes} [Thu Sep 15 18:12:08 2022] DELETE /identity/v3/users/c799c72e06674b6c83f2237a04c3f746 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 15 18:12:08.728633 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b82d0df7-f2a2-462a-af45-265fb7889815 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2c67d6aa814045afb60b46e535f36248, user_id=739cb5ed1b114f61baff1733685d0c1e, role_id=a9e42be86923434f8af52d3fc07fb4f7)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:12:08.731354 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b82d0df7-f2a2-462a-af45-265fb7889815 admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:12:08.746317 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1392/2774] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Sep 15 18:12:08 2022] PUT /identity/v3/projects/2c67d6aa814045afb60b46e535f36248/users/739cb5ed1b114f61baff1733685d0c1e/roles/a9e42be86923434f8af52d3fc07fb4f7 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 15 18:12:08.750466 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec19eae-ee4c-4d04-828e-971302271e52 admin admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:12:08.752020 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-aec19eae-ee4c-4d04-828e-971302271e52 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:12:08.827705 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec19eae-ee4c-4d04-828e-971302271e52 admin admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:12:08.897599 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58f7f17-2986-4022-9b95-77941ffa20d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:12:08.898219 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58f7f17-2986-4022-9b95-77941ffa20d4 admin admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:12:08.898500 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58f7f17-2986-4022-9b95-77941ffa20d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:12:08.898771 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58f7f17-2986-4022-9b95-77941ffa20d4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:12:08.899413 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f58f7f17-2986-4022-9b95-77941ffa20d4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:12:08.900991 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f58f7f17-2986-4022-9b95-77941ffa20d4 admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:12:08.911964 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1383/2775] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Sep 15 18:12:08 2022] GET /identity/v3/roles => generated 1420 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 18:12:08.916280 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82d0df7-f2a2-462a-af45-265fb7889815 admin admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:12:08.921913 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 18:12:08.929850 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82d0df7-f2a2-462a-af45-265fb7889815 admin admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:12:08.934958 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74cf5135-2b8e-4bf6-a731-478623402b53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:12:08.935619 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cf5135-2b8e-4bf6-a731-478623402b53 admin admin] REQUEST_METHOD: `PUT` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:12:08.935897 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cf5135-2b8e-4bf6-a731-478623402b53 admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:12:08.936172 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cf5135-2b8e-4bf6-a731-478623402b53 admin admin] PATH_INFO: `/v3/projects/2c67d6aa814045afb60b46e535f36248/users/739cb5ed1b114f61baff1733685d0c1e/roles/a9e42be86923434f8af52d3fc07fb4f7` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:12:08.938097 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74cf5135-2b8e-4bf6-a731-478623402b53 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2c67d6aa814045afb60b46e535f36248, user_id=739cb5ed1b114f61baff1733685d0c1e, role_id=a9e42be86923434f8af52d3fc07fb4f7)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:12:08.941272 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74cf5135-2b8e-4bf6-a731-478623402b53 admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:12:08.951709 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1393/2776] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Sep 15 18:12:08 2022] PUT /identity/v3/projects/2c67d6aa814045afb60b46e535f36248/users/739cb5ed1b114f61baff1733685d0c1e/roles/a9e42be86923434f8af52d3fc07fb4f7 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 15 18:12:08.962488 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facdf959-8ba5-4bd5-b8b8-a3350931b9f7 None None] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:12:08.962771 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facdf959-8ba5-4bd5-b8b8-a3350931b9f7 None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:12:08.963041 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facdf959-8ba5-4bd5-b8b8-a3350931b9f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:12:08.991762 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.auth.core [None req-facdf959-8ba5-4bd5-b8b8-a3350931b9f7 None None] MFA Rules not processed for user `739cb5ed1b114f61baff1733685d0c1e`. Rule list: `[]` (Enabled: `True`). {{(pid=81592) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 18:12:08.993140 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-facdf959-8ba5-4bd5-b8b8-a3350931b9f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:12:09.010076 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74cf5135-2b8e-4bf6-a731-478623402b53 admin admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:12:09.011737 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-74cf5135-2b8e-4bf6-a731-478623402b53 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:12:09.023676 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 18:12:09.084305 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1384/2777] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 15 18:12:08 2022] POST /identity/v3/auth/tokens => generated 3343 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 18:12:09.085891 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74cf5135-2b8e-4bf6-a731-478623402b53 admin admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:12:09.091060 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1868a660-3c31-40cb-a734-e80b63e6ac59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:12:09.091689 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1868a660-3c31-40cb-a734-e80b63e6ac59 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:12:09.091966 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1868a660-3c31-40cb-a734-e80b63e6ac59 admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:12:09.092239 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1868a660-3c31-40cb-a734-e80b63e6ac59 admin admin] PATH_INFO: `/v3/projects/47851db1314e4e6894b3bfcbe8135bed` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:12:09.093439 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1868a660-3c31-40cb-a734-e80b63e6ac59 admin admin] RBAC: Authorizing `identity:delete_project(project_id=47851db1314e4e6894b3bfcbe8135bed)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:12:09.095010 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-facdf959-8ba5-4bd5-b8b8-a3350931b9f7 None None] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:12:09.095423 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1868a660-3c31-40cb-a734-e80b63e6ac59 admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:12:09.096956 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-facdf959-8ba5-4bd5-b8b8-a3350931b9f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:12:09.144252 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-1868a660-3c31-40cb-a734-e80b63e6ac59 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '47851db1314e4e6894b3bfcbe8135bed', 'request_id': 'req-1868a660-3c31-40cb-a734-e80b63e6ac59'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:12:09.150586 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-1868a660-3c31-40cb-a734-e80b63e6ac59 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '47851db1314e4e6894b3bfcbe8135bed', 'request_id': 'req-1868a660-3c31-40cb-a734-e80b63e6ac59'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:12:09.155869 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-facdf959-8ba5-4bd5-b8b8-a3350931b9f7 None None] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:12:09.159003 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-1868a660-3c31-40cb-a734-e80b63e6ac59 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '47851db1314e4e6894b3bfcbe8135bed', 'request_id': 'req-1868a660-3c31-40cb-a734-e80b63e6ac59'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:12:09.172613 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-1868a660-3c31-40cb-a734-e80b63e6ac59 admin admin] The token cache is being invalidate because project 47851db1314e4e6894b3bfcbe8135bed was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81593) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 18:12:09.172908 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-1868a660-3c31-40cb-a734-e80b63e6ac59 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:12:09.173618 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-1868a660-3c31-40cb-a734-e80b63e6ac59 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:12:09.175932 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1394/2778] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Sep 15 18:12:09 2022] DELETE /identity/v3/projects/47851db1314e4e6894b3bfcbe8135bed => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 18:12:09.180448 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2273ff32-007d-46e0-a3b0-8e368d3d0fec None None] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:12:09.180736 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2273ff32-007d-46e0-a3b0-8e368d3d0fec None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:12:09.181016 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2273ff32-007d-46e0-a3b0-8e368d3d0fec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:12:09.200910 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.auth.core [None req-2273ff32-007d-46e0-a3b0-8e368d3d0fec None None] MFA Rules not processed for user `5cfa58ef86774ab7800bf91930bf6028`. Rule list: `[]` (Enabled: `True`). {{(pid=81593) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 18:12:09.202196 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-2273ff32-007d-46e0-a3b0-8e368d3d0fec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:12:09.207431 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a78da7-cca3-487b-9462-9c873eb9b86c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b232e7a841145ba93c6d8462ccb751a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1213c0d1b584404ba3998e136f166e89', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:12:09.208029 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a78da7-cca3-487b-9462-9c873eb9b86c service cinder] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:12:09.208308 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a78da7-cca3-487b-9462-9c873eb9b86c service cinder] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:12:09.208584 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a78da7-cca3-487b-9462-9c873eb9b86c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:12:09.210342 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-b0a78da7-cca3-487b-9462-9c873eb9b86c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:12:09.261737 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1395/2779] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 15 18:12:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 18:12:09.271120 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e732ae-2a27-4f58-ad5d-e96f5bd2a991 None None] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:12:09.271408 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e732ae-2a27-4f58-ad5d-e96f5bd2a991 None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:12:09.271678 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e732ae-2a27-4f58-ad5d-e96f5bd2a991 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:12:09.274897 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a78da7-cca3-487b-9462-9c873eb9b86c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:12:09.276327 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a78da7-cca3-487b-9462-9c873eb9b86c service cinder] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:12:09.286574 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1385/2780] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 15 18:12:09 2022] GET /identity/v3/auth/tokens => generated 3343 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 15 18:12:09.294887 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.auth.core [None req-59e732ae-2a27-4f58-ad5d-e96f5bd2a991 None None] MFA Rules not processed for user `5cfa58ef86774ab7800bf91930bf6028`. Rule list: `[]` (Enabled: `True`). {{(pid=81593) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 18:12:09.296096 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-59e732ae-2a27-4f58-ad5d-e96f5bd2a991 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:12:09.304169 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1396/2781] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 15 18:12:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 18:12:09.309532 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a78da7-cca3-487b-9462-9c873eb9b86c service cinder] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:12:09.320525 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a78da7-cca3-487b-9462-9c873eb9b86c service cinder] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:12:09.325313 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ca7e20-dfb3-4845-899a-a962adc4d137 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:12:09.325925 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ca7e20-dfb3-4845-899a-a962adc4d137 admin admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:12:09.326206 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ca7e20-dfb3-4845-899a-a962adc4d137 admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:12:09.326479 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ca7e20-dfb3-4845-899a-a962adc4d137 admin admin] PATH_INFO: `/v3/domains` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:12:09.327128 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ca7e20-dfb3-4845-899a-a962adc4d137 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81592) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 18:12:09.327431 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ca7e20-dfb3-4845-899a-a962adc4d137 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:12:09.329005 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ca7e20-dfb3-4845-899a-a962adc4d137 admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:12:09.347495 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1386/2782] 10.222.0.25 () {58 vars in 1153 bytes} [Thu Sep 15 18:12:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 18:12:09.348497 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e732ae-2a27-4f58-ad5d-e96f5bd2a991 None None] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:12:09.362249 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e732ae-2a27-4f58-ad5d-e96f5bd2a991 None None] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:12:09.364426 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ca7e20-dfb3-4845-899a-a962adc4d137 admin admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:12:09.366217 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-14ca7e20-dfb3-4845-899a-a962adc4d137 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:12:09.367130 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b70716-4c3c-4510-864f-e30a32da8fcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:12:09.367720 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b70716-4c3c-4510-864f-e30a32da8fcd admin admin] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:12:09.367996 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b70716-4c3c-4510-864f-e30a32da8fcd admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:12:09.368265 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b70716-4c3c-4510-864f-e30a32da8fcd admin admin] PATH_INFO: `/v3/projects` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:12:09.368890 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b70716-4c3c-4510-864f-e30a32da8fcd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:12:09.370854 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b70716-4c3c-4510-864f-e30a32da8fcd admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:12:09.378600 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ca7e20-dfb3-4845-899a-a962adc4d137 admin admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:12:09.382311 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7672898-7679-411d-a22a-614c069700e6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b232e7a841145ba93c6d8462ccb751a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1213c0d1b584404ba3998e136f166e89', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:12:09.382781 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 18:12:09.383245 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7672898-7679-411d-a22a-614c069700e6 service cinder] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:12:09.383245 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7672898-7679-411d-a22a-614c069700e6 service cinder] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:12:09.383525 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7672898-7679-411d-a22a-614c069700e6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:12:09.385580 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-d7672898-7679-411d-a22a-614c069700e6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:12:09.397113 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 18:12:09.400773 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1397/2783] 10.222.0.25 () {60 vars in 1153 bytes} [Thu Sep 15 18:12:09 2022] POST /identity/v3/projects => generated 365 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 15 18:12:09.404956 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b70716-4c3c-4510-864f-e30a32da8fcd admin admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:12:09.450283 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7672898-7679-411d-a22a-614c069700e6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:12:09.451728 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7672898-7679-411d-a22a-614c069700e6 service cinder] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:12:09.461349 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1387/2784] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 15 18:12:09 2022] GET /identity/v3/auth/tokens => generated 3278 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 15 18:12:09.468286 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b70716-4c3c-4510-864f-e30a32da8fcd admin admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:12:09.473936 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e24802b-cf1f-4d78-9f0e-c050ee282fb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:12:09.474463 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e24802b-cf1f-4d78-9f0e-c050ee282fb7 admin admin] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:12:09.474746 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e24802b-cf1f-4d78-9f0e-c050ee282fb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:12:09.475022 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e24802b-cf1f-4d78-9f0e-c050ee282fb7 admin admin] PATH_INFO: `/v3/users` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:12:09.475663 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e24802b-cf1f-4d78-9f0e-c050ee282fb7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:12:09.477638 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e24802b-cf1f-4d78-9f0e-c050ee282fb7 admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:12:09.500272 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1398/2785] 10.222.0.25 () {60 vars in 1144 bytes} [Thu Sep 15 18:12:09 2022] POST /identity/v3/users => generated 283 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 18:12:09.504313 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7672898-7679-411d-a22a-614c069700e6 service cinder] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:12:09.515133 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7672898-7679-411d-a22a-614c069700e6 service cinder] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:12:09.520351 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b6b022-f281-4030-827b-a7a96127f0de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:12:09.521020 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b6b022-f281-4030-827b-a7a96127f0de admin admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:12:09.521370 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b6b022-f281-4030-827b-a7a96127f0de admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:12:09.521602 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b6b022-f281-4030-827b-a7a96127f0de admin admin] PATH_INFO: `/v3/roles` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:12:09.522266 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b6b022-f281-4030-827b-a7a96127f0de admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:12:09.523839 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b6b022-f281-4030-827b-a7a96127f0de admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:12:09.534975 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1388/2786] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Sep 15 18:12:09 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 15 18:12:09.539231 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e24802b-cf1f-4d78-9f0e-c050ee282fb7 admin admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:12:09.551179 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e24802b-cf1f-4d78-9f0e-c050ee282fb7 admin admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:12:09.555860 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56e1c13-c69c-4f4b-bd11-834f8d87da13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:12:09.556455 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56e1c13-c69c-4f4b-bd11-834f8d87da13 admin admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:12:09.556843 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56e1c13-c69c-4f4b-bd11-834f8d87da13 admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:12:09.557116 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56e1c13-c69c-4f4b-bd11-834f8d87da13 admin admin] PATH_INFO: `/v3/roles` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:12:09.557904 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c56e1c13-c69c-4f4b-bd11-834f8d87da13 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:12:09.559521 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c56e1c13-c69c-4f4b-bd11-834f8d87da13 admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:12:09.569851 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1399/2787] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Sep 15 18:12:09 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 15 18:12:09.634274 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b6b022-f281-4030-827b-a7a96127f0de admin admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:12:09.645890 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b6b022-f281-4030-827b-a7a96127f0de admin admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:12:09.651620 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b719db-2248-46c2-9cb5-8abec2e79763 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:12:09.652370 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b719db-2248-46c2-9cb5-8abec2e79763 admin admin] REQUEST_METHOD: `PUT` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:12:09.652803 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b719db-2248-46c2-9cb5-8abec2e79763 admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:12:09.653104 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b719db-2248-46c2-9cb5-8abec2e79763 admin admin] PATH_INFO: `/v3/projects/b6bd5ace99f04b92b0421f516d3d6f9d/users/c918bdef271a469e8b70c6ab27cf08f2/roles/343cc8b1bc7243eebabdf08147e8366d` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:12:09.669550 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b719db-2248-46c2-9cb5-8abec2e79763 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b6bd5ace99f04b92b0421f516d3d6f9d, user_id=c918bdef271a469e8b70c6ab27cf08f2, role_id=343cc8b1bc7243eebabdf08147e8366d)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:12:09.672777 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b719db-2248-46c2-9cb5-8abec2e79763 admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:12:09.686932 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1389/2788] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Sep 15 18:12:09 2022] PUT /identity/v3/projects/b6bd5ace99f04b92b0421f516d3d6f9d/users/c918bdef271a469e8b70c6ab27cf08f2/roles/343cc8b1bc7243eebabdf08147e8366d => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 18:12:09.698361 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e925e95d-30b4-4617-83cd-1c0b20b9b71d None None] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:12:09.698651 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e925e95d-30b4-4617-83cd-1c0b20b9b71d None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:12:09.698972 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e925e95d-30b4-4617-83cd-1c0b20b9b71d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:12:09.750329 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.auth.core [None req-e925e95d-30b4-4617-83cd-1c0b20b9b71d None None] MFA Rules not processed for user `c918bdef271a469e8b70c6ab27cf08f2`. Rule list: `[]` (Enabled: `True`). {{(pid=81593) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 18:12:09.752620 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-e925e95d-30b4-4617-83cd-1c0b20b9b71d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:12:09.832425 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1400/2789] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 15 18:12:09 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 18:12:09.837441 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b719db-2248-46c2-9cb5-8abec2e79763 admin admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:12:09.899327 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b719db-2248-46c2-9cb5-8abec2e79763 admin admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:12:09.903971 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184efb85-4626-46b2-b5ce-737004fac508 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:12:09.904575 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184efb85-4626-46b2-b5ce-737004fac508 admin admin] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:12:09.904860 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184efb85-4626-46b2-b5ce-737004fac508 admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:12:09.905133 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184efb85-4626-46b2-b5ce-737004fac508 admin admin] PATH_INFO: `/v3/projects` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:12:09.905791 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-184efb85-4626-46b2-b5ce-737004fac508 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:12:09.907700 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-184efb85-4626-46b2-b5ce-737004fac508 admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:12:09.934686 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1390/2790] 10.222.0.25 () {60 vars in 1153 bytes} [Thu Sep 15 18:12:09 2022] POST /identity/v3/projects => generated 363 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 15 18:12:09.938866 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e925e95d-30b4-4617-83cd-1c0b20b9b71d None None] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:12:09.950114 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e925e95d-30b4-4617-83cd-1c0b20b9b71d None None] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:12:10.005824 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f6b8eb-b995-45b5-b827-335bb3804565 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:12:10.006429 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f6b8eb-b995-45b5-b827-335bb3804565 admin admin] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:12:10.006736 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f6b8eb-b995-45b5-b827-335bb3804565 admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:12:10.006973 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f6b8eb-b995-45b5-b827-335bb3804565 admin admin] PATH_INFO: `/v3/users` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:12:10.007598 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f6b8eb-b995-45b5-b827-335bb3804565 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:12:10.009533 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f6b8eb-b995-45b5-b827-335bb3804565 admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:12:10.017413 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 18:12:10.031688 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1401/2791] 10.222.0.25 () {60 vars in 1144 bytes} [Thu Sep 15 18:12:09 2022] POST /identity/v3/users => generated 288 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 15 18:12:10.035751 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184efb85-4626-46b2-b5ce-737004fac508 admin admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:12:10.046801 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184efb85-4626-46b2-b5ce-737004fac508 admin admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:12:10.051880 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d760958-216f-45e4-bab3-585c9ae058bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:12:10.052471 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d760958-216f-45e4-bab3-585c9ae058bf admin admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:12:10.052753 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d760958-216f-45e4-bab3-585c9ae058bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:12:10.053030 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d760958-216f-45e4-bab3-585c9ae058bf admin admin] PATH_INFO: `/v3/roles` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:12:10.053717 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d760958-216f-45e4-bab3-585c9ae058bf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:12:10.055306 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d760958-216f-45e4-bab3-585c9ae058bf admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:12:10.066446 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1391/2792] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Sep 15 18:12:10 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 18:12:10.070791 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f6b8eb-b995-45b5-b827-335bb3804565 admin admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:12:10.080552 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f6b8eb-b995-45b5-b827-335bb3804565 admin admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:12:10.085190 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aeaca73-3bb4-4328-a00e-f4142d748a89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:12:10.085905 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aeaca73-3bb4-4328-a00e-f4142d748a89 admin admin] REQUEST_METHOD: `PUT` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:12:10.086224 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aeaca73-3bb4-4328-a00e-f4142d748a89 admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:12:10.086498 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aeaca73-3bb4-4328-a00e-f4142d748a89 admin admin] PATH_INFO: `/v3/projects/7ddc998fb7744ba9bdf246ddbd2716e5/users/26776fab0b634fd1887688124fa88682/roles/a9e42be86923434f8af52d3fc07fb4f7` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:12:10.101308 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aeaca73-3bb4-4328-a00e-f4142d748a89 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7ddc998fb7744ba9bdf246ddbd2716e5, user_id=26776fab0b634fd1887688124fa88682, role_id=a9e42be86923434f8af52d3fc07fb4f7)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:12:10.104161 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aeaca73-3bb4-4328-a00e-f4142d748a89 admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:12:10.118868 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1402/2793] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Sep 15 18:12:10 2022] PUT /identity/v3/projects/7ddc998fb7744ba9bdf246ddbd2716e5/users/26776fab0b634fd1887688124fa88682/roles/a9e42be86923434f8af52d3fc07fb4f7 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 18:12:10.122937 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d760958-216f-45e4-bab3-585c9ae058bf admin admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:12:10.135258 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d760958-216f-45e4-bab3-585c9ae058bf admin admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:12:10.183686 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 18:12:10.197125 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e51186a-3293-4715-a1c9-c4f3a5e3b1f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:12:10.197784 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e51186a-3293-4715-a1c9-c4f3a5e3b1f2 admin admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:12:10.198048 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e51186a-3293-4715-a1c9-c4f3a5e3b1f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:12:10.198321 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e51186a-3293-4715-a1c9-c4f3a5e3b1f2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:12:10.198967 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e51186a-3293-4715-a1c9-c4f3a5e3b1f2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:12:10.200542 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e51186a-3293-4715-a1c9-c4f3a5e3b1f2 admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:12:10.210327 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1392/2794] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Sep 15 18:12:10 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 18:12:10.214773 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aeaca73-3bb4-4328-a00e-f4142d748a89 admin admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:12:10.225318 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aeaca73-3bb4-4328-a00e-f4142d748a89 admin admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:12:10.229967 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e93d1d-212a-4646-a862-fa614607aeeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:12:10.230604 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e93d1d-212a-4646-a862-fa614607aeeb admin admin] REQUEST_METHOD: `PUT` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:12:10.230883 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e93d1d-212a-4646-a862-fa614607aeeb admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:12:10.231154 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e93d1d-212a-4646-a862-fa614607aeeb admin admin] PATH_INFO: `/v3/projects/7ddc998fb7744ba9bdf246ddbd2716e5/users/26776fab0b634fd1887688124fa88682/roles/a9e42be86923434f8af52d3fc07fb4f7` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:12:10.233114 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e93d1d-212a-4646-a862-fa614607aeeb admin admin] RBAC: Authorizing `identity:create_grant(project_id=7ddc998fb7744ba9bdf246ddbd2716e5, user_id=26776fab0b634fd1887688124fa88682, role_id=a9e42be86923434f8af52d3fc07fb4f7)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:12:10.236189 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e93d1d-212a-4646-a862-fa614607aeeb admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:12:10.246994 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1403/2795] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Sep 15 18:12:10 2022] PUT /identity/v3/projects/7ddc998fb7744ba9bdf246ddbd2716e5/users/26776fab0b634fd1887688124fa88682/roles/a9e42be86923434f8af52d3fc07fb4f7 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 18:12:10.257653 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca14f2bc-dabd-405a-972c-d64a27e195d2 None None] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:12:10.257882 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca14f2bc-dabd-405a-972c-d64a27e195d2 None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:12:10.258159 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca14f2bc-dabd-405a-972c-d64a27e195d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:12:10.285126 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.auth.core [None req-ca14f2bc-dabd-405a-972c-d64a27e195d2 None None] MFA Rules not processed for user `26776fab0b634fd1887688124fa88682`. Rule list: `[]` (Enabled: `True`). {{(pid=81592) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 18:12:10.286367 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-ca14f2bc-dabd-405a-972c-d64a27e195d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:12:10.354278 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1393/2796] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 15 18:12:10 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 18:12:10.365870 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e93d1d-212a-4646-a862-fa614607aeeb admin admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:12:10.421467 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e93d1d-212a-4646-a862-fa614607aeeb admin admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:12:10.425061 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5dd6b3-fb6b-467e-8fe7-978ee35a1b64 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b232e7a841145ba93c6d8462ccb751a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1213c0d1b584404ba3998e136f166e89', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:12:10.425704 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5dd6b3-fb6b-467e-8fe7-978ee35a1b64 service cinder] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:12:10.426006 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5dd6b3-fb6b-467e-8fe7-978ee35a1b64 service cinder] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:12:10.426277 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5dd6b3-fb6b-467e-8fe7-978ee35a1b64 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:12:10.437823 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d5dd6b3-fb6b-467e-8fe7-978ee35a1b64 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:12:10.439312 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d5dd6b3-fb6b-467e-8fe7-978ee35a1b64 service cinder] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:12:10.450366 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1404/2797] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 15 18:12:10 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 18:12:10.531917 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca14f2bc-dabd-405a-972c-d64a27e195d2 None None] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:12:10.541713 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca14f2bc-dabd-405a-972c-d64a27e195d2 None None] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:12:10.545412 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb175bee-6572-48e6-afa7-ecf0ddb8695b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b232e7a841145ba93c6d8462ccb751a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1213c0d1b584404ba3998e136f166e89', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:12:10.545999 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb175bee-6572-48e6-afa7-ecf0ddb8695b service cinder] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:12:10.546273 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb175bee-6572-48e6-afa7-ecf0ddb8695b service cinder] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:12:10.546539 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb175bee-6572-48e6-afa7-ecf0ddb8695b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:12:10.603183 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb175bee-6572-48e6-afa7-ecf0ddb8695b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:12:10.604736 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb175bee-6572-48e6-afa7-ecf0ddb8695b service cinder] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:12:10.614118 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1394/2798] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 15 18:12:10 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 18:12:13.597443 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5dd6b3-fb6b-467e-8fe7-978ee35a1b64 service cinder] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:12:13.599180 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-0d5dd6b3-fb6b-467e-8fe7-978ee35a1b64 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:12:13.665576 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5dd6b3-fb6b-467e-8fe7-978ee35a1b64 service cinder] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:12:13.670109 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5a4c18-509b-414e-8415-5b5ee0b26e6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:12:13.670740 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5a4c18-509b-414e-8415-5b5ee0b26e6a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:12:13.671020 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5a4c18-509b-414e-8415-5b5ee0b26e6a admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:12:13.671298 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5a4c18-509b-414e-8415-5b5ee0b26e6a admin admin] PATH_INFO: `/v3/users/bda9d649fd334dc1a6f5bf7127acb028` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:12:13.672424 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5a4c18-509b-414e-8415-5b5ee0b26e6a admin admin] RBAC: Authorizing `identity:delete_user(user_id=bda9d649fd334dc1a6f5bf7127acb028)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:12:13.674451 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5a4c18-509b-414e-8415-5b5ee0b26e6a admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:12:13.727786 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-7d5a4c18-509b-414e-8415-5b5ee0b26e6a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bda9d649fd334dc1a6f5bf7127acb028'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:12:13.735752 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-7d5a4c18-509b-414e-8415-5b5ee0b26e6a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bda9d649fd334dc1a6f5bf7127acb028'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:12:13.736678 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-7d5a4c18-509b-414e-8415-5b5ee0b26e6a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bda9d649fd334dc1a6f5bf7127acb028'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:12:13.737200 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-7d5a4c18-509b-414e-8415-5b5ee0b26e6a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bda9d649fd334dc1a6f5bf7127acb028'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:12:13.739480 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:INSERT=6,keystone:SELECT=86,keystone:DELETE=8 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 18:12:13.747070 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-7d5a4c18-509b-414e-8415-5b5ee0b26e6a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bda9d649fd334dc1a6f5bf7127acb028'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:12:13.767185 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1405/2799] 10.222.0.25 () {58 vars in 1224 bytes} [Thu Sep 15 18:12:13 2022] DELETE /identity/v3/users/bda9d649fd334dc1a6f5bf7127acb028 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 18:12:13.772698 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec6135d-82ff-4fa5-bf49-65b5ed629f7a None None] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:12:13.773452 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec6135d-82ff-4fa5-bf49-65b5ed629f7a None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:12:13.773663 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec6135d-82ff-4fa5-bf49-65b5ed629f7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:12:13.792887 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.auth.core [None req-bec6135d-82ff-4fa5-bf49-65b5ed629f7a None None] MFA Rules not processed for user `5cfa58ef86774ab7800bf91930bf6028`. Rule list: `[]` (Enabled: `True`). {{(pid=81592) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 18:12:13.794199 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-bec6135d-82ff-4fa5-bf49-65b5ed629f7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:12:13.858510 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1395/2800] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 15 18:12:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 18:12:13.869171 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5a4c18-509b-414e-8415-5b5ee0b26e6a admin admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:12:13.870610 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-7d5a4c18-509b-414e-8415-5b5ee0b26e6a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:12:13.930454 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5a4c18-509b-414e-8415-5b5ee0b26e6a admin admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:12:13.934744 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137b1744-5f0f-46f8-be20-9db444036721 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a32274b4781b40fea9f28da8a9bde5ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1213c0d1b584404ba3998e136f166e89', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:12:13.935357 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137b1744-5f0f-46f8-be20-9db444036721 service neutron] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:12:13.935640 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137b1744-5f0f-46f8-be20-9db444036721 service neutron] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:12:13.936649 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137b1744-5f0f-46f8-be20-9db444036721 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:12:13.948048 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137b1744-5f0f-46f8-be20-9db444036721 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:12:13.949808 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137b1744-5f0f-46f8-be20-9db444036721 service neutron] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:12:13.961315 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1406/2801] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 15 18:12:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 18:12:14.258549 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec6135d-82ff-4fa5-bf49-65b5ed629f7a None None] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:12:14.260122 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-bec6135d-82ff-4fa5-bf49-65b5ed629f7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:12:14.272140 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec6135d-82ff-4fa5-bf49-65b5ed629f7a None None] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:12:14.276822 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc63a8f-ca66-4ee9-8574-5e0ddeccc867 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:12:14.277483 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc63a8f-ca66-4ee9-8574-5e0ddeccc867 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:12:14.277766 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc63a8f-ca66-4ee9-8574-5e0ddeccc867 admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:12:14.278039 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc63a8f-ca66-4ee9-8574-5e0ddeccc867 admin admin] PATH_INFO: `/v3/projects/d74208b733eb4983b91e04c088200d92` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:12:14.279255 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc63a8f-ca66-4ee9-8574-5e0ddeccc867 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d74208b733eb4983b91e04c088200d92)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:12:14.281083 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc63a8f-ca66-4ee9-8574-5e0ddeccc867 admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:12:14.284267 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 18:12:14.330728 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-7fc63a8f-ca66-4ee9-8574-5e0ddeccc867 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd74208b733eb4983b91e04c088200d92', 'request_id': 'req-7fc63a8f-ca66-4ee9-8574-5e0ddeccc867'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:12:14.336411 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-7fc63a8f-ca66-4ee9-8574-5e0ddeccc867 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd74208b733eb4983b91e04c088200d92', 'request_id': 'req-7fc63a8f-ca66-4ee9-8574-5e0ddeccc867'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:12:14.343775 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-7fc63a8f-ca66-4ee9-8574-5e0ddeccc867 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd74208b733eb4983b91e04c088200d92', 'request_id': 'req-7fc63a8f-ca66-4ee9-8574-5e0ddeccc867'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:12:14.355380 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-7fc63a8f-ca66-4ee9-8574-5e0ddeccc867 admin admin] The token cache is being invalidate because project d74208b733eb4983b91e04c088200d92 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81592) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 18:12:14.355670 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-7fc63a8f-ca66-4ee9-8574-5e0ddeccc867 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:12:14.356292 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-7fc63a8f-ca66-4ee9-8574-5e0ddeccc867 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:12:14.357887 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1396/2802] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Sep 15 18:12:14 2022] DELETE /identity/v3/projects/d74208b733eb4983b91e04c088200d92 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 18:12:14.362359 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137b1744-5f0f-46f8-be20-9db444036721 service neutron] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:12:14.373085 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137b1744-5f0f-46f8-be20-9db444036721 service neutron] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:12:14.435800 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88fb1d6-fbf0-4a78-a569-4432e2d468ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:12:14.436617 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88fb1d6-fbf0-4a78-a569-4432e2d468ab admin admin] REQUEST_METHOD: `DELETE` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:12:14.436988 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88fb1d6-fbf0-4a78-a569-4432e2d468ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:12:14.437312 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88fb1d6-fbf0-4a78-a569-4432e2d468ab admin admin] PATH_INFO: `/v3/users/739cb5ed1b114f61baff1733685d0c1e` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:12:14.438705 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f88fb1d6-fbf0-4a78-a569-4432e2d468ab admin admin] RBAC: Authorizing `identity:delete_user(user_id=739cb5ed1b114f61baff1733685d0c1e)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:12:14.441849 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f88fb1d6-fbf0-4a78-a569-4432e2d468ab admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:12:14.487754 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-f88fb1d6-fbf0-4a78-a569-4432e2d468ab admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '739cb5ed1b114f61baff1733685d0c1e'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:12:14.496437 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-f88fb1d6-fbf0-4a78-a569-4432e2d468ab admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '739cb5ed1b114f61baff1733685d0c1e'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:12:14.497054 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-f88fb1d6-fbf0-4a78-a569-4432e2d468ab admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '739cb5ed1b114f61baff1733685d0c1e'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:12:14.497685 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-f88fb1d6-fbf0-4a78-a569-4432e2d468ab admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '739cb5ed1b114f61baff1733685d0c1e'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:12:14.507571 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-f88fb1d6-fbf0-4a78-a569-4432e2d468ab admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '739cb5ed1b114f61baff1733685d0c1e'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:12:14.520264 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 18:12:14.529730 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1407/2803] 10.222.0.25 () {58 vars in 1224 bytes} [Thu Sep 15 18:12:14 2022] DELETE /identity/v3/users/739cb5ed1b114f61baff1733685d0c1e => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 18:12:14.804860 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc63a8f-ca66-4ee9-8574-5e0ddeccc867 admin admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:12:14.806365 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-7fc63a8f-ca66-4ee9-8574-5e0ddeccc867 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:12:14.819317 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc63a8f-ca66-4ee9-8574-5e0ddeccc867 admin admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:12:14.876602 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a97c67-4445-492c-96f8-ef11ed73a17a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:12:14.877253 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a97c67-4445-492c-96f8-ef11ed73a17a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:12:14.877564 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a97c67-4445-492c-96f8-ef11ed73a17a admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:12:14.877839 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a97c67-4445-492c-96f8-ef11ed73a17a admin admin] PATH_INFO: `/v3/projects/2c67d6aa814045afb60b46e535f36248` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:12:14.878947 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a97c67-4445-492c-96f8-ef11ed73a17a admin admin] RBAC: Authorizing `identity:delete_project(project_id=2c67d6aa814045afb60b46e535f36248)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:12:14.880845 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a97c67-4445-492c-96f8-ef11ed73a17a admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:12:14.934029 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-69a97c67-4445-492c-96f8-ef11ed73a17a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2c67d6aa814045afb60b46e535f36248', 'request_id': 'req-69a97c67-4445-492c-96f8-ef11ed73a17a'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:12:14.940100 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-69a97c67-4445-492c-96f8-ef11ed73a17a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2c67d6aa814045afb60b46e535f36248', 'request_id': 'req-69a97c67-4445-492c-96f8-ef11ed73a17a'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:12:14.948438 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-69a97c67-4445-492c-96f8-ef11ed73a17a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2c67d6aa814045afb60b46e535f36248', 'request_id': 'req-69a97c67-4445-492c-96f8-ef11ed73a17a'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:12:14.961705 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-69a97c67-4445-492c-96f8-ef11ed73a17a admin admin] The token cache is being invalidate because project 2c67d6aa814045afb60b46e535f36248 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81592) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 18:12:14.962307 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-69a97c67-4445-492c-96f8-ef11ed73a17a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:12:14.962965 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-69a97c67-4445-492c-96f8-ef11ed73a17a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:12:14.964671 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1397/2804] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Sep 15 18:12:14 2022] DELETE /identity/v3/projects/2c67d6aa814045afb60b46e535f36248 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 18:12:14.969577 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4a9ec9-67fa-4c0a-af33-22c4c9649a10 None None] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:12:14.970050 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4a9ec9-67fa-4c0a-af33-22c4c9649a10 None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:12:14.970264 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4a9ec9-67fa-4c0a-af33-22c4c9649a10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:12:14.989638 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.auth.core [None req-0d4a9ec9-67fa-4c0a-af33-22c4c9649a10 None None] MFA Rules not processed for user `5cfa58ef86774ab7800bf91930bf6028`. Rule list: `[]` (Enabled: `True`). {{(pid=81593) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 18:12:14.990925 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-0d4a9ec9-67fa-4c0a-af33-22c4c9649a10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:12:15.051854 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1408/2805] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 15 18:12:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 18:12:15.059493 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303819fe-1aa4-4e76-b1c2-737c2af7a60b None None] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:12:15.059777 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303819fe-1aa4-4e76-b1c2-737c2af7a60b None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:12:15.060049 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303819fe-1aa4-4e76-b1c2-737c2af7a60b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:12:15.079797 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.auth.core [None req-303819fe-1aa4-4e76-b1c2-737c2af7a60b None None] MFA Rules not processed for user `5cfa58ef86774ab7800bf91930bf6028`. Rule list: `[]` (Enabled: `True`). {{(pid=81592) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 18:12:15.081703 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-303819fe-1aa4-4e76-b1c2-737c2af7a60b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:12:15.089690 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1398/2806] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 15 18:12:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 18:12:15.093863 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4a9ec9-67fa-4c0a-af33-22c4c9649a10 None None] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:12:15.103525 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4a9ec9-67fa-4c0a-af33-22c4c9649a10 None None] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:12:15.108119 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8cba45b-400a-417e-8524-2228844a469f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:12:15.108729 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cba45b-400a-417e-8524-2228844a469f admin admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:12:15.108996 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cba45b-400a-417e-8524-2228844a469f admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:12:15.109267 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cba45b-400a-417e-8524-2228844a469f admin admin] PATH_INFO: `/v3/domains` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:12:15.109937 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8cba45b-400a-417e-8524-2228844a469f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81593) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 18:12:15.110240 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8cba45b-400a-417e-8524-2228844a469f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:12:15.111889 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8cba45b-400a-417e-8524-2228844a469f admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:12:15.123259 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1409/2807] 10.222.0.25 () {58 vars in 1153 bytes} [Thu Sep 15 18:12:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 18:12:15.128013 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303819fe-1aa4-4e76-b1c2-737c2af7a60b None None] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:12:15.137012 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303819fe-1aa4-4e76-b1c2-737c2af7a60b None None] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:12:15.141540 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b7f20b-b9e9-4b7c-8635-296f495841d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:12:15.142127 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b7f20b-b9e9-4b7c-8635-296f495841d8 admin admin] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:12:15.142432 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b7f20b-b9e9-4b7c-8635-296f495841d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:12:15.143298 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b7f20b-b9e9-4b7c-8635-296f495841d8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:12:15.143987 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b7f20b-b9e9-4b7c-8635-296f495841d8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:12:15.145895 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b7f20b-b9e9-4b7c-8635-296f495841d8 admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:12:15.160148 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 18:12:15.172886 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1399/2808] 10.222.0.25 () {60 vars in 1153 bytes} [Thu Sep 15 18:12:15 2022] POST /identity/v3/projects => generated 381 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 18:12:15.176941 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8cba45b-400a-417e-8524-2228844a469f admin admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:12:15.186558 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8cba45b-400a-417e-8524-2228844a469f admin admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:12:15.242165 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5c5a33-7c18-4a1c-bee5-484e329839c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:12:15.242724 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5c5a33-7c18-4a1c-bee5-484e329839c4 admin admin] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:12:15.243025 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5c5a33-7c18-4a1c-bee5-484e329839c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:12:15.243296 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5c5a33-7c18-4a1c-bee5-484e329839c4 admin admin] PATH_INFO: `/v3/users` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:12:15.243920 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5c5a33-7c18-4a1c-bee5-484e329839c4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:12:15.245879 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5c5a33-7c18-4a1c-bee5-484e329839c4 admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:12:15.269713 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1410/2809] 10.222.0.25 () {60 vars in 1144 bytes} [Thu Sep 15 18:12:15 2022] POST /identity/v3/users => generated 291 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 18:12:15.273902 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b7f20b-b9e9-4b7c-8635-296f495841d8 admin admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:12:15.283907 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b7f20b-b9e9-4b7c-8635-296f495841d8 admin admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:12:15.288502 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a31988b-8138-432b-b195-3cf0512cfa05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:12:15.289091 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a31988b-8138-432b-b195-3cf0512cfa05 admin admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:12:15.289399 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a31988b-8138-432b-b195-3cf0512cfa05 admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:12:15.289672 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a31988b-8138-432b-b195-3cf0512cfa05 admin admin] PATH_INFO: `/v3/roles` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:12:15.290306 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a31988b-8138-432b-b195-3cf0512cfa05 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:12:15.291945 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a31988b-8138-432b-b195-3cf0512cfa05 admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:12:15.305173 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1400/2810] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Sep 15 18:12:15 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 18:12:15.306641 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5c5a33-7c18-4a1c-bee5-484e329839c4 admin admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:12:15.317623 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5c5a33-7c18-4a1c-bee5-484e329839c4 admin admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:12:15.322304 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a146c6d5-63a4-402c-bf0c-6a7cd003de1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:12:15.322907 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a146c6d5-63a4-402c-bf0c-6a7cd003de1e admin admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:12:15.323179 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a146c6d5-63a4-402c-bf0c-6a7cd003de1e admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:12:15.323452 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a146c6d5-63a4-402c-bf0c-6a7cd003de1e admin admin] PATH_INFO: `/v3/roles` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:12:15.324109 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a146c6d5-63a4-402c-bf0c-6a7cd003de1e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:12:15.325709 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a146c6d5-63a4-402c-bf0c-6a7cd003de1e admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:12:15.337215 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1411/2811] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Sep 15 18:12:15 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 18:12:15.341385 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a31988b-8138-432b-b195-3cf0512cfa05 admin admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:12:15.351705 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a31988b-8138-432b-b195-3cf0512cfa05 admin admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:12:15.356550 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be860521-4ba1-434c-b34a-d28cef288bfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:12:15.357200 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be860521-4ba1-434c-b34a-d28cef288bfa admin admin] REQUEST_METHOD: `PUT` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:12:15.357530 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be860521-4ba1-434c-b34a-d28cef288bfa admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:12:15.357792 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be860521-4ba1-434c-b34a-d28cef288bfa admin admin] PATH_INFO: `/v3/projects/2d853e738966494f942d79a3b175281b/users/989e7e089340473c94881b5e92878fc4/roles/343cc8b1bc7243eebabdf08147e8366d` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:12:15.373061 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be860521-4ba1-434c-b34a-d28cef288bfa admin admin] RBAC: Authorizing `identity:create_grant(project_id=2d853e738966494f942d79a3b175281b, user_id=989e7e089340473c94881b5e92878fc4, role_id=343cc8b1bc7243eebabdf08147e8366d)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:12:15.375808 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be860521-4ba1-434c-b34a-d28cef288bfa admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:12:15.390098 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1401/2812] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Sep 15 18:12:15 2022] PUT /identity/v3/projects/2d853e738966494f942d79a3b175281b/users/989e7e089340473c94881b5e92878fc4/roles/343cc8b1bc7243eebabdf08147e8366d => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 18:12:15.400395 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a146c6d5-63a4-402c-bf0c-6a7cd003de1e admin admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:12:15.401136 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade06983-88a4-4365-8ae6-c99dce7e8629 None None] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:12:15.401557 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade06983-88a4-4365-8ae6-c99dce7e8629 None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:12:15.401834 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade06983-88a4-4365-8ae6-c99dce7e8629 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:12:15.402226 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-a146c6d5-63a4-402c-bf0c-6a7cd003de1e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:12:15.415477 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a146c6d5-63a4-402c-bf0c-6a7cd003de1e admin admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:12:15.430845 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.auth.core [None req-ade06983-88a4-4365-8ae6-c99dce7e8629 None None] MFA Rules not processed for user `989e7e089340473c94881b5e92878fc4`. Rule list: `[]` (Enabled: `True`). {{(pid=81592) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 18:12:15.432070 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-ade06983-88a4-4365-8ae6-c99dce7e8629 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:12:15.476353 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6124221-2168-42e5-b90e-a159107f65ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:12:15.477010 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6124221-2168-42e5-b90e-a159107f65ab admin admin] REQUEST_METHOD: `DELETE` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:12:15.477285 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6124221-2168-42e5-b90e-a159107f65ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:12:15.477579 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6124221-2168-42e5-b90e-a159107f65ab admin admin] PATH_INFO: `/v3/users/c918bdef271a469e8b70c6ab27cf08f2` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:12:15.478725 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6124221-2168-42e5-b90e-a159107f65ab admin admin] RBAC: Authorizing `identity:delete_user(user_id=c918bdef271a469e8b70c6ab27cf08f2)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:12:15.480863 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6124221-2168-42e5-b90e-a159107f65ab admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:12:15.483230 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 18:12:15.498120 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1402/2813] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 15 18:12:15 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 18:12:15.502509 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade06983-88a4-4365-8ae6-c99dce7e8629 None None] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:12:15.513512 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade06983-88a4-4365-8ae6-c99dce7e8629 None None] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:12:15.519151 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aad3e6e-62c7-4964-8d55-bbd96db82996 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:12:15.519739 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aad3e6e-62c7-4964-8d55-bbd96db82996 admin admin] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:12:15.520017 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aad3e6e-62c7-4964-8d55-bbd96db82996 admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:12:15.520289 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aad3e6e-62c7-4964-8d55-bbd96db82996 admin admin] PATH_INFO: `/v3/projects` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:12:15.521468 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aad3e6e-62c7-4964-8d55-bbd96db82996 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:12:15.523457 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aad3e6e-62c7-4964-8d55-bbd96db82996 admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:12:15.531124 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-f6124221-2168-42e5-b90e-a159107f65ab admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c918bdef271a469e8b70c6ab27cf08f2'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:12:15.539424 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-f6124221-2168-42e5-b90e-a159107f65ab admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c918bdef271a469e8b70c6ab27cf08f2'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:12:15.540425 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-f6124221-2168-42e5-b90e-a159107f65ab admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c918bdef271a469e8b70c6ab27cf08f2'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:12:15.541518 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-f6124221-2168-42e5-b90e-a159107f65ab admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c918bdef271a469e8b70c6ab27cf08f2'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:12:15.549651 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-f6124221-2168-42e5-b90e-a159107f65ab admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c918bdef271a469e8b70c6ab27cf08f2'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:12:15.551022 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1403/2814] 10.222.0.25 () {60 vars in 1153 bytes} [Thu Sep 15 18:12:15 2022] POST /identity/v3/projects => generated 381 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 15 18:12:15.555322 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aad3e6e-62c7-4964-8d55-bbd96db82996 admin admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:12:15.556974 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-7aad3e6e-62c7-4964-8d55-bbd96db82996 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:12:15.569759 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1412/2815] 10.222.0.25 () {58 vars in 1224 bytes} [Thu Sep 15 18:12:15 2022] DELETE /identity/v3/users/c918bdef271a469e8b70c6ab27cf08f2 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 18:12:15.574057 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00f3b02-a4f8-4730-9803-ade6ef20fc3e None None] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:12:15.574860 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00f3b02-a4f8-4730-9803-ade6ef20fc3e None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:12:15.575173 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00f3b02-a4f8-4730-9803-ade6ef20fc3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:12:15.595368 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.auth.core [None req-f00f3b02-a4f8-4730-9803-ade6ef20fc3e None None] MFA Rules not processed for user `5cfa58ef86774ab7800bf91930bf6028`. Rule list: `[]` (Enabled: `True`). {{(pid=81593) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 18:12:15.597145 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-f00f3b02-a4f8-4730-9803-ade6ef20fc3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:12:15.620503 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aad3e6e-62c7-4964-8d55-bbd96db82996 admin admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:12:15.650364 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 18:12:15.655485 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1413/2816] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 15 18:12:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 18:12:15.666275 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00f3b02-a4f8-4730-9803-ade6ef20fc3e None None] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:12:15.667623 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-f00f3b02-a4f8-4730-9803-ade6ef20fc3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:12:15.678885 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca18b9e0-a393-4179-8ee4-b46e0c776eeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:12:15.679655 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca18b9e0-a393-4179-8ee4-b46e0c776eeb admin admin] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:12:15.679935 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca18b9e0-a393-4179-8ee4-b46e0c776eeb admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:12:15.680208 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca18b9e0-a393-4179-8ee4-b46e0c776eeb admin admin] PATH_INFO: `/v3/users` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:12:15.680838 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca18b9e0-a393-4179-8ee4-b46e0c776eeb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:12:15.682929 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca18b9e0-a393-4179-8ee4-b46e0c776eeb admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:12:15.704919 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1404/2817] 10.222.0.25 () {60 vars in 1144 bytes} [Thu Sep 15 18:12:15 2022] POST /identity/v3/users => generated 297 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 18:12:15.709505 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca18b9e0-a393-4179-8ee4-b46e0c776eeb admin admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:12:15.719365 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca18b9e0-a393-4179-8ee4-b46e0c776eeb admin admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:12:15.724834 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6fdd26-1050-4273-907c-b95abea32b58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:12:15.725451 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6fdd26-1050-4273-907c-b95abea32b58 admin admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:12:15.725731 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6fdd26-1050-4273-907c-b95abea32b58 admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:12:15.726001 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6fdd26-1050-4273-907c-b95abea32b58 admin admin] PATH_INFO: `/v3/roles` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:12:15.726200 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00f3b02-a4f8-4730-9803-ade6ef20fc3e None None] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:12:15.726679 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c6fdd26-1050-4273-907c-b95abea32b58 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:12:15.728392 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c6fdd26-1050-4273-907c-b95abea32b58 admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:12:15.729798 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa09ff0-f055-4e2f-ba86-97e9e98a04f2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a32274b4781b40fea9f28da8a9bde5ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1213c0d1b584404ba3998e136f166e89', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:12:15.730397 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa09ff0-f055-4e2f-ba86-97e9e98a04f2 service neutron] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:12:15.730673 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa09ff0-f055-4e2f-ba86-97e9e98a04f2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:12:15.730946 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa09ff0-f055-4e2f-ba86-97e9e98a04f2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:12:15.740080 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1405/2818] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Sep 15 18:12:15 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 15 18:12:15.740265 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa09ff0-f055-4e2f-ba86-97e9e98a04f2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:12:15.741797 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa09ff0-f055-4e2f-ba86-97e9e98a04f2 service neutron] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:12:15.744274 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6fdd26-1050-4273-907c-b95abea32b58 admin admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:12:15.751804 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1414/2819] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 15 18:12:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 18:12:15.756529 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6fdd26-1050-4273-907c-b95abea32b58 admin admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:12:15.761542 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ebc4f0c-96ea-42d1-b975-43a4c3a42ec1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:12:15.762201 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebc4f0c-96ea-42d1-b975-43a4c3a42ec1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:12:15.762480 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebc4f0c-96ea-42d1-b975-43a4c3a42ec1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:12:15.762783 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebc4f0c-96ea-42d1-b975-43a4c3a42ec1 admin admin] PATH_INFO: `/v3/projects/810e3bdc842c403280a31820760e7afd/users/35cbd168d02641c2b9fd00f009c1969b/roles/a9e42be86923434f8af52d3fc07fb4f7` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:12:15.778667 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ebc4f0c-96ea-42d1-b975-43a4c3a42ec1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=810e3bdc842c403280a31820760e7afd, user_id=35cbd168d02641c2b9fd00f009c1969b, role_id=a9e42be86923434f8af52d3fc07fb4f7)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:12:15.781311 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ebc4f0c-96ea-42d1-b975-43a4c3a42ec1 admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:12:15.794782 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1406/2820] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Sep 15 18:12:15 2022] PUT /identity/v3/projects/810e3bdc842c403280a31820760e7afd/users/35cbd168d02641c2b9fd00f009c1969b/roles/a9e42be86923434f8af52d3fc07fb4f7 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 15 18:12:15.798689 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa09ff0-f055-4e2f-ba86-97e9e98a04f2 service neutron] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:12:15.811868 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa09ff0-f055-4e2f-ba86-97e9e98a04f2 service neutron] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:12:15.835758 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 18:12:15.876605 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8444e2bf-d389-4dce-b1be-a38b7ac4345a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:12:15.877777 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8444e2bf-d389-4dce-b1be-a38b7ac4345a admin admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:12:15.878196 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8444e2bf-d389-4dce-b1be-a38b7ac4345a admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:12:15.878477 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8444e2bf-d389-4dce-b1be-a38b7ac4345a admin admin] PATH_INFO: `/v3/roles` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:12:15.879125 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8444e2bf-d389-4dce-b1be-a38b7ac4345a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:12:15.880777 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8444e2bf-d389-4dce-b1be-a38b7ac4345a admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:12:15.890779 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1415/2821] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Sep 15 18:12:15 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 18:12:15.895548 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ebc4f0c-96ea-42d1-b975-43a4c3a42ec1 admin admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:12:15.907547 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ebc4f0c-96ea-42d1-b975-43a4c3a42ec1 admin admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:12:15.916334 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005ac868-d5bf-4ac6-8131-3d29d5dbc1f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:12:15.917272 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005ac868-d5bf-4ac6-8131-3d29d5dbc1f4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:12:15.917725 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005ac868-d5bf-4ac6-8131-3d29d5dbc1f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:12:15.917959 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005ac868-d5bf-4ac6-8131-3d29d5dbc1f4 admin admin] PATH_INFO: `/v3/projects/810e3bdc842c403280a31820760e7afd/users/35cbd168d02641c2b9fd00f009c1969b/roles/a9e42be86923434f8af52d3fc07fb4f7` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:12:15.920178 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005ac868-d5bf-4ac6-8131-3d29d5dbc1f4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=810e3bdc842c403280a31820760e7afd, user_id=35cbd168d02641c2b9fd00f009c1969b, role_id=a9e42be86923434f8af52d3fc07fb4f7)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:12:15.925340 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005ac868-d5bf-4ac6-8131-3d29d5dbc1f4 admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:12:15.934989 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1407/2822] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Sep 15 18:12:15 2022] PUT /identity/v3/projects/810e3bdc842c403280a31820760e7afd/users/35cbd168d02641c2b9fd00f009c1969b/roles/a9e42be86923434f8af52d3fc07fb4f7 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 15 18:12:15.945899 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc4d9f5-255c-4380-8f0a-1e5d5a725811 None None] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:12:15.946210 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc4d9f5-255c-4380-8f0a-1e5d5a725811 None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:12:15.946488 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc4d9f5-255c-4380-8f0a-1e5d5a725811 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:12:15.977476 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.auth.core [None req-3dc4d9f5-255c-4380-8f0a-1e5d5a725811 None None] MFA Rules not processed for user `35cbd168d02641c2b9fd00f009c1969b`. Rule list: `[]` (Enabled: `True`). {{(pid=81593) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 18:12:15.978676 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-3dc4d9f5-255c-4380-8f0a-1e5d5a725811 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:12:16.033595 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005ac868-d5bf-4ac6-8131-3d29d5dbc1f4 admin admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:12:16.036165 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-005ac868-d5bf-4ac6-8131-3d29d5dbc1f4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:12:16.059749 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1416/2823] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 15 18:12:15 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 18:12:16.071380 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc4d9f5-255c-4380-8f0a-1e5d5a725811 None None] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:12:16.072829 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-3dc4d9f5-255c-4380-8f0a-1e5d5a725811 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:12:16.109728 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005ac868-d5bf-4ac6-8131-3d29d5dbc1f4 admin admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:12:16.118517 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0f5f18-26f4-4ae0-b792-c27d92d27480 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:12:16.119616 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0f5f18-26f4-4ae0-b792-c27d92d27480 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:12:16.120095 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0f5f18-26f4-4ae0-b792-c27d92d27480 admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:12:16.120285 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0f5f18-26f4-4ae0-b792-c27d92d27480 admin admin] PATH_INFO: `/v3/projects/b6bd5ace99f04b92b0421f516d3d6f9d` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:12:16.121514 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0f5f18-26f4-4ae0-b792-c27d92d27480 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b6bd5ace99f04b92b0421f516d3d6f9d)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:12:16.124022 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0f5f18-26f4-4ae0-b792-c27d92d27480 admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:12:16.135510 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc4d9f5-255c-4380-8f0a-1e5d5a725811 None None] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:12:16.139605 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5331da0-00a3-4b7a-9461-399f7b543fc5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b232e7a841145ba93c6d8462ccb751a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1213c0d1b584404ba3998e136f166e89', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:12:16.140216 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5331da0-00a3-4b7a-9461-399f7b543fc5 service cinder] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:12:16.140496 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5331da0-00a3-4b7a-9461-399f7b543fc5 service cinder] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:12:16.140772 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5331da0-00a3-4b7a-9461-399f7b543fc5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:12:16.152805 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5331da0-00a3-4b7a-9461-399f7b543fc5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:12:16.155045 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5331da0-00a3-4b7a-9461-399f7b543fc5 service cinder] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:12:16.166341 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1417/2824] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 15 18:12:16 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 15 18:12:16.177142 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-7e0f5f18-26f4-4ae0-b792-c27d92d27480 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b6bd5ace99f04b92b0421f516d3d6f9d', 'request_id': 'req-7e0f5f18-26f4-4ae0-b792-c27d92d27480'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:12:16.183015 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-7e0f5f18-26f4-4ae0-b792-c27d92d27480 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b6bd5ace99f04b92b0421f516d3d6f9d', 'request_id': 'req-7e0f5f18-26f4-4ae0-b792-c27d92d27480'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:12:16.191883 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-7e0f5f18-26f4-4ae0-b792-c27d92d27480 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b6bd5ace99f04b92b0421f516d3d6f9d', 'request_id': 'req-7e0f5f18-26f4-4ae0-b792-c27d92d27480'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:12:16.203932 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-7e0f5f18-26f4-4ae0-b792-c27d92d27480 admin admin] The token cache is being invalidate because project b6bd5ace99f04b92b0421f516d3d6f9d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81592) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 18:12:16.204223 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-7e0f5f18-26f4-4ae0-b792-c27d92d27480 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:12:16.204890 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-7e0f5f18-26f4-4ae0-b792-c27d92d27480 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:12:16.206493 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1408/2825] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Sep 15 18:12:16 2022] DELETE /identity/v3/projects/b6bd5ace99f04b92b0421f516d3d6f9d => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 18:12:16.210402 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5331da0-00a3-4b7a-9461-399f7b543fc5 service cinder] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:12:16.221026 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5331da0-00a3-4b7a-9461-399f7b543fc5 service cinder] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:12:16.243765 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0f5f18-26f4-4ae0-b792-c27d92d27480 admin admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:12:16.245188 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-7e0f5f18-26f4-4ae0-b792-c27d92d27480 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:12:16.251891 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=87,keystone:INSERT=6,keystone:DELETE=7 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 18:12:16.268512 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 18:12:16.280854 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ddc4cc-0968-428b-9ea3-524c68fe14c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:12:16.281506 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ddc4cc-0968-428b-9ea3-524c68fe14c7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:12:16.281783 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ddc4cc-0968-428b-9ea3-524c68fe14c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:12:16.282050 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ddc4cc-0968-428b-9ea3-524c68fe14c7 admin admin] PATH_INFO: `/v3/users/26776fab0b634fd1887688124fa88682` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:12:16.283186 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ddc4cc-0968-428b-9ea3-524c68fe14c7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=26776fab0b634fd1887688124fa88682)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:12:16.285102 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ddc4cc-0968-428b-9ea3-524c68fe14c7 admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:12:16.306035 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0f5f18-26f4-4ae0-b792-c27d92d27480 admin admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:12:16.310274 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898763dc-9879-4718-a356-e87acb12284c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b232e7a841145ba93c6d8462ccb751a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1213c0d1b584404ba3998e136f166e89', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:12:16.310937 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898763dc-9879-4718-a356-e87acb12284c service cinder] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:12:16.311254 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898763dc-9879-4718-a356-e87acb12284c service cinder] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:12:16.311659 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898763dc-9879-4718-a356-e87acb12284c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:12:16.313738 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-898763dc-9879-4718-a356-e87acb12284c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:12:16.333888 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-d1ddc4cc-0968-428b-9ea3-524c68fe14c7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '26776fab0b634fd1887688124fa88682'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:12:16.341724 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-d1ddc4cc-0968-428b-9ea3-524c68fe14c7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '26776fab0b634fd1887688124fa88682'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:12:16.342484 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-d1ddc4cc-0968-428b-9ea3-524c68fe14c7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '26776fab0b634fd1887688124fa88682'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:12:16.343136 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-d1ddc4cc-0968-428b-9ea3-524c68fe14c7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '26776fab0b634fd1887688124fa88682'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:12:16.350298 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-d1ddc4cc-0968-428b-9ea3-524c68fe14c7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '26776fab0b634fd1887688124fa88682'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:12:16.370834 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1418/2826] 10.222.0.25 () {58 vars in 1224 bytes} [Thu Sep 15 18:12:16 2022] DELETE /identity/v3/users/26776fab0b634fd1887688124fa88682 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 15 18:12:16.378999 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-898763dc-9879-4718-a356-e87acb12284c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:12:16.380450 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-898763dc-9879-4718-a356-e87acb12284c service cinder] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:12:16.389712 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1409/2827] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 15 18:12:16 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 15 18:12:16.671177 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ddc4cc-0968-428b-9ea3-524c68fe14c7 admin admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:12:16.672765 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-d1ddc4cc-0968-428b-9ea3-524c68fe14c7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:12:16.690478 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898763dc-9879-4718-a356-e87acb12284c service cinder] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:12:16.691970 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-898763dc-9879-4718-a356-e87acb12284c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:12:16.706456 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898763dc-9879-4718-a356-e87acb12284c service cinder] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:12:16.759838 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ddc4cc-0968-428b-9ea3-524c68fe14c7 admin admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:12:16.764733 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c869d918-82c6-4695-ad39-884b9bea428a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:12:16.765506 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c869d918-82c6-4695-ad39-884b9bea428a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:12:16.765748 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c869d918-82c6-4695-ad39-884b9bea428a admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:12:16.766137 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c869d918-82c6-4695-ad39-884b9bea428a admin admin] PATH_INFO: `/v3/projects/7ddc998fb7744ba9bdf246ddbd2716e5` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:12:16.766769 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0534582f-ae77-4d61-aceb-512217463bab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:12:16.767269 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c869d918-82c6-4695-ad39-884b9bea428a admin admin] RBAC: Authorizing `identity:delete_project(project_id=7ddc998fb7744ba9bdf246ddbd2716e5)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:12:16.767393 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0534582f-ae77-4d61-aceb-512217463bab admin admin] REQUEST_METHOD: `DELETE` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:12:16.768236 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0534582f-ae77-4d61-aceb-512217463bab admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:12:16.768540 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0534582f-ae77-4d61-aceb-512217463bab admin admin] PATH_INFO: `/v3/users/989e7e089340473c94881b5e92878fc4` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:12:16.769763 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0534582f-ae77-4d61-aceb-512217463bab admin admin] RBAC: Authorizing `identity:delete_user(user_id=989e7e089340473c94881b5e92878fc4)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:12:16.770138 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c869d918-82c6-4695-ad39-884b9bea428a admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:12:16.771661 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0534582f-ae77-4d61-aceb-512217463bab admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:12:16.820087 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-0534582f-ae77-4d61-aceb-512217463bab admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '989e7e089340473c94881b5e92878fc4'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:12:16.820683 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-c869d918-82c6-4695-ad39-884b9bea428a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7ddc998fb7744ba9bdf246ddbd2716e5', 'request_id': 'req-c869d918-82c6-4695-ad39-884b9bea428a'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:12:16.826935 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-c869d918-82c6-4695-ad39-884b9bea428a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7ddc998fb7744ba9bdf246ddbd2716e5', 'request_id': 'req-c869d918-82c6-4695-ad39-884b9bea428a'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:12:16.828128 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-0534582f-ae77-4d61-aceb-512217463bab admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '989e7e089340473c94881b5e92878fc4'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:12:16.828907 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-0534582f-ae77-4d61-aceb-512217463bab admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '989e7e089340473c94881b5e92878fc4'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:12:16.829625 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-0534582f-ae77-4d61-aceb-512217463bab admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '989e7e089340473c94881b5e92878fc4'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:12:16.835292 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-c869d918-82c6-4695-ad39-884b9bea428a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7ddc998fb7744ba9bdf246ddbd2716e5', 'request_id': 'req-c869d918-82c6-4695-ad39-884b9bea428a'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:12:16.836039 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 18:12:16.838885 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-0534582f-ae77-4d61-aceb-512217463bab admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '989e7e089340473c94881b5e92878fc4'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:12:16.843029 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 18:12:16.849598 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-c869d918-82c6-4695-ad39-884b9bea428a admin admin] The token cache is being invalidate because project 7ddc998fb7744ba9bdf246ddbd2716e5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81593) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 18:12:16.850077 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-c869d918-82c6-4695-ad39-884b9bea428a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:12:16.851145 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-c869d918-82c6-4695-ad39-884b9bea428a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:12:16.853103 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1419/2828] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Sep 15 18:12:16 2022] DELETE /identity/v3/projects/7ddc998fb7744ba9bdf246ddbd2716e5 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 18:12:16.858092 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b26c5ec-b3b6-482f-a2e4-54a47ff7585c None None] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:12:16.858525 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b26c5ec-b3b6-482f-a2e4-54a47ff7585c None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:12:16.858886 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b26c5ec-b3b6-482f-a2e4-54a47ff7585c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:12:16.861765 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1410/2829] 10.222.0.25 () {58 vars in 1224 bytes} [Thu Sep 15 18:12:16 2022] DELETE /identity/v3/users/989e7e089340473c94881b5e92878fc4 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 15 18:12:16.865905 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e7425c-d6b6-4449-8e65-ca273e5eab23 None None] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:12:16.866186 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e7425c-d6b6-4449-8e65-ca273e5eab23 None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:12:16.866458 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e7425c-d6b6-4449-8e65-ca273e5eab23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:12:16.881376 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.auth.core [None req-4b26c5ec-b3b6-482f-a2e4-54a47ff7585c None None] MFA Rules not processed for user `5cfa58ef86774ab7800bf91930bf6028`. Rule list: `[]` (Enabled: `True`). {{(pid=81593) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 18:12:16.882587 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-4b26c5ec-b3b6-482f-a2e4-54a47ff7585c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:12:16.884579 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.auth.core [None req-41e7425c-d6b6-4449-8e65-ca273e5eab23 None None] MFA Rules not processed for user `5cfa58ef86774ab7800bf91930bf6028`. Rule list: `[]` (Enabled: `True`). {{(pid=81592) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 18:12:16.885756 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-41e7425c-d6b6-4449-8e65-ca273e5eab23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:12:16.944316 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1420/2830] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 15 18:12:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 18:12:16.949945 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1411/2831] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 15 18:12:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 18:12:16.953739 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570bf2ec-7527-4e0c-80ab-31a03068844c None None] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:12:16.953982 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570bf2ec-7527-4e0c-80ab-31a03068844c None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:12:16.954253 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570bf2ec-7527-4e0c-80ab-31a03068844c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:12:16.959818 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e7425c-d6b6-4449-8e65-ca273e5eab23 None None] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:12:16.961163 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-41e7425c-d6b6-4449-8e65-ca273e5eab23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:12:16.974989 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.auth.core [None req-570bf2ec-7527-4e0c-80ab-31a03068844c None None] MFA Rules not processed for user `5cfa58ef86774ab7800bf91930bf6028`. Rule list: `[]` (Enabled: `True`). {{(pid=81593) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 18:12:16.976144 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-570bf2ec-7527-4e0c-80ab-31a03068844c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:12:16.983955 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1421/2832] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 15 18:12:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 18:12:16.988013 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570bf2ec-7527-4e0c-80ab-31a03068844c None None] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:12:16.997915 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570bf2ec-7527-4e0c-80ab-31a03068844c None None] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:12:17.002546 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1caeda1-71e6-448d-ba0f-042cd4dcca30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:12:17.003140 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1caeda1-71e6-448d-ba0f-042cd4dcca30 admin admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:12:17.003419 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1caeda1-71e6-448d-ba0f-042cd4dcca30 admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:12:17.003692 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1caeda1-71e6-448d-ba0f-042cd4dcca30 admin admin] PATH_INFO: `/v3/domains` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:12:17.004328 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1caeda1-71e6-448d-ba0f-042cd4dcca30 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81593) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 18:12:17.004626 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1caeda1-71e6-448d-ba0f-042cd4dcca30 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:12:17.006239 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1caeda1-71e6-448d-ba0f-042cd4dcca30 admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:12:17.018312 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1422/2833] 10.222.0.25 () {58 vars in 1153 bytes} [Thu Sep 15 18:12:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 18:12:17.019478 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e7425c-d6b6-4449-8e65-ca273e5eab23 None None] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:12:17.022271 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1caeda1-71e6-448d-ba0f-042cd4dcca30 admin admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:12:17.023139 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce86c1a4-64e5-450a-aca6-3725ae9aaf7a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a32274b4781b40fea9f28da8a9bde5ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1213c0d1b584404ba3998e136f166e89', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:12:17.023743 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce86c1a4-64e5-450a-aca6-3725ae9aaf7a service neutron] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:12:17.024023 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce86c1a4-64e5-450a-aca6-3725ae9aaf7a service neutron] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:12:17.024293 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce86c1a4-64e5-450a-aca6-3725ae9aaf7a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:12:17.032252 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1caeda1-71e6-448d-ba0f-042cd4dcca30 admin admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:12:17.033936 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce86c1a4-64e5-450a-aca6-3725ae9aaf7a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:12:17.035361 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce86c1a4-64e5-450a-aca6-3725ae9aaf7a service neutron] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:12:17.037792 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e173a10d-b73a-4307-aeaa-4bbd762f7fce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:12:17.038407 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e173a10d-b73a-4307-aeaa-4bbd762f7fce admin admin] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:12:17.038690 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e173a10d-b73a-4307-aeaa-4bbd762f7fce admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:12:17.038964 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e173a10d-b73a-4307-aeaa-4bbd762f7fce admin admin] PATH_INFO: `/v3/projects` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:12:17.039757 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e173a10d-b73a-4307-aeaa-4bbd762f7fce admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:12:17.042266 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e173a10d-b73a-4307-aeaa-4bbd762f7fce admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:12:17.044790 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1412/2834] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 15 18:12:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 18:12:17.069754 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1423/2835] 10.222.0.25 () {60 vars in 1153 bytes} [Thu Sep 15 18:12:17 2022] POST /identity/v3/projects => generated 371 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 15 18:12:17.074105 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce86c1a4-64e5-450a-aca6-3725ae9aaf7a service neutron] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:12:17.084652 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce86c1a4-64e5-450a-aca6-3725ae9aaf7a service neutron] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:12:17.145129 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47fa4759-a61c-4c1e-b391-4415f79bba1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:12:17.145789 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fa4759-a61c-4c1e-b391-4415f79bba1e admin admin] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:12:17.146105 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fa4759-a61c-4c1e-b391-4415f79bba1e admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:12:17.146389 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fa4759-a61c-4c1e-b391-4415f79bba1e admin admin] PATH_INFO: `/v3/users` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:12:17.147056 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47fa4759-a61c-4c1e-b391-4415f79bba1e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:12:17.148952 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47fa4759-a61c-4c1e-b391-4415f79bba1e admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:12:17.171577 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1413/2836] 10.222.0.25 () {60 vars in 1144 bytes} [Thu Sep 15 18:12:17 2022] POST /identity/v3/users => generated 286 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 18:12:17.175901 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e173a10d-b73a-4307-aeaa-4bbd762f7fce admin admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:12:17.186721 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e173a10d-b73a-4307-aeaa-4bbd762f7fce admin admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:12:17.192652 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1beea02-0f58-43f4-bd9b-da958f18babf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:12:17.193273 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1beea02-0f58-43f4-bd9b-da958f18babf admin admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:12:17.193598 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1beea02-0f58-43f4-bd9b-da958f18babf admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:12:17.193855 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1beea02-0f58-43f4-bd9b-da958f18babf admin admin] PATH_INFO: `/v3/roles` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:12:17.194519 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1beea02-0f58-43f4-bd9b-da958f18babf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:12:17.196116 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1beea02-0f58-43f4-bd9b-da958f18babf admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:12:17.207786 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1424/2837] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Sep 15 18:12:17 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 18:12:17.211750 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47fa4759-a61c-4c1e-b391-4415f79bba1e admin admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:12:17.222148 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47fa4759-a61c-4c1e-b391-4415f79bba1e admin admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:12:17.227042 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b241e54b-e927-45e0-8e7b-ebf07dc2c820 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:12:17.227793 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b241e54b-e927-45e0-8e7b-ebf07dc2c820 admin admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:12:17.228130 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b241e54b-e927-45e0-8e7b-ebf07dc2c820 admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:12:17.228737 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b241e54b-e927-45e0-8e7b-ebf07dc2c820 admin admin] PATH_INFO: `/v3/roles` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:12:17.229417 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b241e54b-e927-45e0-8e7b-ebf07dc2c820 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:12:17.231097 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b241e54b-e927-45e0-8e7b-ebf07dc2c820 admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:12:17.238113 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=95,keystone:DELETE=2,keystone:INSERT=3 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 18:12:17.247720 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1414/2838] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Sep 15 18:12:17 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 18:12:17.248306 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1beea02-0f58-43f4-bd9b-da958f18babf admin admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:12:17.258834 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1beea02-0f58-43f4-bd9b-da958f18babf admin admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:12:17.263524 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2beb221-cc48-4209-a9c9-da29bef693a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:12:17.264175 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2beb221-cc48-4209-a9c9-da29bef693a9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:12:17.264450 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2beb221-cc48-4209-a9c9-da29bef693a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:12:17.264723 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2beb221-cc48-4209-a9c9-da29bef693a9 admin admin] PATH_INFO: `/v3/projects/5d5d58f4a3d6436fb5eb2733c2d165d7/users/2d058450102a42d0a0e7b40790341ca8/roles/343cc8b1bc7243eebabdf08147e8366d` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:12:17.280863 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2beb221-cc48-4209-a9c9-da29bef693a9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5d5d58f4a3d6436fb5eb2733c2d165d7, user_id=2d058450102a42d0a0e7b40790341ca8, role_id=343cc8b1bc7243eebabdf08147e8366d)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:12:17.283753 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2beb221-cc48-4209-a9c9-da29bef693a9 admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:12:17.297813 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1425/2839] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Sep 15 18:12:17 2022] PUT /identity/v3/projects/5d5d58f4a3d6436fb5eb2733c2d165d7/users/2d058450102a42d0a0e7b40790341ca8/roles/343cc8b1bc7243eebabdf08147e8366d => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 18:12:17.309921 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6f4dcb-c488-4993-bd82-86cf9cddc0d0 None None] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:12:17.310208 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6f4dcb-c488-4993-bd82-86cf9cddc0d0 None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:12:17.310488 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6f4dcb-c488-4993-bd82-86cf9cddc0d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:12:17.326838 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2beb221-cc48-4209-a9c9-da29bef693a9 admin admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:12:17.329512 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-f2beb221-cc48-4209-a9c9-da29bef693a9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:12:17.347168 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.auth.core [None req-4e6f4dcb-c488-4993-bd82-86cf9cddc0d0 None None] MFA Rules not processed for user `2d058450102a42d0a0e7b40790341ca8`. Rule list: `[]` (Enabled: `True`). {{(pid=81592) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 18:12:17.349457 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-4e6f4dcb-c488-4993-bd82-86cf9cddc0d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:12:17.402452 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2beb221-cc48-4209-a9c9-da29bef693a9 admin admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:12:17.406903 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e280ca05-7dde-4ece-859a-98cd68dd6b02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:12:17.407523 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e280ca05-7dde-4ece-859a-98cd68dd6b02 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:12:17.407798 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e280ca05-7dde-4ece-859a-98cd68dd6b02 admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:12:17.408073 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e280ca05-7dde-4ece-859a-98cd68dd6b02 admin admin] PATH_INFO: `/v3/projects/2d853e738966494f942d79a3b175281b` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:12:17.409355 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e280ca05-7dde-4ece-859a-98cd68dd6b02 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2d853e738966494f942d79a3b175281b)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:12:17.411451 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e280ca05-7dde-4ece-859a-98cd68dd6b02 admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:12:17.417681 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1415/2840] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 15 18:12:17 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 18:12:17.428819 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6f4dcb-c488-4993-bd82-86cf9cddc0d0 None None] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:12:17.430362 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-4e6f4dcb-c488-4993-bd82-86cf9cddc0d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:12:17.438059 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=97,keystone:INSERT=2,keystone:DELETE=1 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 18:12:17.465731 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-e280ca05-7dde-4ece-859a-98cd68dd6b02 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2d853e738966494f942d79a3b175281b', 'request_id': 'req-e280ca05-7dde-4ece-859a-98cd68dd6b02'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:12:17.471393 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-e280ca05-7dde-4ece-859a-98cd68dd6b02 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2d853e738966494f942d79a3b175281b', 'request_id': 'req-e280ca05-7dde-4ece-859a-98cd68dd6b02'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:12:17.481175 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-e280ca05-7dde-4ece-859a-98cd68dd6b02 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2d853e738966494f942d79a3b175281b', 'request_id': 'req-e280ca05-7dde-4ece-859a-98cd68dd6b02'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:12:17.491517 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6f4dcb-c488-4993-bd82-86cf9cddc0d0 None None] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:12:17.492114 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-e280ca05-7dde-4ece-859a-98cd68dd6b02 admin admin] The token cache is being invalidate because project 2d853e738966494f942d79a3b175281b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81593) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 18:12:17.492400 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-e280ca05-7dde-4ece-859a-98cd68dd6b02 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:12:17.493035 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-e280ca05-7dde-4ece-859a-98cd68dd6b02 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:12:17.494537 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1426/2841] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Sep 15 18:12:17 2022] DELETE /identity/v3/projects/2d853e738966494f942d79a3b175281b => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 18:12:17.498313 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e280ca05-7dde-4ece-859a-98cd68dd6b02 admin admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:12:17.499627 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-e280ca05-7dde-4ece-859a-98cd68dd6b02 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:12:17.545146 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236d0f43-696d-406e-acec-a22289c53743 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b232e7a841145ba93c6d8462ccb751a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1213c0d1b584404ba3998e136f166e89', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:12:17.545789 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236d0f43-696d-406e-acec-a22289c53743 service cinder] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:12:17.546119 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236d0f43-696d-406e-acec-a22289c53743 service cinder] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:12:17.546338 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236d0f43-696d-406e-acec-a22289c53743 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:12:17.548112 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-236d0f43-696d-406e-acec-a22289c53743 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:12:17.563467 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e280ca05-7dde-4ece-859a-98cd68dd6b02 admin admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:12:17.568635 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc52137-7dac-4d1e-bdaf-a2dcf807f193 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:12:17.569259 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc52137-7dac-4d1e-bdaf-a2dcf807f193 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:12:17.569566 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc52137-7dac-4d1e-bdaf-a2dcf807f193 admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:12:17.569837 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc52137-7dac-4d1e-bdaf-a2dcf807f193 admin admin] PATH_INFO: `/v3/users/35cbd168d02641c2b9fd00f009c1969b` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:12:17.570985 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc52137-7dac-4d1e-bdaf-a2dcf807f193 admin admin] RBAC: Authorizing `identity:delete_user(user_id=35cbd168d02641c2b9fd00f009c1969b)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:12:17.572909 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc52137-7dac-4d1e-bdaf-a2dcf807f193 admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:12:17.608752 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-236d0f43-696d-406e-acec-a22289c53743 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:12:17.610222 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-236d0f43-696d-406e-acec-a22289c53743 service cinder] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:12:17.615560 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 18:12:17.621036 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-0bc52137-7dac-4d1e-bdaf-a2dcf807f193 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '35cbd168d02641c2b9fd00f009c1969b'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:12:17.621606 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1416/2842] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 15 18:12:17 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 15 18:12:17.630385 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-0bc52137-7dac-4d1e-bdaf-a2dcf807f193 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '35cbd168d02641c2b9fd00f009c1969b'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:12:17.631076 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-0bc52137-7dac-4d1e-bdaf-a2dcf807f193 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '35cbd168d02641c2b9fd00f009c1969b'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:12:17.632197 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-0bc52137-7dac-4d1e-bdaf-a2dcf807f193 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '35cbd168d02641c2b9fd00f009c1969b'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:12:17.640197 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-0bc52137-7dac-4d1e-bdaf-a2dcf807f193 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '35cbd168d02641c2b9fd00f009c1969b'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:12:17.642357 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236d0f43-696d-406e-acec-a22289c53743 service cinder] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:12:17.644287 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-236d0f43-696d-406e-acec-a22289c53743 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:12:17.659164 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236d0f43-696d-406e-acec-a22289c53743 service cinder] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:12:17.660149 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1427/2843] 10.222.0.25 () {58 vars in 1224 bytes} [Thu Sep 15 18:12:17 2022] DELETE /identity/v3/users/35cbd168d02641c2b9fd00f009c1969b => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 18:12:17.717611 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe41657-8945-4cd2-80bf-ec226b39bd1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:12:17.718245 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe41657-8945-4cd2-80bf-ec226b39bd1a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:12:17.718524 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe41657-8945-4cd2-80bf-ec226b39bd1a admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:12:17.718796 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe41657-8945-4cd2-80bf-ec226b39bd1a admin admin] PATH_INFO: `/v3/users/2d058450102a42d0a0e7b40790341ca8` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:12:17.719945 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe41657-8945-4cd2-80bf-ec226b39bd1a admin admin] RBAC: Authorizing `identity:delete_user(user_id=2d058450102a42d0a0e7b40790341ca8)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:12:17.722734 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe41657-8945-4cd2-80bf-ec226b39bd1a admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:12:17.771314 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-ebe41657-8945-4cd2-80bf-ec226b39bd1a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2d058450102a42d0a0e7b40790341ca8'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:12:17.778907 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-ebe41657-8945-4cd2-80bf-ec226b39bd1a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2d058450102a42d0a0e7b40790341ca8'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:12:17.779595 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-ebe41657-8945-4cd2-80bf-ec226b39bd1a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2d058450102a42d0a0e7b40790341ca8'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:12:17.780220 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-ebe41657-8945-4cd2-80bf-ec226b39bd1a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2d058450102a42d0a0e7b40790341ca8'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:12:17.788135 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-ebe41657-8945-4cd2-80bf-ec226b39bd1a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2d058450102a42d0a0e7b40790341ca8'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:12:17.814182 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1417/2844] 10.222.0.25 () {58 vars in 1224 bytes} [Thu Sep 15 18:12:17 2022] DELETE /identity/v3/users/2d058450102a42d0a0e7b40790341ca8 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 15 18:12:17.818454 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdc14cd-1cbe-40a6-b4f2-d3ec4fcdb9d4 None None] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:12:17.818746 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdc14cd-1cbe-40a6-b4f2-d3ec4fcdb9d4 None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:12:17.819102 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdc14cd-1cbe-40a6-b4f2-d3ec4fcdb9d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:12:17.838477 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.auth.core [None req-efdc14cd-1cbe-40a6-b4f2-d3ec4fcdb9d4 None None] MFA Rules not processed for user `5cfa58ef86774ab7800bf91930bf6028`. Rule list: `[]` (Enabled: `True`). {{(pid=81593) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 18:12:17.839686 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-efdc14cd-1cbe-40a6-b4f2-d3ec4fcdb9d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:12:17.866146 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 18:12:17.901950 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1428/2845] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 15 18:12:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 18:12:17.912558 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe41657-8945-4cd2-80bf-ec226b39bd1a admin admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:12:17.914027 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-ebe41657-8945-4cd2-80bf-ec226b39bd1a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:12:17.943083 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efdc14cd-1cbe-40a6-b4f2-d3ec4fcdb9d4 None None] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:12:17.946134 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-efdc14cd-1cbe-40a6-b4f2-d3ec4fcdb9d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:12:17.960265 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efdc14cd-1cbe-40a6-b4f2-d3ec4fcdb9d4 None None] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:12:17.965764 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2e6dda-a7c2-49de-91f6-808f4870cd04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:12:17.966390 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2e6dda-a7c2-49de-91f6-808f4870cd04 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:12:17.966670 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2e6dda-a7c2-49de-91f6-808f4870cd04 admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:12:17.967123 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2e6dda-a7c2-49de-91f6-808f4870cd04 admin admin] PATH_INFO: `/v3/projects/810e3bdc842c403280a31820760e7afd` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:12:17.968273 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2e6dda-a7c2-49de-91f6-808f4870cd04 admin admin] RBAC: Authorizing `identity:delete_project(project_id=810e3bdc842c403280a31820760e7afd)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:12:17.970238 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2e6dda-a7c2-49de-91f6-808f4870cd04 admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:12:17.985075 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe41657-8945-4cd2-80bf-ec226b39bd1a admin admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:12:17.988952 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f1a0ab-9da4-4ddd-b94d-11720f038f67 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a32274b4781b40fea9f28da8a9bde5ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1213c0d1b584404ba3998e136f166e89', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:12:17.989593 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f1a0ab-9da4-4ddd-b94d-11720f038f67 service neutron] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:12:17.989868 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f1a0ab-9da4-4ddd-b94d-11720f038f67 service neutron] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:12:17.990135 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f1a0ab-9da4-4ddd-b94d-11720f038f67 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:12:18.001127 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f1a0ab-9da4-4ddd-b94d-11720f038f67 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:12:18.003382 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f1a0ab-9da4-4ddd-b94d-11720f038f67 service neutron] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:12:18.012942 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1418/2846] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 15 18:12:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 15 18:12:18.025662 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-ac2e6dda-a7c2-49de-91f6-808f4870cd04 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '810e3bdc842c403280a31820760e7afd', 'request_id': 'req-ac2e6dda-a7c2-49de-91f6-808f4870cd04'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:12:18.031194 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-ac2e6dda-a7c2-49de-91f6-808f4870cd04 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '810e3bdc842c403280a31820760e7afd', 'request_id': 'req-ac2e6dda-a7c2-49de-91f6-808f4870cd04'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:12:18.039260 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-ac2e6dda-a7c2-49de-91f6-808f4870cd04 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '810e3bdc842c403280a31820760e7afd', 'request_id': 'req-ac2e6dda-a7c2-49de-91f6-808f4870cd04'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:12:18.051427 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-ac2e6dda-a7c2-49de-91f6-808f4870cd04 admin admin] The token cache is being invalidate because project 810e3bdc842c403280a31820760e7afd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81593) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 18:12:18.051735 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-ac2e6dda-a7c2-49de-91f6-808f4870cd04 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:12:18.052384 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-ac2e6dda-a7c2-49de-91f6-808f4870cd04 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:12:18.054197 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1429/2847] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Sep 15 18:12:17 2022] DELETE /identity/v3/projects/810e3bdc842c403280a31820760e7afd => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 15 18:12:18.059180 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e793b3eb-de40-441c-805c-a8f2950bc71e None None] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:12:18.059537 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e793b3eb-de40-441c-805c-a8f2950bc71e None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:12:18.059876 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e793b3eb-de40-441c-805c-a8f2950bc71e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:12:18.082059 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.auth.core [None req-e793b3eb-de40-441c-805c-a8f2950bc71e None None] MFA Rules not processed for user `5cfa58ef86774ab7800bf91930bf6028`. Rule list: `[]` (Enabled: `True`). {{(pid=81592) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 18:12:18.083342 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-e793b3eb-de40-441c-805c-a8f2950bc71e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:12:18.101374 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 18:12:18.146755 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1419/2848] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 15 18:12:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 18:12:18.155984 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cb3977-23e7-4370-9107-9efd1cd11b79 None None] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:12:18.156266 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cb3977-23e7-4370-9107-9efd1cd11b79 None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:12:18.156545 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cb3977-23e7-4370-9107-9efd1cd11b79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:12:18.187437 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.auth.core [None req-09cb3977-23e7-4370-9107-9efd1cd11b79 None None] MFA Rules not processed for user `5cfa58ef86774ab7800bf91930bf6028`. Rule list: `[]` (Enabled: `True`). {{(pid=81593) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 18:12:18.188787 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-09cb3977-23e7-4370-9107-9efd1cd11b79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:12:18.197866 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1430/2849] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 15 18:12:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 18:12:18.202110 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e793b3eb-de40-441c-805c-a8f2950bc71e None None] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:12:18.212558 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e793b3eb-de40-441c-805c-a8f2950bc71e None None] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:12:18.217771 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764abb16-a2bf-4bf4-aa64-013d922b86db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:12:18.218365 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764abb16-a2bf-4bf4-aa64-013d922b86db admin admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:12:18.218973 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764abb16-a2bf-4bf4-aa64-013d922b86db admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:12:18.218973 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764abb16-a2bf-4bf4-aa64-013d922b86db admin admin] PATH_INFO: `/v3/domains` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:12:18.219557 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-764abb16-a2bf-4bf4-aa64-013d922b86db admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81592) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 18:12:18.219856 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-764abb16-a2bf-4bf4-aa64-013d922b86db admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:12:18.221503 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-764abb16-a2bf-4bf4-aa64-013d922b86db admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:12:18.233392 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1420/2850] 10.222.0.25 () {58 vars in 1153 bytes} [Thu Sep 15 18:12:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 18:12:18.237808 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09cb3977-23e7-4370-9107-9efd1cd11b79 None None] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:12:18.247801 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09cb3977-23e7-4370-9107-9efd1cd11b79 None None] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:12:18.253023 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16761a8f-e2fa-4d55-9368-943e7b398848 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:12:18.253753 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16761a8f-e2fa-4d55-9368-943e7b398848 admin admin] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:12:18.254084 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16761a8f-e2fa-4d55-9368-943e7b398848 admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:12:18.254350 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16761a8f-e2fa-4d55-9368-943e7b398848 admin admin] PATH_INFO: `/v3/projects` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:12:18.254977 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16761a8f-e2fa-4d55-9368-943e7b398848 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:12:18.257267 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16761a8f-e2fa-4d55-9368-943e7b398848 admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:12:18.287446 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1431/2851] 10.222.0.25 () {60 vars in 1153 bytes} [Thu Sep 15 18:12:18 2022] POST /identity/v3/projects => generated 375 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 15 18:12:18.288453 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764abb16-a2bf-4bf4-aa64-013d922b86db admin admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:12:18.290337 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-764abb16-a2bf-4bf4-aa64-013d922b86db admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:12:18.291017 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16761a8f-e2fa-4d55-9368-943e7b398848 admin admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:12:18.304516 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764abb16-a2bf-4bf4-aa64-013d922b86db admin admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:12:18.361038 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16761a8f-e2fa-4d55-9368-943e7b398848 admin admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:12:18.365648 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c43f361-f8c7-4bfc-9ba9-4146505c883c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:12:18.366347 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c43f361-f8c7-4bfc-9ba9-4146505c883c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:12:18.366464 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1a41ad-10b0-4a7f-b30c-7de3d42b801f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:12:18.366763 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c43f361-f8c7-4bfc-9ba9-4146505c883c admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:12:18.366953 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1a41ad-10b0-4a7f-b30c-7de3d42b801f admin admin] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:12:18.367165 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c43f361-f8c7-4bfc-9ba9-4146505c883c admin admin] PATH_INFO: `/v3/projects/5d5d58f4a3d6436fb5eb2733c2d165d7` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:12:18.367268 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1a41ad-10b0-4a7f-b30c-7de3d42b801f admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:12:18.367497 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1a41ad-10b0-4a7f-b30c-7de3d42b801f admin admin] PATH_INFO: `/v3/users` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:12:18.368129 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec1a41ad-10b0-4a7f-b30c-7de3d42b801f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:12:18.368672 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c43f361-f8c7-4bfc-9ba9-4146505c883c admin admin] RBAC: Authorizing `identity:delete_project(project_id=5d5d58f4a3d6436fb5eb2733c2d165d7)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:12:18.370111 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec1a41ad-10b0-4a7f-b30c-7de3d42b801f admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:12:18.370708 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c43f361-f8c7-4bfc-9ba9-4146505c883c admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:12:18.396387 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1432/2852] 10.222.0.25 () {60 vars in 1144 bytes} [Thu Sep 15 18:12:18 2022] POST /identity/v3/users => generated 288 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 15 18:12:18.397474 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1a41ad-10b0-4a7f-b30c-7de3d42b801f admin admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:12:18.407480 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1a41ad-10b0-4a7f-b30c-7de3d42b801f admin admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:12:18.418334 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-5c43f361-f8c7-4bfc-9ba9-4146505c883c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5d5d58f4a3d6436fb5eb2733c2d165d7', 'request_id': 'req-5c43f361-f8c7-4bfc-9ba9-4146505c883c'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:12:18.418875 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 18:12:18.424756 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-5c43f361-f8c7-4bfc-9ba9-4146505c883c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5d5d58f4a3d6436fb5eb2733c2d165d7', 'request_id': 'req-5c43f361-f8c7-4bfc-9ba9-4146505c883c'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:12:18.432655 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-5c43f361-f8c7-4bfc-9ba9-4146505c883c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5d5d58f4a3d6436fb5eb2733c2d165d7', 'request_id': 'req-5c43f361-f8c7-4bfc-9ba9-4146505c883c'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:12:18.446245 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-5c43f361-f8c7-4bfc-9ba9-4146505c883c admin admin] The token cache is being invalidate because project 5d5d58f4a3d6436fb5eb2733c2d165d7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81592) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 18:12:18.446536 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-5c43f361-f8c7-4bfc-9ba9-4146505c883c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:12:18.447199 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-5c43f361-f8c7-4bfc-9ba9-4146505c883c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:12:18.448758 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1421/2853] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Sep 15 18:12:18 2022] DELETE /identity/v3/projects/5d5d58f4a3d6436fb5eb2733c2d165d7 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 15 18:12:18.453499 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135f5931-c674-411f-b3c8-ab1c767ecf5d None None] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:12:18.453787 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135f5931-c674-411f-b3c8-ab1c767ecf5d None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:12:18.454063 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135f5931-c674-411f-b3c8-ab1c767ecf5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:12:18.467966 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a11a6e-7e98-44d1-83aa-25c16a61254f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:12:18.468604 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a11a6e-7e98-44d1-83aa-25c16a61254f admin admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:12:18.468879 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a11a6e-7e98-44d1-83aa-25c16a61254f admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:12:18.469148 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a11a6e-7e98-44d1-83aa-25c16a61254f admin admin] PATH_INFO: `/v3/roles` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:12:18.469825 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a11a6e-7e98-44d1-83aa-25c16a61254f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:12:18.471615 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a11a6e-7e98-44d1-83aa-25c16a61254f admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:12:18.474137 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.auth.core [None req-135f5931-c674-411f-b3c8-ab1c767ecf5d None None] MFA Rules not processed for user `5cfa58ef86774ab7800bf91930bf6028`. Rule list: `[]` (Enabled: `True`). {{(pid=81592) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 18:12:18.475361 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-135f5931-c674-411f-b3c8-ab1c767ecf5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:12:18.481483 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1433/2854] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Sep 15 18:12:18 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 18:12:18.483997 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1422/2855] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 15 18:12:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 18:12:18.485489 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a11a6e-7e98-44d1-83aa-25c16a61254f admin admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:12:18.487660 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-63a11a6e-7e98-44d1-83aa-25c16a61254f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:12:18.492117 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfea251-5593-40ff-8a85-7d3133d08c34 None None] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:12:18.492547 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfea251-5593-40ff-8a85-7d3133d08c34 None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:12:18.492848 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfea251-5593-40ff-8a85-7d3133d08c34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:12:18.499720 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a11a6e-7e98-44d1-83aa-25c16a61254f admin admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:12:18.506668 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b030359d-18e5-4195-916a-8ee7ecd5bec7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:12:18.507707 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b030359d-18e5-4195-916a-8ee7ecd5bec7 admin admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:12:18.508075 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b030359d-18e5-4195-916a-8ee7ecd5bec7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:12:18.508365 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b030359d-18e5-4195-916a-8ee7ecd5bec7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:12:18.508996 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b030359d-18e5-4195-916a-8ee7ecd5bec7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:12:18.510633 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b030359d-18e5-4195-916a-8ee7ecd5bec7 admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:12:18.513998 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.auth.core [None req-dbfea251-5593-40ff-8a85-7d3133d08c34 None None] MFA Rules not processed for user `5cfa58ef86774ab7800bf91930bf6028`. Rule list: `[]` (Enabled: `True`). {{(pid=81592) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 18:12:18.515400 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-dbfea251-5593-40ff-8a85-7d3133d08c34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:12:18.522857 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1434/2856] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Sep 15 18:12:18 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 15 18:12:18.524717 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1423/2857] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 15 18:12:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 18:12:18.526795 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b030359d-18e5-4195-916a-8ee7ecd5bec7 admin admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:12:18.528879 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbfea251-5593-40ff-8a85-7d3133d08c34 None None] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:12:18.536743 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b030359d-18e5-4195-916a-8ee7ecd5bec7 admin admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:12:18.537730 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbfea251-5593-40ff-8a85-7d3133d08c34 None None] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:12:18.541574 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046ad854-e2cb-4e20-b8c0-102d5370ffdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:12:18.542214 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046ad854-e2cb-4e20-b8c0-102d5370ffdd admin admin] REQUEST_METHOD: `PUT` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:12:18.542493 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046ad854-e2cb-4e20-b8c0-102d5370ffdd admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:12:18.542597 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03fcd08f-716a-42a5-a2eb-20134f4261bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:12:18.542767 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046ad854-e2cb-4e20-b8c0-102d5370ffdd admin admin] PATH_INFO: `/v3/projects/eeb6f3f4115c4f79b08591f1cc1b8022/users/5e99f0bda0f8452b8ba4dfae28f323cb/roles/343cc8b1bc7243eebabdf08147e8366d` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:12:18.543064 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fcd08f-716a-42a5-a2eb-20134f4261bd admin admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:12:18.543348 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fcd08f-716a-42a5-a2eb-20134f4261bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:12:18.543612 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fcd08f-716a-42a5-a2eb-20134f4261bd admin admin] PATH_INFO: `/v3/domains` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:12:18.544248 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03fcd08f-716a-42a5-a2eb-20134f4261bd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81592) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 18:12:18.544545 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03fcd08f-716a-42a5-a2eb-20134f4261bd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:12:18.546711 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03fcd08f-716a-42a5-a2eb-20134f4261bd admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:12:18.559682 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1424/2858] 10.222.0.25 () {58 vars in 1153 bytes} [Thu Sep 15 18:12:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 18:12:18.560093 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046ad854-e2cb-4e20-b8c0-102d5370ffdd admin admin] RBAC: Authorizing `identity:create_grant(project_id=eeb6f3f4115c4f79b08591f1cc1b8022, user_id=5e99f0bda0f8452b8ba4dfae28f323cb, role_id=343cc8b1bc7243eebabdf08147e8366d)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:12:18.562844 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046ad854-e2cb-4e20-b8c0-102d5370ffdd admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:12:18.563844 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03fcd08f-716a-42a5-a2eb-20134f4261bd admin admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:12:18.575381 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03fcd08f-716a-42a5-a2eb-20134f4261bd admin admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:12:18.576280 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1435/2859] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Sep 15 18:12:18 2022] PUT /identity/v3/projects/eeb6f3f4115c4f79b08591f1cc1b8022/users/5e99f0bda0f8452b8ba4dfae28f323cb/roles/343cc8b1bc7243eebabdf08147e8366d => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 15 18:12:18.585414 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 18:12:18.586617 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f9fb10-bc9a-46de-a616-2a9976737705 None None] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:12:18.586930 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f9fb10-bc9a-46de-a616-2a9976737705 None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:12:18.587730 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f9fb10-bc9a-46de-a616-2a9976737705 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:12:18.616808 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.auth.core [None req-07f9fb10-bc9a-46de-a616-2a9976737705 None None] MFA Rules not processed for user `5e99f0bda0f8452b8ba4dfae28f323cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81593) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 18:12:18.618080 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-07f9fb10-bc9a-46de-a616-2a9976737705 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:12:18.636908 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1fe806-9838-4793-bf53-e1f17df7a131 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:12:18.637539 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1fe806-9838-4793-bf53-e1f17df7a131 admin admin] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:12:18.637822 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1fe806-9838-4793-bf53-e1f17df7a131 admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:12:18.638096 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1fe806-9838-4793-bf53-e1f17df7a131 admin admin] PATH_INFO: `/v3/projects` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:12:18.638728 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1fe806-9838-4793-bf53-e1f17df7a131 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:12:18.640626 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1fe806-9838-4793-bf53-e1f17df7a131 admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:12:18.668817 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1425/2860] 10.222.0.25 () {60 vars in 1153 bytes} [Thu Sep 15 18:12:18 2022] POST /identity/v3/projects => generated 371 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 15 18:12:18.672934 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1fe806-9838-4793-bf53-e1f17df7a131 admin admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:12:18.689457 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1436/2861] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 15 18:12:18 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 18:12:18.690448 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f9fb10-bc9a-46de-a616-2a9976737705 None None] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:12:18.700538 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f9fb10-bc9a-46de-a616-2a9976737705 None None] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:12:18.736169 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1fe806-9838-4793-bf53-e1f17df7a131 admin admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:12:18.742644 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94160758-1435-49c9-969a-fb3d9a72a16a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:12:18.743272 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94160758-1435-49c9-969a-fb3d9a72a16a admin admin] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:12:18.743554 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94160758-1435-49c9-969a-fb3d9a72a16a admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:12:18.743874 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94160758-1435-49c9-969a-fb3d9a72a16a admin admin] PATH_INFO: `/v3/users` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:12:18.744552 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94160758-1435-49c9-969a-fb3d9a72a16a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:12:18.746540 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94160758-1435-49c9-969a-fb3d9a72a16a admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:12:18.756585 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6420e6-38b9-4236-88f1-813cdd4513e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:12:18.757218 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6420e6-38b9-4236-88f1-813cdd4513e1 admin admin] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:12:18.757535 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6420e6-38b9-4236-88f1-813cdd4513e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:12:18.757807 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6420e6-38b9-4236-88f1-813cdd4513e1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:12:18.758429 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a6420e6-38b9-4236-88f1-813cdd4513e1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:12:18.760567 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a6420e6-38b9-4236-88f1-813cdd4513e1 admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:12:18.769673 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1426/2862] 10.222.0.25 () {60 vars in 1144 bytes} [Thu Sep 15 18:12:18 2022] POST /identity/v3/users => generated 286 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 15 18:12:18.772129 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 18:12:18.775566 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94160758-1435-49c9-969a-fb3d9a72a16a admin admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:12:18.786724 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94160758-1435-49c9-969a-fb3d9a72a16a admin admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:12:18.793542 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1437/2863] 10.222.0.25 () {60 vars in 1153 bytes} [Thu Sep 15 18:12:18 2022] POST /identity/v3/projects => generated 377 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 15 18:12:18.793709 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0477e015-330f-4f2f-81ec-73bd12ae13b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:12:18.793709 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0477e015-330f-4f2f-81ec-73bd12ae13b8 admin admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:12:18.793709 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0477e015-330f-4f2f-81ec-73bd12ae13b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:12:18.793709 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0477e015-330f-4f2f-81ec-73bd12ae13b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:12:18.794080 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0477e015-330f-4f2f-81ec-73bd12ae13b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:12:18.795004 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6420e6-38b9-4236-88f1-813cdd4513e1 admin admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:12:18.795125 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0477e015-330f-4f2f-81ec-73bd12ae13b8 admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:12:18.809034 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1427/2864] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Sep 15 18:12:18 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 15 18:12:18.810050 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0477e015-330f-4f2f-81ec-73bd12ae13b8 admin admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:12:18.819539 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0477e015-330f-4f2f-81ec-73bd12ae13b8 admin admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:12:18.856873 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6420e6-38b9-4236-88f1-813cdd4513e1 admin admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:12:18.862392 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e9537d-c4dd-424c-aac5-5a76f9bb9a39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:12:18.863003 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e9537d-c4dd-424c-aac5-5a76f9bb9a39 admin admin] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:12:18.863289 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e9537d-c4dd-424c-aac5-5a76f9bb9a39 admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:12:18.863566 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e9537d-c4dd-424c-aac5-5a76f9bb9a39 admin admin] PATH_INFO: `/v3/users` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:12:18.864196 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e9537d-c4dd-424c-aac5-5a76f9bb9a39 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:12:18.866221 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e9537d-c4dd-424c-aac5-5a76f9bb9a39 admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:12:18.879952 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10e389c-b0ef-485f-990c-9b3105ce8c17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:12:18.880898 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10e389c-b0ef-485f-990c-9b3105ce8c17 admin admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:12:18.881288 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10e389c-b0ef-485f-990c-9b3105ce8c17 admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:12:18.881602 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10e389c-b0ef-485f-990c-9b3105ce8c17 admin admin] PATH_INFO: `/v3/roles` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:12:18.882290 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f10e389c-b0ef-485f-990c-9b3105ce8c17 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:12:18.883881 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f10e389c-b0ef-485f-990c-9b3105ce8c17 admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:12:18.890437 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1438/2865] 10.222.0.25 () {60 vars in 1144 bytes} [Thu Sep 15 18:12:18 2022] POST /identity/v3/users => generated 289 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 15 18:12:18.891681 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e9537d-c4dd-424c-aac5-5a76f9bb9a39 admin admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:12:18.897036 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1428/2866] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Sep 15 18:12:18 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 18:12:18.898597 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10e389c-b0ef-485f-990c-9b3105ce8c17 admin admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:12:18.901183 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e9537d-c4dd-424c-aac5-5a76f9bb9a39 admin admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:12:18.905821 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a046a85d-b84f-4aed-8698-1a5cec5dea6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:12:18.906409 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a046a85d-b84f-4aed-8698-1a5cec5dea6d admin admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:12:18.906691 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a046a85d-b84f-4aed-8698-1a5cec5dea6d admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:12:18.906963 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a046a85d-b84f-4aed-8698-1a5cec5dea6d admin admin] PATH_INFO: `/v3/roles` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:12:18.907601 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a046a85d-b84f-4aed-8698-1a5cec5dea6d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:12:18.909056 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10e389c-b0ef-485f-990c-9b3105ce8c17 admin admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:12:18.909760 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a046a85d-b84f-4aed-8698-1a5cec5dea6d admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:12:18.918143 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0efa34e2-c32f-40ad-bd95-9416930b8e26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:12:18.918878 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efa34e2-c32f-40ad-bd95-9416930b8e26 admin admin] REQUEST_METHOD: `PUT` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:12:18.919110 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efa34e2-c32f-40ad-bd95-9416930b8e26 admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:12:18.919389 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efa34e2-c32f-40ad-bd95-9416930b8e26 admin admin] PATH_INFO: `/v3/projects/dcd6bd5397da4de794025d727589a33d/users/c17b6d56eaed4603a874b382380d2fd4/roles/343cc8b1bc7243eebabdf08147e8366d` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:12:18.919804 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1439/2867] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Sep 15 18:12:18 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 15 18:12:18.923738 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a046a85d-b84f-4aed-8698-1a5cec5dea6d admin admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:12:18.934157 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 18:12:18.938384 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a046a85d-b84f-4aed-8698-1a5cec5dea6d admin admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:12:18.938857 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0efa34e2-c32f-40ad-bd95-9416930b8e26 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dcd6bd5397da4de794025d727589a33d, user_id=c17b6d56eaed4603a874b382380d2fd4, role_id=343cc8b1bc7243eebabdf08147e8366d)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:12:18.942264 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0efa34e2-c32f-40ad-bd95-9416930b8e26 admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:12:18.943152 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc443290-4d4c-43b2-bd23-287005c612b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:12:18.943816 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc443290-4d4c-43b2-bd23-287005c612b1 admin admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:12:18.944099 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc443290-4d4c-43b2-bd23-287005c612b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:12:18.944372 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc443290-4d4c-43b2-bd23-287005c612b1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:12:18.945186 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc443290-4d4c-43b2-bd23-287005c612b1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:12:18.947207 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc443290-4d4c-43b2-bd23-287005c612b1 admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:12:18.955036 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1429/2868] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Sep 15 18:12:18 2022] PUT /identity/v3/projects/dcd6bd5397da4de794025d727589a33d/users/c17b6d56eaed4603a874b382380d2fd4/roles/343cc8b1bc7243eebabdf08147e8366d => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 15 18:12:18.958374 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1440/2869] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Sep 15 18:12:18 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 15 18:12:18.963286 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807f67da-22ac-4517-8b38-16cac3c1ad4c None None] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:12:18.963442 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc443290-4d4c-43b2-bd23-287005c612b1 admin admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:12:18.963567 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807f67da-22ac-4517-8b38-16cac3c1ad4c None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:12:18.963837 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807f67da-22ac-4517-8b38-16cac3c1ad4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:12:18.974541 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc443290-4d4c-43b2-bd23-287005c612b1 admin admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:12:18.982493 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.auth.core [None req-807f67da-22ac-4517-8b38-16cac3c1ad4c None None] MFA Rules not processed for user `5cfa58ef86774ab7800bf91930bf6028`. Rule list: `[]` (Enabled: `True`). {{(pid=81592) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 18:12:18.984032 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-807f67da-22ac-4517-8b38-16cac3c1ad4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:12:19.031940 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b699bc-2826-411c-a6f7-24db23de3a5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:12:19.032603 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b699bc-2826-411c-a6f7-24db23de3a5f admin admin] REQUEST_METHOD: `PUT` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:12:19.032882 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b699bc-2826-411c-a6f7-24db23de3a5f admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:12:19.033158 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b699bc-2826-411c-a6f7-24db23de3a5f admin admin] PATH_INFO: `/v3/projects/9f42fed629ee4c5fa99ba60cdbafb46c/users/bbeea62f955c4324a146b69fcda0bf82/roles/343cc8b1bc7243eebabdf08147e8366d` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:12:19.044364 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1430/2870] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 15 18:12:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 18:12:19.048006 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b699bc-2826-411c-a6f7-24db23de3a5f admin admin] RBAC: Authorizing `identity:create_grant(project_id=9f42fed629ee4c5fa99ba60cdbafb46c, user_id=bbeea62f955c4324a146b69fcda0bf82, role_id=343cc8b1bc7243eebabdf08147e8366d)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:12:19.050597 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b699bc-2826-411c-a6f7-24db23de3a5f admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:12:19.053967 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807f67da-22ac-4517-8b38-16cac3c1ad4c None None] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:12:19.055408 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-807f67da-22ac-4517-8b38-16cac3c1ad4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:12:19.063445 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1441/2871] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Sep 15 18:12:18 2022] PUT /identity/v3/projects/9f42fed629ee4c5fa99ba60cdbafb46c/users/bbeea62f955c4324a146b69fcda0bf82/roles/343cc8b1bc7243eebabdf08147e8366d => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 18:12:19.073483 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c387a2-2cda-44e9-843f-e13fb281877c None None] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:12:19.073762 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c387a2-2cda-44e9-843f-e13fb281877c None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:12:19.074030 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c387a2-2cda-44e9-843f-e13fb281877c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:12:19.102149 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.auth.core [None req-a6c387a2-2cda-44e9-843f-e13fb281877c None None] MFA Rules not processed for user `bbeea62f955c4324a146b69fcda0bf82`. Rule list: `[]` (Enabled: `True`). {{(pid=81593) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 18:12:19.103378 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-a6c387a2-2cda-44e9-843f-e13fb281877c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:12:19.114002 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807f67da-22ac-4517-8b38-16cac3c1ad4c None None] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:12:19.132931 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 18:12:19.164651 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7583c8b3-bae1-4f96-8dbd-6681c6f18323 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a32274b4781b40fea9f28da8a9bde5ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1213c0d1b584404ba3998e136f166e89', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:12:19.165261 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7583c8b3-bae1-4f96-8dbd-6681c6f18323 service neutron] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:12:19.165570 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7583c8b3-bae1-4f96-8dbd-6681c6f18323 service neutron] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:12:19.165875 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7583c8b3-bae1-4f96-8dbd-6681c6f18323 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:12:19.170891 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1442/2872] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 15 18:12:19 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 18:12:19.176202 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c387a2-2cda-44e9-843f-e13fb281877c None None] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:12:19.227807 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 18:12:19.230738 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7583c8b3-bae1-4f96-8dbd-6681c6f18323 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:12:19.232923 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7583c8b3-bae1-4f96-8dbd-6681c6f18323 service neutron] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:12:19.242149 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c387a2-2cda-44e9-843f-e13fb281877c None None] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:12:19.247309 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d91bc0-ede8-4992-89e5-c04608c2fbfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:12:19.247484 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1431/2873] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 15 18:12:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 15 18:12:19.248067 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d91bc0-ede8-4992-89e5-c04608c2fbfc admin admin] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:12:19.248403 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d91bc0-ede8-4992-89e5-c04608c2fbfc admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:12:19.248684 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d91bc0-ede8-4992-89e5-c04608c2fbfc admin admin] PATH_INFO: `/v3/projects` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:12:19.251274 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d91bc0-ede8-4992-89e5-c04608c2fbfc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:12:19.251418 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d91bc0-ede8-4992-89e5-c04608c2fbfc admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:12:19.280694 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1443/2874] 10.222.0.25 () {60 vars in 1153 bytes} [Thu Sep 15 18:12:19 2022] POST /identity/v3/projects => generated 375 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 15 18:12:19.285105 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7583c8b3-bae1-4f96-8dbd-6681c6f18323 service neutron] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:12:19.294969 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7583c8b3-bae1-4f96-8dbd-6681c6f18323 service neutron] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:12:19.355124 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c412f85-b111-4c32-af17-4470c09adfbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:12:19.355740 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c412f85-b111-4c32-af17-4470c09adfbb admin admin] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:12:19.356018 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c412f85-b111-4c32-af17-4470c09adfbb admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:12:19.356290 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c412f85-b111-4c32-af17-4470c09adfbb admin admin] PATH_INFO: `/v3/users` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:12:19.356949 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c412f85-b111-4c32-af17-4470c09adfbb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:12:19.358986 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c412f85-b111-4c32-af17-4470c09adfbb admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:12:19.380838 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1432/2875] 10.222.0.25 () {60 vars in 1144 bytes} [Thu Sep 15 18:12:19 2022] POST /identity/v3/users => generated 294 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 18:12:19.385266 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d91bc0-ede8-4992-89e5-c04608c2fbfc admin admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:12:19.396446 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d91bc0-ede8-4992-89e5-c04608c2fbfc admin admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:12:19.401288 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34593e92-f9b7-473b-94c3-1852519e691f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:12:19.402007 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34593e92-f9b7-473b-94c3-1852519e691f admin admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:12:19.402451 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34593e92-f9b7-473b-94c3-1852519e691f admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:12:19.402804 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34593e92-f9b7-473b-94c3-1852519e691f admin admin] PATH_INFO: `/v3/roles` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:12:19.403530 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34593e92-f9b7-473b-94c3-1852519e691f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:12:19.405216 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34593e92-f9b7-473b-94c3-1852519e691f admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:12:19.418184 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1444/2876] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Sep 15 18:12:19 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 18:12:19.421920 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c412f85-b111-4c32-af17-4470c09adfbb admin admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:12:19.432267 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c412f85-b111-4c32-af17-4470c09adfbb admin admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:12:19.437344 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4f548b-5b4a-47aa-9a53-0f307193b4cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:12:19.438601 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4f548b-5b4a-47aa-9a53-0f307193b4cf admin admin] REQUEST_METHOD: `PUT` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:12:19.438882 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4f548b-5b4a-47aa-9a53-0f307193b4cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:12:19.439156 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4f548b-5b4a-47aa-9a53-0f307193b4cf admin admin] PATH_INFO: `/v3/projects/88c25e32c22147d1b31d43cbda64a8e4/users/5bc9cb70e48849cbaa6875e78d03201a/roles/a9e42be86923434f8af52d3fc07fb4f7` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:12:19.455027 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c4f548b-5b4a-47aa-9a53-0f307193b4cf admin admin] RBAC: Authorizing `identity:create_grant(project_id=88c25e32c22147d1b31d43cbda64a8e4, user_id=5bc9cb70e48849cbaa6875e78d03201a, role_id=a9e42be86923434f8af52d3fc07fb4f7)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:12:19.458622 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c4f548b-5b4a-47aa-9a53-0f307193b4cf admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:12:19.471945 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1433/2877] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Sep 15 18:12:19 2022] PUT /identity/v3/projects/88c25e32c22147d1b31d43cbda64a8e4/users/5bc9cb70e48849cbaa6875e78d03201a/roles/a9e42be86923434f8af52d3fc07fb4f7 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 15 18:12:19.476018 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34593e92-f9b7-473b-94c3-1852519e691f admin admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:12:19.485915 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34593e92-f9b7-473b-94c3-1852519e691f admin admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:12:19.551873 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46d5c94-7d6c-4972-8435-2a945b8d1882 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:12:19.552493 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46d5c94-7d6c-4972-8435-2a945b8d1882 admin admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:12:19.552774 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46d5c94-7d6c-4972-8435-2a945b8d1882 admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:12:19.553047 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46d5c94-7d6c-4972-8435-2a945b8d1882 admin admin] PATH_INFO: `/v3/roles` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:12:19.553786 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a46d5c94-7d6c-4972-8435-2a945b8d1882 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:12:19.555384 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a46d5c94-7d6c-4972-8435-2a945b8d1882 admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:12:19.566846 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1445/2878] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Sep 15 18:12:19 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 18:12:19.571297 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4f548b-5b4a-47aa-9a53-0f307193b4cf admin admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:12:19.584398 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4f548b-5b4a-47aa-9a53-0f307193b4cf admin admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:12:19.592864 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33b3b0f-c5f9-48c9-9a31-ee7c8966247b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:12:19.593608 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33b3b0f-c5f9-48c9-9a31-ee7c8966247b admin admin] REQUEST_METHOD: `PUT` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:12:19.593988 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33b3b0f-c5f9-48c9-9a31-ee7c8966247b admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:12:19.594363 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33b3b0f-c5f9-48c9-9a31-ee7c8966247b admin admin] PATH_INFO: `/v3/projects/88c25e32c22147d1b31d43cbda64a8e4/users/5bc9cb70e48849cbaa6875e78d03201a/roles/a9e42be86923434f8af52d3fc07fb4f7` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:12:19.596735 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b33b3b0f-c5f9-48c9-9a31-ee7c8966247b admin admin] RBAC: Authorizing `identity:create_grant(project_id=88c25e32c22147d1b31d43cbda64a8e4, user_id=5bc9cb70e48849cbaa6875e78d03201a, role_id=a9e42be86923434f8af52d3fc07fb4f7)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:12:19.599851 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b33b3b0f-c5f9-48c9-9a31-ee7c8966247b admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:12:19.610756 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1434/2879] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Sep 15 18:12:19 2022] PUT /identity/v3/projects/88c25e32c22147d1b31d43cbda64a8e4/users/5bc9cb70e48849cbaa6875e78d03201a/roles/a9e42be86923434f8af52d3fc07fb4f7 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 18:12:19.622234 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b66918-ece0-4844-9399-5108cdedb1a6 None None] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:12:19.622522 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b66918-ece0-4844-9399-5108cdedb1a6 None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:12:19.622798 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b66918-ece0-4844-9399-5108cdedb1a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:12:19.659115 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.auth.core [None req-72b66918-ece0-4844-9399-5108cdedb1a6 None None] MFA Rules not processed for user `5bc9cb70e48849cbaa6875e78d03201a`. Rule list: `[]` (Enabled: `True`). {{(pid=81593) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 18:12:19.660574 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-72b66918-ece0-4844-9399-5108cdedb1a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:12:19.694532 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 18:12:19.734432 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1446/2880] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 15 18:12:19 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 18:12:19.747483 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33b3b0f-c5f9-48c9-9a31-ee7c8966247b admin admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:12:19.749626 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-b33b3b0f-c5f9-48c9-9a31-ee7c8966247b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:12:19.810503 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33b3b0f-c5f9-48c9-9a31-ee7c8966247b admin admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:12:19.814215 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941ed935-1978-417d-b8ac-9af780d6a053 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b232e7a841145ba93c6d8462ccb751a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1213c0d1b584404ba3998e136f166e89', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:12:19.815369 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941ed935-1978-417d-b8ac-9af780d6a053 service cinder] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:12:19.815649 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941ed935-1978-417d-b8ac-9af780d6a053 service cinder] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:12:19.815923 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941ed935-1978-417d-b8ac-9af780d6a053 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:12:19.891859 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-941ed935-1978-417d-b8ac-9af780d6a053 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:12:19.894244 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-941ed935-1978-417d-b8ac-9af780d6a053 service cinder] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:12:19.911233 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1435/2881] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 15 18:12:19 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 18:12:19.933383 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f8454c-93b7-4422-a147-f9748fe17ec7 None None] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:12:19.933860 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f8454c-93b7-4422-a147-f9748fe17ec7 None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:12:19.934136 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f8454c-93b7-4422-a147-f9748fe17ec7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:12:19.970891 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.auth.core [None req-10f8454c-93b7-4422-a147-f9748fe17ec7 None None] MFA Rules not processed for user `c17b6d56eaed4603a874b382380d2fd4`. Rule list: `[]` (Enabled: `True`). {{(pid=81593) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 18:12:19.972145 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-10f8454c-93b7-4422-a147-f9748fe17ec7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:12:20.052244 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1447/2882] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 15 18:12:19 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 18:12:20.063606 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941ed935-1978-417d-b8ac-9af780d6a053 service cinder] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:12:20.066449 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-941ed935-1978-417d-b8ac-9af780d6a053 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:12:20.074963 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 18:12:20.084930 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941ed935-1978-417d-b8ac-9af780d6a053 service cinder] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:12:20.090452 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e658d060-0add-4ea6-ae9d-7f62cc6c2266 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b232e7a841145ba93c6d8462ccb751a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1213c0d1b584404ba3998e136f166e89', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:12:20.091072 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e658d060-0add-4ea6-ae9d-7f62cc6c2266 service cinder] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:12:20.091351 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e658d060-0add-4ea6-ae9d-7f62cc6c2266 service cinder] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:12:20.091623 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e658d060-0add-4ea6-ae9d-7f62cc6c2266 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:12:20.102128 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e658d060-0add-4ea6-ae9d-7f62cc6c2266 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:12:20.103591 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e658d060-0add-4ea6-ae9d-7f62cc6c2266 service cinder] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:12:20.114925 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1436/2883] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 15 18:12:20 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 18:12:21.482743 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f8454c-93b7-4422-a147-f9748fe17ec7 None None] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:12:21.492411 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f8454c-93b7-4422-a147-f9748fe17ec7 None None] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:12:21.494133 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b8eb20-98f3-4996-b456-7959a15480ae None None] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:12:21.494592 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b8eb20-98f3-4996-b456-7959a15480ae None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:12:21.494715 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b8eb20-98f3-4996-b456-7959a15480ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:12:21.495975 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f6686f-fd2d-4558-9fc4-8ffe8ce390ef service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b232e7a841145ba93c6d8462ccb751a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1213c0d1b584404ba3998e136f166e89', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:12:21.496569 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f6686f-fd2d-4558-9fc4-8ffe8ce390ef service cinder] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:12:21.496847 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f6686f-fd2d-4558-9fc4-8ffe8ce390ef service cinder] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:12:21.497116 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f6686f-fd2d-4558-9fc4-8ffe8ce390ef service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:12:21.514644 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.auth.core [None req-43b8eb20-98f3-4996-b456-7959a15480ae None None] MFA Rules not processed for user `c17b6d56eaed4603a874b382380d2fd4`. Rule list: `[]` (Enabled: `True`). {{(pid=81592) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 18:12:21.515837 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-43b8eb20-98f3-4996-b456-7959a15480ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:12:21.525038 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1437/2884] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 15 18:12:21 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 18:12:21.555780 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f6686f-fd2d-4558-9fc4-8ffe8ce390ef service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:12:21.557702 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f6686f-fd2d-4558-9fc4-8ffe8ce390ef service cinder] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:12:21.566846 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b8eb20-98f3-4996-b456-7959a15480ae None None] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:12:21.567306 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1448/2885] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 15 18:12:21 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 18:12:21.568449 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-43b8eb20-98f3-4996-b456-7959a15480ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:12:21.627432 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b8eb20-98f3-4996-b456-7959a15480ae None None] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:12:21.631130 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8fddd4-d0c3-4ba9-8d2d-1bc1c1b7dc6c service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c194f79928aa4a4d94619c417b4e39e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1213c0d1b584404ba3998e136f166e89', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:12:21.631741 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8fddd4-d0c3-4ba9-8d2d-1bc1c1b7dc6c service glance] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:12:21.632020 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8fddd4-d0c3-4ba9-8d2d-1bc1c1b7dc6c service glance] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:12:21.632294 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8fddd4-d0c3-4ba9-8d2d-1bc1c1b7dc6c service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:12:21.634043 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-4c8fddd4-d0c3-4ba9-8d2d-1bc1c1b7dc6c service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:12:21.712626 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8fddd4-d0c3-4ba9-8d2d-1bc1c1b7dc6c service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:12:21.714143 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8fddd4-d0c3-4ba9-8d2d-1bc1c1b7dc6c service glance] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:12:21.725851 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1438/2886] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 15 18:12:21 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 15 18:12:22.137928 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f6686f-fd2d-4558-9fc4-8ffe8ce390ef service cinder] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:12:22.146512 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f6686f-fd2d-4558-9fc4-8ffe8ce390ef service cinder] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:12:22.150239 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912e8708-5590-47c8-9892-1676b14ec022 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b232e7a841145ba93c6d8462ccb751a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1213c0d1b584404ba3998e136f166e89', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:12:22.150838 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912e8708-5590-47c8-9892-1676b14ec022 service cinder] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:12:22.151119 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912e8708-5590-47c8-9892-1676b14ec022 service cinder] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:12:22.151389 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912e8708-5590-47c8-9892-1676b14ec022 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:12:22.160412 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-912e8708-5590-47c8-9892-1676b14ec022 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:12:22.161834 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-912e8708-5590-47c8-9892-1676b14ec022 service cinder] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:12:22.171166 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1449/2887] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 15 18:12:22 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 18:12:22.288594 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8fddd4-d0c3-4ba9-8d2d-1bc1c1b7dc6c service glance] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:12:22.290601 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912e8708-5590-47c8-9892-1676b14ec022 service cinder] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:12:22.292075 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-912e8708-5590-47c8-9892-1676b14ec022 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:12:22.340973 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 18:12:22.345886 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8fddd4-d0c3-4ba9-8d2d-1bc1c1b7dc6c service glance] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:12:22.349622 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d465b5-4210-49f0-af0b-8d8f7841da3b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a32274b4781b40fea9f28da8a9bde5ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1213c0d1b584404ba3998e136f166e89', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:12:22.350299 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d465b5-4210-49f0-af0b-8d8f7841da3b service neutron] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:12:22.350699 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d465b5-4210-49f0-af0b-8d8f7841da3b service neutron] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:12:22.351043 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d465b5-4210-49f0-af0b-8d8f7841da3b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:12:22.352823 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-25d465b5-4210-49f0-af0b-8d8f7841da3b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:12:22.366190 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912e8708-5590-47c8-9892-1676b14ec022 service cinder] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:12:22.367656 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d465b5-4210-49f0-af0b-8d8f7841da3b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:12:22.369077 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d465b5-4210-49f0-af0b-8d8f7841da3b service neutron] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:12:22.371831 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4170e8-fcf2-4f8b-9d7e-b9b92d6a293a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10af119bd39841ed8163993676230fca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1213c0d1b584404ba3998e136f166e89', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:12:22.372552 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4170e8-fcf2-4f8b-9d7e-b9b92d6a293a service placement] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:12:22.372845 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4170e8-fcf2-4f8b-9d7e-b9b92d6a293a service placement] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:12:22.373119 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4170e8-fcf2-4f8b-9d7e-b9b92d6a293a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:12:22.374949 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-9a4170e8-fcf2-4f8b-9d7e-b9b92d6a293a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:12:22.380731 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1439/2888] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 15 18:12:22 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 18:12:22.388821 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4170e8-fcf2-4f8b-9d7e-b9b92d6a293a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:12:22.390546 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4170e8-fcf2-4f8b-9d7e-b9b92d6a293a service placement] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:12:22.402055 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1450/2889] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 15 18:12:22 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 15 18:12:26.110272 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d465b5-4210-49f0-af0b-8d8f7841da3b service neutron] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:12:26.140021 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 18:12:26.172331 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d465b5-4210-49f0-af0b-8d8f7841da3b service neutron] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:12:26.177445 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87482ed7-9ac2-4174-837c-452fb2910c5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:12:26.178069 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87482ed7-9ac2-4174-837c-452fb2910c5b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:12:26.178350 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87482ed7-9ac2-4174-837c-452fb2910c5b admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:12:26.178620 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87482ed7-9ac2-4174-837c-452fb2910c5b admin admin] PATH_INFO: `/v3/users/5e99f0bda0f8452b8ba4dfae28f323cb` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:12:26.179729 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87482ed7-9ac2-4174-837c-452fb2910c5b admin admin] RBAC: Authorizing `identity:delete_user(user_id=5e99f0bda0f8452b8ba4dfae28f323cb)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:12:26.181674 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87482ed7-9ac2-4174-837c-452fb2910c5b admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:12:26.227582 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-87482ed7-9ac2-4174-837c-452fb2910c5b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5e99f0bda0f8452b8ba4dfae28f323cb'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:12:26.234926 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-87482ed7-9ac2-4174-837c-452fb2910c5b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5e99f0bda0f8452b8ba4dfae28f323cb'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:12:26.235572 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-87482ed7-9ac2-4174-837c-452fb2910c5b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5e99f0bda0f8452b8ba4dfae28f323cb'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:12:26.236177 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-87482ed7-9ac2-4174-837c-452fb2910c5b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5e99f0bda0f8452b8ba4dfae28f323cb'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:12:26.243846 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-87482ed7-9ac2-4174-837c-452fb2910c5b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5e99f0bda0f8452b8ba4dfae28f323cb'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:12:26.262058 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1440/2890] 10.222.0.25 () {58 vars in 1224 bytes} [Thu Sep 15 18:12:26 2022] DELETE /identity/v3/users/5e99f0bda0f8452b8ba4dfae28f323cb => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 18:12:26.267232 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ccb0aab-5af8-496d-9caf-8390c868a8e5 None None] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:12:26.267708 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ccb0aab-5af8-496d-9caf-8390c868a8e5 None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:12:26.267863 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ccb0aab-5af8-496d-9caf-8390c868a8e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:12:26.287506 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.auth.core [None req-8ccb0aab-5af8-496d-9caf-8390c868a8e5 None None] MFA Rules not processed for user `5cfa58ef86774ab7800bf91930bf6028`. Rule list: `[]` (Enabled: `True`). {{(pid=81593) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 18:12:26.288686 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-8ccb0aab-5af8-496d-9caf-8390c868a8e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:12:26.345307 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1451/2891] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 15 18:12:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 18:12:26.355447 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87482ed7-9ac2-4174-837c-452fb2910c5b admin admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:12:26.356901 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-87482ed7-9ac2-4174-837c-452fb2910c5b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:12:26.412680 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87482ed7-9ac2-4174-837c-452fb2910c5b admin admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:12:26.416298 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51d4578-e74c-4e78-ba06-7e3fcd7a56de service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a32274b4781b40fea9f28da8a9bde5ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1213c0d1b584404ba3998e136f166e89', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:12:26.416897 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51d4578-e74c-4e78-ba06-7e3fcd7a56de service neutron] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:12:26.417181 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51d4578-e74c-4e78-ba06-7e3fcd7a56de service neutron] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:12:26.417500 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51d4578-e74c-4e78-ba06-7e3fcd7a56de service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:12:26.427028 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f51d4578-e74c-4e78-ba06-7e3fcd7a56de service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:12:26.428445 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f51d4578-e74c-4e78-ba06-7e3fcd7a56de service neutron] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:12:26.437686 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1441/2892] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 15 18:12:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 15 18:12:26.743822 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ccb0aab-5af8-496d-9caf-8390c868a8e5 None None] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:12:26.745563 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-8ccb0aab-5af8-496d-9caf-8390c868a8e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:12:26.758401 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ccb0aab-5af8-496d-9caf-8390c868a8e5 None None] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:12:26.763291 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ab8d18-a905-4d98-b385-14e42ab54557 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:12:26.763927 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ab8d18-a905-4d98-b385-14e42ab54557 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:12:26.764201 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ab8d18-a905-4d98-b385-14e42ab54557 admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:12:26.764470 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ab8d18-a905-4d98-b385-14e42ab54557 admin admin] PATH_INFO: `/v3/projects/eeb6f3f4115c4f79b08591f1cc1b8022` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:12:26.765611 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ab8d18-a905-4d98-b385-14e42ab54557 admin admin] RBAC: Authorizing `identity:delete_project(project_id=eeb6f3f4115c4f79b08591f1cc1b8022)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:12:26.767522 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ab8d18-a905-4d98-b385-14e42ab54557 admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:12:26.816010 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-52ab8d18-a905-4d98-b385-14e42ab54557 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eeb6f3f4115c4f79b08591f1cc1b8022', 'request_id': 'req-52ab8d18-a905-4d98-b385-14e42ab54557'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:12:26.821544 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-52ab8d18-a905-4d98-b385-14e42ab54557 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eeb6f3f4115c4f79b08591f1cc1b8022', 'request_id': 'req-52ab8d18-a905-4d98-b385-14e42ab54557'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:12:26.829643 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-52ab8d18-a905-4d98-b385-14e42ab54557 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eeb6f3f4115c4f79b08591f1cc1b8022', 'request_id': 'req-52ab8d18-a905-4d98-b385-14e42ab54557'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:12:26.842392 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-52ab8d18-a905-4d98-b385-14e42ab54557 admin admin] The token cache is being invalidate because project eeb6f3f4115c4f79b08591f1cc1b8022 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81593) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 18:12:26.842692 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-52ab8d18-a905-4d98-b385-14e42ab54557 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:12:26.843373 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-52ab8d18-a905-4d98-b385-14e42ab54557 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:12:26.844860 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1452/2893] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Sep 15 18:12:26 2022] DELETE /identity/v3/projects/eeb6f3f4115c4f79b08591f1cc1b8022 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 18:12:26.849517 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51d4578-e74c-4e78-ba06-7e3fcd7a56de service neutron] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:12:26.859227 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51d4578-e74c-4e78-ba06-7e3fcd7a56de service neutron] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:12:26.907132 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 18:12:26.923327 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78f1620-6c7c-4758-979c-1459c04e25db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:12:26.924676 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78f1620-6c7c-4758-979c-1459c04e25db admin admin] REQUEST_METHOD: `DELETE` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:12:26.924676 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78f1620-6c7c-4758-979c-1459c04e25db admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:12:26.924931 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78f1620-6c7c-4758-979c-1459c04e25db admin admin] PATH_INFO: `/v3/users/bbeea62f955c4324a146b69fcda0bf82` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:12:26.926124 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c78f1620-6c7c-4758-979c-1459c04e25db admin admin] RBAC: Authorizing `identity:delete_user(user_id=bbeea62f955c4324a146b69fcda0bf82)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:12:26.928160 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c78f1620-6c7c-4758-979c-1459c04e25db admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:12:26.983687 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-c78f1620-6c7c-4758-979c-1459c04e25db admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bbeea62f955c4324a146b69fcda0bf82'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:12:26.992106 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-c78f1620-6c7c-4758-979c-1459c04e25db admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bbeea62f955c4324a146b69fcda0bf82'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:12:26.992968 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-c78f1620-6c7c-4758-979c-1459c04e25db admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bbeea62f955c4324a146b69fcda0bf82'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:12:26.993609 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-c78f1620-6c7c-4758-979c-1459c04e25db admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bbeea62f955c4324a146b69fcda0bf82'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:12:27.001975 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-c78f1620-6c7c-4758-979c-1459c04e25db admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bbeea62f955c4324a146b69fcda0bf82'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:12:27.024762 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1442/2894] 10.222.0.25 () {58 vars in 1224 bytes} [Thu Sep 15 18:12:26 2022] DELETE /identity/v3/users/bbeea62f955c4324a146b69fcda0bf82 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 18:12:27.332452 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ab8d18-a905-4d98-b385-14e42ab54557 admin admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:12:27.333932 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-52ab8d18-a905-4d98-b385-14e42ab54557 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:12:27.347539 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ab8d18-a905-4d98-b385-14e42ab54557 admin admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:12:27.397419 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 18:12:27.405660 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc615df-0944-42e7-9483-995557b8b3cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:12:27.406238 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc615df-0944-42e7-9483-995557b8b3cf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:12:27.406689 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc615df-0944-42e7-9483-995557b8b3cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:12:27.407114 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc615df-0944-42e7-9483-995557b8b3cf admin admin] PATH_INFO: `/v3/projects/9f42fed629ee4c5fa99ba60cdbafb46c` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:12:27.408474 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc615df-0944-42e7-9483-995557b8b3cf admin admin] RBAC: Authorizing `identity:delete_project(project_id=9f42fed629ee4c5fa99ba60cdbafb46c)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:12:27.410971 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc615df-0944-42e7-9483-995557b8b3cf admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:12:27.456089 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-bcc615df-0944-42e7-9483-995557b8b3cf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9f42fed629ee4c5fa99ba60cdbafb46c', 'request_id': 'req-bcc615df-0944-42e7-9483-995557b8b3cf'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:12:27.461592 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-bcc615df-0944-42e7-9483-995557b8b3cf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9f42fed629ee4c5fa99ba60cdbafb46c', 'request_id': 'req-bcc615df-0944-42e7-9483-995557b8b3cf'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:12:27.469065 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-bcc615df-0944-42e7-9483-995557b8b3cf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9f42fed629ee4c5fa99ba60cdbafb46c', 'request_id': 'req-bcc615df-0944-42e7-9483-995557b8b3cf'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:12:27.480919 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-bcc615df-0944-42e7-9483-995557b8b3cf admin admin] The token cache is being invalidate because project 9f42fed629ee4c5fa99ba60cdbafb46c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81593) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 18:12:27.481210 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-bcc615df-0944-42e7-9483-995557b8b3cf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:12:27.481895 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-bcc615df-0944-42e7-9483-995557b8b3cf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:12:27.483339 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1453/2895] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Sep 15 18:12:27 2022] DELETE /identity/v3/projects/9f42fed629ee4c5fa99ba60cdbafb46c => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 18:12:27.487360 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78f1620-6c7c-4758-979c-1459c04e25db admin admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:12:27.488783 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-c78f1620-6c7c-4758-979c-1459c04e25db admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:12:27.501149 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78f1620-6c7c-4758-979c-1459c04e25db admin admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:12:27.556038 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaee878c-494f-45b7-8eb9-372a2c551496 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:12:27.556662 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaee878c-494f-45b7-8eb9-372a2c551496 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:12:27.556941 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaee878c-494f-45b7-8eb9-372a2c551496 admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:12:27.557214 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaee878c-494f-45b7-8eb9-372a2c551496 admin admin] PATH_INFO: `/v3/users/5bc9cb70e48849cbaa6875e78d03201a` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:12:27.558370 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaee878c-494f-45b7-8eb9-372a2c551496 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5bc9cb70e48849cbaa6875e78d03201a)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:12:27.560283 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaee878c-494f-45b7-8eb9-372a2c551496 admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:12:27.610119 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-aaee878c-494f-45b7-8eb9-372a2c551496 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5bc9cb70e48849cbaa6875e78d03201a'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:12:27.617923 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-aaee878c-494f-45b7-8eb9-372a2c551496 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5bc9cb70e48849cbaa6875e78d03201a'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:12:27.618778 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-aaee878c-494f-45b7-8eb9-372a2c551496 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5bc9cb70e48849cbaa6875e78d03201a'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:12:27.619393 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-aaee878c-494f-45b7-8eb9-372a2c551496 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5bc9cb70e48849cbaa6875e78d03201a'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:12:27.627605 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-aaee878c-494f-45b7-8eb9-372a2c551496 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5bc9cb70e48849cbaa6875e78d03201a'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:12:27.633506 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=79,keystone:DELETE=19,keystone:INSERT=2 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 18:12:27.648810 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1443/2896] 10.222.0.25 () {58 vars in 1224 bytes} [Thu Sep 15 18:12:27 2022] DELETE /identity/v3/users/5bc9cb70e48849cbaa6875e78d03201a => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 18:12:27.935192 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc615df-0944-42e7-9483-995557b8b3cf admin admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:12:27.937592 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-bcc615df-0944-42e7-9483-995557b8b3cf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:12:27.952553 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc615df-0944-42e7-9483-995557b8b3cf admin admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:12:28.012323 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c125b8-36f6-47b7-9074-7ea7c3bb6ac3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:12:28.012962 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c125b8-36f6-47b7-9074-7ea7c3bb6ac3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:12:28.013239 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c125b8-36f6-47b7-9074-7ea7c3bb6ac3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:12:28.013543 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c125b8-36f6-47b7-9074-7ea7c3bb6ac3 admin admin] PATH_INFO: `/v3/projects/88c25e32c22147d1b31d43cbda64a8e4` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:12:28.014659 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c125b8-36f6-47b7-9074-7ea7c3bb6ac3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=88c25e32c22147d1b31d43cbda64a8e4)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:12:28.016565 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c125b8-36f6-47b7-9074-7ea7c3bb6ac3 admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:12:28.061833 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-65c125b8-36f6-47b7-9074-7ea7c3bb6ac3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '88c25e32c22147d1b31d43cbda64a8e4', 'request_id': 'req-65c125b8-36f6-47b7-9074-7ea7c3bb6ac3'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:12:28.067453 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-65c125b8-36f6-47b7-9074-7ea7c3bb6ac3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '88c25e32c22147d1b31d43cbda64a8e4', 'request_id': 'req-65c125b8-36f6-47b7-9074-7ea7c3bb6ac3'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:12:28.074955 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-65c125b8-36f6-47b7-9074-7ea7c3bb6ac3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '88c25e32c22147d1b31d43cbda64a8e4', 'request_id': 'req-65c125b8-36f6-47b7-9074-7ea7c3bb6ac3'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:12:28.090774 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-65c125b8-36f6-47b7-9074-7ea7c3bb6ac3 admin admin] The token cache is being invalidate because project 88c25e32c22147d1b31d43cbda64a8e4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81593) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 18:12:28.091062 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-65c125b8-36f6-47b7-9074-7ea7c3bb6ac3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:12:28.091717 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-65c125b8-36f6-47b7-9074-7ea7c3bb6ac3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:12:28.093205 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1454/2897] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Sep 15 18:12:27 2022] DELETE /identity/v3/projects/88c25e32c22147d1b31d43cbda64a8e4 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 18:12:30.812876 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaee878c-494f-45b7-8eb9-372a2c551496 admin admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:12:30.814366 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-aaee878c-494f-45b7-8eb9-372a2c551496 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:12:30.870922 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaee878c-494f-45b7-8eb9-372a2c551496 admin admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:12:30.918818 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a40f04-abd7-40b9-b280-5e9998236317 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a32274b4781b40fea9f28da8a9bde5ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1213c0d1b584404ba3998e136f166e89', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:12:30.919427 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a40f04-abd7-40b9-b280-5e9998236317 service neutron] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:12:30.920020 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a40f04-abd7-40b9-b280-5e9998236317 service neutron] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:12:30.920302 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a40f04-abd7-40b9-b280-5e9998236317 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:12:30.922085 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-b9a40f04-abd7-40b9-b280-5e9998236317 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:12:30.932219 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a40f04-abd7-40b9-b280-5e9998236317 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:12:30.933689 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a40f04-abd7-40b9-b280-5e9998236317 service neutron] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:12:30.941795 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1444/2898] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 15 18:12:30 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 18:12:35.596109 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c125b8-36f6-47b7-9074-7ea7c3bb6ac3 admin admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:12:35.598699 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-65c125b8-36f6-47b7-9074-7ea7c3bb6ac3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:12:35.617615 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 18:12:35.677086 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c125b8-36f6-47b7-9074-7ea7c3bb6ac3 admin admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:12:35.682979 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d550e7-cd36-48a7-b81d-6769800b5e28 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe2244818e4d4dca9c424cd078653e6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1213c0d1b584404ba3998e136f166e89', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:12:35.683594 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d550e7-cd36-48a7-b81d-6769800b5e28 service nova] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:12:35.683873 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d550e7-cd36-48a7-b81d-6769800b5e28 service nova] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:12:35.684142 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d550e7-cd36-48a7-b81d-6769800b5e28 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:12:35.685891 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-89d550e7-cd36-48a7-b81d-6769800b5e28 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:12:35.699301 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d550e7-cd36-48a7-b81d-6769800b5e28 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:12:35.700930 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d550e7-cd36-48a7-b81d-6769800b5e28 service nova] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:12:35.713553 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1455/2899] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 15 18:12:35 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 18:12:37.036610 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef44f32-d72f-4a80-9742-51cf0a2d9da6 None None] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:12:37.037091 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef44f32-d72f-4a80-9742-51cf0a2d9da6 None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:12:37.037189 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef44f32-d72f-4a80-9742-51cf0a2d9da6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:12:37.057856 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.auth.core [None req-fef44f32-d72f-4a80-9742-51cf0a2d9da6 None None] MFA Rules not processed for user `c17b6d56eaed4603a874b382380d2fd4`. Rule list: `[]` (Enabled: `True`). {{(pid=81592) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 18:12:37.059138 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-fef44f32-d72f-4a80-9742-51cf0a2d9da6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:12:37.113054 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1445/2900] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 15 18:12:37 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 18:12:37.340237 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d550e7-cd36-48a7-b81d-6769800b5e28 service nova] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:12:37.341726 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-89d550e7-cd36-48a7-b81d-6769800b5e28 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:12:37.353587 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d550e7-cd36-48a7-b81d-6769800b5e28 service nova] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:12:37.357074 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11f3175-49fd-4da9-89ba-083dd6db43d9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a32274b4781b40fea9f28da8a9bde5ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1213c0d1b584404ba3998e136f166e89', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:12:37.357697 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11f3175-49fd-4da9-89ba-083dd6db43d9 service neutron] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:12:37.357976 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11f3175-49fd-4da9-89ba-083dd6db43d9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:12:37.358244 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11f3175-49fd-4da9-89ba-083dd6db43d9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:12:37.359882 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-d11f3175-49fd-4da9-89ba-083dd6db43d9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:12:37.368848 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d11f3175-49fd-4da9-89ba-083dd6db43d9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:12:37.370313 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d11f3175-49fd-4da9-89ba-083dd6db43d9 service neutron] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:12:37.381449 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1456/2901] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 15 18:12:37 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 18:12:44.621015 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef44f32-d72f-4a80-9742-51cf0a2d9da6 None None] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:12:44.635345 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef44f32-d72f-4a80-9742-51cf0a2d9da6 None None] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:12:44.641881 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78849c29-1b99-4068-98bf-2e9bb5676a27 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe2244818e4d4dca9c424cd078653e6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1213c0d1b584404ba3998e136f166e89', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:12:44.642506 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78849c29-1b99-4068-98bf-2e9bb5676a27 service nova] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:12:44.642786 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78849c29-1b99-4068-98bf-2e9bb5676a27 service nova] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:12:44.643549 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78849c29-1b99-4068-98bf-2e9bb5676a27 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:12:44.645400 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-78849c29-1b99-4068-98bf-2e9bb5676a27 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:12:44.657923 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78849c29-1b99-4068-98bf-2e9bb5676a27 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:12:44.660172 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78849c29-1b99-4068-98bf-2e9bb5676a27 service nova] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:12:44.671308 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1446/2902] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 15 18:12:44 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 18:12:47.374558 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=33 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 18:12:52.904317 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bffdeca-3be9-4845-b552-b313487d043a None None] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:12:52.904961 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bffdeca-3be9-4845-b552-b313487d043a None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:12:52.904961 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bffdeca-3be9-4845-b552-b313487d043a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:12:52.957184 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.auth.core [None req-4bffdeca-3be9-4845-b552-b313487d043a None None] MFA Rules not processed for user `d899ec4fcbeb4de382c7f0a779ca8ed5`. Rule list: `[]` (Enabled: `True`). {{(pid=81593) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 18:12:52.958446 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-4bffdeca-3be9-4845-b552-b313487d043a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:12:53.021925 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1457/2903] 10.222.0.25 () {58 vars in 1009 bytes} [Thu Sep 15 18:12:52 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 18:12:53.067676 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78849c29-1b99-4068-98bf-2e9bb5676a27 service nova] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:12:53.069057 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-78849c29-1b99-4068-98bf-2e9bb5676a27 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:12:53.112340 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 18:12:53.161560 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78849c29-1b99-4068-98bf-2e9bb5676a27 service nova] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:12:53.166488 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc44b702-5ed0-4b15-b7ca-4be0bed87905 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '685f7ad4c6fe4c878d542dddd6d81593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1213c0d1b584404ba3998e136f166e89', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:12:53.167083 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc44b702-5ed0-4b15-b7ca-4be0bed87905 service swift] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:12:53.167360 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc44b702-5ed0-4b15-b7ca-4be0bed87905 service swift] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:12:53.167630 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc44b702-5ed0-4b15-b7ca-4be0bed87905 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:12:53.175797 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc44b702-5ed0-4b15-b7ca-4be0bed87905 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:12:53.177669 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc44b702-5ed0-4b15-b7ca-4be0bed87905 service swift] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:12:53.185655 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1447/2904] 10.222.0.25 () {60 vars in 1384 bytes} [Thu Sep 15 18:12:53 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 15 18:13:03.019405 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=40 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 18:13:03.182787 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=24 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 18:13:08.541890 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e39b4f-8582-4b01-9630-a38735b43979 None None] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:13:08.542379 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e39b4f-8582-4b01-9630-a38735b43979 None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:13:08.542493 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e39b4f-8582-4b01-9630-a38735b43979 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:13:08.561603 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.auth.core [None req-69e39b4f-8582-4b01-9630-a38735b43979 None None] MFA Rules not processed for user `d899ec4fcbeb4de382c7f0a779ca8ed5`. Rule list: `[]` (Enabled: `True`). {{(pid=81593) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 18:13:08.562785 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-69e39b4f-8582-4b01-9630-a38735b43979 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:13:08.570470 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1458/2905] 10.222.0.25 () {58 vars in 967 bytes} [Thu Sep 15 18:13:08 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 18:13:08.582518 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc44b702-5ed0-4b15-b7ca-4be0bed87905 service swift] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:13:08.593272 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc44b702-5ed0-4b15-b7ca-4be0bed87905 service swift] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:13:08.598375 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8b4aeb-e2cb-4da6-8b18-19d75fe10d31 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '685f7ad4c6fe4c878d542dddd6d81593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1213c0d1b584404ba3998e136f166e89', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:13:08.598965 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8b4aeb-e2cb-4da6-8b18-19d75fe10d31 service swift] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:13:08.599244 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8b4aeb-e2cb-4da6-8b18-19d75fe10d31 service swift] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:13:08.599515 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8b4aeb-e2cb-4da6-8b18-19d75fe10d31 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:13:08.607367 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e8b4aeb-e2cb-4da6-8b18-19d75fe10d31 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:13:08.608923 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e8b4aeb-e2cb-4da6-8b18-19d75fe10d31 service swift] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:13:08.617262 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1448/2906] 10.222.0.25 () {60 vars in 1384 bytes} [Thu Sep 15 18:13:08 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 15 18:13:10.506652 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e39b4f-8582-4b01-9630-a38735b43979 None None] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:13:10.508249 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-69e39b4f-8582-4b01-9630-a38735b43979 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:13:10.572423 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e39b4f-8582-4b01-9630-a38735b43979 None None] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:13:10.576724 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f88f10-e8c3-479b-8d55-44545f521ba1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:13:10.577393 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f88f10-e8c3-479b-8d55-44545f521ba1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:13:10.577670 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f88f10-e8c3-479b-8d55-44545f521ba1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:13:10.577937 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f88f10-e8c3-479b-8d55-44545f521ba1 admin admin] PATH_INFO: `/v3/users/c17b6d56eaed4603a874b382380d2fd4` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:13:10.579041 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f88f10-e8c3-479b-8d55-44545f521ba1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c17b6d56eaed4603a874b382380d2fd4)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:13:10.581612 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f88f10-e8c3-479b-8d55-44545f521ba1 admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:13:10.626542 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-36f88f10-e8c3-479b-8d55-44545f521ba1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c17b6d56eaed4603a874b382380d2fd4'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:13:10.634127 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-36f88f10-e8c3-479b-8d55-44545f521ba1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c17b6d56eaed4603a874b382380d2fd4'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:13:10.634721 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-36f88f10-e8c3-479b-8d55-44545f521ba1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c17b6d56eaed4603a874b382380d2fd4'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:13:10.635319 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-36f88f10-e8c3-479b-8d55-44545f521ba1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c17b6d56eaed4603a874b382380d2fd4'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:13:10.642080 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-36f88f10-e8c3-479b-8d55-44545f521ba1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c17b6d56eaed4603a874b382380d2fd4'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:13:10.659552 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1459/2907] 10.222.0.25 () {58 vars in 1224 bytes} [Thu Sep 15 18:13:10 2022] DELETE /identity/v3/users/c17b6d56eaed4603a874b382380d2fd4 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 18:13:10.826565 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8b4aeb-e2cb-4da6-8b18-19d75fe10d31 service swift] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:13:10.840314 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8b4aeb-e2cb-4da6-8b18-19d75fe10d31 service swift] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:13:10.897165 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3de8ff5-ced2-4751-9dd4-a002a33fdead admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:13:10.897812 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3de8ff5-ced2-4751-9dd4-a002a33fdead admin admin] REQUEST_METHOD: `DELETE` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:13:10.898088 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3de8ff5-ced2-4751-9dd4-a002a33fdead admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:13:10.898358 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3de8ff5-ced2-4751-9dd4-a002a33fdead admin admin] PATH_INFO: `/v3/projects/dcd6bd5397da4de794025d727589a33d` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:13:10.899465 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3de8ff5-ced2-4751-9dd4-a002a33fdead admin admin] RBAC: Authorizing `identity:delete_project(project_id=dcd6bd5397da4de794025d727589a33d)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:13:10.901363 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3de8ff5-ced2-4751-9dd4-a002a33fdead admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:13:10.947542 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-c3de8ff5-ced2-4751-9dd4-a002a33fdead admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dcd6bd5397da4de794025d727589a33d', 'request_id': 'req-c3de8ff5-ced2-4751-9dd4-a002a33fdead'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:13:10.953112 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-c3de8ff5-ced2-4751-9dd4-a002a33fdead admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dcd6bd5397da4de794025d727589a33d', 'request_id': 'req-c3de8ff5-ced2-4751-9dd4-a002a33fdead'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:13:10.960642 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-c3de8ff5-ced2-4751-9dd4-a002a33fdead admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dcd6bd5397da4de794025d727589a33d', 'request_id': 'req-c3de8ff5-ced2-4751-9dd4-a002a33fdead'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:13:10.972112 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-c3de8ff5-ced2-4751-9dd4-a002a33fdead admin admin] The token cache is being invalidate because project dcd6bd5397da4de794025d727589a33d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81592) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 18:13:10.972402 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-c3de8ff5-ced2-4751-9dd4-a002a33fdead admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:13:10.973031 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-c3de8ff5-ced2-4751-9dd4-a002a33fdead admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:13:10.974527 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1449/2908] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Sep 15 18:13:10 2022] DELETE /identity/v3/projects/dcd6bd5397da4de794025d727589a33d => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 18:13:10.979383 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb0c1c7-dcbe-413f-b05c-931acf6b86be None None] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:13:10.979668 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb0c1c7-dcbe-413f-b05c-931acf6b86be None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:13:10.979951 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb0c1c7-dcbe-413f-b05c-931acf6b86be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:13:10.999707 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.auth.core [None req-adb0c1c7-dcbe-413f-b05c-931acf6b86be None None] MFA Rules not processed for user `5cfa58ef86774ab7800bf91930bf6028`. Rule list: `[]` (Enabled: `True`). {{(pid=81593) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 18:13:11.000901 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-adb0c1c7-dcbe-413f-b05c-931acf6b86be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:13:11.058986 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1460/2909] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 15 18:13:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 18:13:11.067319 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedeab6d-8cff-487c-b9d8-e112805e0c5b None None] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:13:11.067604 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedeab6d-8cff-487c-b9d8-e112805e0c5b None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:13:11.067876 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedeab6d-8cff-487c-b9d8-e112805e0c5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:13:11.087140 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.auth.core [None req-dedeab6d-8cff-487c-b9d8-e112805e0c5b None None] MFA Rules not processed for user `5cfa58ef86774ab7800bf91930bf6028`. Rule list: `[]` (Enabled: `True`). {{(pid=81592) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 18:13:11.088266 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-dedeab6d-8cff-487c-b9d8-e112805e0c5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:13:11.096359 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1450/2910] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 15 18:13:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 18:13:11.100459 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb0c1c7-dcbe-413f-b05c-931acf6b86be None None] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:13:11.110536 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb0c1c7-dcbe-413f-b05c-931acf6b86be None None] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:13:11.115524 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67444850-f63f-4231-9948-e8ac535e1be9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:13:11.116118 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67444850-f63f-4231-9948-e8ac535e1be9 admin admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:13:11.116398 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67444850-f63f-4231-9948-e8ac535e1be9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:13:11.116673 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67444850-f63f-4231-9948-e8ac535e1be9 admin admin] PATH_INFO: `/v3/domains` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:13:11.117343 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67444850-f63f-4231-9948-e8ac535e1be9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81593) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 18:13:11.117652 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67444850-f63f-4231-9948-e8ac535e1be9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:13:11.119253 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67444850-f63f-4231-9948-e8ac535e1be9 admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:13:11.127689 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 18:13:11.135104 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1461/2911] 10.222.0.25 () {58 vars in 1153 bytes} [Thu Sep 15 18:13:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 18:13:11.136359 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dedeab6d-8cff-487c-b9d8-e112805e0c5b None None] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:13:11.145816 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dedeab6d-8cff-487c-b9d8-e112805e0c5b None None] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:13:11.150446 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba56930a-62e9-467d-8faa-3ef33b14c46c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:13:11.151034 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba56930a-62e9-467d-8faa-3ef33b14c46c admin admin] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:13:11.151315 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba56930a-62e9-467d-8faa-3ef33b14c46c admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:13:11.151586 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba56930a-62e9-467d-8faa-3ef33b14c46c admin admin] PATH_INFO: `/v3/projects` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:13:11.152259 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba56930a-62e9-467d-8faa-3ef33b14c46c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:13:11.154182 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba56930a-62e9-467d-8faa-3ef33b14c46c admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:13:11.181309 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1451/2912] 10.222.0.25 () {60 vars in 1153 bytes} [Thu Sep 15 18:13:11 2022] POST /identity/v3/projects => generated 383 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 15 18:13:11.185389 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67444850-f63f-4231-9948-e8ac535e1be9 admin admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:13:11.195361 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67444850-f63f-4231-9948-e8ac535e1be9 admin admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:13:11.250790 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127962e3-eda6-469c-92b4-93f8855fb738 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:13:11.251385 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127962e3-eda6-469c-92b4-93f8855fb738 admin admin] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:13:11.251666 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127962e3-eda6-469c-92b4-93f8855fb738 admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:13:11.251937 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127962e3-eda6-469c-92b4-93f8855fb738 admin admin] PATH_INFO: `/v3/users` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:13:11.252547 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-127962e3-eda6-469c-92b4-93f8855fb738 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:13:11.254494 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-127962e3-eda6-469c-92b4-93f8855fb738 admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:13:11.274876 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1462/2913] 10.222.0.25 () {60 vars in 1144 bytes} [Thu Sep 15 18:13:11 2022] POST /identity/v3/users => generated 292 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 18:13:11.278993 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba56930a-62e9-467d-8faa-3ef33b14c46c admin admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:13:11.290359 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba56930a-62e9-467d-8faa-3ef33b14c46c admin admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:13:11.295137 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d82f48-0606-4ff4-a714-3f9d8f446484 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:13:11.295734 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d82f48-0606-4ff4-a714-3f9d8f446484 admin admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:13:11.296017 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d82f48-0606-4ff4-a714-3f9d8f446484 admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:13:11.296289 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d82f48-0606-4ff4-a714-3f9d8f446484 admin admin] PATH_INFO: `/v3/roles` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:13:11.296970 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d82f48-0606-4ff4-a714-3f9d8f446484 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:13:11.298605 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d82f48-0606-4ff4-a714-3f9d8f446484 admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:13:11.309218 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1452/2914] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Sep 15 18:13:11 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 18:13:11.313210 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127962e3-eda6-469c-92b4-93f8855fb738 admin admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:13:11.323743 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127962e3-eda6-469c-92b4-93f8855fb738 admin admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:13:11.328960 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc0b9c1-1e37-4ae3-a3ec-6e7ab4008fee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:13:11.329577 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc0b9c1-1e37-4ae3-a3ec-6e7ab4008fee admin admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:13:11.329858 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc0b9c1-1e37-4ae3-a3ec-6e7ab4008fee admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:13:11.330125 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc0b9c1-1e37-4ae3-a3ec-6e7ab4008fee admin admin] PATH_INFO: `/v3/roles` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:13:11.330754 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc0b9c1-1e37-4ae3-a3ec-6e7ab4008fee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:13:11.332348 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc0b9c1-1e37-4ae3-a3ec-6e7ab4008fee admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:13:11.344311 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1463/2915] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Sep 15 18:13:11 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 18:13:11.348915 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d82f48-0606-4ff4-a714-3f9d8f446484 admin admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:13:11.358769 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d82f48-0606-4ff4-a714-3f9d8f446484 admin admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:13:11.364058 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b879dc-a556-46b1-8839-093da4487208 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:13:11.364696 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b879dc-a556-46b1-8839-093da4487208 admin admin] REQUEST_METHOD: `PUT` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:13:11.364978 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b879dc-a556-46b1-8839-093da4487208 admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:13:11.365256 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b879dc-a556-46b1-8839-093da4487208 admin admin] PATH_INFO: `/v3/projects/f2ebda4975784256940ad9f1bb0d1bbb/users/0ebb141fcdec4180974808d4bb0d801f/roles/343cc8b1bc7243eebabdf08147e8366d` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:13:11.379621 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b879dc-a556-46b1-8839-093da4487208 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f2ebda4975784256940ad9f1bb0d1bbb, user_id=0ebb141fcdec4180974808d4bb0d801f, role_id=343cc8b1bc7243eebabdf08147e8366d)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:13:11.382345 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b879dc-a556-46b1-8839-093da4487208 admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:13:11.395114 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1453/2916] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Sep 15 18:13:11 2022] PUT /identity/v3/projects/f2ebda4975784256940ad9f1bb0d1bbb/users/0ebb141fcdec4180974808d4bb0d801f/roles/343cc8b1bc7243eebabdf08147e8366d => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 18:13:11.400141 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a652fd-e9c2-4b43-bd99-fee2bf13d233 None None] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:13:11.400429 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a652fd-e9c2-4b43-bd99-fee2bf13d233 None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:13:11.400729 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a652fd-e9c2-4b43-bd99-fee2bf13d233 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:13:11.420220 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.auth.core [None req-d2a652fd-e9c2-4b43-bd99-fee2bf13d233 None None] MFA Rules not processed for user `5cfa58ef86774ab7800bf91930bf6028`. Rule list: `[]` (Enabled: `True`). {{(pid=81593) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 18:13:11.421465 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-d2a652fd-e9c2-4b43-bd99-fee2bf13d233 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:13:11.479616 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1464/2917] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 15 18:13:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 18:13:11.489881 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b879dc-a556-46b1-8839-093da4487208 admin admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:13:11.491591 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-b9b879dc-a556-46b1-8839-093da4487208 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:13:11.505481 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 18:13:11.550103 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b879dc-a556-46b1-8839-093da4487208 admin admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:13:11.553711 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbcb721f-58e4-4b7f-afcc-6953195cce49 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a32274b4781b40fea9f28da8a9bde5ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1213c0d1b584404ba3998e136f166e89', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:13:11.554302 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcb721f-58e4-4b7f-afcc-6953195cce49 service neutron] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:13:11.554576 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcb721f-58e4-4b7f-afcc-6953195cce49 service neutron] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:13:11.554844 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcb721f-58e4-4b7f-afcc-6953195cce49 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:13:11.563835 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbcb721f-58e4-4b7f-afcc-6953195cce49 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:13:11.565250 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbcb721f-58e4-4b7f-afcc-6953195cce49 service neutron] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:13:11.574511 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1454/2918] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 15 18:13:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 18:13:12.195116 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32af5cca-66a0-408b-8cae-12437128bcff None None] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:13:12.195631 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32af5cca-66a0-408b-8cae-12437128bcff None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:13:12.195730 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32af5cca-66a0-408b-8cae-12437128bcff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:13:12.225231 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.auth.core [None req-32af5cca-66a0-408b-8cae-12437128bcff None None] MFA Rules not processed for user `0ebb141fcdec4180974808d4bb0d801f`. Rule list: `[]` (Enabled: `True`). {{(pid=81593) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 18:13:12.226501 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-32af5cca-66a0-408b-8cae-12437128bcff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:13:12.291581 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1465/2919] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 15 18:13:12 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 18:13:12.304978 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbcb721f-58e4-4b7f-afcc-6953195cce49 service neutron] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:13:12.306669 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-dbcb721f-58e4-4b7f-afcc-6953195cce49 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:13:12.363271 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbcb721f-58e4-4b7f-afcc-6953195cce49 service neutron] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:13:12.367370 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3a3d4d-cf4d-403f-b425-e2806c9583d3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b232e7a841145ba93c6d8462ccb751a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1213c0d1b584404ba3998e136f166e89', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:13:12.367974 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3a3d4d-cf4d-403f-b425-e2806c9583d3 service cinder] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:13:12.368256 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3a3d4d-cf4d-403f-b425-e2806c9583d3 service cinder] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:13:12.368524 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3a3d4d-cf4d-403f-b425-e2806c9583d3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:13:12.377800 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a3a3d4d-cf4d-403f-b425-e2806c9583d3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:13:12.379752 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a3a3d4d-cf4d-403f-b425-e2806c9583d3 service cinder] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:13:12.388512 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1455/2920] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 15 18:13:12 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 18:13:13.758215 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca49e58-1707-49c7-ad2f-336101edd317 None None] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:13:13.758768 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca49e58-1707-49c7-ad2f-336101edd317 None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:13:13.758768 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca49e58-1707-49c7-ad2f-336101edd317 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:13:13.777453 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.auth.core [None req-7ca49e58-1707-49c7-ad2f-336101edd317 None None] MFA Rules not processed for user `0ebb141fcdec4180974808d4bb0d801f`. Rule list: `[]` (Enabled: `True`). {{(pid=81593) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 18:13:13.778658 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-7ca49e58-1707-49c7-ad2f-336101edd317 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:13:13.785505 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1466/2921] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 15 18:13:13 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 18:13:22.384499 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=46 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 18:13:23.771940 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=96,keystone:INSERT=3 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 18:13:39.737988 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64d128e-4aed-4719-a45d-76e6a6b2db1f None None] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:13:39.738421 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64d128e-4aed-4719-a45d-76e6a6b2db1f None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:13:39.738533 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64d128e-4aed-4719-a45d-76e6a6b2db1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:13:39.758429 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.auth.core [None req-b64d128e-4aed-4719-a45d-76e6a6b2db1f None None] MFA Rules not processed for user `5cfa58ef86774ab7800bf91930bf6028`. Rule list: `[]` (Enabled: `True`). {{(pid=81592) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 18:13:39.759664 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-b64d128e-4aed-4719-a45d-76e6a6b2db1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:13:39.767648 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1456/2922] 10.222.0.27 () {58 vars in 1016 bytes} [Thu Sep 15 18:13:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 18:13:39.825725 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca49e58-1707-49c7-ad2f-336101edd317 None None] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:13:39.827742 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-7ca49e58-1707-49c7-ad2f-336101edd317 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:13:39.900331 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca49e58-1707-49c7-ad2f-336101edd317 None None] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:13:39.905699 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1ffc46-4bf9-4338-95ff-a34854f2d01b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe2244818e4d4dca9c424cd078653e6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1213c0d1b584404ba3998e136f166e89', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:13:39.906295 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1ffc46-4bf9-4338-95ff-a34854f2d01b service nova] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:13:39.906570 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1ffc46-4bf9-4338-95ff-a34854f2d01b service nova] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:13:39.906841 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1ffc46-4bf9-4338-95ff-a34854f2d01b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:13:39.914982 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba1ffc46-4bf9-4338-95ff-a34854f2d01b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:13:39.916589 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba1ffc46-4bf9-4338-95ff-a34854f2d01b service nova] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:13:39.925886 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1467/2923] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 15 18:13:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 18:13:42.814933 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61d359a-ca84-45a2-9f69-f34c9821b0fc None None] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:13:42.815503 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61d359a-ca84-45a2-9f69-f34c9821b0fc None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:13:42.815503 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61d359a-ca84-45a2-9f69-f34c9821b0fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:13:42.836385 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.auth.core [None req-a61d359a-ca84-45a2-9f69-f34c9821b0fc None None] MFA Rules not processed for user `5cfa58ef86774ab7800bf91930bf6028`. Rule list: `[]` (Enabled: `True`). {{(pid=81592) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 18:13:42.837615 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-a61d359a-ca84-45a2-9f69-f34c9821b0fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:13:42.845679 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1457/2924] 10.222.0.27 () {58 vars in 1016 bytes} [Thu Sep 15 18:13:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 18:13:42.873783 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1ffc46-4bf9-4338-95ff-a34854f2d01b service nova] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:13:42.875140 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-ba1ffc46-4bf9-4338-95ff-a34854f2d01b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:13:42.890012 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1ffc46-4bf9-4338-95ff-a34854f2d01b service nova] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:13:42.895921 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567ff6f7-54c5-4839-af89-8fea8fb4cb6e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe2244818e4d4dca9c424cd078653e6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1213c0d1b584404ba3998e136f166e89', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:13:42.896508 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567ff6f7-54c5-4839-af89-8fea8fb4cb6e service nova] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:13:42.896790 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567ff6f7-54c5-4839-af89-8fea8fb4cb6e service nova] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:13:42.897069 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567ff6f7-54c5-4839-af89-8fea8fb4cb6e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:13:42.904972 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-567ff6f7-54c5-4839-af89-8fea8fb4cb6e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:13:42.906587 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-567ff6f7-54c5-4839-af89-8fea8fb4cb6e service nova] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:13:42.916137 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1468/2925] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 15 18:13:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 18:13:46.067509 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65106805-7182-4fc8-ac29-b521b90f5bac None None] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:13:46.068034 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65106805-7182-4fc8-ac29-b521b90f5bac None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:13:46.068165 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65106805-7182-4fc8-ac29-b521b90f5bac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:13:46.087593 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.auth.core [None req-65106805-7182-4fc8-ac29-b521b90f5bac None None] MFA Rules not processed for user `5cfa58ef86774ab7800bf91930bf6028`. Rule list: `[]` (Enabled: `True`). {{(pid=81592) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 18:13:46.088781 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-65106805-7182-4fc8-ac29-b521b90f5bac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:13:46.096797 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1458/2926] 10.222.0.27 () {58 vars in 1016 bytes} [Thu Sep 15 18:13:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 18:13:46.120508 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567ff6f7-54c5-4839-af89-8fea8fb4cb6e service nova] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:13:46.131536 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567ff6f7-54c5-4839-af89-8fea8fb4cb6e service nova] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:13:46.136838 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea0db25-b130-4f36-ad58-fe91870922f0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe2244818e4d4dca9c424cd078653e6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1213c0d1b584404ba3998e136f166e89', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:13:46.137450 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea0db25-b130-4f36-ad58-fe91870922f0 service nova] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:13:46.137726 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea0db25-b130-4f36-ad58-fe91870922f0 service nova] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:13:46.137995 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea0db25-b130-4f36-ad58-fe91870922f0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:13:46.145966 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea0db25-b130-4f36-ad58-fe91870922f0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:13:46.148017 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea0db25-b130-4f36-ad58-fe91870922f0 service nova] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:13:46.157275 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1469/2927] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 15 18:13:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 18:13:49.167630 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af4c732-947e-4b69-87c0-987891bf1698 None None] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:13:49.168157 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af4c732-947e-4b69-87c0-987891bf1698 None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:13:49.168157 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af4c732-947e-4b69-87c0-987891bf1698 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:13:49.187727 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.auth.core [None req-8af4c732-947e-4b69-87c0-987891bf1698 None None] MFA Rules not processed for user `5cfa58ef86774ab7800bf91930bf6028`. Rule list: `[]` (Enabled: `True`). {{(pid=81592) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 18:13:49.188880 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-8af4c732-947e-4b69-87c0-987891bf1698 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:13:49.197042 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1459/2928] 10.222.0.27 () {58 vars in 1016 bytes} [Thu Sep 15 18:13:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 18:13:49.224437 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea0db25-b130-4f36-ad58-fe91870922f0 service nova] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:13:49.235524 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea0db25-b130-4f36-ad58-fe91870922f0 service nova] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:13:49.241674 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a565a1a-ab67-4760-b325-cde3245f4218 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe2244818e4d4dca9c424cd078653e6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1213c0d1b584404ba3998e136f166e89', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:13:49.242299 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a565a1a-ab67-4760-b325-cde3245f4218 service nova] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:13:49.242578 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a565a1a-ab67-4760-b325-cde3245f4218 service nova] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:13:49.242852 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a565a1a-ab67-4760-b325-cde3245f4218 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:13:49.251752 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a565a1a-ab67-4760-b325-cde3245f4218 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:13:49.253365 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a565a1a-ab67-4760-b325-cde3245f4218 service nova] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:13:49.263314 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1470/2929] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 15 18:13:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 18:13:52.316020 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f570a792-19b8-4f09-a93d-f22de9c6d9e0 None None] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:13:52.316545 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f570a792-19b8-4f09-a93d-f22de9c6d9e0 None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:13:52.316545 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f570a792-19b8-4f09-a93d-f22de9c6d9e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:13:52.337725 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.auth.core [None req-f570a792-19b8-4f09-a93d-f22de9c6d9e0 None None] MFA Rules not processed for user `5cfa58ef86774ab7800bf91930bf6028`. Rule list: `[]` (Enabled: `True`). {{(pid=81592) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 18:13:52.338906 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-f570a792-19b8-4f09-a93d-f22de9c6d9e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:13:52.347068 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1460/2930] 10.222.0.27 () {58 vars in 1016 bytes} [Thu Sep 15 18:13:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 18:13:52.383441 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a565a1a-ab67-4760-b325-cde3245f4218 service nova] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:13:52.394789 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a565a1a-ab67-4760-b325-cde3245f4218 service nova] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:13:52.400262 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b237bf1-1f4b-4b22-8d97-bf62fe9299ae service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe2244818e4d4dca9c424cd078653e6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1213c0d1b584404ba3998e136f166e89', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:13:52.400888 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b237bf1-1f4b-4b22-8d97-bf62fe9299ae service nova] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:13:52.401166 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b237bf1-1f4b-4b22-8d97-bf62fe9299ae service nova] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:13:52.401487 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b237bf1-1f4b-4b22-8d97-bf62fe9299ae service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:13:52.409733 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b237bf1-1f4b-4b22-8d97-bf62fe9299ae service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:13:52.411304 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b237bf1-1f4b-4b22-8d97-bf62fe9299ae service nova] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:13:52.421711 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1471/2931] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 15 18:13:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 18:13:55.462631 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812f000d-baed-4e12-8f9b-8ff6b6be9a0e None None] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:13:55.463410 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812f000d-baed-4e12-8f9b-8ff6b6be9a0e None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:13:55.463766 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812f000d-baed-4e12-8f9b-8ff6b6be9a0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:13:55.485129 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.auth.core [None req-812f000d-baed-4e12-8f9b-8ff6b6be9a0e None None] MFA Rules not processed for user `5cfa58ef86774ab7800bf91930bf6028`. Rule list: `[]` (Enabled: `True`). {{(pid=81592) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 18:13:55.486336 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-812f000d-baed-4e12-8f9b-8ff6b6be9a0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:13:55.494647 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1461/2932] 10.222.0.27 () {58 vars in 1016 bytes} [Thu Sep 15 18:13:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 18:13:55.526944 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b237bf1-1f4b-4b22-8d97-bf62fe9299ae service nova] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:13:55.538396 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b237bf1-1f4b-4b22-8d97-bf62fe9299ae service nova] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:13:55.543791 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db69c321-fdf4-47aa-a3d0-6ed0e0dc47f5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe2244818e4d4dca9c424cd078653e6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1213c0d1b584404ba3998e136f166e89', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:13:55.544375 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db69c321-fdf4-47aa-a3d0-6ed0e0dc47f5 service nova] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:13:55.544655 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db69c321-fdf4-47aa-a3d0-6ed0e0dc47f5 service nova] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:13:55.544928 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db69c321-fdf4-47aa-a3d0-6ed0e0dc47f5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:13:55.552867 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db69c321-fdf4-47aa-a3d0-6ed0e0dc47f5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:13:55.555013 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db69c321-fdf4-47aa-a3d0-6ed0e0dc47f5 service nova] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:13:55.565288 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1472/2933] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 15 18:13:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 18:14:05.480006 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=18 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 18:14:05.560092 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=64 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 18:14:10.785803 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fb7800-71c5-4b82-9931-4af5124af762 None None] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:14:10.786296 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fb7800-71c5-4b82-9931-4af5124af762 None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:14:10.786417 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fb7800-71c5-4b82-9931-4af5124af762 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:14:10.804742 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.auth.core [None req-31fb7800-71c5-4b82-9931-4af5124af762 None None] MFA Rules not processed for user `0ebb141fcdec4180974808d4bb0d801f`. Rule list: `[]` (Enabled: `True`). {{(pid=81592) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 18:14:10.806456 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-31fb7800-71c5-4b82-9931-4af5124af762 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:14:10.813122 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1462/2934] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 15 18:14:10 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 18:14:20.799504 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=3 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 18:14:24.609776 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebdb084-6af9-4bee-b881-cf2d260ef85b None None] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:14:24.610334 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebdb084-6af9-4bee-b881-cf2d260ef85b None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:14:24.610334 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebdb084-6af9-4bee-b881-cf2d260ef85b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:14:24.630180 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.auth.core [None req-6ebdb084-6af9-4bee-b881-cf2d260ef85b None None] MFA Rules not processed for user `5cfa58ef86774ab7800bf91930bf6028`. Rule list: `[]` (Enabled: `True`). {{(pid=81593) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 18:14:24.631358 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-6ebdb084-6af9-4bee-b881-cf2d260ef85b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:14:24.639156 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1473/2935] 10.222.0.27 () {58 vars in 1016 bytes} [Thu Sep 15 18:14:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 18:14:24.671762 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31fb7800-71c5-4b82-9931-4af5124af762 None None] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:14:24.685286 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31fb7800-71c5-4b82-9931-4af5124af762 None None] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:14:24.690814 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea08e315-71e5-484c-90c6-05f955ff73ca service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe2244818e4d4dca9c424cd078653e6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1213c0d1b584404ba3998e136f166e89', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:14:24.691436 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea08e315-71e5-484c-90c6-05f955ff73ca service nova] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:14:24.691739 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea08e315-71e5-484c-90c6-05f955ff73ca service nova] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:14:24.692008 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea08e315-71e5-484c-90c6-05f955ff73ca service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:14:24.700136 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea08e315-71e5-484c-90c6-05f955ff73ca service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:14:24.701735 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea08e315-71e5-484c-90c6-05f955ff73ca service nova] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:14:24.710770 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1463/2936] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 15 18:14:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 18:14:27.886969 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746cbc0d-0b5a-43e3-bed9-e045d20531e7 None None] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:14:27.887495 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746cbc0d-0b5a-43e3-bed9-e045d20531e7 None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:14:27.887495 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746cbc0d-0b5a-43e3-bed9-e045d20531e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:14:27.907933 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.auth.core [None req-746cbc0d-0b5a-43e3-bed9-e045d20531e7 None None] MFA Rules not processed for user `5cfa58ef86774ab7800bf91930bf6028`. Rule list: `[]` (Enabled: `True`). {{(pid=81593) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 18:14:27.909181 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-746cbc0d-0b5a-43e3-bed9-e045d20531e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:14:27.917182 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1474/2937] 10.222.0.27 () {58 vars in 1016 bytes} [Thu Sep 15 18:14:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 18:14:27.946677 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea08e315-71e5-484c-90c6-05f955ff73ca service nova] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:14:27.958431 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea08e315-71e5-484c-90c6-05f955ff73ca service nova] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:14:27.964156 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3dff80d-1306-446d-961d-f695230ba3bc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe2244818e4d4dca9c424cd078653e6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1213c0d1b584404ba3998e136f166e89', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:14:27.964772 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3dff80d-1306-446d-961d-f695230ba3bc service nova] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:14:27.965050 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3dff80d-1306-446d-961d-f695230ba3bc service nova] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:14:27.965373 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3dff80d-1306-446d-961d-f695230ba3bc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:14:27.973856 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3dff80d-1306-446d-961d-f695230ba3bc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:14:27.975405 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3dff80d-1306-446d-961d-f695230ba3bc service nova] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:14:27.985396 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1464/2938] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 15 18:14:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 18:14:30.952057 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f95919d-dec0-449a-ba28-98d3e1547af0 None None] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:14:30.952524 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f95919d-dec0-449a-ba28-98d3e1547af0 None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:14:30.952757 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f95919d-dec0-449a-ba28-98d3e1547af0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:14:30.972020 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.auth.core [None req-1f95919d-dec0-449a-ba28-98d3e1547af0 None None] MFA Rules not processed for user `5cfa58ef86774ab7800bf91930bf6028`. Rule list: `[]` (Enabled: `True`). {{(pid=81593) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 18:14:30.973257 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-1f95919d-dec0-449a-ba28-98d3e1547af0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:14:30.980946 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1475/2939] 10.222.0.27 () {58 vars in 1016 bytes} [Thu Sep 15 18:14:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 18:14:31.023064 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3dff80d-1306-446d-961d-f695230ba3bc service nova] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:14:31.034339 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3dff80d-1306-446d-961d-f695230ba3bc service nova] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:14:31.039677 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b1100c-57dd-4b28-aa89-ccdfe1823760 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe2244818e4d4dca9c424cd078653e6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1213c0d1b584404ba3998e136f166e89', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:14:31.040266 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b1100c-57dd-4b28-aa89-ccdfe1823760 service nova] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:14:31.040543 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b1100c-57dd-4b28-aa89-ccdfe1823760 service nova] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:14:31.040815 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b1100c-57dd-4b28-aa89-ccdfe1823760 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:14:31.048681 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b1100c-57dd-4b28-aa89-ccdfe1823760 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:14:31.050357 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b1100c-57dd-4b28-aa89-ccdfe1823760 service nova] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:14:31.060095 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1465/2940] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 15 18:14:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 18:14:34.114368 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5a0789-c63f-41ec-bdfa-f0482a349c40 None None] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:14:34.114866 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5a0789-c63f-41ec-bdfa-f0482a349c40 None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:14:34.114969 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5a0789-c63f-41ec-bdfa-f0482a349c40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:14:34.134070 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.auth.core [None req-0a5a0789-c63f-41ec-bdfa-f0482a349c40 None None] MFA Rules not processed for user `5cfa58ef86774ab7800bf91930bf6028`. Rule list: `[]` (Enabled: `True`). {{(pid=81593) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 18:14:34.136082 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-0a5a0789-c63f-41ec-bdfa-f0482a349c40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:14:34.143792 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1476/2941] 10.222.0.27 () {58 vars in 1016 bytes} [Thu Sep 15 18:14:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 18:14:34.182914 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b1100c-57dd-4b28-aa89-ccdfe1823760 service nova] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:14:34.194273 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b1100c-57dd-4b28-aa89-ccdfe1823760 service nova] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:14:34.199616 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e083c24a-4119-4f78-a3f5-91708c3e0e52 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe2244818e4d4dca9c424cd078653e6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1213c0d1b584404ba3998e136f166e89', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:14:34.200200 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e083c24a-4119-4f78-a3f5-91708c3e0e52 service nova] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:14:34.200477 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e083c24a-4119-4f78-a3f5-91708c3e0e52 service nova] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:14:34.200744 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e083c24a-4119-4f78-a3f5-91708c3e0e52 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:14:34.208706 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e083c24a-4119-4f78-a3f5-91708c3e0e52 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:14:34.210285 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e083c24a-4119-4f78-a3f5-91708c3e0e52 service nova] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:14:34.220436 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1466/2942] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 15 18:14:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 18:14:37.293262 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7034accd-f811-4467-997e-e3e31033477a None None] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:14:37.293782 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7034accd-f811-4467-997e-e3e31033477a None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:14:37.293897 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7034accd-f811-4467-997e-e3e31033477a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:14:37.312615 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.auth.core [None req-7034accd-f811-4467-997e-e3e31033477a None None] MFA Rules not processed for user `5cfa58ef86774ab7800bf91930bf6028`. Rule list: `[]` (Enabled: `True`). {{(pid=81593) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 18:14:37.313824 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-7034accd-f811-4467-997e-e3e31033477a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:14:37.321858 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1477/2943] 10.222.0.27 () {58 vars in 1016 bytes} [Thu Sep 15 18:14:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 18:14:37.354287 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e083c24a-4119-4f78-a3f5-91708c3e0e52 service nova] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:14:37.365596 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e083c24a-4119-4f78-a3f5-91708c3e0e52 service nova] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:14:37.370926 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f92e93-dbc4-454a-a2d0-164041d802f9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe2244818e4d4dca9c424cd078653e6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1213c0d1b584404ba3998e136f166e89', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:14:37.371510 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f92e93-dbc4-454a-a2d0-164041d802f9 service nova] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:14:37.371786 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f92e93-dbc4-454a-a2d0-164041d802f9 service nova] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:14:37.372055 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f92e93-dbc4-454a-a2d0-164041d802f9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:14:37.380005 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f92e93-dbc4-454a-a2d0-164041d802f9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:14:37.381602 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f92e93-dbc4-454a-a2d0-164041d802f9 service nova] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:14:37.391235 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1467/2944] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 15 18:14:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 18:14:47.307374 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=15 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 18:14:47.387219 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=30 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 18:15:06.464314 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7034accd-f811-4467-997e-e3e31033477a None None] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:15:06.474386 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7034accd-f811-4467-997e-e3e31033477a None None] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:15:06.479084 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc55df92-b77f-460f-aaba-5349ba0e0205 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:15:06.479746 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc55df92-b77f-460f-aaba-5349ba0e0205 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:15:06.480028 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc55df92-b77f-460f-aaba-5349ba0e0205 admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:15:06.480303 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc55df92-b77f-460f-aaba-5349ba0e0205 admin admin] PATH_INFO: `/v3/users/0ebb141fcdec4180974808d4bb0d801f` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:15:06.481461 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc55df92-b77f-460f-aaba-5349ba0e0205 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0ebb141fcdec4180974808d4bb0d801f)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:15:06.483985 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc55df92-b77f-460f-aaba-5349ba0e0205 admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:15:06.531867 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-dc55df92-b77f-460f-aaba-5349ba0e0205 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0ebb141fcdec4180974808d4bb0d801f'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:15:06.538537 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-dc55df92-b77f-460f-aaba-5349ba0e0205 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0ebb141fcdec4180974808d4bb0d801f'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:15:06.539267 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-dc55df92-b77f-460f-aaba-5349ba0e0205 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0ebb141fcdec4180974808d4bb0d801f'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:15:06.539891 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-dc55df92-b77f-460f-aaba-5349ba0e0205 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0ebb141fcdec4180974808d4bb0d801f'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:15:06.547210 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-dc55df92-b77f-460f-aaba-5349ba0e0205 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0ebb141fcdec4180974808d4bb0d801f'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:15:06.565148 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1478/2945] 10.222.0.25 () {58 vars in 1224 bytes} [Thu Sep 15 18:15:06 2022] DELETE /identity/v3/users/0ebb141fcdec4180974808d4bb0d801f => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 18:15:06.734851 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f92e93-dbc4-454a-a2d0-164041d802f9 service nova] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:15:06.744974 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f92e93-dbc4-454a-a2d0-164041d802f9 service nova] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:15:06.803104 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c92d65-568e-4b3b-a79f-d82672b3f094 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfa58ef86774ab7800bf91930bf6028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e456d0186b2040e49cb0f3fd71d6c972', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:15:06.803733 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c92d65-568e-4b3b-a79f-d82672b3f094 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:15:06.804012 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c92d65-568e-4b3b-a79f-d82672b3f094 admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:15:06.804287 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c92d65-568e-4b3b-a79f-d82672b3f094 admin admin] PATH_INFO: `/v3/projects/f2ebda4975784256940ad9f1bb0d1bbb` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:15:06.805431 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c92d65-568e-4b3b-a79f-d82672b3f094 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f2ebda4975784256940ad9f1bb0d1bbb)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:15:06.807332 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c92d65-568e-4b3b-a79f-d82672b3f094 admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:15:06.855043 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-e9c92d65-568e-4b3b-a79f-d82672b3f094 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f2ebda4975784256940ad9f1bb0d1bbb', 'request_id': 'req-e9c92d65-568e-4b3b-a79f-d82672b3f094'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:15:06.861184 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-e9c92d65-568e-4b3b-a79f-d82672b3f094 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f2ebda4975784256940ad9f1bb0d1bbb', 'request_id': 'req-e9c92d65-568e-4b3b-a79f-d82672b3f094'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:15:06.868716 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-e9c92d65-568e-4b3b-a79f-d82672b3f094 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f2ebda4975784256940ad9f1bb0d1bbb', 'request_id': 'req-e9c92d65-568e-4b3b-a79f-d82672b3f094'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:15:06.879932 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-e9c92d65-568e-4b3b-a79f-d82672b3f094 admin admin] The token cache is being invalidate because project f2ebda4975784256940ad9f1bb0d1bbb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81592) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 18:15:06.880222 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-e9c92d65-568e-4b3b-a79f-d82672b3f094 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:15:06.880850 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-e9c92d65-568e-4b3b-a79f-d82672b3f094 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 18:15:06.882366 dv-cinder-835384-27-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1468/2946] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Sep 15 18:15:06 2022] DELETE /identity/v3/projects/f2ebda4975784256940ad9f1bb0d1bbb => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 18:15:16.561188 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=29,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 18:15:16.877062 dv-cinder-835384-27-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=51,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 18:16:11.360394 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc55df92-b77f-460f-aaba-5349ba0e0205 admin admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 18:16:11.361868 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-dc55df92-b77f-460f-aaba-5349ba0e0205 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:16:11.428646 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc55df92-b77f-460f-aaba-5349ba0e0205 admin admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 18:16:11.485080 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dea1497-bc69-46a1-a544-67521f00e58a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10af119bd39841ed8163993676230fca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1213c0d1b584404ba3998e136f166e89', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 18:16:11.485716 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dea1497-bc69-46a1-a544-67521f00e58a service placement] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 18:16:11.485994 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dea1497-bc69-46a1-a544-67521f00e58a service placement] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 18:16:11.486265 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dea1497-bc69-46a1-a544-67521f00e58a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 18:16:11.488488 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-4dea1497-bc69-46a1-a544-67521f00e58a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 18:16:11.499274 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dea1497-bc69-46a1-a544-67521f00e58a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 18:16:11.500832 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dea1497-bc69-46a1-a544-67521f00e58a service placement] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 18:16:11.511031 dv-cinder-835384-27-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1479/2947] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 15 18:16:11 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 18:16:21.506870 dv-cinder-835384-27-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=58 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}